Null fields in JSON are ignored and not ingested
saipasha
Registered Posts: 1 ✭
Hi! I am new to using Dataiku and noticed that fields in my JSON files that are null are not being ingested. Is this common/expected behaviour? Is there a setting to force ingesting fields in JSON even though they are null in every JSON I have? I am extracting the JSON files from an S3 bucket
Operating system used: MacOS 12.6.3
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,226 DataikerHi @saipasha
,
How are you reading the file exactly?You can try to use one record per line in format/preview that and then use a prepare recipe unnest the JSON https://doc.dataiku.com/dss/latest/preparation/processors/object-unnest-json.html. This should keep even all null/empty columns.
