Null fields in JSON are ignored and not ingested

saipasha
Level 1
Null fields in JSON are ignored and not ingested

Hi! I am new to using Dataiku and noticed that fields in my JSON files that are null are not being ingested. Is this common/expected behaviour? Is there a setting to force ingesting fields in JSON even though they are null in every JSON I have? I am extracting the JSON files from an S3 bucket


Operating system used: MacOS 12.6.3

0 Kudos
1 Reply
AlexT
Dataiker

Hi @saipasha,
How are you reading the file exactly?

You can try to use one record per line in format/preview that and then use a prepare recipe unnest the JSON https://doc.dataiku.com/dss/latest/preparation/processors/object-unnest-json.html. This should keep even all null/empty columns.

Screenshot 2023-05-10 at 8.47.01 PM.png

 

0 Kudos

Labels

?
Labels (1)
A banner prompting to get Dataiku