Survey banner
The Dataiku Community is moving to a new home! Some short term disruption starting next week: LEARN MORE

Null fields in JSON are ignored and not ingested

Level 1
Null fields in JSON are ignored and not ingested

Hi! I am new to using Dataiku and noticed that fields in my JSON files that are null are not being ingested. Is this common/expected behaviour? Is there a setting to force ingesting fields in JSON even though they are null in every JSON I have? I am extracting the JSON files from an S3 bucket

Operating system used: MacOS 12.6.3

0 Kudos
1 Reply

Hi @saipasha,
How are you reading the file exactly?

You can try to use one record per line in format/preview that and then use a prepare recipe unnest the JSON This should keep even all null/empty columns.

Screenshot 2023-05-10 at 8.47.01 PM.png


0 Kudos



Setup info

A banner prompting to get Dataiku