When writing to a dataframe to a dataset with Python recipes, the row counts do not match

Josiel
Josiel Registered Posts: 1

Hello, when I am printing a dataframe before I save the output with write_dataframe() or write_schema_from_dataframe() and check the counts on the dataset object, it does not match. Why does it not match? If I run the code in the python recipe notebook, it prints out it wrote the correct amount of rows, but when I check on the dataset object and refresh the row count, it is not matching.

Operating system used: macOS

Operating system used: macOS

Answers

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,090 Neuron

    Please post your Python recipe code in a code block (the </> icon). Also are you rerunning the notebook from scratch?

Setup Info
    Tags
      Help me…