Dataiku macro issue(metadata of hourly partition not syncing to be able to query on athena)

goku
goku Registered Posts: 16 ✭
in Using Dataiku

Need to repair table(MSCK REPAIR TABLE NAME;) everytime to load partitions in the table to see the updated metastore. partitions are not existing to be able to query in athena.

· Share on FacebookShare on Twitter

Answers

  • Alexandru
    Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,226 Dataiker

    Hi @goku
    ,

    Could please open a support ticket with the scenario job diagnostics that is causing the issue so we can get a better understanding of what may be happening?
    Thanks,

    · Share on FacebookShare on Twitter
Bookmark this topic

Categories

Setup Info
    Tags
      Help me…