Access the partition value in Pyspark Recipe

Options
torbiks
torbiks Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Registered Posts: 1

I have a table that is partitioned by date, how can I access the partition date in a pyspark recipe

I tried the following code but does not recognize actual_date

fct_pm_card.select("application_id", "product") \
.filter(col('actual_date') <= end_date)

Tagged:

Answers

Setup Info
    Tags
      Help me…