Check out the first Dataiku 8 Deep Dive focusing on Productivity on October 29th Read More

Stack Post-Filter with Project variable

Level 1
Stack Post-Filter with Project variable

Hey,

I have this project variable :

 

{

"filter_condition" : "timestamp>='2019-03-13' && timestamp<='2019-03-13')"

}

 

I want to use this variable on a Stack Post filter.

I tried to stack post filter using  ${filter_condition} but i got this error :

An invalid argument has been encountered : Incorrect formula: '${filter_condition}' : Missing number, string, identifier, regex, or parenthesized expression(Parsing error at offset 0), caused by: ParsingException: Missing number, string, identifier, regex, or parenthesized expression(Parsing error at offset 0)

I also tried with "${filter_condition}" filter but it doesn't seem like its doing the job cauz im getting rows of 2019-04-14.

0 Kudos
3 Replies
Dataiker
Dataiker

Hi, 

I believe you need to change your variable syntax: 

{
"filter_condition" : "'2019-03-13'"
}

 

And then in the recipe post-filter use a formula like:

timestamp >= asDate(${filter_condition}, "yyyy-MM-dd")

 

You can also use this inside a Prepare recipe to create a column with your date variable and compute time difference inside the Prepare, which will make your Stack post-filter easier.

Hope this helps

0 Kudos
Level 1
Author

Idk if i can really do that, because i may have multiple conditions to test for example 

 

(timestamp>='2019-03-13T07:44:10.000000Z' && timestamp<='2019-03-13T09:44:10.000000Z') || (timestamp>='2019-03-19T12:28:43.000000Z' && timestamp<='2019-03-19T14:38:43.000000Z')
0 Kudos
Dataiker
Dataiker

To do that you may need to create multiple variables and use a syntax like: 

timestamp >= asDate(${date1}, "yyyy-MM-dd") ||timestamp <= asDate(${date2}, "yyyy-MM-dd").....

In any case you cannot have a logical expression in your variable.

 

0 Kudos