Announcing the winners & finalists of the Dataiku Frontrunner Awards 2021! Read their inspiring stories

http connection to csv file that changes column count

Solved!
tgb417
Neuron
Neuron
http connection to csv file that changes column count

I've been playing with the GitHub Coronavirus data at:

https://github.com/CSSEGISandData/COVID-19

Thank You Johns Hopkins CSSE.

I've been using this URL in an HTTP dataset.

https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_ti...

However, the dataset gets a new column each day.  When DSS looks at the new data it does not reflect the Schema that the data had the prior day and throws at least a warning.

Is there a better way to gather such a dataset that expands in this column-wise way without manually refreshing the schema?

--Tom

 

--Tom
1 Solution
tgb417
Neuron
Neuron
Author

So,  I think that I found the answer.

tgb417_1-1585087296973.png

 

--Tom

View solution in original post

1 Reply
tgb417
Neuron
Neuron
Author

So,  I think that I found the answer.

tgb417_1-1585087296973.png

 

--Tom

View solution in original post

A banner prompting to get Dataiku DSS