Community Conundrum 28: News Engagement is live! Read More

http connection to csv file that changes column count

Neuron
Neuron
http connection to csv file that changes column count

I've been playing with the GitHub Coronavirus data at:

https://github.com/CSSEGISandData/COVID-19

Thank You Johns Hopkins CSSE.

I've been using this URL in an HTTP dataset.

https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_ti...

However, the dataset gets a new column each day.  When DSS looks at the new data it does not reflect the Schema that the data had the prior day and throws at least a warning.

Is there a better way to gather such a dataset that expands in this column-wise way without manually refreshing the schema?

--Tom

 

--Tom
1 Reply
Neuron
Neuron
Author

So,  I think that I found the answer.

tgb417_1-1585087296973.png

 

--Tom
A banner prompting to get Dataiku DSS