Submit your use case or success story to the 2023 edition of the Dataiku Frontrunner Awards ENTER YOUR SUBMISSION

http connection to csv file that changes column count

Solved!
tgb417
http connection to csv file that changes column count

I've been playing with the GitHub Coronavirus data at:

https://github.com/CSSEGISandData/COVID-19

Thank You Johns Hopkins CSSE.

I've been using this URL in an HTTP dataset.

https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_ti...

However, the dataset gets a new column each day.  When DSS looks at the new data it does not reflect the Schema that the data had the prior day and throws at least a warning.

Is there a better way to gather such a dataset that expands in this column-wise way without manually refreshing the schema?

--Tom

 

--Tom
1 Solution
tgb417
Author

So,  I think that I found the answer.

tgb417_1-1585087296973.png

 

--Tom

View solution in original post

1 Reply
tgb417
Author

So,  I think that I found the answer.

tgb417_1-1585087296973.png

 

--Tom