Run SQL ETL scripts from Git repo

WH Registered Posts: 17 ✭✭✭✭

Hi, I have existing ETL scripts (mainly pure SQL) on an existing Git repo.

I need to continue to write the SQL to the Git repo directly (i.e. outside DSS).

I'd like to use DSS run these scripts – either (a) just the SQL, or (b) using Python scripts in combination with SQL.

Current line of thinking: I can run scripts easily as Scenarios if I import the Git repo with the scripts, but there doesn't seem to be an automated way to pull a remote Git repo ("Update from Git") after it has new commits.

Is there an API to update Git references, or some other way to pull an external Git repo and use the scripts from that repo as input to a Scenario?

Or: what's the best way to do this? Thanks

Best Answer


Setup Info
      Help me…