incident ticket id creation for every new row that is added to the MS SQL server dataset
I am trying to sync hdfs dataset to MS sql server dataset where the rows are appended whenever there is a change is dataset using a scenario. while doing it i want an incident id generated so that a ticket can be tracked over the incident. and table will be used again for ML feedback.
I am stuck at creating a way to distinct the ticket. can some one help me. and can i also have a Dataiku expert to help me out with few new approaches that i am trying out to do in Dataiku.
Answers
-
Ignacio_Toledo Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 411 NeuronOptionsHi @sasidharp
. There could be so many solutions to your problem, that a little bit more or context could be useful.For example, does you hdfs dataset contains any column or a group of columns, that could be used as indexes? For example, you might have column with a timestamp, and that timestamp is unique for all rows, then you could use that column to create a unique index.
Or maybe you have duplicate timestamps, but you have multiple categories, and there are no rows where both the timestamp and the category are equal: then you could use both columns to create a unique index.
It might as well be very likely that there is a DSS function or feature that allows you to do exactly what you want, and I don't know it, but this is how I would try to solve the problem you describe.
I hope this helps! And if there is a better solution, I think others will post more information.
Good luck!