synchronize dataset schema from metastore

NN
NN Neuron, Registered, Neuron 2022, Neuron 2023 Posts: 145 Neuron

Hi Everyone,
If i have a S3 dataset and it has a linked Glue Metastore.
I know we can sync the dataset definitions to the metastore.

But i was wondering is there a way to sync the dataset schema from the metastore as well.

Tagged:

Answers

  • NN
    NN Neuron, Registered, Neuron 2022, Neuron 2023 Posts: 145 Neuron

    Bumping this question in the hopes that someone has a suggestion.
    was hoping we have something similar to the code below
    mydataset = project.get_dataset("s3_dataset")
    mydataset.update_from_hive()

Setup Info
    Tags
      Help me…