Join us on July 16th as we explore real-world Reinforcement Learning Learn more

How to setup Settings in Elasticsearch

Dataiker
Dataiker
How to setup Settings in Elasticsearch
Hello,

I know how to configure a custom mapping on Elasticsearch. But, how to setup settings for a specific index (Like analyzer...) ?

Thank you,
0 Kudos
4 Replies
Dataiker
Dataiker

Hi,



DSS supports 2 modes for ElasticSearch mapping, defined in each dataset's settings:




  • Either it is automatically deduced from the Dataset's schema

  • Or it is manual and you must specify the whole mapping, including the analyzer to use on a field



Other settings that are not done on the fields (like defining a new analyzer on the index) should be done manually, for example in a code recipe (Shell, Python…).

0 Kudos
Level 1
Hello,

I create it manually. But the default sync receipe delete and create the index. And I dont want the "Append" mode.

I want to purge index and bulk insert, not delete and create.

Is it possible ?

regards,
0 Kudos
Dataiker
Dataiker
Yes, what you want is an external elasticsearch dataset http://doc.dataiku.com/dss/latest/connecting/elasticsearch.html#external-elasticsearch-datasets (see managed & external datasets: http://doc.dataiku.com/dss/latest/concepts/index.html#managed-datasets). Managed dataset are managed by DSS, so may be deleted and re-created by recipes. External datasets, on the other hand, are only emptied when written, not deleted.
0 Kudos
Level 1
Perfect ! Exactly what i looking for.
0 Kudos
Labels (1)