Want to Stop Rebuilding "Expensive" Parts of your Flow? Explicit Builds are the Answer!READ MORE

How to setup Settings in Elasticsearch

Solved!
UserBird
Dataiker
Dataiker
How to setup Settings in Elasticsearch
Hello,

I know how to configure a custom mapping on Elasticsearch. But, how to setup settings for a specific index (Like analyzer...) ?

Thank you,
0 Kudos
1 Solution
AdrienL
Dataiker
Dataiker

Hi,



DSS supports 2 modes for ElasticSearch mapping, defined in each dataset's settings:




  • Either it is automatically deduced from the Dataset's schema

  • Or it is manual and you must specify the whole mapping, including the analyzer to use on a field



Other settings that are not done on the fields (like defining a new analyzer on the index) should be done manually, for example in a code recipe (Shell, Python…).

View solution in original post

0 Kudos
4 Replies
AdrienL
Dataiker
Dataiker

Hi,



DSS supports 2 modes for ElasticSearch mapping, defined in each dataset's settings:




  • Either it is automatically deduced from the Dataset's schema

  • Or it is manual and you must specify the whole mapping, including the analyzer to use on a field



Other settings that are not done on the fields (like defining a new analyzer on the index) should be done manually, for example in a code recipe (Shell, Python…).

0 Kudos
Florian
Level 1
Hello,

I create it manually. But the default sync receipe delete and create the index. And I dont want the "Append" mode.

I want to purge index and bulk insert, not delete and create.

Is it possible ?

regards,
0 Kudos
AdrienL
Dataiker
Dataiker
Yes, what you want is an external elasticsearch dataset http://doc.dataiku.com/dss/latest/connecting/elasticsearch.html#external-elasticsearch-datasets (see managed & external datasets: http://doc.dataiku.com/dss/latest/concepts/index.html#managed-datasets). Managed dataset are managed by DSS, so may be deleted and re-created by recipes. External datasets, on the other hand, are only emptied when written, not deleted.
0 Kudos
Florian
Level 1
Perfect ! Exactly what i looking for.
0 Kudos

Labels

?
Labels (1)
A banner prompting to get Dataiku