Ready for Dataiku 9? Try out the Crash Course on new features! GET STARTED

How to setup Settings in Elasticsearch

Solved!
UserBird
Dataiker
Dataiker
How to setup Settings in Elasticsearch
Hello,

I know how to configure a custom mapping on Elasticsearch. But, how to setup settings for a specific index (Like analyzer...) ?

Thank you,
0 Kudos
1 Solution
AdrienL
Dataiker
Dataiker

Hi,



DSS supports 2 modes for ElasticSearch mapping, defined in each dataset's settings:




  • Either it is automatically deduced from the Dataset's schema

  • Or it is manual and you must specify the whole mapping, including the analyzer to use on a field



Other settings that are not done on the fields (like defining a new analyzer on the index) should be done manually, for example in a code recipe (Shell, Python…).

View solution in original post

0 Kudos
4 Replies
AdrienL
Dataiker
Dataiker

Hi,



DSS supports 2 modes for ElasticSearch mapping, defined in each dataset's settings:




  • Either it is automatically deduced from the Dataset's schema

  • Or it is manual and you must specify the whole mapping, including the analyzer to use on a field



Other settings that are not done on the fields (like defining a new analyzer on the index) should be done manually, for example in a code recipe (Shell, Python…).

View solution in original post

0 Kudos
Florian
Level 1
Hello,

I create it manually. But the default sync receipe delete and create the index. And I dont want the "Append" mode.

I want to purge index and bulk insert, not delete and create.

Is it possible ?

regards,
0 Kudos
AdrienL
Dataiker
Dataiker
Yes, what you want is an external elasticsearch dataset http://doc.dataiku.com/dss/latest/connecting/elasticsearch.html#external-elasticsearch-datasets (see managed & external datasets: http://doc.dataiku.com/dss/latest/concepts/index.html#managed-datasets). Managed dataset are managed by DSS, so may be deleted and re-created by recipes. External datasets, on the other hand, are only emptied when written, not deleted.
0 Kudos
Florian
Level 1
Perfect ! Exactly what i looking for.
0 Kudos
Labels (1)
A banner prompting to get Dataiku DSS