Elasticsearch - A distributed RESTful search and analytics server
Module to provide Elasticsearch compatibility to Salt (compatible with Elasticsearch version 1.5.2+)
New in version 2015.8.0.
This module accepts connection configuration details either as parameters or as configuration settings in /etc/salt/minion on the relevant minions:
elasticsearch:
host: '10.10.10.100:9200'
elasticsearch-cluster:
hosts:
- '10.10.10.100:9200'
- '10.10.10.101:9200'
- '10.10.10.102:9200'
elasticsearch-extra:
hosts:
- '10.10.10.100:9200'
use_ssl: True
verify_certs: True
ca_certs: /path/to/custom_ca_bundle.pem
number_of_shards: 1
number_of_replicas: 0
functions_blacklist:
- 'saltutil.find_job'
- 'pillar.items'
- 'grains.items'
proxies:
- http: http://proxy:3128
- https: http://proxy:1080
When specifying proxies the requests backend will be used and the 'proxies' data structure is passed as-is to that module.
This data can also be passed into pillar. Options passed into opts will overwrite options passed into pillar.
Some functionality might be limited by elasticsearch-py and Elasticsearch server versions.
Create an alias for a specific index/indices
Single or multiple indices separated by comma, use _all to perform the operation on all indices.
Alias name
Optional definition such as routing or filter as defined in https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-aliases.html
URL of file specifying optional definition such as routing or filter. Cannot be used in combination with body
.
CLI Example:
salt myminion elasticsearch.alias_create testindex_v1 testindex
Delete an alias of an index
Single or multiple indices separated by comma, use _all to perform the operation on all indices.
Alias names separated by comma
CLI Example:
salt myminion elasticsearch.alias_delete testindex_v1 testindex
Return a boolean indicating whether given alias exists
Single or multiple indices separated by comma, use _all to perform the operation on all indices.
Alias names separated by comma
CLI Example:
salt myminion elasticsearch.alias_exists None testindex
Check for the existence of an alias and if it exists, return it
Single or multiple indices separated by comma, use _all to perform the operation on all indices.
Alias names separated by comma
CLI Example:
salt myminion elasticsearch.alias_get testindex
New in version 3000.
Return Elasticsearch cluster settings.
Return settings in flat format.
Whether to return all default clusters setting.
CLI Example:
salt myminion elasticsearch.cluster_get_settings
New in version 2017.7.0.
Return Elasticsearch cluster health.
Limit the information returned to a specific index
Specify the level of detail for returned information, default 'cluster', valid choices are: 'cluster', 'indices', 'shards'
Return local information, do not retrieve the state from master node
CLI Example:
salt myminion elasticsearch.cluster_health
New in version 3000.
Set Elasticsearch cluster settings.
The settings to be updated. Can be either 'transient' or 'persistent' (survives cluster restart) http://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-update-settings.html
Return settings in flat format.
CLI Example:
salt myminion elasticsearch.cluster_put_settings '{"persistent": {"indices.recovery.max_bytes_per_sec": "50mb"}}'
salt myminion elasticsearch.cluster_put_settings '{"transient": {"indices.recovery.max_bytes_per_sec": "50mb"}}'
New in version 2017.7.0.
Return Elasticsearch cluster stats.
List of cluster nodes (id or name) to display stats for. Use _local for connected node, empty for all
CLI Example:
salt myminion elasticsearch.cluster_stats
Create a document in a specified index
Index name where the document should reside
Type of the document
Document to store
URL of file specifying document to store. Cannot be used in combination with body
.
Optional unique document identifier for specified doc_type (empty for random)
CLI Example:
salt myminion elasticsearch.document_create testindex doctype1 '{}'
Delete a document from an index
Index name where the document resides
Type of the document
Document identifier
CLI Example:
salt myminion elasticsearch.document_delete testindex doctype1 AUx-384m0Bug_8U80wQZ
Return a boolean indicating whether given document exists
Index name where the document resides
Document identifier
Type of the document, use _all to fetch the first document matching the ID across all types
CLI Example:
salt myminion elasticsearch.document_exists testindex AUx-384m0Bug_8U80wQZ
Check for the existence of a document and if it exists, return it
Index name where the document resides
Document identifier
Type of the document, use _all to fetch the first document matching the ID across all types
CLI Example:
salt myminion elasticsearch.document_get testindex AUx-384m0Bug_8U80wQZ
New in version 3000.
Perform a normal flush, then add a generated unique marker (sync_id) to all shards. http://www.elastic.co/guide/en/elasticsearch/reference/current/indices-synced-flush.html
(Optional, string) A comma-separated list of index names; use _all or empty string for all indices. Defaults to '_all'.
(Optional, boolean) If true, missing or closed indices are not included in the response. Defaults to false.
(Optional, boolean) If true, the request does not return an error if a wildcard expression or _all value retrieves only missing or closed indices. This parameter also applies to index aliases that point to a missing or closed index.
(Optional, string) Controls what kind of indices that wildcard expressions can expand to.
Valid values are:
all - Expand to open and closed indices.
open - Expand only to open indices.
closed - Expand only to closed indices.
none - Wildcard expressions are not accepted.
The defaults settings for the above parameters depend on the API being used.
CLI Example:
salt myminion elasticsearch.flush_synced index='index1,index2' ignore_unavailable=True allow_no_indices=True expand_wildcards='all'
New in version 2017.7.0.
Close specified index.
Index to be closed
Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes _all string or when no indices have been specified)
Whether to expand wildcard expression to concrete indices that are open, closed or both., default ‘open’, valid choices are: ‘open’, ‘closed’, ‘none’, ‘all’
Whether specified concrete indices should be ignored when unavailable (missing or closed)
CLI Example:
salt myminion elasticsearch.index_close testindex
Create an index
Index name
Index definition, such as settings and mappings as defined in https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-create-index.html
URL to file specifying index definition. Cannot be used in combination with body
.
CLI Example:
salt myminion elasticsearch.index_create testindex
salt myminion elasticsearch.index_create testindex2 '{"settings" : {"index" : {"number_of_shards" : 3, "number_of_replicas" : 2}}}'
Delete an index
Index name
CLI Example:
salt myminion elasticsearch.index_delete testindex
Return a boolean indicating whether given index exists
Index name
CLI Example:
salt myminion elasticsearch.index_exists testindex
Check for the existence of an index and if it exists, return it
Index name
CLI Example:
salt myminion elasticsearch.index_get testindex
New in version 3000.
Check for the existence of an index and if it exists, return its settings http://www.elastic.co/guide/en/elasticsearch/reference/current/indices-get-settings.html
(Optional, string) A comma-separated list of index names; use _all or empty string for all indices. Defaults to '_all'.
(Optional, string) The name of the settings that should be included
(Optional, boolean) Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes _all string or when no indices have been specified)
(Optional, string) Whether to expand wildcard expression to concrete indices that are open, closed or both. Valid choices are: ‘open’, ‘closed’, ‘none’, ‘all’
(Optional, boolean) Return settings in flat format
(Optional, boolean) Whether specified concrete indices should be ignored when unavailable (missing or closed)
(Optional, boolean) Whether to return all default setting for each of the indices.
(Optional, boolean) Return local information, do not retrieve the state from master node
The defaults settings for the above parameters depend on the API version being used.
CLI Example:
salt myminion elasticsearch.index_get_settings index=testindex
New in version 2017.7.0.
Open specified index.
Index to be opened
Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes _all string or when no indices have been specified)
Whether to expand wildcard expression to concrete indices that are open, closed or both., default ‘closed’, valid choices are: ‘open’, ‘closed’, ‘none’, ‘all’
Whether specified concrete indices should be ignored when unavailable (missing or closed)
CLI Example:
salt myminion elasticsearch.index_open testindex
New in version 3000.
Update existing index settings https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-update-settings.html
The index settings to be updated.
URL to file specifying index definition. Cannot be used in combination with body
.
(Optional, string) A comma-separated list of index names; use _all or empty string to perform the operation on all indices
(Optional, boolean) Whether to ignore if a wildcard indices expression resolves into no concrete indices. (This includes _all string or when no indices have been specified)
(Optional, string) Whether to expand wildcard expression to concrete indices that are open, closed or both. Valid choices are: ‘open’, ‘closed’, ‘none’, ‘all’
(Optional, boolean) Return settings in flat format (default: false)
(Optional, boolean) Whether specified concrete indices should be ignored when unavailable (missing or closed)
(Optional, time units) Explicit operation timeout for connection to master node
(Optional, boolean) Whether to update existing settings. If set to true existing settings on an index remain unchanged, the default is false
The defaults settings for the above parameters depend on the API version being used.
Note
Elasticsearch time units can be found here: https://www.elastic.co/guide/en/elasticsearch/reference/current/common-options.html#time-units
CLI Example:
salt myminion elasticsearch.index_put_settings index=testindex body='{"settings" : {"index" : {"number_of_replicas" : 2}}}'
Create an index template
Index template name
Template definition as specified in http://www.elastic.co/guide/en/elasticsearch/reference/current/indices-templates.html
URL to file specifying template definition. Cannot be used in combination with body
.
CLI Example:
salt myminion elasticsearch.index_template_create testindex_templ '{ "template": "logstash-*", "order": 1, "settings": { "number_of_shards": 1 } }'
Delete an index template (type) along with its data
Index template name
CLI Example:
salt myminion elasticsearch.index_template_delete testindex_templ user
Return a boolean indicating whether given index template exists
Index template name
CLI Example:
salt myminion elasticsearch.index_template_exists testindex_templ
Retrieve template definition of index or index/type
Index template name
CLI Example:
salt myminion elasticsearch.index_template_get testindex_templ
New in version 2017.7.0.
Return Elasticsearch information.
CLI Example:
salt myminion elasticsearch.info
salt myminion elasticsearch.info profile=elasticsearch-extra
Create a mapping in a given index
Index for the mapping
Name of the document type
Mapping definition as specified in https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-put-mapping.html
URL to file specifying mapping definition. Cannot be used in combination with body
.
CLI Example:
salt myminion elasticsearch.mapping_create testindex user '{ "user" : { "properties" : { "message" : {"type" : "string", "store" : true } } } }'
Delete a mapping (type) along with its data. As of Elasticsearch 5.0 this is no longer available.
Index for the mapping
Name of the document type
CLI Example:
salt myminion elasticsearch.mapping_delete testindex user
Retrieve mapping definition of index or index/type
Index for the mapping
Name of the document type
CLI Example:
salt myminion elasticsearch.mapping_get testindex user
New in version 2017.7.0.
Return Elasticsearch node information.
List of cluster nodes (id or name) to display stats for. Use _local for connected node, empty for all
Flatten settings keys
CLI Example:
salt myminion elasticsearch.node_info flat_settings=True
New in version 2017.7.0.
Test connection to Elasticsearch instance. This method does not fail if not explicitly specified.
Throw exception if ping fails
CLI Example:
salt myminion elasticsearch.ping allow_failure=True
salt myminion elasticsearch.ping profile=elasticsearch-extra
New in version 2017.7.0.
Create Ingest pipeline by supplied definition. Available since Elasticsearch 5.0.
Pipeline id
Pipeline definition as specified in https://www.elastic.co/guide/en/elasticsearch/reference/master/pipeline.html
CLI Example:
salt myminion elasticsearch.pipeline_create mypipeline '{"description": "my custom pipeline", "processors": [{"set" : {"field": "collector_timestamp_millis", "value": "{{_ingest.timestamp}}"}}]}'
New in version 2017.7.0.
Delete Ingest pipeline. Available since Elasticsearch 5.0.
Pipeline id
CLI Example:
salt myminion elasticsearch.pipeline_delete mypipeline
New in version 2017.7.0.
Retrieve Ingest pipeline definition. Available since Elasticsearch 5.0.
Pipeline id
CLI Example:
salt myminion elasticsearch.pipeline_get mypipeline
New in version 2017.7.0.
Simulate existing Ingest pipeline on provided data. Available since Elasticsearch 5.0.
Pipeline id
Pipeline definition as specified in https://www.elastic.co/guide/en/elasticsearch/reference/master/pipeline.html
Specify if the output should be more verbose
CLI Example:
salt myminion elasticsearch.pipeline_simulate mypipeline '{"docs":[{"_index":"index","_type":"type","_id":"id","_source":{"foo":"bar"}},{"_index":"index","_type":"type","_id":"id","_source":{"foo":"rab"}}]}' verbose=True
New in version 2017.7.0.
Create repository for storing snapshots. Note that shared repository paths have to be specified in path.repo Elasticsearch configuration option.
Repository name
Repository definition as in https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-snapshots.html
CLI Example:
salt myminion elasticsearch.repository_create testrepo '{"type":"fs","settings":{"location":"/tmp/test","compress":true}}'
New in version 2017.7.0.
Delete existing repository.
Repository name
CLI Example:
salt myminion elasticsearch.repository_delete testrepo
New in version 2017.7.0.
Get existing repository details.
Repository name
Retrieve only local information, default is false
CLI Example:
salt myminion elasticsearch.repository_get testrepo
New in version 2017.7.0.
Obtain list of cluster nodes which successfully verified this repository.
Repository name
CLI Example:
salt myminion elasticsearch.repository_verify testrepo
New in version 2017.7.0.
Create search template by supplied definition
Template ID
Search template definition
CLI Example:
salt myminion elasticsearch.search_template_create mytemplate '{"template":{"query":{"match":{"title":"{{query_string}}"}}}}'
New in version 2017.7.0.
Delete existing search template definition.
Template ID
CLI Example:
salt myminion elasticsearch.search_template_delete mytemplate
New in version 2017.7.0.
Obtain existing search template definition.
Template ID
CLI Example:
salt myminion elasticsearch.search_template_get mytemplate
New in version 2017.7.0.
Create snapshot in specified repository by supplied definition.
Repository name
Snapshot name
Snapshot definition as in https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-snapshots.html
CLI Example:
salt myminion elasticsearch.snapshot_create testrepo testsnapshot '{"indices":"index_1,index_2","ignore_unavailable":true,"include_global_state":false}'
New in version 2017.7.0.
Delete snapshot from specified repository.
Repository name
Snapshot name
CLI Example:
salt myminion elasticsearch.snapshot_delete testrepo testsnapshot
New in version 2017.7.0.
Obtain snapshot residing in specified repository.
Repository name
Snapshot name, use _all to obtain all snapshots in specified repository
Ignore unavailable snapshots
CLI Example:
salt myminion elasticsearch.snapshot_get testrepo testsnapshot
New in version 2017.7.0.
Restore existing snapshot in specified repository by supplied definition.
Repository name
Snapshot name
Restore definition as in https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-snapshots.html
CLI Example:
salt myminion elasticsearch.snapshot_restore testrepo testsnapshot '{"indices":"index_1,index_2","ignore_unavailable":true,"include_global_state":true}'
New in version 2017.7.0.
Obtain status of all currently running snapshots.
Particular repository to look for snapshots
Snapshot name
Ignore unavailable snapshots
CLI Example:
salt myminion elasticsearch.snapshot_status ignore_unavailable=True