Elasticsearch: is bulk search possible?

elasticsearch elasticsearch-dsl elasticsearch-query
piotrek picture piotrek · Jan 20, 2016 · Viewed 7k times · Source

i know there is support for bulk index operation. but is it possible to do the same for search queries? i want to send many different unrelated queries (to do precision/recall testing) and it would probably be faster using bulk query

Answer

Val picture Val · Jan 20, 2016

Yes, you can use the multi search API and the /_msearch endpoint to send as many queries as you wish in one shot.

curl -XPOST localhost:9200/_msearch -d '
{"index" : "test1"}
{"query" : {"match_all" : {}}, "from" : 0, "size" : 10}
{"index" : "test2"}
{"query" : {"match_all" : {}}}
'

You'll get a responses array with the response of each query in the same order as in the request.

Note:

  1. make sure to separate each line by a newline character
  2. make sure to add the extra newline after the last query.

Related questions

Elasticsearch query to return all records

I have a small database in Elasticsearch and for testing purposes would like to pull all records back. I am attempting to use a URL of the form... http://localhost:9200/foo/_search?pretty=true&q={'matchAll':{''}} Can someone …

Read More
aggregate a field in elasticsearch-dsl using python

Can someone tell me how to write Python statements that will aggregate (sum and count) stuff about my documents? SCRIPT from datetime import datetime from elasticsearch_dsl import DocType, String, Date, Integer from elasticsearch_dsl.connections import connections from elasticsearch …

Read More
Index CSV to ElasticSearch in Python

Looking to index a CSV file to ElasticSearch, without using Logstash. I am using the elasticsearch-dsl high level library. Given a CSV with header for example: name,address,url adam,hills 32,http://rockit.com jane,valleys 23,http://popit.com What …

Read More