python 2.7 - Helper scan fails over 90000 documents? -


because of limit of search in elasticsearch python module starter using scroll access more 10000 documents. didn't test if there limit scroll because working ok. couple of days ago got on 100000 documents result of query , implementation of scroll started failing with:

searchcontextmissingexception [no search context found id [568]

i thought code failing somehow although couldn't see problem. while googleing found helper scan , decided use since work of implementing scroll without worries code having bug. when using scan large amount of data ( around 90000) keep getting previous error. has seen same behaviour before? expected? there workaround can use avoid problem without splitting query?

best regards,

ruben

is not clear if set size of scroll 900000 or bigger or if looping on more documents keep calling scroll. happen handling data takes time before return scroll. context kept default amount of time can configure using scroll parameter described in following url:

https://www.elastic.co/guide/en/elasticsearch/reference/current/search-request-scroll.html


Comments

Popular posts from this blog

ruby - Trying to change last to "x"s to 23 -

jquery - Clone last and append item to closest class -

c - Unrecognised emulation mode: elf_i386 on MinGW32 -