batch size of prepared statement in spring data cassandra

cassandra cassandra-2.0 spring-data-cassandra
Oggie picture Oggie · Jul 29, 2014 · Viewed 10.8k times · Source

I'm getting this warning in the log:

WARN [Native-Transport-Requests:17058] 2014-07-29 13:58:33,776 BatchStatement.java (line 223) Batch of prepared statements for [keyspace.tablex] is of size 10924, exceeding specified threshold of 5120 by 5804.

Is there a way in spring data cassandra to specify the size?

Cassandra 2.0.9 and spring data cassandra 1.0.0-RELEASE

Answer

Viliam picture Viliam · Aug 27, 2014

This is just a warning, informing you that the query size exceeds certain limit.

The query is still being processed. The reasoning behind is that bigger batched queries are expensive and may cause cluster imbalance. Therefore warning you (the developer) beforehand.

Look for batch_size_warn_threshold_in_kb in cassandra.yaml to adjust when should this warning be produced.

Here is the ticket where it was introduced: https://issues.apache.org/jira/browse/CASSANDRA-6487

Related questions

Cassandra "no viable alternative at input"

I am trying to insert a simple row into the table. Can someone point out what is happening here ? CREATE TABLE recommendation_engine_poc.user_by_category ( game_category text, customer_id text, amount double, game_date timestamp, PRIMARY KEY (…

Read More
How to run cql files (.cql) from within cqlsh?

The problem that I am having is that I want to run the following command (and I can't): cqlsh < cql_directory/cql_create_stuff.cql Because I have not logged in to cqlsh. So I logged in: cqlsh -u …

Read More
How to obtain number of rows in Cassandra table

This is a super basic question but it's actually been bugging me for days. Is there a good way to obtain the equivalent of a COUNT(*) of a given table in Cassandra? I will be moving several hundreds of millions …

Read More