rrd tool alternative for high volume

sql time-series rrdtool opentsdb
SorinV picture SorinV · Mar 3, 2009 · Viewed 12k times · Source

I am interested in knowing if there is any alternative to rrdtool for logging time series data. I am looking at something that can scale for a large number of devices to monitor.

From what I read on this subject, rrdtool is I/O bound when you hit it with large amounts of data. Since I envision this to scale to a very large number of devices to monitor, I am curious if there's any alternative that would not choke on I/O. Preferable SQL based, but not necessarily.

Thanks

Answer

Leen Toelen picture Leen Toelen · Aug 25, 2011

There are some time series databases which have high availability and/or scalability as goals.

Maybe have a look at

  • rrdcached, a caching layer on top of rrd
  • whisper, the database engine behind graphite
  • opentsdb is a distributed, scalable Time Series Database (TSDB) written on top of HBase
  • reconnoiter although its focus is more on monitoring

Related questions

Postgresql generate_series of months

I'm trying to generate a series in PostgreSQL with the generate_series function. I need a series of months starting from Jan 2008 until current month + 12 (a year out). I'm using and restricted to PostgreSQL 8.3.14 (so I don't have the timestamp …

Read More
Generate series of week intervals for given month

In a Postgres 9.1 database, I am trying to generate a series of weeks for a given month but with some constraints. I need all weeks to start on Monday and get cut when they start or end in another month. …

Read More
How do I UPDATE from a SELECT in SQL Server?

In SQL Server, it is possible to insert rows into a table with an INSERT.. SELECT statement: INSERT INTO Table (col1, col2, col3) SELECT col1, col2, col3 FROM other_table WHERE sql = 'cool' Is it also possible to update a …

Read More