Is writing server log files to a database a good idea?

database logging log-analysis log-files
Thomas Owens picture Thomas Owens · Nov 14, 2008 · Viewed 27.5k times · Source

After reading an article about the subject from O'Reilly, I wanted to ask Stack Overflow for their thoughts on the matter.

Answer

Jon Skeet picture Jon Skeet · Nov 14, 2008

Write locally to disk, then batch insert to the database periodically (e.g. at log rollover time). Do that in a separate, low-priority process. More efficient and more robust...

(Make sure that your database log table contains a column for "which machine the log event came from" by the way - very handy!)

Related questions

Log to a database using log4j

Since in log4j javadoc is WARNING: This version of JDBCAppender is very likely to be completely replaced in the future. Moreoever, it does not log exceptions. What should I do to log to a database?

Read More
Limiting mysql log file size

I have a mysql log file that regularly goes over 30gb, this sucks when you realise that your server is full because of this file. I need a simple solution to limit this file to about 1gb, i don't need …

Read More
Handling large datasets with SQL Server

I'm looking to manage a large dataset of log files. There is an average of 1.5 million new events per month that I'm trying to keep. I've used access in the past, though it's clearly not meant for this, and managing …

Read More