Faster bulk inserts in sqlite3?

c++ sqlite insert bulk
scubabbl picture scubabbl · Dec 12, 2008 · Viewed 46.5k times · Source

I have a file of about 30000 lines of data that I want to load into a sqlite3 database. Is there a faster way than generating insert statements for each line of data?

The data is space-delimited and maps directly to an sqlite3 table. Is there any sort of bulk insert method for adding volume data to a database?

Has anyone devised some deviously wonderful way of doing this if it's not built in?

I should preface this by asking, is there a C++ way to do it from the API?

Answer

Javier picture Javier · Dec 12, 2008
  • wrap all INSERTs in a transaction, even if there's a single user, it's far faster.
  • use prepared statements.

Related questions

How do I include libraries to a project in Visual Studio?

I am a beginner on C++ and trying to learn about including libraries, and I haven't found documentation about it. What are the ways of including libraries to a C++ project (Visual Studio). How do I implement them and which …

Read More
Saving to disk an in-memory database

I made a database through sqlite in c++. The db has been created in memory (using the ":memory:" parameter insted of a filename), in order to have a very quick behavior. The database is created by the following lines: sqlite3* …

Read More
Using SQLite with Qt

I am thinking of using SQLite as a backend DB for a C++ applicatiojn I am writing. I have read the relevant docs on both teh trolltech site and sqlite, but the information seems a little disjointed, there is no …

Read More