Inserting only unique rows into SQLite (python)

Question

I'm using `cursor.executemany` to insert batches of rows from CSV files into a SQLite table, some of which are expected to be duplicates based on the primary key field. When I execute the command, I predictably get an Integrity Error and nothing gets inserted. How do I selectively insert only non-duplicate rows without having to manually filter them out ahead of time? I know in just pure Python you could simply create an error exception and skip the duplicate row--is there something similar I can implement in this use case?

Accepted Answer

Simply use `INSERT OR IGNORE` to ignore the duplicates.

http://sqlite.org/lang_insert.html

Inserting only unique rows into SQLite (python)

Solution

Problem