[thelist] MySQL: importing non-duplicate records

Canfield, Joel JCanfield at PacAdvantage.org
Thu May 11 11:19:21 CDT 2006


a few thoughts in response; very helpful, but with some questions and/or
issues:

> --Do one more sanity check with the phone system to make sure 
> you can't 
> get just the new records (e.g. via some sort of a 'tee' directive.)

possible; just need to get the busy and not entirely invested net admin
on board

> --Consider lowering the size of the phone system's database to a more 
> manageable size.
> --Consider rotating out the phone system's cdr log every night, i.e. 
> produce a completely new file every night.

can't touch the original db except via vendor-supplied tools, or for
select queries only; vendor won't allow it

> --Import the phone data into a new table every night, delete 
> as much of 
> the data as possible without risking deleting the new stuff, 
> then import 
> into your  master table using the "REPLACE" command in MySQL.

hmmm . . . mysqlimport with --ignore specified? will that do what I
want?

anyone? bueller? anyone?

> Hope there's something worthwhile there.

certainly is; i need all the brain stimulation i can get on this
project; thanks for putting the thought into it

spinhead



More information about the thelist mailing list