nzvasup.blogg.se - Best database software python

#Best database software python update
#Best database software python code

There are around 500 000 products so I'm a bit worried about performances.

#Best database software python update

Then compare and update the product if the new hash is different from the old one. I will store all hashes in a single table ( item code, current_hash, old_hash ) for performances purpose.

A new hash based on the same data will be created on a daily basis from the source database.

#Best database software python code

I think about creating a hash for each product, based on the fields to update in the target database: md5( code + description + supplier + around 10 other fields). So the whole process needs to be done in a single Python (ideally) script. There are no "updated time" fields anywhere.Target database uses a MySQL server - source may be DB2.Target and source db have completely different structures, tables are not the same at all, therefore data really have to be rearranged - comparing tables won't work.

On the target database, I can do usual queries (select, update, insert, create) but I can't modify the existing structure/tables.

I'm not allowed to do anything on the source database apart select queries.

Obviously, there are a few issues that make this tricky. But I'm looking for a way to update some specific data - not all data - about each product. Basically, I need to grap some data about products in different tables in the first database and re-arrange them for other tables in the second database.Ĭreating my products on the first time is not very complicated. I have to implement data synchronization between two big databases which have completely different structures.