I need to reduce the time demanded to parse 12 ldif files (9 GBytes each file) by 5X, current approach process one file at a time and save the results in different csv files.
Output can be csv files (one file per parsed category) or data loaded in a PostgreSQL database (second option preferred).
Software should be in python and properly commented, but some easier approach can be discussed.
Multi-processing or Multi-threading can be used, current version uses one processor at a time.
I´ve attached the SW, ldif test files will be provided.
Solution must work over windows 7 and 10
8 freelanceria on tarjonnut keskimäärin 205$ tähän työhön
Hi, I have worked with multithreading for parallel csv file processing in Python. I would like to work on your project. Let me know if you want to discuss further. Regards, Monir
Dear Sir/Madam, I have very good experience in Python parsing and RDBMS with gigabytes of data in legacy system and multi processing programming writing, anuj