implement with SPEED my current Python script "FUZZY COMPARE" on "large file" (multithreading ??)
€8-30 EUR
已完成
已发布大约 4 年前
€8-30 EUR
货到付款
I already have the similar FUZZY COMPARE script in LARGE List
that I would send to you, together with the 2 BIG FILE:
"[login to view URL]" contains 800,000 lines to compare with the file
"[login to view URL]" which has 6,000,000 lines
but now I would like to get an implementation: "faster"
indeed; at this moment the script processes about 1500 lines in comparison to the day .... therefore it would take years to process 800.000 lines :(
to implement speed, I thought it might be useful for something "multithreading".
Instead of comparing a single row with the whole database, it could start with multiple processes (10, 50, 100 analyze multiple rows)
obviously much depends on the performance of the machine (pc) but I could force .... using a machine with excellent performance (CPU + RAM)
Hi there,
Yes sure. Multi-threaded setup will speed up the process. But I also want to review your code and algorithm :) Hope I can be helpful.
Best regards,
Ishaq
Hi, how are you? I can implement multi-threading in your script or if you want, do it with the gpu instead of the cpu that its faster or with both! But maybe there is a bad optimization of your code! i can check it and maybe only modification some lines it would be much faster! Hope to work with you!
Hi, there
I am very interested in your post project.
I am really looking for this kind of project for a long time in freelancer since i have rich experience on it.
I think this project is very suitable for me and i am sure i can give you good result .
If you award me for your project, you will get good result .
looking forward to work with you.
thanks regard
Greetings,
I have already worked on this kind of project when the file is > 2 gb and we need to compare and contains millions of records.
Please send me the files and more description on how to compare and I will help you out.
Everyone should born as a baby likewise everyone should started as a fresher like me.
Hi. I'm interested on this project. You can chat me when you are free. You can trust me.