It took forever to merge them because the datasets are too huge and innumerable.
But if the quantity is fewer, the merging takes place super-fast, showing that the Python codes are done right.
So obviously, the root of the problem is that the datasets are: Too Innumerable and Too Huge.
Merge with Hadoop in AWS for more Instantaneous response expected.
In addition, to run a short algo on the merged dataset once it is viable. Algo already been written. It is just waiting for the Merged dataset to become viable and available.
Another Term/Condition: Milestones will not be released until project is completed and delivered to our side.
6 freelancers are bidding on average $192 for this job
Hello, Experienced Python programmer and familiar with Hadoop and Spark. Can get this project finished today, just contact me to discuss details. Niels