Matching System

1. There are a series of json file each around 15GB contains (IP+port)

2. There are series of json files each around a GB contains (traceroutes)

3. There are 3 group of csv files, each group contains 30 csv file

1st step


1. Load all the Json (1) in a MySQL table and delete the duplicates. (tbl_ports)

2. Load all the Json (2) in a MySQL table as they are traceroute IP's, Ignore the first two hop and last hop and store the rest in a SQL table. (tbl_tracceroutes)

3. Load each group of CSV file in a seprate table in MySQL and and add new column to this table and write the name of the csv file. (Do this step for the two rest of csv files group)

group1(tbl_xxx) - I will tell you the exact name when you start working

group2(tbl_yyy) - I will tell you the exact name when you start working

group3(tbl_zzz) - I will tell you the exact name when you start working

2nd Step


1. in tbl_zzz, tbl_yyy, tbl_xxx there is a column contains subnetmask(IP+Cidr), take each of that (IP+Cidr) and look on tbl_ports on column IP, if any IP there matches to any (IP+Cidr) of tbl_zzz, you do this process for all of (IP+Cidr) for table tbl_zzz.

Create a new table (report_zzz), take some column from tbl_zzz (I will tell you which columns) and add a new column (port). for the ones that you find match write in report_zzz that row of that plus the port number you find for that (IP+Cidr).

** DO this process for tbl_xxx and tbl_zzz exactly the same way.

2. from the table report_zzz take the (IP+Cidr) data and look if any IP in tbl_traceroute match to that subnet, add new column to report_zzz named as (seen), if you find match write yes and if you don't find match write no.

** DO this process for report_xxx, report_yyy and report_zzz.


optimized code

As it is relatively big data, it should be fast enough

Bug free

Dynamic style

Taidot: MySQL, SQL, Python, Verkonhallinta

Näytä lisää: joomla template matching phpbb style, php script matching system, auto matching system, order matching system, trade order matching system, php matching system, schedule matching system, nyminutedating matching system freelancer, web development trade matching system, online matching system login, create online matching system, profile matching system, job matching system php, design controller automatic paint color matching system, controller automatic paint color matching system circuit, digital logic controller automatic paint color matching system, automatic paint color matching system logic

Tietoa työnantajasta:
( 2 arvostelua ) Berlin, Afghanistan

Projektin tunnus: #20101564

Myönnetty käyttäjälle:

                                                's Profile Picture"                                                    >
                                        <div class=

Hi. I have very strong experience in dealing with big data (json, csv etc) using python. I can suggest you python and fast algorithm. It is no problem at all to do your job. Please send me a message to discuss more. Ki Lisää

$80 USD 3 päivässä
(1 arvostelu)

26 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön


Thank you for your detailed project description. Very. Surely I can help you. I feel confidence all the requirements you want. I will do my best to satisfy you. Let's have a quick chat to discuss it further. Thanks aga Lisää

$200 USD 2 päivässä
(49 arvostelua)

Hello. How are you today? I've read your job post carefully. This job really attracts me and also your required skills are completely matched with my major skills. I have good knowledge and rich experience with it. I b Lisää

$500 USD 10 päivässä
(11 arvostelua)

Hi, employer. I've read your proposals carefully and I think I can do it with python I have many previous works in this work and I will complete your project definitely. The person who waits too long loses the opport Lisää

$150 USD 3 päivässä
(24 arvostelua)

I can write fast and efficient python script to analyse these files and save results after processing files as described .

$200 USD 7 päivässä
(62 arvostelua)

Hello, I read out your task completely and I am interested in your post. I have confident that I will provide you quality work within your deadline. I have a deep passion for research and I guarantee that all of my wo Lisää

$140 USD 7 päivässä
(54 arvostelua)
$140 USD 3 päivässä
(44 arvostelua)

Hi, glad to bid on your project. I have read your description and convinced I am suitable for your project. I have skills of C#/Java/Python in db management and programming related to db. I have worked 7+ years in DBMS Lisää

$100 USD 5 päivässä
(16 arvostelua)

I am a Python expert. I have worked in Python development for 7+ years. And then I am a good english speaker. So anytime,anywhere you will discuss anything with me freely. Credit is the most important to me. No credit, Lisää

$130 USD 4 päivässä
(14 arvostelua)

Hi, How are you? I've carefully read your description and I am very interested in your project. I am ready for your project, I can start immediately and finish it within the agreed deadline. I have expertise with Pytho Lisää

$140 USD 7 päivässä
(23 arvostelua)

hi sir can i help you to clean your data according to your desire and your requirement i have very good expreince in data cleaning.

$140 USD 7 päivässä
(7 arvostelua)

Hello dear, I read your job posting carefully and am very interest your project. I am a full stack developer with great experience and skills in Web development for over 5 years long. I've always been giving clients sa Lisää

$250 USD 7 päivässä
(13 arvostelua)

hello,how are you. i read your bid carefully. i am Python, SQL expert and have full experience for 7 years. Python, SQL is my top skill and i can handle your project fully. I can provide most quality and high fast. if Lisää

$150 USD 7 päivässä
(2 arvostelua)

Hi, I have a lot of experience optimizing databases to makes searches quicker as well as filling databases faster. I have lots of tips which can make the whole process a lot faster

$240 USD 7 päivässä
(9 arvostelua)

Dear sir. How are you? I have gone through the requirement and would like to raise my interest in the same. I am an expert at : Python, PHP, Mysql, Laravel, Codeigniter,JavaScript, jQuery etc. I believe I have most of Lisää

$200 USD 7 päivässä
(4 arvostelua)

Hello How are you? I've read carefully your job description. I have more than five years experience in Development. Your satisfaction with the project is my top priority! If you give me a chance to work with you, the Lisää

$250 USD 7 päivässä
(4 arvostelua)

Need Web Development or Business Growing? My experiences range from building responsive software design that work well cross-browser to Business Goal. I am glad to provide full solution to you. We Are in House of Web a Lisää

$400 USD 7 päivässä
(3 arvostelua)

Hi I have read your job description carefully and I am very interested. I am a Python expert. And I have good experience in MySQL. I have worked in Python development for 7+ years. And then I am a good english speaker Lisää

$140 USD 7 päivässä
(3 arvostelua)

Hello, I am pleasure with your job for Matching System. Thank you for the job posting. It’s a pleasure to meet you. I’d really like to work with you on this one if possible! I do have a couple of questions, but first I Lisää

$140 USD 7 päivässä
(1 arvostelu)
$155 USD 3 päivässä
(1 arvostelu)

Hi, I'm glad to bid your project. I am very interested in your job. I am a PHP&JS expert and confident on your job. I can do that with my this price for your successful product. As a senior web app full time develope Lisää

$100 USD 7 päivässä
(3 arvostelua)