Linux scripts for data processing

I have a large volume of zipped JSON files on a Linux virtual machine. Each JSON stores 5min of digital marketing data and there's about 6months length of data (meaning thousands of files). I want to get each of them unzipped, and converted to csv files with ready python code. After this, I would like to select limited columns from the csv files and load & append all of them into one SQL database table.

I'm hiring someone who can write Linux scripts to realize the objectives above. The virtual machine has SQL, Python, R, and can be accessed with my account.

Taidot: tekniikka, Linux, MySQL, Python

Näytä lisää: data swing forms database, data processing skills, data processing spreadsheet, introduction to shell for data science course, bash for data science, bash scripting, data science at the command line, unix for data science, bash data analysis, bash data structures, linux commands for data analysis, data processing forum, data processing health care, excel data processing home, radar data processing code, scripts data processing methods, linux image processing free source code, linux scripts data collection, data processing linux, data processing source code java

Tietoa työnantajasta:
( 1 arvostelu ) Tokyo, Japan

Projektin tunnus: #17849566

Myönnetty käyttäjälle:


Hi, I have lots of experience in processing large json, csv files during the stock analyzing project. I tried in different languages such as node.js and python. And python is the best fit for processing large fi Lisää

$200 USD 3 päivässä
(73 Arvostelua)

16 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön


I can create simple Python scripts that will process your zipped JSON files into CSV and next upload it into your database (using some filtering). I can start today and complete it in less than two days for just $80 Lisää

$80 USD 2 päivässä
(251 arvostelua)

I can write you a script in Bash, that will do all of your requirements. Can start work immediately, after you award.

$50 USD 1 päivässä
(241 arvostelua)

--Very Nice Job. Professional Engineering, Linux, MySQL, Python & Machine Learning expert. Best result in time----- [login to view URL] I read your description very carefully. I am very interesting for your project because Lisää

$250 USD 3 päivässä
(37 arvostelua)

Hello! This is Vibrant Webtech and I was glad to see that you're looking for help for project Linux scripts for data processing. I've delivered more than 400 + projects in the last 5 years and this makes me very c Lisää

$250 USD 4 päivässä
(41 arvostelua)

hi, i'm expert in scripting and python. hope to work with you in this project. you can check my profile for comments Thanks.

$250 USD 3 päivässä
(62 arvostelua)

-Professional Engineering, Linux, MySQL, Python expert ! Best Result in Time!-- Hello sir. I've really rich experience for your project, so your project is very interesting to me. I'm really confident about your pro Lisää

$100 USD 3 päivässä
(26 arvostelua)

Hello mate, I checked requirement and i think this is you need: + you want to get each of them unzipped, and converted to csv files with ready python code I have ability to do this project: MySQL, Linux, Enginee Lisää

$165 USD 3 päivässä
(18 arvostelua)

Hi there !! I'm a System Engineer with coding skills. I have been working with Linux for years. I had done many projects using Python too. Would you share a sample of your digital marketing JSON data? T Lisää

$250 USD 4 päivässä
(36 arvostelua)

Hi , It’s great to meet you. we will make the ERC20,ERC721 and ETH based Token in one day. ping me up so that we can discuss it more. We develop: cutting-edge software for Blockchain, ERC721, ERC20 Token Deve Lisää

$222 USD 3 päivässä
(9 arvostelua)

Good day, I can start working on this project today, and I believe it will only take 1 day to complete. Approach: - My expectation is that we can do this 100% in python. - I would recommend simultaneously creat Lisää

$97 USD 1 päivässä
(11 arvostelua)

I can do it

$77 USD 1 päivässä
(1 arvostelu)

Hi, I can help you in writing a python script which can inhibhit all the functionalities as mentioned in job description. I've written such code previously as well including zipping of csv files, remote transfer, file Lisää

$56 USD 3 päivässä
(4 arvostelua)

Hi, i have read your post. i can write script to solve your problem. i have worked with Linux script, MySQL and python. So, contact me to complete your task. Thank you!

$80 USD 2 päivässä
(0 arvostelua)

Hi, I've written many python scripts to work with JSON and CSV data. I also have approximately six months experience in Linux server administration (primarily Ubuntu and Debian, but a simple bash file should be mos Lisää

$100 USD 2 päivässä
(0 arvostelua)

I'm working in IT for 7 years. Last 3 years as Senior Systems Engineer. My job responsibilities hand on Linux systems and Cisco network equipment. I also have experience with Microsoft services.

$48 USD 3 päivässä
(0 arvostelua)