Pyspark unit test cases

There is a simple project on Python testing.

Pyspark unit test cases need to be developed.

Roughly 10 functions and likely to take a few hours

for total work for experienced developer.

Any IDE like intellij or Pycharm will do.

Unit test library name is "Unittest" , using "mock".

Details of what the function does, variable details, and expected results.

Functions will involve pyspark dataframes and udfs (user defined functions).

Input1 (variable1) is json text data with multiple nested key value pairs.

Input2 is a list of keys from a json file (variable2) ,

output will be these attributes in json format (variable3).

Some functions will involve returning results.

Some are only to call other functions without a return value.

Set of python pyspark functions involving dataframes, uds,

general pyspark operations such as join, select, python lambdas,

reading and writing files from and to S3,

handling different spark data types like integers, arrays, strings

and different data formats such as csv, json.

Taidot: Python, PySpark, JSON, Ohjelmistojen testaus

Näytä lisää: test cases auto insurance project, simple project python, write unit test cases java hsbc, automate unit test cases, how to copy test cases from one project to another in jira, copying test cases from one project to another in jira, how to move test cases from one project to another in jira, add unit test to existing c# project, copy test cases from one project to another in zephyr, moving test cases from one project to another in tfs, add unit test to existing mvc project, how to write unit test cases in java, qt unit test cases, how to run unit test cases in android studio, how to write unit test cases in react js, how to write unit test cases, unit test cases in c# for console application, unit test cases in core web api, how to write unit test cases in react js using jest, writing unit test cases react

Tietoa työnantajasta:
( 0 arvostelua ) India

Projektin tunnus: #31461238

7 freelanceria on tarjonnut keskimäärin ₹9301 tähän työhön


hi I'm professional python developer with 6 plus years of experience and I have experience in test automation also. have used unittest, pytest and robot framework I can do this task..

₹11111 INR 2 päivässä
(16 arvostelua)

Hi, I am an experienced Data Engineer with a solid background in Spark. I have also experience in writing units tests in Python and Scala. Let's have a call for more details about the project. Regards

₹10000 INR 3 päivässä
(1 arvostelu)

I have pursued my bachelor's degree in computer engineering I've completed the data science course by Greyatom and I've also worked on capstone projects like Sentiment analysis of Twitter data. I'm comfortable with cod Lisää

₹7000 INR 7 päivässä
(0 arvostelua)

Hello, Greetings for the day!!! I have gone through your requirement and understood every aspect of them. I can help you with your requirements and my work will be flawless. I have experience of more than 3 years. Lisää

₹12500 INR 30 päivässä
(0 arvostelua)

"Hi !! Nice to E-meet you. We have more than 5 years experienced in Android, iOS, Windows App and Web Design and Software Development. We Can develop entire project from scratch or modify existing code, fix bugs & ass Lisää

₹4999 INR 7 päivässä
(0 arvostelua)

A result-oriented, energetic professional having 7.6 years of experience in Functional and Automation testing in Selenium using Python & Core Java. ISTQB Foundation Level Certified with proficient in managing all phase Lisää

₹7000 INR 7 päivässä
(0 arvostelua)

Hi I am a Cloudera certified Hadoop Developer(CCD-410). I have 9 years of IT experience and 6 years of Bigdata technologies like Hadoop,Yarn,Hive,Pig,Spark,Scala,Python,Java,Snowflake and R. I am familiar with PySpar Lisää

₹12500 INR 4 päivässä
(0 arvostelua)