Hello,
I need help in integration of the scripts and the modules to work perfectly.
Please help me also in correcting the issues within the script.
Also, I need help with the following conditions:
1. Put the text pattern as variable instead of a literal
0000000000_* in [login to view URL]
2. Arguments should be clearly define with regard to $2 & $3
Clearly define all the arguments in [login to view URL] with regard to $2, $3
3. Remove all of the 'remain_entries' logic, from the while to done.
Remove the below code from [login to view URL] and make it straightforward to read the files from the directory one by one, once they are processed move the file to the archive folder.
while IFS= read -r entry; do
while IFS= read -r line; do
if [ "$entry" == "$line" ]; then
remain_entries=${remain_entries}$entry$'\r'
continue 2
fi
done <"$2"
4. Mail logic to be completed. Code for mail in [login to view URL]
5. Avro tools command -
Remove/comment out the code from [login to view URL] as we are not using the converted Json further
6. Demonstrate the running of code as part of dry run and replace the processing script with a stub (for pyspark program) with the stub sleeping for 1 min and returning zero
7. Archive folder to be specific.
Little changes are to be done, so, please do it at the earliest.
Thanks,
Mirza Mujtaba Baig
Hi,
My name is George. I have a lot of experience on bash scripting and perl scripting from my current job where I'm working on a full time project based on networking activities and linux based systems. I've make many script files. For more informations please contact me!
Everything in your project description looks familiar, I see no surprises. I can easily make the required changes. Let's begin make the requested changes. I can do in 1 day if preferred, but if given 2 days they you can have a higher quality script for you.
1) Is 0000000000_* the pattern for the files to process?
2) I specifically see the issues with $2 and $3.
3) Remaining files to process - yes, I can process them one by one and move to the archive folder.
4) I can set it to send the "finished" mail
5) looks to be commented
6) I can provide dry run which has a stub that sleeps for 60 seconds and returns "0".
7) Can take archive folder as an argument if you like.
I see other logic issues, such as "$?" that can be fixed.