PySpark Developer

PySpark technology to join our growing Analytics practice delivering

transformative solutions. The candidate will be part of the project that will be migrating SAS jobs/

programs to PySpark technology without affecting the overall functionality and with enhanced

performance. This is a time sensitive project and will have tight timelines.

Job Requirements

Educational Requirement Bachelor’s degree

Technical Skills (Must Have) PySpark, Unix, Control-M, Shell Scripting, SQL

Process Knowledge SDLC, Scrum, Agile, Git, JIRA, confluence

Overall Experience 5 to 6 Years with minimum 3 years+ in the Must have

technical skills

Other Experiences SAS skills, migrating a SAS job/program to PySpark achieving

the same functionality

Desired Experience

1. Any experience in the Banking domain will be an added advantage.

2. Any Experience in big data technologies (HDFS, SPARK, HIVE SQL, SCALA, SCOOP, KAFKA

etc).

3. Strong experience in writing shell scripts (PowerShell scripting will be an added advantage)

4. Experience across all stages of SDLC lifecycle.

5. Ability to Coordinate with multiple teams.

Responsibilities:

1. Understand the existing SAS job/ program functionality and convert it to PySpark code

using tool.

2. Enhancement of the converted PySpark job for performance and accuracy of the output.

3. Manage communication with stakeholders.

4. Excellent written and oral communication.

5. Have an eye for automation of manual tasks.

6. Ability to debug the converted PySpark job in case of issues.

7. Adherence to commitment timelines

8. Coordinate and support SIT/UAT/SIT and PT

9. Work in coordination with Production support / SRE teams to maintain stability of

production applications via controlled, automated deployments with minimal outages and

impact.

10. Provide updates to the project / program manager with regards to progress and issues,

where appropriate

11. Ability to learn other tools and technology within a short span of time or with the help of

training.

12. Document detailed Unit test results, application functionality, design etc. in Confluence

and JIRA’s with supporting evidence & test cases

Next Steps

Please apply in confidence with your current and expected package.

Due to the volume of applications, we regret only shortlisted candidates will be notified.

Posted Date
2023-09-29 18:08:43
Experience
5 -10 years
Primary Skills
PySpark, Unix, Control-M, Shell Scripting, SQL
Required Documents
Resume
Contact
bhawya@lorventech.com,diana@lorventech.com,ashwiny@lorventech.com,geetha@lorventech.com,fathih@lorventech.com,ganeshk@lorventech.com,sarga@lorventech.com,naresh@lorventech.com,jeevitha@lorventech.com
Bootstrap Example