<< Back to all jobs
Data Pipeline Developer
Chennai | Posted: 2022-08-29 18:18:30
Easy Apply Apply Now
  • Formal Education in Computer Science. Bachelors or Masters degree
  • Experience in designing and developing data warehouse and data lake ETL/ELT pipelines.
  • Experience with data engineering emphasis on data pipelines
  • Storage S3/Delta, SQL,  PySpark Experience. Experience with troubleshooting and performance tuning of  distributed systems. 
  • Well Versed with AWS Services – cloud formation, EC2, S3, IAM roles
  • Strong experience SQL scripting and excellent understanding of SQL joins, ranks, nested queries, complex CDC logic etc.              
  • Multiple years of Experience developing with Python, familiar with pandas, sklearn, numpy, pytest
  • Must have used CI/CD pipeline components  such as git, Jenkins, artifactory, Docker and be an expert on using it.
  • Ideally can demonstrate own code published on github
  • Formal Education in Computer Science. Bachelors or Masters degree
  • Experience in designing and developing data warehouse and data lake ETL/ELT pipelines.
  • Experience with data engineering emphasis on data pipelines
  • Storage S3/Delta, SQL,  PySpark Experience. Experience with troubleshooting and performance tuning of  distributed systems. 
  • Well Versed with AWS Services – cloud formation, EC2, S3, IAM roles
  • Strong experience SQL scripting and excellent understanding of SQL joins, ranks, nested queries, complex CDC logic etc.              
  • Multiple years of Experience developing with Python, familiar with pandas, sklearn, numpy, pytest
  • Must have used CI/CD pipeline components  such as git, Jenkins, artifactory, Docker and be an expert on using it.
  • Ideally can demonstrate own code published on github
Posted Date
2022-08-29 18:18:30
Experience
3 -5 years
Primary Skills
SQL, PySpark, Python, AWS Services
Required Documents
Resume
Contact
bhawya@lorventech.com,diana@lorventech.com,hema@lorventech.com,ashwiny@lorventech.com,krishna@lorventech.com,santhana@lorventech.com,nivethas@lorventech.com
Bootstrap Example