At least 3 years of experience with data engineering emphasis on data pipelines

Storage S3, PySpark Experience

Well Versed with AWS CLI  and Console

Ability to write  Lambda

Strong experience with SQL and Spark framework (ideally Data Bricks but will consider strong Spark and Python candidates)

Exposure to large datasets

Multiple years of Experience developing with Python

Must have used GIT

Experience with GLUE will be a  PLUS

Experience with Kinesis (SQS, SNS) will be a plus.

 Solid grasp of database engineering and design

At least 3 years of experience with data engineering emphasis on data pipelines

Storage S3, PySpark Experience

Well Versed with AWS CLI  and Console

Ability to write  Lambda

Strong experience with SQL and Spark framework (ideally Data Bricks but will consider strong Spark and Python candidates)

Exposure to large datasets

Multiple years of Experience developing with Python

Must have used GIT

Experience with GLUE will be a  PLUS

Experience with Kinesis (SQS, SNS) will be a plus.

 Solid grasp of database engineering and design