Job Title      : Senior Data Engineer
Experience  : 8-16 Years
Location      : Bengaluru

Job Description :

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, with a strong focus on Databricks, Python, and SQL. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support various business needs.

Key Responsibilities

• Develop and implement efficient data pipelines and ETL processes to migrate and manage client, investment, and accounting data in Databricks
• Work closely with the investment management team to understand data structures and business requirements, ensuring data accuracy and quality.
• Monitor and troubleshoot data pipelines, ensuring high availability and reliability of data systems.
• Optimize database performance by designing scalable and cost-effective solutions.

What’s on offer

• Competitive salary and benefits package.
• Opportunities for professional growth and development.
• A collaborative and inclusive work environment.
• The chance to work on impactful projects with a talented team.

Candidate Profile

Experience:

• 8+ years of experience in data engineering or a similar role.
• Proficiency in Apache Spark.  Databricks Data Cloud,  including schema design, data partitioning, and query optimization
• Exposure to Azure.
• Exposure to Streaming technologies. (e.g Autoloader, DLT Streaming)
• Advanced SQL,  data modeling skills and data warehousing concepts tailored to investment management data (e.g., transaction, accounting, portfolio data, reference data etc).
• Experience with ETL/ELT tools like snap logic and programming languages (e.g., Python, Scala, R programing).
• Familiarity workload automation and job scheduling tool such as Control M.
• Familiar with data governance frameworks and security protocols.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Education

• Bachelor’s degree in computer science, IT, or a related discipline.