Job Title : Sr. Snowflake Developer
Experience : 16 LPA
Location : Chennai
Description:
• Design, develop, and maintain large-scale data pipelines and solutions on Snowflake/AWS, using the modern 'configuration driven design' framework, that can be repeatable for additional dataset consumptions
• Develop and implement data quality checks and procedures
• Troubleshoot and resolve data issues by working closely with the Business and Technical Data Stewards as necessary.
• Document data pipelines and data warehouses flows as artifacts in working with Data Architect Lead team to help in being fully compliant with the Compliance and Cybersecurity team and for yearly audit purposes
• Stay up to date on Snowflake/AWS features and best practices and work closely with Data Architect team to jointly make recommendations for framework and pattern improvements.
• Participate in data governance and security initiatives to ensure there is full compliance of the work with Data Governance, Data Stewards and Cybersecurity team's policies and procedures.
• Work with Data Governance and Data Stewards along with the Clinical Informatics team to understand the Data Standards, Data Quality rules to be maintained, Data Normalization and Harmonization rules those needs to be applied from the clinical perspective to be able to effectively create the Enterprise Data Hubs, Satellites and the Links based off the Data Vault modeling principles.
• Work closely with Data Governance, Data Stewards to help with Data Classification, contribute towards Data Archival and Retention policies. Ideate frameworks, when with automation applied can aid with these tasks based on configurations by other Data Engineering Leads.
• Develop and maintain the data warehouse, data marts, data hub in Snowflake and other potential datastores in AWS schemas, views, and procedures using Data Vault 2.0 modeling methodology
• Develop and maintain scripts and automations for Data Engineering tasks like CI/CD, Performance testing, QA/QC, Audit Balance and Control, and Security testing
• Troubleshoot and resolve Data Engineering issues
• Serve as an advanced Level of support tier along with the Data Architect Lead tier to help resolve Data Issues
• Mentor and develop junior data engineers data processes, governance, and policies
• Provide engineering leadership, accountability, and guidance to the data engineering team