Job Title : Senior Data Engineer - Datastage
Experience : 4 - 8 Years
Location : Chennai
Description:
Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in
architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data
(Hadoop, Kafka), and integration tools to connect sources or other databases.
Role Responsibility:
Translate functional specifications and change requests into
technical specifications
Translate business requirement document, functional
specification, and technical specification to related coding
Develop efficient code with unit testing and code
documentation
Ensuring accuracy and integrity of data and applications
through analysis, coding, documenting, testing, and problem
solving
Setting up the development environment and configuration of
the development tools
Communicate with all the project stakeholders on the project
status
Manage, monitor, and ensure the security and privacy of data
to satisfy business needs
• Contribute to the automation of modules, wherever required
To be proficient in written, verbal and presentation
communication (English)
• Co-ordinating with the UAT team
Role Requirement:
Proficient in basic and advanced SQL programming concepts
(Procedures, Analytical functions etc.)
Good Knowledge and Understanding of Data warehouse
concepts (Dimensional Modeling, change data capture, slowly
changing dimensions etc.)
• Knowledgeable in Shell / PowerShell scripting
Knowledgeable in relational databases, nonrelational
databases, data streams, and file stores
• Knowledgeable in performance tuning and optimization
• Experience in Data Profiling and Data validation
Experience in requirements gathering and documentation
processes and performing unit testing
Understanding and Implementing QA and various testing
process in the project
• Knowledge in any BI tools will be an added advantage
Sound aptitude, outstanding logical reasoning, and analytical
skills
• Willingness to learn and take initiatives
• Ability to adapt to fast-paced Agile environment
Additional Requirement:
• 2 years of experience in Data Engineering, with a focus on ETL using IBM InfoSphere DataStage.
• Understanding how to configure and utilize sequence generators within DataStage jobs to fulfill specific business requirements or to establish a consistent
numbering scheme across data sets.
• Creating strategies for capturing historical changes while retaining previous versions of data in the data warehouse.
• Handling various types of flat file structures and formats to access the necessary information.
• Using the parameters to customize ETL jobs, adapt data extraction or transformation logic, or configure connections to different data sources or destinations.
• Certifications in IBM InfoSphere DataStage or related technologies would be a plus.