Data Engineer

Job Title      : Data Engineer
Experience  : 5-10 Years
Location      : Chennai, Bangalore

Job Description :

  • Minimum 5+ years of development and design experience in Informatica Big Data Management
  • Extensive knowledge on Oozie scheduling, HQL, Hive, HDFS (including usage of storage controllers) and data partitioning.
  • Extensive experience working with SQL and NoSQL databases.
  • Linux OS configuration and use, including shell scripting.
  • Good hands-on experience with design patterns and their implementation.
  • Well versed with Agile, DevOps and CI/CD principles (GitHub, Jenkins etc.), and actively involved in solving, troubleshooting issues in distributed services ecosystem.
  • Familiar with Distributed services resiliency and monitoring in a production environment.
  • Experience in designing, building, testing, and implementing security systems –
  • Including identifying security design gaps in existing and proposed architectures and recommend changes or enhancements.
  • Responsible for adhering to established policies, following best practices, developing, and possessing an in-depth
  • Understanding of exploits and vulnerabilities, resolving issues by taking the appropriate corrective action.
  • Knowledge on security controls designing Source and Data Transfers including CRON, ETLs, and JDBC-ODBC scripts.
  • Understand basics of Networking including DNS, Proxy, ACL, Policy, and troubleshooting
  • High level knowledge of compliance and regulatory requirements of data including but not limited to encryption, anonymization, data integrity, policy control features in large scale infrastructures.
  • Understand data sensitivity in terms of logging, events and in memory data storage– such as no card numbers or personally identifiable data in logs.
  • Implements wrapper solutions for new/existing components with no/minimal security controls to ensure compliance to bank standards.

 

Posted Date
2025-02-18 18:21:46
Experience
5 -10 years
Primary Skills
SQL, NoSQL, Databases, Agile, DevOps.
Required Documents
Resume
Contact
bhawya@lorventech.com,recruit@lorventech.com
Bootstrap Example