Added 1 year ago
Lead Data Engineer – Informatica/CDC(Immediate to 2 weeks of joiners ONLY)
LocationAbu-Dhabi, Abu Dhabi, Middle East Staffing Adecco
Job typeSpecialist
Date2022-07-18
CategoryBanking and Insurance
Lead Data Engineer – Informatica/CDC(Immediate to 2 weeks of joiners ONLY)
Adecco Middle East is looking for a Lead Data Engineer – Informatica/CDC to join one of our clients based in Abu Dhabi, UAE. We are looking for a resource who will be responsible for implementing complex big data projects with a focus on real time, change data capture, ETL, ingestion and manipulation of large sets of data to turn information into insights using multiple platforms. He will be accountable for maintaining direction and ensuring alignment with business objectives with regards to how data is managed across the organisation. The job holder will work closely with infrastructure, network, database, business-intelligence and operations teams to implement ways to improve data reliability, efficiency, and quality.
Job Title: Lead Data Engineer – Informatica/CDC
Job Location: Abu Dhabi, UAE
Duration: 12 months extendable contract
Salary: Open for discussion
Roles & Responsibilities
Create and manage Power center Repositories and Integration services.
Create and Configuration Power Exchange CDC Environments listener and Logger.
Create application connections for Power Exchange CDC real time and continues mode.
Creating Registration Groups & Maps and Importing to Informatica CDC Repositories.
Monitor Memory space usage and allocation and code deployment management.
Serve as a subject matter expert on Informatica.
Data acquisition, develop data set processes.
Resource and security management.
Troubleshooting application errors and ensuring that they do not occur again
Support the development of the organizational Data Strategy and support data management in line with strategic business objectives and cultures and values.
Supports the Data Engineering Lead in the development and oversight of the big data platform, standards, practices, policies and processes.
Supports the development of the Data Engineering Office as a center of excellence committed to ingraining a data-driven decision making culture across the organization, teaming with external partners, and offering end-to-end data services across business and support groups.
Aligns architecture with business requirements.
Promotes good data engineering practices and the management of data as a strategic asset
Minimum Qualifications:
Degree educated with a minimum of 3 years of direct experience, 5+ years overall industry experience
Minimum Experience:
Minimum 3 years of direct experience in Apache Hadoop, Informatica and CDC design patterns.
Experience of contributing to financial projects would be beneficial.
Effectively creating and maintaining the data pipeline architecture that accounts for security, scalability, maintainability, and performance.
Full working knowledge of SQL and the ability to identify and translate user cases into Hadoop/Informatica ETL is essential.
Baaic Hadoop Administration skills: Cloudera Manager and Cloudera Navigator and HUE.
Proficiency in writing Spark processes in Java/Scala and ideally in Python as well.
Strong Unix/Red Hat skills, python scripting highly beneficial.
Must be capable of designing and documenting solutions independently.
Excellent track record of supporting and managing internal clients.
Knowledge and Skills
Good knowledge of Big Data platforms, frameworks, policies, and procedures.
Proficient understanding of distributed computing principles
Good knowledge of Big Data querying tools, such as Hive, and Impala
ETL tools - Informatica Power center, Informatica Power Exchange.
Experience with building stream-processing systems, using solutions such as Kafka and Spark-Streaming
Test and debug all ETL and objects to evaluate the performance.
Excellent SQL knowledge
Experience on Cloud big data technologies beneficial like Databricks and Azure HDinsights.
Attributes
A reliable and trustworthy person, able to anticipate and deal with the varying needs and concerns of numerous stakeholders adapting personal style accordingly.
Adaptable and knowledgeable who can able to learn and improve his skills with existing and new technologies.
Recently viewed Jobs
- Dubai, Dubai, Middle East Staffing Adecco
- Manager
- Abu-Dhabi, Abu Dhabi, Middle East Staffing Adecco
- Specialist
- Dubai, Dubai, Middle East Staffing Adecco
- Manager