Data Engineer-Data Integration
About the position
- Responsibilities
- Develop, maintain, evaluate, and test big data solutions.
- Create pipelines/workflows for Source to Target and implement solutions that tackle the client's needs.
- Design, build, optimize and support new and existing data models and ETL processes based on our client's business requirements.
- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.
- Coordinate data access and security to enable data scientists and analysts to easily access data whenever they need to.
- Requirements
- Bachelor's Degree
- Design, develop, and maintain Ab Initio graphs for extracting, transforming, and loading (ETL) data from diverse sources to various target systems.
- Implement data quality and validation processes within Ab Initio.
- Collaborate with data architects and business analysts to understand data requirements and translate them into effective ETL processes.
- Analyse and model data to ensure optimal ETL design and performance.
- Utilize Ab Initio components such as Transform Functions, Rollup, Join, Normalize, and others to build scalable and efficient data integration solutions.
- Implement best practices for reusable Ab Initio components.
- Nice-to-haves
- Master's Degree
- Optimize Ab Initio graphs for performance, ensuring efficient data processing and minimal resource utilization.
- Conduct performance tuning and troubleshooting as needed.
- Work closely with cross-functional teams, including data analysts, database administrators, and quality assurance, to ensure seamless integration of ETL processes.
- Participate in design reviews and provide technical expertise to enhance overall solution quality.
Apply Now
Apply Now