Job description

Six months of focused pipeline work, with a view to extend, is what this Abu Dhabi contract offers, building AWS-based data ingestion at scale. AWS Glue, PySpark, S3, Athena and Lambda form the core toolset. Loading patterns vary by source, covering CDC, full load, delta, snapshot and historical migration. Bronze-layer ingestion in a Lakehouse built on Medallion principles is where most of the effort lands. Performance matters, so partitioning, parallelisation and AWS best practice are applied throughout. Deployment and infrastructure are automated with Git and Terraform, inside a CI/CD and Agile setup run through Jira. Data Architects, Data Assurance and Platform teams are close collaborators, and every pipeline must meet data contracts, monitoring and data quality standards. Repetitive migration tasks are good candidates for automation, and spotting them is part of the brief. At least 5 years of data engineering is required, banking experience helps, and pay is AED 20,000 to 24,000 per month for an in-office role.