
Luxoft
Senior Data Engineer
- Permanent
- Abu Dhabi, United Arab Emirates
- Experience 5 - 10 yrs
- Urgent
Job expiry date: 02/11/2026
Job overview
Date posted
18/09/2026
Location
Abu Dhabi, United Arab Emirates
Salary
AED 20,000 - 30,000 per month
Compensation
Comprehensive package
Experience
5 - 10 yrs
Seniority
Senior & Lead
Qualification
Bachelors degree
Expiration date
02/11/2026
Job description
Investment teams and Middle and Back office functions need data they can trust, and this Senior Data Engineer role exists to design, build and operate the pipelines and models that make that possible. Financial markets familiarity matters here, covering securities, prices, corporate actions and positions and holdings, since the data itself reflects how these instruments actually move. Ambiguity comes with the territory, and the expectation is to shape solutions proactively rather than wait for a ticket to land. You'll own data end to end, from ingesting vendor and internal sources through modeling in the lakehouse to making that data discoverable, reliable and cost efficient. Close partnership with BAs, PMs and quants runs through the job, anticipating downstream needs and proposing architectures that balance speed, governance and scalability. Day to day work includes requirements clarification, sprint planning and designing technical solutions, with ETL pipelines built and tuned in PySpark for better performance and reliability. Unit and integration tests get written along the way, and QA teammates get support through the acceptance process. Production incidents also land here, handled as a third line engineer when something in the data pipeline breaks.
Required skills
Key responsibilities
- Participate in requirements clarification and sprint planning sessions
- Design technical solutions and implement ETL pipelines using PySpark
- Build data pipelines in PySpark to extract and transform investment data
- Optimize existing ETL processes for better performance, scalability and reliability
- Write unit and integration tests
- Support QA teammates through the acceptance process
- Resolve production incidents as a third line engineer
Experience & skills
- Hold a bachelor's degree in Computer Science, Engineering, Information Systems or a related discipline
- Bring 5+ years of experience in data engineering roles
- Show strong hands-on experience with Databricks in production environments
- Demonstrate strong programming experience with PySpark and strong SQL
- Carry proven experience with Declarative Pipelines and pipeline orchestration on Databricks
- Apply a strong understanding of data engineering fundamentals, including ingestion patterns, transformation design, incremental processing, testing and performance tuning
- Deliver production-ready datasets with appropriate operational controls such as monitoring, troubleshooting and reliability patterns
- Use modern Lakehouse concepts such as Delta tables, optimization strategies, file skipping and metadata/statistics awareness
- Understand data governance practices including cataloguing, documentation, business glossary and lineage
- Work in enterprise environments with CI/CD pipelines and structured release processes
- Know vendor market data feeds such as Bloomberg, Refinitiv, MSCI and FactSet, or similar multi-source mastering patterns