Job description

The Senior Data Engineer within Corporate Services (Group Tech & Dig Platforms) at Al-Futtaim Private Company LLC is responsible for transforming complex data into actionable business insights by evaluating and integrating new data sources into the Azure Data platform so that data is structured for effective business intelligence and analytics. The role designs, documents, develops, implements, and tests rapid prototypes to demonstrate data value to business audiences; engages in early-stage design discussions and feature definition by predefining potential insights to shape future projects; and develops and supports the integration of new data streams into the Azure Data platform to ensure accessibility, reliability, and structure. It builds and manages reusable and scalable data pipelines, optimizes data flows, converts business requirements into Technical and Functional Specification Documents (TSDs and FSDs), and assists with regular reporting queries while supporting developers using Alteryx, Power BI, and Azure. The position collaborates across multiple engineering teams to integrate prototypes into core intelligence products, guides internal and external teams using agile and waterfall methodologies to ensure timely and on-spec deliveries, and acts as a senior team member providing leadership in dynamic project environments. Required capabilities include strong analytical skills for handling and deriving insights from unstructured datasets; experience with Azure DevOps for deploying ADF pipelines and continuous integration; expertise in Python, PySpark, and related data engineering components; adaptability to both agile and waterfall delivery; robust knowledge of relational and non-relational databases; proven experience in big data pipelines, architectures, and datasets; and deep knowledge of Azure Data Factory, Databricks, Azure Event Hub, Python, PySpark, MongoDB, GraphDB, and SQL, with 10+ years of data engineering experience with Azure and Databricks.