Key responsibilities

• Design, construct, install, test, and maintain highly scalable data pipelines with a focus on machine learning models and analytics.
• Work closely with data scientists, ML engineers, and stakeholders to ensure that data is accessible, consistent, and reliable for ongoing projects.
• Develop and maintain APIs for data access and manipulation, and integrate with external data services as needed.
• Manage and optimize data storage solutions for both structured and unstructured data including relational databases and NoSQL engines.
• Understand data engines and structure to effectively design solutions for transactional, analytics, and search purposes.
• Implement processes to monitor data quality and ensure production data is always accurate and available for key stakeholders.
• Collaborate with ML engineers to assist in data-related technical issues and provide architectural guidance and solutions.
• Ensure compliance with data security and privacy policies.
• Maintain clear and up-to-date documentation including data dictionaries, metadata, and architectural diagrams.