Senior Data Engineer

About the Role
We are looking for a Senior Data Engineer to join a dynamic team, working on a cutting-edge data platform designed to provide valuable insights from diverse data sources to government and corporate leaders. You’ll play a key role in designing and developing data pipelines that will have a direct impact on decision-making processes at the highest levels. The platform is built using modern technologies, allowing you to work without legacy constraints and deliver results faster and smarter.

Responsibilities:

• Design, develop, and maintain data pipelines using Azure Data Factory, Databricks, Python, Spark, Pandas, and SQL.
• Optimize and manage Azure resources, including Blob Storage and Data Lake.
• Develop and maintain scalable ETL processes.
• Implement and manage automated data workflows for seamless orchestration and integration.
• Work with Azure DevOps, Terraform, and/or CI/CD to deploy and manage data pipelines efficiently.
• Ensure data security, quality, and governance, including setting access controls, monitoring data quality, and managing retention policies.
• Collaborate with cross-functional teams to understand business needs and translate them into effective technical solutions.

• Proficiency in Azure Data Factory, Databricks, or similar tools like Apache Spark or Azure Synapse.
• Strong skills in Python (with Pandas) and SQL.
• Experience with data architecture concepts, including Unity Catalog and Medallion architecture.
• Bonus: Experience with DevOps practices, Terraform, and handling complex data projects.

• Learning & Development: Opportunities to grow your career with continuous professional development.
• Flexible Working Hours: Enjoy the flexibility of hybrid or fully remote work, with hours aligned to your team.
• Collaborative & Supportive Environment: Join a multicultural team that values teamwork, innovation, and personal growth.
• Perks: Health insurance, a wellbeing app, and additional employee benefits to support your well-being.