Context

As part of its 2027 roadmap, STIB-MIVB is continuing to modernize and optimize its Data Platform. Following the migration of non-SAP data to Azure, our key priorities include:

• Developing new business use cases to support reporting, analytics, and Data Science.
• Strengthening data governance through Databricks Unity Catalog.
• Expanding our self-service data strategy to empower business teams while ensuring proper governance and security.
• Monitoring and optimizing Azure and Databricks consumption and costs to improve platform efficiency.
• Continuously improving our Data Platform architecture, focusing on performance, scalability, and reliability.

To support these initiatives, we are looking for an experienced Azure Data Engineer with strong expertise in Azure Databricks and Unity Catalog to strengthen our Data & Analytics team.

Main Mission:

As an Azure Data Engineer, you will play a key role in the continuous development, optimization, and governance of STIB-MIVB’s Data Platform.

You will design, develop, and maintain reliable and scalable data solutions on Microsoft Azure, while contributing to the evolution of our Azure Databricks architecture.

You will also help implement data governance and self-service capabilities using Unity Catalog, monitor platform consumption and costs, and ensure that our Data Platform meets business needs in terms of performance, security, and reliability.

Key Responsibilities:

• Design and develop data pipelines using Azure Data Factory, Databricks, and other Azure services.
• Implement modern data architectures (Data Lake, Delta Lake, Lakehouse).
• Develop and industrialize new business use cases.
• Contribute to the implementation and management of Databricks Unity Catalog (catalogs, schemas, permissions, data sharing, and governance).
• Support the implementation of a self-service data strategy.
• Monitor and optimize Azure and Databricks performance, resource consumption, and costs.
• Automate data ingestion, transformation, and deployment processes.
• Collaborate with Data Analysts, Data Scientists, and business stakeholders.
• Document data flows, architecture, and best practices.
• Contribute to the maintenance and continuous improvement of the Azure Data Platform.

Required Technical Skills:

• Strong experience with Azure services: Data Factory, Azure Databricks, Azure Storage, Azure SQL, Key Vault, Azure DevOps.
• Hands-on experience with Databricks Unity Catalog, including access management, security, and data governance.
• Strong knowledge of Azure Databricks architecture, including Lakehouse design, scalability, security, and best practices.
• Experience with Spark, PySpark, and Delta Lake.
• Strong skills in SQL and Python.
• Experience with monitoring, performance tuning, and cost optimization in Azure and Databricks.
• Knowledge of CI/CD principles applied to data engineering.
• Knowledge of application integration patterns (REST API, AMQP).

Profile:

• Degree in Computer Science, Data Engineering, or a related field.
• Minimum 5 years of experience in a similar role.
• Proven experience with Azure Databricks, Unity Catalog, and Azure data architecture.
• Analytical mindset, autonomy, problem-solving skills, and team spirit.
• Strong communication skills and ability to explain technical concepts clearly.

Nice to Have:

• Microsoft Azure or Databricks certifications.
• Experience with Power BI administration and governance.
• Experience with real-time data streaming.
• Experience with Terraform or Infrastructure as Code.
• Familiarity with Azure Monitor and Log Analytics.
• Basic SAP knowledge (S/4HANA or BW/4HANA as data sources).
• Experience working in Agile/Scrum environments.

If you enjoy working with modern data technologies and want to contribute to the future of mobility in Brussels, we’d love to hear from you!