2 days, 12 hours ago

Data Engineer Microsoft Fabric

In recent years, the FAVV has been striving to become a fully data-driven organization and relies on a central data warehouse for its reporting and analysis.

Given the rapidly evolving technologies and business needs, the FAVV now wants to modernize this platform by migrating it to the Microsoft Azure cloud. This transition is accompanied by the implementation of new, powerful tools, including Microsoft Fabric (ETL) and Power BI.

To assist us with this challenge, we are looking for two Data Engineer Microsoft Fabric

Mission:

  • Design and develop ETL flows in Microsoft Fabric (Dataflows Gen2, Notebooks PySpark, Pipelines) on Azure Cloud
  • Set up data models oriented towards BI according to the Kimball / snowflake methodology
  • Develop fact tables, dimensions, and aggregates in the DataWarehouse, respecting priorities and planning
  • Ensure the quality, reliability, monitoring, and performance of features and flows
  • Manage and monitor traceability, flow alerts, and rejection issues
  • Automate deployments with CI/CD (Azure DevOps or GitHub)
  • Work closely with the IC team to ensure coherence between systems and solutions
  • Connect to various sources (Oracle, SQL Server, XML, Flat files, …), understand their structures, and optimize extractions
  • Adhere to defined technical standards: naming, security, management, monitoring, CI/CD
  • Comply with guidelines and internal procedures at both technical and organizational levels
  • Document operations and flows

Technical skills:

  • Microsoft Fabric: Lakehouse, Dataflows Gen2, Pipelines, Warehouse
  • Azure: Azure Data Lake, Azure Synapse (a plus)
  • Databases: excellent command of Oracle and SQL Server (connection, extraction, optimization of selects)
  • SQL: advanced level
  • PySpark: distributed operations for large volumes of data
  • DAX (basic knowledge)
  • Data warehouse concepts
  • Modelling Kimball: Star Schema & Snowflake, Slowly Changing Dimensions (SCD)
  • ETL/ELT: good practical knowledge for sequencing and monitoring
  • CI/CD: Azure DevOps or GitHub Actions
  • Security and management of data on Azure
  • Knowledge of Sparx Enterprise Architect for documentation is a plus
  • Knowledge of Informatica Powercenter (or willingness to learn it) is a plus

Desired profile:

  • Bachelor in Computer Science or equivalent experience
  • At least 5 years of experience in Data Engineering, of which at least 3 years in Fabric on Azure Cloud
  • Good command of the Kimball methodology for BI
  • Proven experience with Oracle and SQL Server databases
  • Ability to optimize performance and document processes
  • Ability to work in a team with respect for governance and internal procedures
  • FR/NL with a good passive knowledge of the other language (required)

Apply for this Job

This position was originally posted on Pro Unity.

It is publicly accessible, and we recommend applying directly through the Pro Unity website instead of going through third party recruiters.

Newsletter signup illustration