Solution architect – Target Data Platform, storage and lakehouse

You support the design of Sciensano's multi-user data and analytics platform, particularly the ‘storage layer’ component (including the data lake, which forms the foundation of the data platform). You also support interactions with other components (‘ingestion layer’, ‘core systems’, ‘front-end-systems’, etc.).

You are specialized in data and analytics platforms, with expertise in lakehouse architectures, Kubernetes-based data science environments, open source ecosystems, and European digital sovereignty initiatives.

You have experience in designing scalable, interoperable, secure (GDPR, NIS2), and production-oriented platforms using technologies such as PostgreSQL, MinIO, OpenStack, Apache, Kubernetes, Docker, Spark, Onyxia, and modern frameworks for governance and metadata.

You bridge the gap between organizational-level architecture and detailed technical implementation. You collaborate with internal services, technical teams, and external partners to find an integrated and robust solution.

Your responsibilities include, in coordination with the Data Office (Data Governance department, Sciensano):

• Propose, evaluate, test, and provide advice on technologies, tools, and methodologies for the ‘storage’ (lakehouse) component. This includes:

• BLOB storage, data lake

• data warehouse relational database management system (RDBMS)

• SQL RDBMS

• NoSQL Database System.

• Propose how to implement the ‘medallion’ architecture (bronze, silver, gold), archiving, and backup within the data platform, taking into account the ingestion, processing, integration, consumption, and dissemination of various types of data flows and obligations (legal, Belgian health data ecosystem, animals and environment).

• Evaluate, propose, and test that these solutions are consistent with the general architecture of the platform, are based on open source, sovereign, and multi-user technologies, and are compatible and interoperable with other ‘Application architecture’ components, particularly with:

• ‘ingestion layer’ (including the different sources)

• ‘core systems’

• ‘front-end-systems’ (data science workbench, BI, data service gateway, secure processing environment)

• Ensure that the architecture and data flows comply with the requirements defined by the Data Office, GDPR, NIS2, Information Security Committee (CSI), the new registry policy, and the European Health Data Space (health data holder, trusted data holder).

• Proactively resolve challenges related to system choices and implementation

• Advise technical teams, evaluate technical designs and code, support best practices;

• Collaborate with the different relevant services, management, and external partners and act as a technical point of contact;

• Draft (technical) documentation;

• Ensure high-quality technical implementation;

Master’s degree in computer science, engineering, data management (or equivalent, complemented by relevant experience)

At least 10 years’ experience:

• in data platforms, data engineering, solution architecture, data storage, big data ecosystems, data modeling, and database technologies;

• design and implementation of modern data and analytics platforms.

• in lakehouse architectures, open source ecosystems (without single vendor lock-in), and European digital sovereignty initiatives.

Expertise in:

• data platform architecture

• data ingestion, data lakes, data warehousing, ETL/ELT pipelines

Technical expertise in the selection, implementation, and maintenance of:

• Storage (e.g. MinIO, PostgreSQL, NoSQL, S3-compatible object storage)

• Data processing (e.g. Apache ecosystem, Iceberg, Spark, dbt)

• Containers and orchestration (e.g. Docker, Kubernetes, Helm)

• Security (e.g. Keycloak, vault)

• Infrastructure (e.g. Terraform, OpenStack)

• Management and version control (e.g. open project, JIRA, github, gitlab)

[Asset] Sovereign cloud stack (e.g. OVHcloud, Hetzner, Scaleway)

Generic skills:

• metadata management, data governance, privacy, data protection and security (e.g. GDPR, NIS2, Data Governance Act)

• strong analytical and problem-solving skills;

• excellent interpersonal and communication skills, able to convey complex topics to both technical and non-technical audiences;

• motivated and able to work autonomously, with a collaborative mindset and strong communication skills;

• ability to lead, contribute to defining and influencing solution design and development

• a client-oriented mindset with a strong results orientation.

Languages: Dutch or French; and excellent knowledge of English