Data Engineer – Real-time Data Pipelines

About the role

We are looking for a Data Engineer to design, build and operate robust, scalable data pipelines that support algorithmic trading and energy management. The role focuses on real-time and intraday data flows, working closely with traders, analysts and data scientists in our Energy Business IT department.

Key responsibilities

• Design, develop and maintain high‑availability data pipelines ingesting internal and external sources such as market data, forecasts and asset data.
• Ensure low latency, operational stability and monitoring of near‑real‑time data flows used for decision‑making.
• Integrate new data sources end‑to‑end, from acquisition and validation to storage, transformation and consumption.
• Collaborate with traders, analysts and data scientists to translate business requirements into production‑ready data solutions.
• Optimize pipelines and infrastructure for performance, scalability, cost efficiency and compliance with security and governance standards.
• Contribute to the evolution of data architecture, tooling and observability.
• Support deployment and lifecycle management of data pipelines, taking ownership of defined platform components.

Required profile

• University degree in IT, Data Science or a related field.
• Experience developing in Python or NodeJS.
• Understanding of microservice or event‑driven integration patterns.
• Knowledge of database design and query optimisation.
• Ability to communicate and collaborate with diverse stakeholders.
• Fluent English; German or French is a plus.

Required skills

• Python
• NodeJS
• Microservice architecture
• Event‑driven architecture
• Database design and SQL
• MuleSoft (or similar integration platform)
• Apache Camel
• Apache Airflow

What we offer

• Opportunity to contribute to Luxembourg’s energy transition.
• Multicultural, international environment that values diversity and inclusion.
• Competitive salary with benefits such as pension plan, health insurance, meal vouchers, free parking and company restaurant.
• Long‑term employment stability.