Senior Data Engineer

About the role

Devoteam, an AI-driven tech consulting firm specializing in cloud, cyber, data and sustainability, is looking for a Senior Data Engineer to join its Innovative Tech department in Luxembourg. You will design, build and optimize robust data architectures so that clients can use their data effectively, working in a dynamic environment with cross-functional teams.

Key responsibilities

• Develop and optimize ETL/ELT pipelines handling batch and streaming data
• Integrate data flows from structured and unstructured sources
• Contribute to scalable designs using medallion architecture
• Implement cloud-based architectures such as Data Lakehouse and Delta Lake
• Evaluate emerging technologies and architectural patterns
• Ensure data security, governance and performance standards
• Solve complex data challenges for reliable distributed systems
• Share knowledge through documentation, training and tech updates
• Work with Data Science, BI, Product and Architecture teams

Required profile

• Fluent spoken and written English and French
• Collaborative, analytical, autonomous and detail-oriented
• Nice to have: experience in regulated environments (financial services, healthcare, critical infrastructure) and knowledge of Luxembourg's regulatory environment, including CSSF regulations

Required skills

• Python and strong SQL
• Spark (batch and streaming), Hadoop
• Airflow, Kubernetes-native pipelines, GitOps
• Lakehouse formats: Iceberg, Delta Lake, Parquet, S3 / MinIO, Polaris Catalog
• Kafka, Spark Streaming, Flink, and real-time architectures such as Debezium
• Databases such as PostgreSQL, MongoDB or Cassandra
• Strong experience with Databricks, Snowflake, GCP or AWS is a major asset
• Nice to have: machine learning model development, TensorFlow, PyTorch, Scikit-learn, and Google Cloud Professional Data Engineer or Machine Learning Engineer certification

What we offer

• Work with modern Microsoft technologies (Fabric, Copilot, Azure AI)
• A diverse community of 140+ tech enthusiasts from 30+ countries
• Training center, certifications and mentoring
• The opportunity to contribute to social causes and sustainability through the Devoteam Foundation