Software Engineer – Data Platform

About the role

As a Software Engineer on the Data Platform team, you will ensure that data from source systems is consolidated, accurate and readily available for business intelligence and analytics across John Deere Financial in Europe. You will work extensively with Databricks and the Enterprise Data Lake to make data discoverable, consumable and compliant with security standards.

Key responsibilities

• Collaborate on data migration initiatives from on‑premises systems to a cloud‑hosted Enterprise Data Lake.
• Design, build and automate scalable, secure data pipelines using Apache Spark (PySpark) and AWS services.
• Develop and maintain ETL processes, data models and data‑warehousing solutions for large‑scale datasets.
• Follow agile software design methodologies and maintain clear documentation.
• Support teammates through pair‑programming, code reviews and knowledge sharing.

Required profile

• Hands‑on experience with data engineering tools and technologies (Python, Apache Spark/PySpark, SQL/NoSQL, Data Lake concepts).
• Experience with Databricks workflows, dashboards and Unity Catalog.
• Proven background in ETL, data modeling, data warehousing and handling large datasets.
• Working knowledge of AWS services such as Lambda and API Gateway.

Required skills

• Python
• Apache Spark / PySpark
• SQL
• NoSQL databases
• Data Lake architecture
• Databricks
• Unity Catalog
• ETL processes
• Data modeling
• Data warehousing
• AWS Lambda
• AWS API Gateway