Data Engineer

Job description:

We are looking for an experienced data engineer who can build scalable data pipelines and optimize queries to handle large volumes of data. The ideal candidate will have a strong background in software engineering, data modeling, ETL processes, and data architecture.

Responsibilities:

• Design, develop and maintain data pipelines and workflows to handle large volumes of data
• Ensure data quality, reliability and scalability
• Optimize query performance
• Develop and maintain data models and schema definitions
• Collaborate with cross-functional teams to identify and prioritize data requirements
• Develop and maintain ETL processes
• Manage and monitor data processing and storage systems
• Troubleshoot and debug data-related issues

Skills:

• At least 3 years of experience as a data engineer or software engineer, with a focus on building scalable data pipelines and query optimization
• Strong experience in Scala
• Proficiency in SQL and database technologies
• Knowledge of big data processing frameworks such as Spark, Flink, or Hadoop
• Familiarity with distributed systems and cloud computing environments
• Familiarity with scheduling tools such as Airflow or Control-M
• Familiarity with Python
• Familiarity with Azure or GCP

Bonus skills:

• Experience with data visualization tools such as Tableau or Power BI
• Knowledge of machine learning techniques and frameworks
• Experience with NoSQL databases such as MongoDB or Cassandra
• Familiarity with visual modeling tools such as Sparx Systems Enterprise Architect
• Familiarity with agile development methodologies

Screening
Om de betrouwbaarheid en integriteit van kandidaten te toetsen is screening onderdeel van de sollicitatieprocedure. Voor vragen over de screeningprocedure kunt u contact opnemen met de vermelde contactpersoon bij de betreffende vacature of interim opdracht.