A.K.A. Solution Architect or Data Strategist
Job description:
You have proven to be an experienced, t-shaped software engineer. A technical leader and coach to others. With your strong knowledge about software development and technologies & methodologies you focus on building high quality applications that are maintainable, performant and secure. You are a colleague that is great and fun to work with. You have strong communication skills and you like to work in an international environment with lots of cultural diversity. You are result driven, customer oriented and flexible to change. Although it would be great if you have all the technical skills mentioned below, we find it more important that you are pro-active, a good learner and an enthusiast for modern technology.
We are looking for a data engineer with experience in building data pipelines to a big data cluster and deployment of Data Science engines working with the data on this cluster. You will be working in a team with two other data engineers and we are looking for a third one next to this position. As a level 3 SE you are expected to bring some experience in the team and help further professionalize our delivery pipelines and together with the data science lead build on the architecture roadmap and create a vision for the way we will migrate to the cloud. Also we expect you to help the other SE’s in the team develop themselves as Data Engineers and train them to become more experienced.
Currently our landscape consists of an Hadoop cluster where we are gathering data from a lot of different sources into our data lake. This data is then pushed to a SQL server database where we can connect our dashboards to and build data science engines on. The data is extracted using API calls and/or downloads from FTP servers.
Skills:
- Scala
- Spark
- Hadoop file system
- Python
- Linux commands
- SQL
- Google BigQuery
- Git
Pre:
- SAP systems
- BW development
Om de betrouwbaarheid en integriteit van kandidaten te toetsen is screening onderdeel van de sollicitatieprocedure. Voor vragen over de screeningprocedure kunt u contact opnemen met de vermelde contactpersoon bij de betreffende vacature of interim opdracht.
