about 1 month ago
Senior Data Engineer
We are looking for a Data Engineer for a permanent position based in Warsaw, Poland.
The Senior Data Engineer will have the following responsibilities:
- Build the solutions required for optimal loading of data from a wide variety of datasources-20%
- Create and maintain, with the team, an optimal data pipeline architecture- 15%
- Assemble large, complex data sets that meet functional / non-functional requirements – 15%
- Identify, design, and implement internal process improvements- 15%
- Keep data separated and secure across international boundaries through multiple data centres – 15%
- Work with data and analytics experts to strive for greater functionality in our data systems – 10%
- Work with stakeholders including the Data and Design teams to assist with data-related technical issues and support their data infrastructure need – 10 %
The Senior Data Engineer will ideally have at least 75% of the below skills and expertise:
- Experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases,
- Experience with development skills in, Scala or Python
- 5+ years of experience in a Data and/or Software Engineer role.
- Experience with HDFS/Hive and generally with Hadoop
- Experience with Spring/springboot based microservices creation,
- Bash and/or Ansible knowledge,
- Experience in the financial services area.
- Experience with stream-processing using Flink or Kafka,
- Experience in building and optimizing big scale data pipelines, architectures, and data sets - in both batch and real-time data integration,
- Working knowledge of message queuing, stream processing, and highly scalable Big Data stores,
- Experience working in a DevOps environment - CI/CD, Azure DevOps, Test automation, Dockereld.
If you are a skilled Senior Data Engineer you can apply by:
Select the Apply button below or contact me directly.
I am a market specialist in the Netherlands working with a large variety of international clients across the Financial Service and IT industries. If this role is of interest to you, or if you would like to explore other opportunities in the market, please feel free to reach out directly. Contact Kevin Lindijer at firstname.lastname@example.org.