about 1 month ago
Software Engineer (with Data focus)
We are looking for a DevOps Engineer - Data Analytics Platform for a permanent position based in Warsaw, Poland.
We are building a cloud-ready state of the art infrastructure for a Data Analytics Platform to support global clients advanced analytics capabilities. We are going to grow to reach thousands of nodes.
The Software Engineer (with Data focus) will ideally have the following responsibilities:
- As a Software Engineer, you will develop our next-generation, container-based Data Analytics Products.
- The platforms you develop will allow the client to scale to new data and user volumes and will encourage our teams to continually innovate in the latest technologies and techniques.
The Software Engineer (with Data focus) will ideally have at least 75% of the below skills and expertise:
- Great programming skills in a statically typed language – Scala or Java
- Hands-on experience managing and further developing distributed systems and clusters for both batch as well as streaming data (S3/Spark and/or Kafka/Flink)
- Great skills in interpreted languages, e.g., Python
- Experience with SQL and NoSQL databases
- Experience with deployment and provisioning automation tools e.g., Docker, Kubernetes, OpenShift, CI/CD
- Security, authentication, and authorization (LDAP / Kerberos / PAM)
- Experience with data-related projects
- Knowledge of data manipulation and transformation
- Hands-on experience building complex data pipelines.
- Experience with Spark
- Experience with Kafka/Atlas/Airflow/Amundsen/Elasticsearch/
- Bash scripting and Linux systems administration
- Passion to work with and contribute to open-source technologies.
- Affinity with Advanced Analytics, Data Science
Kubernetes, Python, Scala, Kafka, Kafka Streams, Kafka Connect, Kafka Schema Registry, Airflow, Atlas, Amundsen (Flask + ReactJS), Cassandra and Elasticsearch.
If you are a skilled Software Engineer (with a Data focus) you can apply by:
Select the Apply button below or contact me directly.
I am a market specialist in the Netherlands working with a large variety of international clients across the Financial Service and IT industries. If this role is of interest to you, or if you would like to explore other opportunities in the market, please feel free to reach out directly. Contact Kevin Lindijer at firstname.lastname@example.org.