Connecting linkedin

W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9oyw1sew4td2lsbglhbxmvanbnl2jhbm5lci1kzwzhdwx0lwpvyi5qcgcixv0

Job

Data Engineer - Big Data (Fintech / 35K+)

  • Location

    Unknown

  • Sector:

    Technology

  • Job type:

    Permanent

  • Contact:

    Louis Lui

  • Contact email:

    l.lui@hamlynwilliams.com

  • Salary high:

    0

  • Salary low:

    0

  • Published:

    10 days ago

  • Expiry date:

    2021-08-21

Responsibilities

  • Develop data pipelines for batch and streaming applications
  • Develop data products and services like user profiling, realtime reconciliation
  • Keep learning big data technologies and continuously optimize products and services

 

Qualifications

  • 3+ years experiences of developing big data related applications
  • Proficient Java / Scala / Python (at least one language) and SQL programming languages
  • Proficient in big data pipeline development including batch and streaming processing
  • Familiar with big data components like Hadoop, Hive, Spark, Spark streaming, Flink, Presto, Hbase, Kafka, Zookeeper, Airflow, Elasticsearch, Redis
  • Experience in big data product development is a plus, including data warehouse, query platform, streaming, recommendation, user profiling, risk management

#LI-LL2