SENIOR DATA ENGINEER | ZCJ846

You will support the data processing, engineering, and enrichment phase for various projects. **what will you do at dyvenia?**: as a data engineer on international and local projects you will be involved inresponsible for: - participating in the ideation, conceptualization, development, and maintenance of our own data-ingestion platform built on top of prefect; - creating, monitoring, and troubleshooting elt jobs to ingest and transform data from various systems using batch and stream processing; - driving and advocating for state-of-the-art methods of handling data in the company, eg. data lake, stream processing, iac, devops, dataops - collaborate with analytics and business teams to improve data feed. you will be working with the following technologies: - python, prefect (preferred), dask, sql - kafka (preferred) - aws and/or azure - docker - linux, bash, git - ci/cd **what do we expect from you?**: as a senior data engineer, we expect you to demonstrate proficiency in the data engineering area. we also expect you to be able to communicate infrastructure concepts to non-technical colleagues. we also expect you that you have: - good understanding of distributed computing - familiarity with software engineering best practices and design patterns - very good understanding of at least one workflow orchestration framework (airflow, prefect, etc.) - familiarity with dataops principles - english b2 **benefits**: when you join our team, you can expect: **trainings**: we want you to thrive as a member of our team and for that reason, we organize int...