**Company Description** Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change. By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses. From prototype to real-world impact - be part of a global shift by doing work that matters. We are seeking a skilled and analytical Data Engineer to join our team in Colombia. In this role, you will be responsible for designing, implementing, and maintaining robust data infrastructure to support our organization's data-driven decision-making processes. - Design, develop, and maintain scalable data pipelines to extract, transform, and load data from various sources. - Collaborate with data scientists and analysts to understand data requirements and implement efficient data models. - Optimize data storage and retrieval systems to ensure high performance and reliability. - Implement and maintain data quality checks and monitoring systems. - Develop and maintain documentation for data processes and architectures. - Stay up-to-date with emerging technologies and best practices in data engineering. - Troubleshoot and resolve data-related issues in a timely manner. - Ensure data security and compliance with relevant regulations and company policies. **Qualifications** - ** 3+ years** of experience in data engineering or a related role. - ** Programming Languages**: Python, Scala, SQL - ** Big Data Frameworks**: Apache Spark, Databricks (including Delta Lake and Delta Tables) - ** Cloud Platforms & Services**: Microsoft Azure (Azure Data Factory, Azure Event Hub, Azure Functions) - ** Data Engineering**: Data pipelines, ETL/ELT design, batch and streaming data processing - ** Data Storage & Management**: Delta Tables, Azure Data Lake, Azure Blob Storage - ** Orchestration & Integration**: Azure Data Factory (ADF), Azure Functions, Event-driven architecture - ** Workflow & Automation Tools**: CI/CD pipelines, version control (Git), DevOps practices - ** Data Modeling & Warehousing**: Dimensional modeling, data lakes, lakehouse architectures - ** Monitoring & Optimization**: Performance tuning in Spark, job monitoring with Azure tools - ** Collaboration Tools**: Jira, Confluence, Agile/Scrum methodologies **Additional Information** Discover some of the global benefits that empower our people to become the best version of themselves: - ** Finance**: Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus; - ** Career Development**: Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership; - ** Learning Opportunities**: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences; - ** Work-Life Balance**: Hybrid work and flexible working hours, employee assistance programme; - ** Health**: Global internal wellbeing programme, access to wellbeing apps; - ** Community**: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations. - In compliance with the Law 1581 of 2012, _**_Endava S.A.S. / Endava Colombia S.A.S_**_, identified with _**_NIT. Nº 900.955.679-3 / N° 900.594.521-9 _**_, with an address at Street 96 No. 10 - 38, floor 7th in the city of Bogotá and Career 48 No. 18A - 14 Floor 19, with telephone number (+571) 3905061, (hereinafter referred as “ENDAVA” or the “Organization”), as RESPONSIBLE for the processing of personal information informs:_ - You, and every personal information owner, have the right to: know, update and rectify your personal data; access to it free of charge; to be informed about its use; request proof of authorization; file complaints for violations of the provisions of current regulations before the Superintendence of Industry and Commerce. Finally, in some applicable cases, modify and revoke the consent given and/or request the deletion of your personal information._