DATA ENGINEER

40.000.000 - 80.000.000
Infinita Consulting


We are seeking a skilled Data Engineer to design and build scalable data pipelines on Azure using Databricks. You will play a key role in building and optimizing data lakehouse architecture (Medallion), ingesting data from multiple sources, ensuring data quality and governance, and enabling advanced analytics through integrations with BI tools. About the Role We are seeking a skilled Data Engineer to design and build scalable data pipelines on Azure using Databricks. You will play a key role in building and optimizing data lakehouse architecture (Medallion), ingesting data from multiple sources, ensuring data quality and governance, and enabling advanced analytics through integrations with BI tools. Key Responsibilities Design and maintain scalable data pipelines using Databricks on Azure. Implement Medallion architecture (Bronze, Silver, Gold) for data processing and curation. Integrate structured and unstructured data from various sources (APIs, databases, flat files). Transform data with Python (PySpark, Pandas) and SQL. Deploy and monitor pipelines using CI/CD and DevOps practices. Enable data consumption via BI tools like Power BI or Tableau. Ensure compliance with data security and governance standards. Collaborate with cross-functional teams and stakeholders to align technical solutions with business goals. Must-Have Qualifications Proven experience as a Data Engineer. Strong hands-on experience with Databricks and Azure services (Data Factory, Data Lake, Key Vault). Advanced SQL and data modeling expertise. Python development for ETL (PySpark, Pandas). Experience with Medallion architecture. Data ingestion from multiple sources (APIs, RDBMS, flat files). Exposure to BI tools for data visualization and reporting. Experience with Git, version control, and CI/CD pipelines. Familiarity with data privacy, governance, and security best practices. Ability to communicate effectively with both technical and non-technical stakeholders. Nice to Have Experience with MLflow, Delta Lake, or Unity Catalog. Automated testing of data pipelines. Documentation of data architecture and design decisions. Knowledge of advanced DevOps and Infrastructure as Code. Exposure to AI/Data Science workflows. Consulting or enterprise environment experience. Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function Information Technology Industries Business Consulting and Services Referrals increase your chances of interviewing at Infinita Consulting by 2x Get notified about new Data Engineer jobs in Colombia . Bogota, D.C., Capital District, Colombia 2 weeks ago Bogota, D.C., Capital District, Colombia 5 days ago Bogota, D.C., Capital District, Colombia $24,000.00-$36,000.00 1 month ago Bogota, D.C., Capital District, Colombia 5 months ago Bogota, D.C., Capital District, Colombia 3 weeks ago Bogota, D.C., Capital District, Colombia 3 days ago Python Software Engineer - (Colombia, Remote) Bogota, D.C., Capital District, Colombia 6 months ago Data Visualization Engineer (Latin America) Bogota, D.C., Capital District, Colombia 3 weeks ago Bogota, D.C., Capital District, Colombia 11 hours ago Senior Data Analytics and Visualization Engineer We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr

trabajosonline.net © 2017–2021
Más información