1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. We are seeking a skilled Python Data Engineer with experience in CI/CD to design and implement scalable data pipelines supporting machine learning models in production environments. The ideal candidate will have deep experience with AWS native event- driven services such as EventBridge, Lambda, Step Functions, S3, Glue, IAM, CDK and Cloudformation. Strong data engineering skills, and a demonstrated ability to operationalize machine learning models while ensuring data quality, security, and governance. You will collaborate closely with data scientists and DevOps teams to optimize model deployment, manage CI/CD pipelines, and maintain comprehensive documentation, playing a pivotal role in advancing our machine learning workflows and infrastructure. RESPONSIBILITIES Design, construction, implementation and optimization or maintenance of data pipelines that are efficient, scalable, and automated to support data science workflows and machine learning models. Management of the ML Model Lifecycle: Collaborate with data science teams to implement, automate, and manage the lifecycle of machine learning models (training, validation, deployment, monitoring, and tuning) using MLOps techniques. Develop and maintain documentation for data pipelines, infrastructure, and processes. Strong understanding of AWS . Collaborate with data scientists to integrate machine learning models into production environments. Cloud Integration ( AWS ): Deploy solutions in the cloud using AWS services such as S3, Lambda, among others, to manage large volumes of data and train models. Management of DevOps Tools: Establish and maintain CI/CD pipelines for ML and data workflows using tools such as AWS CDK, AWS CodePipeline, AWS CodeBuild or similar. Ensure data quality and reliability in machine learning workflows. Work closely with DevOps and IT teams to ensure seamless integration of machine learning systems with existing infrastructure. MINIMUM QUALIFICATION 4 years of experience in data engineering. 3 years of experience with AWS services. Experience setting up CI/CD pipeline processes. Experience with databases such as PostgreSQL and DynamoDB. Knowledge with monitoring tools. Experience with Python , SQL. Experience with Data Zone Experience with Data Governance DESIRABLE SKILLS Experience with AWS Sage Maker. SOFT SKILLS Strong problem-solving skills and analytical thinking, with the ability to troubleshoot complex issues and optimize system performance. Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders. Stay updated with the latest advancements in data engineering, machine learning, and DevOps technologies. Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function Information Technology Industries Software Development Referrals increase your chances of interviewing at MPS Group LLC by 2x Sabaneta, Antioquia, Colombia COP4,400,000.00-COP4,800,000.00 2 weeks ago Bello, Antioquia, Colombia COP4,400,000.00-COP4,800,000.00 2 weeks ago Girardota, Antioquia, Colombia COP4,400,000.00-COP4,800,000.00 2 weeks ago Barbosa, Antioquia, Colombia COP4,400,000.00-COP4,800,000.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr