MIDDLE DATA ENGINEER

40.000.000 - 80.000.000


Job Description: Data Engineer for Fintech Platform We are developing a fintech project aimed at creating and maintaining banking platforms used by approximately 10,000 bank employees. These platforms serve clients of one of Canada's largest banks, facilitating investments and internal banking operations. As a key member of our data engineering team, you will play a crucial role in developing and implementing our Data Platform. You will collaborate with stakeholders to understand business needs and design, develop, and maintain robust data processing pipelines to support our data, BI, Machine Learning, and AI capabilities. Requirements: 3-5 years of experience in building batch and real-time data pipelines using big data technologies. Experience with distributed data processing tools such as Spark, Hadoop, Airflow, NiFi, and Kafka. Hands-on experience designing, developing, and maintaining ETL processes and data pipelines. Proficiency in Python and/or Scala, with strong scripting and optimization skills. Strong SQL skills and experience designing scalable data models. Familiarity with cloud platforms like Snowflake, Databricks, AWS, Azure, or GCP. Experience with CI/CD tools, Docker, and Kubernetes for automation. Ability to troubleshoot and optimize data workflows for performance and reliability. Understanding of data governance, quality frameworks, and compliance. Nice-to-Have: Experience with OpenShift, Trino, Ranger, Hive. Knowledge of machine learning and data science tools. Familiarity with BI tools like Tableau and Superset. Good communication skills, attention to detail, Agile mindset, and flexibility. Responsibilities: Collaborate with stakeholders to understand data requirements and deliver scalable solutions. Design, develop, and maintain ETL processes from various sources. Build batch and event-driven data pipelines using cloud and on-premises platforms. Review data solutions with architects, ensuring best practices. Own assigned deliverables, ensuring quality and timeliness. Implement data quality standards and ensure compliance. Optimize workflows for performance and reliability. Troubleshoot data issues and resolve them promptly. Follow DataOps best practices for CI/CD pipelines. Work in an agile environment, experimenting and iterating on initiatives. Stay updated on emerging data engineering technologies. What We Offer: Paid Day Off: 10 days annually. Unpaid days off: up to 15 days annually. Professional Growth Opportunities: Courses through Sombra University. Community events in various tech areas. Mentorship programs (upon request). Access to Udemy courses for continuous learning. English language courses and speaking clubs. Additional Benefits: Work equipment allowance (laptop, monitor, small devices). Referral bonuses for recommending suitable candidates. 18 statutory holidays in Colombia. Participation in company events (online and offline). Apply Now If you do not find a suitable position, send us your CV, and we will contact you shortly. Full Name: Email: Additional Information about your career, skills, and experience: #J-18808-Ljbffr

trabajosonline.net © 2017–2021
Más información