SENIOR DATA ENGINEER (DD-129)

Epam Systems


We are searching for a highly skilled and experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for data onboarding and costumes integration projects. You must possess excellent AWS infrastructure-building expertise, including integration building with API, FTP, or JDBC connectors. Your thorough knowledge of infrastructure as code and git/CI/CD processes will be highly valued in this role. Responsibilities Collaborate with the team to deliver scalable, robust, and cost-effective data products and solutions Develop AWS Cloud infrastructure including data pipelines and connectors Produce data in the data lake through AWS Glue and Lake formation Establish unit and data tests for the onboarding process Manage the data architecture and make recommendations for improvements Requirements 3+ years of experience building data pipelines in Python, with PySpark experience Strong understanding of AWS Cloud fundamentals Solid knowledge in infrastructure as code using CDK Git & CI/CD Knowledge is a must Experience with common data Python libraries such as Pandas and AWS Wrangler Understanding of REST APIs from the consumer perspective ML knowledge is a plus, particularly with Kubeflow We offer/Benefits - International projects with top brands - Work with global teams of highly skilled, diverse peers - Healthcare benefits - Employee financial programs - Paid time off and sick leave - Upskilling, reskilling and certification courses - Unlimited access to the LinkedIn Learning library and 22,000+ courses - Global career opportunities - Volunteer and community involvement opportunities - EPAM Employee Groups - Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn

trabajosonline.net © 2017–2021
Más información