We are seeking an experienced and accomplished Senior Data Software Engineer to join our team and take the lead in advancing a secure and innovative document flow solution hosted on AWS. As a senior member of our team, you will work with top-tier professionals to drive the evolution of an end-to-end information lifecycle solution, leveraging advanced technologies such as AWS Glue, Athena, and Apache Spark. Your role will place a heightened emphasis on designing and overseeing the scalability, efficiency, and reliability of a state-of-the-art system, aiming to streamline digital document management for a diverse and global clientele. Responsibilities Lead the design, development, and implementation of complex data pipelines and workflows using AWS Glue and related technologies Architect and maintain scalable, efficient, and secure data models with Athena and S3 to support advanced reporting and analytics requirements Oversee and develop advanced ETL processes with tools like Apache Spark, ensuring seamless handling of high-volume data workloads Collaborate with BI analysts, architects, and cross-functional teams to drive the enhancement of data-driven processes for Business Intelligence and analytics Establish and enforce best practices for optimizing the cost, performance, and security of cloud-based solutions using fully managed AWS services Design and improve CI/CD pipelines to enhance deployment automation, scalability, and productivity in data workflows Monitor critical solution performance, ensuring high reliability and cost efficiency through cutting-edge observability and monitoring tools Support and guide the development of reporting dashboards by delivering well-structured, accurate, and timely data models Deliver enterprise-grade, high-quality code by establishing and enforcing best practices for testing, versioning, and documentation Proactively identify, troubleshoot, and resolve complex issues involving data workflows, ensuring consistent system uptime and reliability Mentor and guide junior team members, fostering a culture of growth, collaboration, and technical excellence Requirements 3+ years of demonstrated experience in data engineering or software development with a proven track record of working extensively with AWS services Advanced proficiency in AWS Glue, Amazon Athena, and core AWS tools like S3, Lambda, and CloudFormation Deep expertise in Apache Spark and hands-on experience designing and maintaining large-scale, high-performance data processing systems Comprehensive knowledge of BI process analysis and the ability to work closely with analytics teams to implement and optimize data pipelines for advanced workflows Strong SQL skills, including experience building and optimizing complex queries for data manipulation and analytics purposes In-depth understanding of data lake, ETL pipeline architecture, and modern data storage concepts Expertise in designing and maintaining CI/CD pipelines, ensuring an effective integration of data workflows into deployment frameworks Familiarity with additional tools such as Amazon Kinesis, Apache Hive, or Elastic Kubernetes Service, with the ability to introduce advanced functionality into data workflows Proven ability to design secure, reliable, and efficient solutions that align with best practices for cloud-first architectures Excellent written and verbal communication skills in English (B2+ level) Nice to have Hands-on experience with Amazon Elastic Kubernetes Service (EKS) for orchestrating containerized applications at scale Strong understanding of Amazon Kinesis for processing real-time data streams and events Experience with Apache Hive in designing and maintaining high-performing data warehouses Expertise in improving efficiency and workflows within Business Intelligence platforms Proficiency in programming languages such as Java, Scala, or Node.js to extend the capabilities of data processing solutions We offer/Benefits - International projects with top brands - Work with global teams of highly skilled, diverse peers - Healthcare benefits - Employee financial programs - Paid time off and sick leave - Upskilling, reskilling and certification courses - Unlimited access to the LinkedIn Learning library and 22,000+ courses - Global career opportunities - Volunteer and community involvement opportunities - EPAM Employee Groups - Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn