The ideal candidate will lead major projects within a renowned consulting firm, collaborating with the data engineering team to develop innovative data-driven solutions. These solutions integrate distributed sources of data, perform large-scale learning and reasoning, and integrate results. Job Responsibilities • Collaborate with stakeholders to deeply understand the needs of data practitioners to deliver at scale. • Lead Data Engineers to define, build, and maintain Data Platforms. • Work on emerging technologies, building distributed applications. • Drive end-to-end development efforts for timely delivery of high-quality solutions that conform to requirements, architectural vision, and applicable standards. • Present technical solutions, capabilities, considerations, and features in business terms, effectively communicating status, issues, and risks in a precise and timely manner. • Further develop critical initiatives such as Data Discovery, Data Lineage, and Data Quality. • Lead and mentor junior resources. • Help team members grow in their role and achieve their career aspirations. • Build data systems, pipelines, analytical tools, and programs. • Conduct complex data analysis and report on results. Qualifications • 7+ Years of Experience • Degree in Computer Science, Data Science, Mathematics, IT, or similar field • 3-5 Years of Experience as a data engineer or similar role • Must have experience executing projects end-to-end • Technical expertise with data models, data mining, and segmentation techniques • Deep understanding of object-oriented libraries (Python, Scala) • Strong SQL skills and good understanding of existing SQL warehouses and relational databases • Strong Spark, PySpark, Spark SQL skills and good understanding of distributed processing frameworks • Ability to work independently and mentor junior resources • Desire to lead and develop a team of Data Engineers across multiple levels • Nice to have: Cloud experience (AWS, Azure, GCP), Snowflake, Databricks, Hadoop, DBT, Elastic Search, Data modeling, Airflow, CI/CD, Agile Methodologies, Docker/Kubernetes