Back to SearchLead Data Engineer
Remote in India
Data Software Engineering
& 7 others
Sorry, this position is no longer available
India
We are seeking a Lead Data Engineer to join our Corporate Data Engineering team and drive the creation of cutting-edge data solutions and applications that empower critical business decisions across the organization. If you are a forward-thinking and structured thinker with a passion for scalable system development, we encourage you to apply and play a pivotal role in shaping our data engineering endeavors.
Responsibilities
- Lead the design, development, and implementation of world-class data solutions and applications, ensuring their scalability and performance
- Collaborate closely with cross-functional teams to understand business requirements and translate them into innovative data engineering strategies
- Provide mentorship and guidance to the data engineering team, fostering professional growth and knowledge sharing
- Oversee end-to-end data pipeline development, from data ingestion to transformation and storage
- Establish and enforce best practices for data engineering, ensuring data quality, security, and compliance
- Contribute to the continuous improvement of data engineering processes by adopting Agile methodologies and driving CI/CD practices
Requirements
- A minimum of 5 years of relevant experience in Data Engineering or a similar role, demonstrating your expertise in building and optimizing data solutions
- At least 1 year of direct leadership and team management experience, showcasing your ability to lead and inspire a technical team
- Proficiency in Python, utilizing its capabilities to develop efficient and scalable data solutions
- Strong familiarity with AWS, harnessing cloud resources to optimize data processing and storage.
- Expertise in Databricks, contributing to efficient data processing and analysis.
- Proficiency in either Apache Spark or Hive, enabling you to work with large-scale data processing and analysis.
- Knowledge of CI/CD practices, promoting efficient and reliable software development processes
- Proficiency in SQL, enabling you to query and manipulate data effectively
- Experience with Terraform, enhancing your ability to manage and automate infrastructure
- Strong understanding of Agile methodologies, enabling you to work collaboratively within dynamic teams
- Fluent English communication skills at a B2+ level, facilitating effective collaboration and communication
Nice to have
- Familiarity with containerization and orchestration tools such as Docker and Kubernetes
- Knowledge of streaming data processing technologies like Apache Kafka or Apache Flink
- Experience with data warehousing solutions like Amazon Redshift or Snowflake
- Understanding of machine learning concepts and their integration into data engineering pipelines
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn