Back to SearchSenior Python Developer
Remote in India
Python.Data
& 10 others
Sorry, this position is no longer available
India
We are seeking a driven, detail-oriented Senior Python Developer to join our remote team. As a Senior Python Developer, you will be responsible for building and maintaining complex data pipelines, working with Spark and Hive data processing frameworks, and developing microservices and CI/CD pipelines.
Responsibilities
- Develop and maintain complex data pipelines using Spark and Hive data processing frameworks
- Collaborate with cross-functional teams to design, develop, and deploy microservices and CI/CD pipelines
- Write and optimize SQL queries to improve database performance and accuracy
- Create and maintain technical documentation, including architecture diagrams and data flow diagrams
- Work closely with the data governance team to ensure compliance with data security and privacy regulations
- Participate in code reviews and provide feedback to other developers on best practices and coding standards
- Troubleshoot and debug issues in the data pipeline and microservices architecture
- Design and develop data models to support business requirements
Requirements
- At least 3 years of experience in Python development, with a focus on data engineering
- Bachelor's degree in a relevant field, such as Computer Science, Mathematics, or a related discipline
- Extensive experience with SQL, including writing complex queries and optimizing database performance
- Experience with test-driven development and writing unit testing cases using mock frameworks, such as Pytest or unittest
- Familiarity with data orchestration tools, such as Airflow, and data modeling
- Extensive knowledge of Spark and Hive data processing frameworks, including developing and maintaining data pipelines
- Experience with AWS cloud components, such as EC2, S3, Lambda, DynamoDB, SQS, and RDS
- Good understanding of data structures and algorithms
- Upper-intermediate or higher level of spoken and written English proficiency
Nice to have
- Knowledge and experience of CI/CD processes, including unit testing, code coverage, and code quality metrics
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn