Back to SearchSenior Data Software Engineer
Remote in India: Hyderabad,
& 5 others
Data Software Engineering
& 5 others
Sorry, this position is no longer available
India: Hyderabad
Join our remote team as a Senior Data Software Engineer to work on exciting projects involving Databricks workflows, APIs, and analytical development. You will be an integral part of our team and must possess expertise in building and deploying production solutions using Azure, Python, Spark, PySpark, and SQL. We require a thoughtful and knowledgeable candidate who can create robust data pipelines and tie together loose ends for solutions across systems.
Responsibilities
- Collaborate with stakeholders to design, develop, and deploy data pipelines for various use cases
- Develop and maintain robust ETL processes to extract, transform, and load data from various sources
- Design and develop data models to support reporting and analytics use cases
- Ensure data quality and reliability by implementing data validation and error handling mechanisms
- Optimize data pipelines for performance and scalability
- Troubleshoot and resolve data pipeline issues in a timely manner
- Develop and maintain technical documentation for data pipelines and data processes
- Contribute to the development of data engineering best practices and standards
Requirements
- At least 3 years of relevant experience in data software engineering and development
- Proven track record of building end-to-end production solutions
- Expertise in one of the languages (Python, Spark, PySpark, SQL) with knowledge on how to build both within dev and enabling deployment to production
- Experience using Databricks for data engineering
- Ability to analyze, troubleshoot, and optimize data pipelines for performance and reliability
- Experience working on one or more cloud platforms (Azure, GCP, AWS), with a strong preference for Azure
- Ability to design and develop robust, scalable, and efficient data pipelines
- Experience using Azure DevOps, GitHub, (or others) and version control
- Ability to write and maintain technical documentation for data pipelines and data processes
- Excellent communication skills in spoken and written English, at an upper-intermediate level or higher
Nice to have
- Experience with RESTful APIs and other data transfer protocols
- Experience with data visualization tools like Power BI
- Experience with Agile software development methodologies
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn