Back to SearchSenior Data Software Engineer
Sorry, this position is no longer available
Join our remote team as a Senior Data Software Engineer to work with our global leader in providing innovative software solutions. We are looking for someone who can develop and maintain data processing pipelines, design and implement data storage solutions, and integrate advanced analytics algorithms. The ideal candidate should have experience in Python, PySpark, and Databricks, as well as a deep understanding of Microsoft Azure and SQL Azure. You will work alongside a team of highly skilled professionals and impact the overall design and functionality of our data infrastructure.
Responsibilities
- Build proof of concept (POC) for replacing the external vendor inside the infrastructure
- Set up required Azure services for the POC
- Extract data from data lake (EDL) for processing
- Process data based on application requirements and architecture
- Build a service layer that mimics the current existing application
- Design and implement data storage solutions
- Integrate advanced analytics algorithms into data processing pipelines
- Develop and maintain automated data quality checks
- Work with cross-functional teams to identify and prioritize business requirements
- Ensure the overall design and functionality of data infrastructure
- Collaborate with other developers to implement and maintain data processing pipelines
Requirements
- 3+ years of experience in Data Software Engineering
- Experience in Python, PySpark, and Databricks for data processing
- Deep understanding of Microsoft Azure and SQL Azure for building and maintaining data storage solutions
- Experience with Python web services such as Django and Flask
- Experience building and maintaining data processing pipelines
- Experience with data integration and analytics algorithms
- Ability to develop and maintain automated data quality checks
- Experience with performance tuning and optimization of large-scale data processing systems
- Ability to work with cross-functional teams to identify and prioritize business requirements
- Excellent communication skills in spoken and written English, at an upper-intermediate level or higher
Nice to have
- Experience with scalable search technologies such as Elasticsearch is a plus
- Experience with machine learning and artificial intelligence is a plus
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn