Back to SearchSenior Data Software Engineer
Data Software Engineering, Apache Spark, Microsoft Azure, Python, Forecasting Models, Data Science, MLOps, Databricks
Sorry, this position is no longer available
Join our remote team as a Senior Data Software Engineer within a globally recognized company that specializes in delivering innovative technology solutions. We are currently seeking a hands-on technical expert to collaborate closely with development peers, product leadership, and other technical staff to create innovative data integration solutions. The successful candidate will have the opportunity to contribute significantly to the design, development, and optimization of features in a dynamic Agile development environment.
Responsibilities
- Designing and implementing data integration solutions that meet business requirements and are scalable, efficient, and reliable
- Collaborating with data scientists to transform their models into production-ready solutions
- Developing and implementing data integration processes and workflows using Apache Spark and Databricks
- Working closely with cross-functional teams to identify and resolve data-related issues and ensure data quality
- Implementing MLOps processes to ensure that machine learning models are deployed and maintained in production environments
- Designing and implementing data architecture and storage solutions in Microsoft Azure
- Designing and implementing data migration solutions to migrate data from on-premise systems to Microsoft Azure
- Performing code reviews, ensuring code quality and adherence to standards
- Mentoring junior team members, helping them enhance their skills and grow their careers
- Actively participating in architectural and technical discussions
Requirements
- At least 3 years of experience in software engineering with a focus on data integration solutions
- Experience with Apache Spark for processing large datasets, and Databricks for data integration and machine learning workflows
- Expertise in Microsoft Azure for cloud-based infrastructure and application management
- Deep understanding of Python programming language and knowledge of forecasting models and statistical models
- Experience with MLOps for taking data science models and making them production ready
- Familiarity with Git for version control
- Excellent knowledge of SQL and relational tables
- Ability to design and develop scalable and efficient data integration pipelines using Python, Spark, and other relevant technologies
- Experience with developing machine learning models and utilizing ML tools and libraries
- Excellent communication skills in spoken and written English, at an upper-intermediate level or higher
Nice to have
- Experience with Panda library for data manipulation and analysis is a plus
- Knowledge of cloud computing concepts such as regions and ADLS
- Experience with other Microsoft Azure services such as Azure Data Factory and Azure Stream Analytics
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn