Data Migration Jobs

EPAM is looking for Data Migration Specialists.

Data Engineer

Data Software Engineering

Azure Databricks, Azure DevOps, Azure Event Hubs

40 hrs/week

12+ months

Portugal

We are looking for a talented and driven Data Engineer to become a part of our dynamic team.

The chosen candidate will handle the upkeep of existing data systems, boost the capabilities of our existing Data Platform, and manage upcoming modifications to align with our clients' evolving consumption requirements and data ingestion. This position demands proficiency in managing intricate datasets and working in close collaboration with senior team members on projects of significant impact.

responsibilities

Uphold and boost the capabilities of existing data systems
Enhance the existing Data Platform
Manage modifications to meet growing consumption requirements and data ingestion
Handle complex datasets, including the creation of new datasets from the ground up
Partner with senior team members on complex projects, especially when introducing new large datasets
Evolve with the technological landscape, embracing new tools and methodologies as they appear

requirements

2+ years in Data Software Engineering
Proficient in PySpark
Skilled in Azure Databricks, Azure DevOps, and Azure Event Hubs
Knowledgeable about the Azure cloud stack
Experienced in handling large and complex datasets
Capable of teamwork and collaboration with various stakeholders
Knowledge of Databricks Unity Catalog and Terraform

nice to have

Background in Azure Analytics Engineering
Knowledge of DevOps practices

Data Engineer

Data Software Engineering

Azure Databricks, Azure DevOps, Azure Event Hubs

40 hrs/week

12+ months

Portugal

We are seeking a highly skilled and motivated Data Engineer to join our team.

The ideal candidate will be responsible for maintaining existing data systems, enhancing our current Data Platform, and implementing future changes as our clients' consumption needs and ingestion evolve. This role requires expertise in handling complex datasets and collaborating with senior team members on high-impact projects.

responsibilities

Maintain and enhance existing data systems
Develop enhancements for the existing Data Platform
Implement future changes to accommodate growing consumption needs and ingestion
Work with complex datasets, including the addition of new datasets from scratch
Collaborate with senior team members on complex projects, particularly when adding new large datasets
Grow with the technological landscape, adapting to new tools and methodologies as they emerge

requirements

2+ experience in Data Software Engineering
Proficiency in PySpark
Experience with Azure Databricks, Azure DevOps, and Azure Event Hubs
Knowledge of the Azure cloud stack
Experience in working with large and complex datasets
Ability to work in a team and collaborate with various stakeholders
Familiarity with Databricks Unity Catalog and Terraform

nice to have

Experience in Azure Analytics Engineering
Familiarity with DevOps practices

Senior Data Engineer

Data Software Engineering

Azure Databricks, Azure DevOps, Azure Event Hubs

40 hrs/week

12+ months

Portugal

We are seeking a highly skilled and motivated Senior Data Engineer to join our team.

responsibilities

Maintain and enhance existing data systems
Develop enhancements for the existing Data Platform
Implement future changes to accommodate growing consumption needs and ingestion
Work with complex datasets, including the addition of new datasets from scratch
Collaborate with senior team members on complex projects, particularly when adding new large datasets
Grow with the technological landscape, adapting to new tools and methodologies as they emerge
Ensure data quality and integrity in all solutions delivered
Optimize data retrieval and data storage processes
Conduct data analysis and provide insights to inform business decisions

requirements

3+ years of experience in Data Software Engineering
Proficiency in PySpark
Experience with Azure Databricks, Azure DevOps, and Azure Event Hubs
Knowledge of the Azure cloud stack
Experience working with large and complex datasets
Ability to work in a team and collaborate with various stakeholders
Familiarity with Databricks Unity Catalog and Terraform
Strong problem-solving skills and attention to detail
Fluent English communication skills at a B2+ level

nice to have

Experience in Azure Analytics Engineering
Familiarity with DevOps practices

Senior Data Software Engineer

Data Software Engineering

Databricks, Python, Microsoft Azure

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer within a global leader in building Enterprise Data Platform and Data Products on top. We are currently seeking a talented and experienced developer to work on a cutting-edge project involving the design, development, and implementation of high-performance data solutions. You will have the opportunity to collaborate with other experts in the field, and work with the latest tools and technologies to build innovative solutions that will impact businesses worldwide.

responsibilities

Design, develop and maintain data processing pipelines and data products to support business needs and objectives
Collaborate with cross-functional teams to ensure high-quality deliverables
Provide technical leadership and guidance to other developers in the team
Participate in code review and ensure code quality and adherence to standards
Work with stakeholders to define requirements and develop solutions that meet their needs
Develop, test and deploy scalable and performant data solutions
Ensure the reliability, availability, and scalability of data systems
Stay up-to-date with the latest Big Data technologies and trends and apply them to solve business problems
Drive continuous improvement and optimization of data processing pipelines

requirements

At least 3+ years of experience in building Data Platform
Successful implementations of Big Data high-performance solutions
Expertise in Python and Databricks for developing and implementing data solutions
Experience with Microsoft Azure Big Data Services for data processing and storage
Experience with Event-driven architecture for building scalable and high-performance applications
Solid knowledge of Data Architecture and Data Modeling
Familiarity with Agile methodologies for software development
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with Machine Learning and AI technologies
Experience with Spark and Hadoop
Experience with NoSQL databases

Senior Data Software Engineer

Data Software Engineering

Databricks, Microsoft Azure, PySpark

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer within a leading tech firm. In this role, you will be responsible for designing, building, and optimizing robust data pipelines to support our cutting-edge applications. The successful candidate will have deep expertise in one of the languages (Python, Spark, PySpark, SQL) and be able to build within dev and enable deployment to production. We are seeking a thoughtful and reliable engineer who is capable of tying together solutions across systems and delivering end-to-end production solutions.

responsibilities

Design and implement scalable data pipelines to support our cutting-edge applications
Ensure data quality and data accuracy across all stages of data processing
Collaborate with cross-functional teams to understand business requirements and develop solutions that meet their needs
Develop and maintain codebase in accordance with industry best practices and standards
Troubleshoot and resolve issues in a timely and effective manner
Optimize data processing algorithms and improve application performance
Ensure compliance with data security and data privacy regulations
Conduct code reviews and ensure high code quality and compliance with standards and guidelines
Participate in architectural and technical discussions to help shape the product roadmap
Stay up-to-date with emerging trends and technologies in data engineering and analytics

requirements

At least 3+ years of experience as a Data Software Engineer or in similar roles
Expertise in one of the languages (Python, Spark, PySpark, SQL) for building scalable and high-performance applications
Experience with Microsoft Azure for cloud-based infrastructure and application management
Experience using Databricks for building robust data pipelines
Experience using Azure DevOps, GitHub, or other version control systems
Familiarity with developing end-to-end production solutions
Ability to tie loose ends together for solutions across systems
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with GCP and AWS cloud platforms
Experience with Apache Kafka and Apache Beam for building data pipelines
Experience with machine learning and data science tools and frameworks

Senior Data Engineer

Data Software Engineering

Azure Databricks, Azure DevOps, Azure Event Hubs

40 hrs/week

12+ months

Portugal

We are seeking a highly skilled and motivated Senior Data Engineer to join our team.

responsibilities

Maintain and enhance existing data systems
Develop enhancements for the existing Data Platform
Implement future changes to accommodate growing consumption needs and ingestion
Work with complex datasets, including the addition of new datasets from scratch
Collaborate with senior team members on complex projects, particularly when adding new large datasets
Grow with the technological landscape, adapting to new tools and methodologies as they emerge
Ensure data quality and integrity in all solutions delivered
Optimize data retrieval and data storage processes
Conduct data analysis and provide insights to inform business decisions

requirements

3+ years of experience in Data Software Engineering
Proficiency in PySpark
Experience with Azure Databricks, Azure DevOps, and Azure Event Hubs
Knowledge of the Azure cloud stack
Experience working with large and complex datasets
Ability to work in a team and collaborate with various stakeholders
Familiarity with Databricks Unity Catalog and Terraform
Strong problem-solving skills and attention to detail
Fluent English communication skills at a B2+ level

nice to have

Experience in Azure Analytics Engineering
Familiarity with DevOps practices

Senior Python Data Developer (Databricks)

Data Software Engineering

Databricks, Python, Amazon Web Services

40 hrs/week

12+ months

Poland

We are seeking a highly skilled and experienced remote Senior Python Data Developer with a background in Databricks to join our team.

In this role, you will be responsible for building an enterprise-grade data platform, establishing data governance and data quality.

responsibilities

Build an enterprise-grade data platform
Establish data governance and data quality
Implement reusable Databricks components for data ingestion and analytic
Work collaboratively with architects, technical leads and key individuals within other functional groups
Actively participate in code review and test solutions to ensure they meet best practice specifications
Write project documentation

requirements

At least 3+ years of experience as a Python Developer
Expertise in DSE, Python and Azure Databricks
Experience with data modelling and hands-on development experience Big Date
Cloud experience in designing, administering scalable and fault-tolerant systems
Strong data-oriented personality and compliance awareness
Experience with Amazon Web Services and SQL
Upper-intermediate English level (B2+)

Senior Data Software Engineer

Data Software Engineering

Apache Spark, Microsoft Azure, Python

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Data Software Engineer to join our team.

The right candidate will have a strong technical background with expertise in Apache Spark, Microsoft Azure, and Python. This position offers a unique opportunity to work on a high-impact project with one of the world's most recognized brands.

responsibilities

Collaborate with cross-functional teams to build and maintain the data integration solution
Develop, build, and optimize data pipelines using Apache Spark, Microsoft Azure, and Python
Ensure data pipelines are scalable, maintainable, and reliable
Take data science models and make them production ready
Develop and maintain forecasting models to support business decisions
Ensure data quality and consistency across all data sources
Monitor and optimize data pipelines to ensure efficient and effective data processing
Collaborate with data scientists to develop and implement machine learning models
Work with the team to continuously improve and optimize the data integration solution for Fedex
Stay current with emerging technologies and trends in data software engineering

requirements

At least 3+ years of experience in data software engineering or similar roles
Expertise in Apache Spark, Microsoft Azure, and Python
Strong knowledge of forecasting models, data science, and MLOps
Experience working with Databricks to build, maintain, and optimize data pipelines
Ability to take data science models and make them production ready
Experience with Git for version control
Understanding of basic Azure concepts including clouds, regions, ADLS, and compute
Strong analytical and problem-solving skills with the ability to think critically and creatively
Experience working in Agile development environments
Excellent English communication skills, both written and verbal (B2+ level)

nice to have

Experience with Panda for data manipulation and analysis
Strong knowledge of SQL and relational tables
Understanding of statistical models and the ability to develop models utilizing Python, Spark, etc.
Knowledge of ML tools space

Senior Data Software Developer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Data Software Developer to join our dynamic team.

The successful candidate will have at least 3 years of hands-on experience in Data Software Engineering, specifically with Azure, PySpark, Python, Python web services, Databricks, and Advanced SQL.

responsibilities

Set up required Azure services and extract data from data lake (EDL)
Process data based on application requirements and architecture
Build service layer and mimic current existing application
Collaborate with the team to design and build high-performance, scalable, and secure software solutions

requirements

Bachelor's degree in Computer Science or related field
3+ years of hands-on experience in Data Software Engineering
Proficiency in Azure, PySpark, Python, Python web services, Databricks, and Advanced SQL
Hands-on experience with building POCs for data engineering solutions
Strong analytical and problem-solving skills
B2+ English level

nice to have

Leadership skills

Senior Data Software Engineer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer within a global leader in providing cutting-edge cloud-based solutions. We are actively seeking a hands-on and deeply technical developer to collaborate closely with development peers, product leadership, and other technical staff to create innovative and impactful solutions. This role offers an opportunity to contribute significantly to the design, development, and optimization of features in a dynamic Agile development environment, using technologies such as Python, PySpark, Microsoft Azure, SQL Azure, and Databricks.

responsibilities

Setting up required Azure services
Building and deploying POC for replacement of the external vendor inside of the infrastructure
Extracting data from data lake (EDL)
Processing data based on application requirements & architecture
Mimicking current existing application
Prioritizing and ensuring high-quality standards at every stage of development
Guaranteeing reliability, availability, performance, and scalability of systems
Collaborating with Developers, Product and Program Management, and senior technical staff to deliver customer-centric solutions.
Providing technical input for new feature requirements, partnering with business owners and architects
Ensuring continuous improvement by staying abreast of industry trends and emerging technologies
Actively contributing to architectural and technical discussions

requirements

At least 3+ years of production experience in Data Software Engineering
Be hands-on with deep expertise in Data Engineering, in both functional and non-functional areas
Deep expertise in PySpark for building scalable and high-performance data applications
Experience with Microsoft Azure for cloud-based infrastructure and application management
Familiarity with SQL Azure for designing and managing database schema, including procedures, triggers, and views
Exposure to Databricks for creating unified data analytics platforms
Knowledge of Python web services such as Django and Flask for building efficient APIs and web solutions
Support applications and systems in a production environment, ensuring timely resolution of issues
Expertise in build and test tools for managing build and testing processes
Excellent communication skills in spoken and written English at an Upper-intermediate level or higher

nice to have

Experience in Big Data technologies such as Hadoop, Spark, Kafka, and Hive is a plus

Data Migration Jobs

Related skills