Skip To Main Content
epam-logo-black.svgepam-logo-black.svg

Big Data Developer Jobs

EPAM is looking for Big Data Developers.

Senior Big Data Engineer
We are looking for a Senior Big Data Engineer to join our team and help us create and adjust analytics data pipelines. The ideal candidate should have hands-on experience in Cloud computing on AWS, developing scripts using Python and developing ETL processes whilst displaying a strong understanding of query execution plans and query optimization.
Senior Big Data Engineer
We are looking for a Senior Big Data Engineer to join our team and help us create and adjust analytics data pipelines. The ideal candidate should have hands-on experience in Cloud computing on AWS, developing scripts using Python and developing ETL processes whilst displaying a strong understanding of query execution plans and query optimization.
Senior Big Data Engineer with Snowflake
We are seeking a highly skilled Senior Big Data Engineer to join our remote team, working on exciting projects in the field of data engineering and analytics. In this position, you will be responsible for writing batch processing pipelines using Spark Scala, collaborating with ingestion teams to create new pipelines, troubleshooting and fixing production issues, testing the created code, implementing unit and integration tests, and deploying solutions to production. You will also be responsible for data modeling, and also reading data from Kafka, and processing it in batch mode.
Senior Big Data Engineer with Databricks
We are seeking a highly proficient remote Senior Big Data Engineer with extensive experience in Databricks, Python, AWS, and Data Warehousing. The ideal candidate should be well-versed in software development lifecycle methodologies and proficient in advanced SQL coding. As a Senior Big Data Engineer, you will be responsible for developing and implementing scalable and resilient systems, utilizing data lake solutions, and stream processing engines to meet business goals.
Senior Big Data Engineer with Databricks
We are seeking a highly proficient remote Senior Big Data Engineer with extensive experience in Databricks, Python, AWS, and Data Warehousing. The ideal candidate should be well-versed in software development lifecycle methodologies and proficient in advanced SQL coding. As a Senior Big Data Engineer, you will be responsible for developing and implementing scalable and resilient systems, utilizing data lake solutions, and stream processing engines to meet business goals.
Senior Big Data Engineer with Databricks
We are looking for a remote Senior Big Data Engineer with Databricks expertise to join our team. The ideal candidate should have a Bachelor's/Master's Degree in Computer Science, Information Systems, or equivalent with at least 3 years of experience in Data Software Engineering, DSE Python, and AWS Databricks.
Senior Big Data Engineer with Databricks
We are looking for a remote Senior Big Data Engineer with Databricks expertise to join our team. The ideal candidate should have a Bachelor's/Master's Degree in Computer Science, Information Systems, or equivalent with at least 3 years of experience in Data Software Engineering, DSE Python, and AWS Databricks.
Senior Big Data Engineer with Python
We are looking for an experienced remote Senior Big Data Engineer with a passion for data to develop, monitor, and operate the curated data pipeline for our project. The ideal candidate has a strong background in Data Software Engineering and extensive experience with DSE Python AWS Databricks and SQL. In this position, you will be responsible for redeveloping legacy pipelines into new, advanced, and scalable versions, consulting with data scientists and product managers, building and improving KPIs, and maintaining our cloud-based tech stack.
Senior Big Data Engineer with Python
We are looking for an experienced remote Senior Big Data Engineer with a passion for data to develop, monitor, and operate the curated data pipeline for our project. The ideal candidate has a strong background in Data Software Engineering and extensive experience with DSE Python AWS Databricks and SQL. In this position, you will be responsible for redeveloping legacy pipelines into new, advanced, and scalable versions, consulting with data scientists and product managers, building and improving KPIs, and maintaining our cloud-based tech stack.
Senior Big Data Engineer with Databricks
We are seeking a remote Senior Big Data Engineer with expertise in Databricks to join our innovative team. The ideal candidate should have extensive experience in Spark/Scala and AWS, as well as a solid foundation in Python. In this position, you will be responsible for designing, developing, and deploying large-scale data processing systems with Databricks. You will also be responsible for optimizing data pipelines, monitoring performance, and resolving any related issues. The successful candidate should be able to collaborate closely with other teams, evaluate technical trade-offs, and ensure high-quality solutions are delivered.

Big Data Developer Jobs at EPAM

Big Data Developer is a key technical role responsible for designing, building, and maintaining architectures such as large-scale data processing systems and databases. This professional works with complex datasets to extract valuable insights that inform strategic decisions across various business sectors. They develop, construct, test, and maintain data architectures while ensuring the integrity and accessibility of data. The Big Data Developer also collaborates with data scientists and other stakeholders to implement advanced analytics programs that leverage big data tools and technologies. This role requires a deep understanding of data processing technologies and methodologies, and the ability to innovate and solve problems efficiently.

Big data developers create various products using programming and development processes. The purpose of the latter is to accommodate a huge data flow in the company’s business processes, which the usual databases are not able to cope with. Most often, big data developers work with the Hadoop platform and create software using various programming languages <wbr><wbr>and tools. Big data developer jobs involve many different tasks and the use of various methods to achieve goals.

Main job description

In any business, there are processes that require reliable software. Big data developers are able to process a huge amount of data every day to achieve the necessary requirements for any project. These professionals need to be familiar with many technologies and be able to find the optimal solution for any problem. A huge benefit of the profession is that you can work from home.

Big data developer job responsibilities

Online and offline big data developer work involves the following responsibilities:

  1. Produce products for processing a huge data stream
  2. Analyze data
  3. Ensure a quick response from the product to solve the problems of the company
  4. Support for scalability and high performance of developed services
  5. Detail complex projects
  6. Develop and implement Hadoop applications
  7. Ensure the security of data storage
  8. Set up all automation processes and access data quickly

The number of responsibilities will depend on the skill level of the big data developer. Juniors will not have to do even half of the above. Their job is to perform routine tasks under the supervision of senior specialists. But for middle and senior professionals, the list can grow. For example, a senior big data developer often fills the role of a manager. They constantly monitor the performance of their subordinates, manage them, and distribute the entire scope of tasks.

Requirements for big data developer work

There are many requirements for a big data developer, but we have chosen the most common ones that are required for both office and online jobs:

  1. 2+ years of experience in a similar job position
  2. Excellent knowledge of several programming languages
  3. Ability to debug huge data streams
  4. Experience with different visualization and data analysis tools
  5. Deep knowledge of modeling and data structuring processes
  6. Knowledge of streaming frameworks and automation tools
  7. Familiarity with one scripting language
  8. Bachelor's or master's degree in computer technology
  9. Knowledge of ETL methodology and agile principles
  10. Experience in creating high-volume applications based on open source systems
  11. Knowledge of the basics of machine learning and the Hadoop ecosystem

Personal qualities of big data developers

Big data developer jobs require more than just technical skills. These specialists are often tied to a whole team of professionals from other IT areas. Big data developers must have a high level of communication, the ability to delegate tasks to their colleagues, and the desire to work together with other specialists.

There are additional requirements for working from home. If you are sure that you are ready for a remote job in the big data developer specialty, make sure you have the right qualities. You will need to be good at separating your work area from your place of rest and have excellent time management skills.

Related skills