Apache Spark Jobs
FILTERS
COUNTRY
6
5
1
1
SPECIALIZATIONS
8
SKILLS
311
249
241
198
191
8
Start typing...
SENIORITY
6
2
INDUSTRY
7
1
Viewing 1-8 out of 8 jobs found
relevant first
40 hrs/week
12+ months
Georgia
Georgia
Currently, we are looking for a Remote Senior Python Developer to join our team.
The customer is a premier asset management firm, focused on delivering unique insight and partnership for the most sophisticated global institutional investors.
responsibilities
- Query tuning, performance tuning, troubleshooting, and debugging Spark or other big data solutions
- Build use cases that use data - such as risk modeling, fraud detection, customer life-time value
- Experience with design and implementation of big data technologies such as Spark/Delta, Hadoop, and NoSQL
- Maintain and extend production data systems to evolve with complex needs
requirements
- 3+ years of experience with Python.Core
- Production programming experience in Python or Scala
- Deep Expertise with Spark Structured Streaming
- Apache Spark experience
- Big Data experience
nice to have
- Experience scaling big data workloads that are performant and cost-effective
- Experience with Development Tools for CI/CD, Unit and Integration testing, Automation and Orchestration, REST API, BI tools and SQL Interfaces. E.g. GitLab
- Experience designing data solutions on cloud infrastructure and services, such as AWS, Azure, or GCP using best practices in cloud security and networking
40 hrs/week
12+ months
Colombia, Mexico
Colombia, Mexico
We are seeking a skilled Lead Java Engineer to join our dynamic team.
The chosen candidate will take charge of architecting, developing, and maintaining robust and expandable Java applications. This position requires effective collaboration with interdisciplinary teams to produce high-quality software solutions that satisfy business needs.
responsibilities
- Architected and developed Java applications and services
- Optimized and refactored existing code to enhance performance and scalability
- Cooperated with product and engineering teams to define specifications and deliver solutions
- Authored clean, efficient, and well-documented code
- Contributed to code reviews and team knowledge sharing
- Diagnosed and fixed production issues
- Provided mentorship to junior developers and advocated for best practices
- Kept abreast of the latest trends and technologies in Java development
requirements
- 5+ years of proficiency in Java and frameworks like Spring and Hibernate
- 1+ years of relevant leadership experience
- Proficiency in the design and development of RESTful APIs
- Experience in deploying applications in a microservices architecture
- Acquaintance with front-end technologies like JavaScript, HTML, and CSS
- Proficiency in database technologies including MySQL, PostgreSQL, and MongoDB
- Experience with version control systems like Git
- Ability to integrate third-party services and APIs
- Experience in writing unit tests and integration tests
- Degree in Computer Science, Engineering, or a related field
- Demonstration of excellent problem-solving abilities and attention to detail
- Willingness to adopt Docker and Kubernetes for containerization and orchestration
- Proficiency in DevOps practices and CI/CD tools like Jenkins or CircleCI
- Familiarity with Agile practices like Scrum or Kanban
nice to have
- Experience with AWS deployment and management
- Expertise in Scala or Kotlin
- Knowledge of Big Data technologies like Apache Kafka or Hadoop
40 hrs/week
12+ months
Colombia, Mexico
Colombia, Mexico
We are actively seeking a Lead Java Developer to become part of our team at a top US company specializing in business information, analytics, and outsourcing services. The selected candidate will possess robust Java development capabilities along with experience in Spring framework and microservices architecture, contributing to the innovation and enhancement of our products. Our agile team environment prioritizes TDD, pair programming, and XP processes.
We are seeking a Senior Java Developer to join our team at a leading US company specializing in business information, analytics, and outsourcing services. The ideal candidate will bring strong Java development skills and experience in Spring framework and microservices architecture to help us innovate and improve our products. Our agile team environment emphasizes TDD, pair programming, and XP processes.
responsibilities
- Lead the design, development, and maintenance of Java applications
- Implement and manage microservices using the Spring framework
- Work with cross-functional teams to establish and meet project objectives
- Develop clean, scalable, and efficient code
- Engage in code reviews and enhance team knowledge-sharing
- Adhere to TDD and XP practices within an agile development framework
- Enhance application performance and scalability
- Troubleshoot and resolve technical issues
- Provide mentorship to junior developers
- Drive the continuous enhancement of our development processes
requirements
- Minimum of 5 years in software design, development, and testing
- At least 1 year in a relevant leadership role
- Bachelor's degree in Computer Science or a related field
- Profound knowledge of Spring framework
- Proficiency in microservice architecture
- Strong written and verbal communication skills
- Capability to work independently with general direction
- Commitment to staying current with emerging technology trends
- Proficiency with Kafka and Elasticsearch
- Knowledge of GCP (DataFlow)
- Experience with Spark and PostgreSQL
- Demonstrated ability to tackle complex problems
- Willingness to collaborate closely with others
- Experience in an agile development setting
- Keen attention to detail
- Fluent in English at a B2+ level
nice to have
- Certifications in Java or related technologies
40 hrs/week
12+ months
Colombia
Colombia
We are seeking a remote Senior Java Developer with BigData expertise to join our team.
As a part of our data engineering and MLOps team, you will be responsible for developing and maintaining software solutions for our customer. The successful candidate will have experience with Java, Spring Boot, and the BigData stack including AWS, Kafka, MongoDB, and Apache Flink/Spark.
responsibilities
- Develop and maintain software solutions using Java and the BigData stack
- Collaborate with cross-functional team members to design and implement scalable solutions
- Participate in code reviews and help maintain code quality standards
- Create and maintain documentation related to software design and architecture
- Continuously improve software development processes and procedures
requirements
- Minimum of 3 years of experience in Java development
- Strong experience in Java, as well as the BigData stack including AWS, Kafka, and MongoDB
- Spring Boot development experience
- Experience with container technologies such as Docker and Kubernetes
- Excellent communication skills and ability to effectively collaborate with cross-functional teams
- B2+ English level
nice to have
- Experience with Apache Flink, Kafka, and Databricks
- Knowledge of Python and Scala
40 hrs/week
12+ months
Colombia, Mexico
Colombia, Mexico
We are seeking a Senior Java Developer to join our team at a leading US company specializing in business information, analytics, and outsourcing services.
The ideal candidate will bring strong Java development skills and experience in Spring framework and microservices architecture to help us innovate and improve our products. Our agile team environment emphasizes TDD, pair programming, and XP processes.
responsibilities
- Design, develop, and maintain Java applications
- Implement and maintain microservices using Spring framework
- Collaborate with cross-functional teams to define and achieve project goals
- Write clean, scalable, and efficient code
- Participate in code reviews and contribute to team knowledge sharing
- Follow TDD and XP practices within an agile development framework
- Optimize applications for performance and scalability
- Debug and resolve technical issues
- Mentor junior developers
- Contribute to the continuous improvement of our development processes
requirements
- Bachelor's degree in Computer Science or related field
- 3+ years of experience in software design, development, and testing
- Strong knowledge of Spring framework
- Understanding of microservice architecture
- Excellent written and verbal communication skills
- Ability to work independently under general direction
- Dedication to keeping abreast of emerging technology trends
- Experience with Kafka and Elasticsearch
- Familiarity with GCP (DataFlow)
- Experience with Spark and PostgreSQL
- Proven ability to solve complex problems
- Ready to work in pairs
- Experience working in an agile environment
- Strong attention to detail
- Fluent English at a B2+ level
nice to have
- Additional certifications in Java or related technologies
40 hrs/week
12+ months
Poland
Poland
We are seeking a remote Senior Data Software Engineer to join our team.
The right candidate will have a strong technical background with expertise in Apache Spark, Microsoft Azure, and Python. This position offers a unique opportunity to work on a high-impact project with one of the world's most recognized brands.
responsibilities
- Collaborate with cross-functional teams to build and maintain the data integration solution
- Develop, build, and optimize data pipelines using Apache Spark, Microsoft Azure, and Python
- Ensure data pipelines are scalable, maintainable, and reliable
- Take data science models and make them production ready
- Develop and maintain forecasting models to support business decisions
- Ensure data quality and consistency across all data sources
- Monitor and optimize data pipelines to ensure efficient and effective data processing
- Collaborate with data scientists to develop and implement machine learning models
- Work with the team to continuously improve and optimize the data integration solution for Fedex
- Stay current with emerging technologies and trends in data software engineering
requirements
- At least 3+ years of experience in data software engineering or similar roles
- Expertise in Apache Spark, Microsoft Azure, and Python
- Strong knowledge of forecasting models, data science, and MLOps
- Experience working with Databricks to build, maintain, and optimize data pipelines
- Ability to take data science models and make them production ready
- Experience with Git for version control
- Understanding of basic Azure concepts including clouds, regions, ADLS, and compute
- Strong analytical and problem-solving skills with the ability to think critically and creatively
- Experience working in Agile development environments
- Excellent English communication skills, both written and verbal (B2+ level)
nice to have
- Experience with Panda for data manipulation and analysis
- Strong knowledge of SQL and relational tables
- Understanding of statistical models and the ability to develop models utilizing Python, Spark, etc.
- Knowledge of ML tools space
40 hrs/week
12+ months
Colombia, Mexico
Colombia, Mexico
We are seeking an experienced Senior Java Developer to join our team at a leading US Company specializing in business information, analytics, and outsourcing services.
As a global organization, we are dedicated to providing expert solutions in risk assessment, underwriting support, investment and marketing decisions, fraud prevention, and enhancing business performance. The ideal candidate will thrive in a highly agile environment, following TDD, pair programming, and XP processes.
responsibilities
- Design, develop, and test software solutions using Java and Spring framework
- Implement and maintain microservices architecture
- Work collaboratively in pairs and participate in peer programming
- Develop and integrate functionalities using Kafka and Elastic
- Manage databases using PostgreSQL and ensure data integrity
- Leverage cloud technologies for scalable software deployment
- Communicate effectively with team members and stakeholders
- Stay updated with emerging technology trends and incorporate them into projects
- Provide technical guidance and mentorship to junior developers
requirements
- Four to seven years of experience in software design, development, and testing
- Strong Java development skills
- Deep knowledge of Spring framework
- Understanding of microservice architecture
- Experience with Cloud technologies and PostgreSQL
- Proficiency with Kafka and Elasticsearch
- Experience with Spark
- Dedication to keeping abreast of emerging technology trends
- Ability to work independently under general direction
- Ready to work in pairs
- Ability to work till 12 PM CST
- Excellent written and verbal communication skills
nice to have
- Experience with Google Cloud Platform
- Familiarity with Test-Driven Development (TDD) methodologies
40 hrs/week
12+ months
Colombia, Mexico
Colombia, Mexico
We are seeking a talented and experienced Senior Java Engineer to join our team.
The ideal candidate will be responsible for designing, building, and supporting robust and scalable Java applications. This role will involve close collaboration with cross-functional teams to deliver high-quality software solutions that meet business requirements.
responsibilities
- Design and implement Java applications and services
- Optimize and refactor existing code for performance and scalability
- Collaborate with product and engineering teams to define specifications and deliver solutions
- Write clean, efficient, and well-documented code
- Participate in code reviews and contribute to team knowledge sharing
- Troubleshoot, debug, and resolve production issues
- Mentor junior developers and promote best practices
- Stay up-to-date with emerging trends and technologies in Java development
requirements
- 3+ years of experience in Java and frameworks such as Spring and Hibernate
- Knowledge of RESTful API design and development
- Background in building and deploying applications in a microservices architecture
- Familiarity with front-end technologies such as JavaScript, HTML, and CSS
- Understanding of database technologies like MySQL, PostgreSQL, and MongoDB
- Skills in version control systems like Git
- Capability to integrate with third-party services and APIs
- Competency in writing unit tests and integration tests
- Qualifications in Computer Science, Engineering, or a related field
- Showcase of strong problem-solving skills and attention to detail
- Flexibility to use Docker and Kubernetes for containerization and orchestration
- Expertise in DevOps practices and CI/CD tools like Jenkins or CircleCI
- Experience with Agile methodologies such as Scrum or Kanban
nice to have
- AWS deployment and management experience
- Proficiency in Scala or Kotlin
- Familiarity with Big Data technologies such as Apache Kafka or Hadoop