Senior Big Data Engineer

Data Software Engineering, Amazon Web Services, Python, Apache Spark, Databricks, Data Architecture, SQL, Redis

We are looking for a Senior Big Data Engineer to join our team and help us create and adjust analytics data pipelines. The ideal candidate should have hands-on experience in Cloud computing on AWS, developing scripts using Python and developing ETL processes whilst displaying a strong understanding of query execution plans and query optimization.

Responsibilities

Develop analytics data pipelines
Develop ETL processes and scripts in Python for data integration, from multiple sources
Optimize and tune both SQL and NoSQL queries to ensure efficient and seamless data processing and delivery across our data pipelines
Develop and maintain data architecture standards, principles, and models for efficient data integration and management
Effectively communicate with stakeholders to understand business needs and translate them into technical requirements

Requirements

2+ years of experience in Cloud computing on AWS
Experience with Spark
Knowledge of Databricks
2+ years of experience in developing scripts using Python
Strong knowledge and expertise with SQL and NoSQL Databases
Experience with Data architecture

Benefits

International projects with top brands
Work with global teams of highly skilled, diverse peers
Healthcare benefits
Employee financial programs
Paid time off and sick leave
Upskilling, reskilling and certification courses
Unlimited access to the LinkedIn Learning library and 22,000+ courses
Global career opportunities
Volunteer and community involvement opportunities
EPAM Employee Groups
Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn