Back to Search
Senior Data Engineer
Data Software Engineering, Apache Kafka, Azure Data Factory, Azure Data Lake Storage, Databricks, PySpark, Python, SQL
Sorry, this position is no longer available
Currently, we are looking for a remote Senior Data Engineer to join our global team
Responsibilities
- Redesign the database to enhance the existing way of storing and sharing the data
- Redesign of Database web layer to enhance the manual process for Client service of survey creation
- Setup data acquisition on aggregated and respondent levels from KAP, Affectiva, Context Lab,LinkDB, Link+DB
- Create a calculation module (study bank) in EDP which will conduct new calculations using reference data
- Create API for EDP to pass the data to other systems (e.g. Dashboard)
- Ensure new calculations and norms are passed to EDP for storage
- Migrate historical data from LinkDB and CXL
Requirements
- 3+ years of experience in Data Engineering
- Strong knowledge of Apache Kafka
- Strong knowledge of Azure Data Factory
- Strong knowledge of Azure Data Lake Storage
- Strong knowledge of Databricks
- Strong knowledge of PySpark
- Strong knowledge of Python
- Strong knowledge of SQL
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn