Senior Data Quality Engineer
Data Quality Engineering
& 3 others
Chile
We are seeking a remote Senior Data Quality Engineer to join our team.
The ideal candidate must have advanced skills in Data Quality Engineering and be able to write complex scripts using T-SQL and Python (Pandas). They must have experience with various file formats, relational tables in SQL Server, and have a good understanding of QA and Testing best practices.
Responsibilities
- Create test plans and test cases to do end-to-end testing of data pipelines
- Appropriately identify data quality issues, and document them for bug fixes
- Perform regression testing for bug fixes
- Design test harness for automated testing
- Work with Azure DevOps and various ETL Tools especially ADF and Databricks
Requirements
- At least 3 years of experience in Data Quality Engineering
- Expertise in Advanced Data Analysis using T-SQL, Python (familiarity with Pandas)
- Proficient in Data Profiling and identifying data issues related to data types, formats, missing values, duplicate data, etc.
- Experience working with various file formats more specifically CSV, Parquet, Any other Delimited, XML, JSON
- Good understanding of QA and Testing best practices
- B2+ English level
Nice to have
- Good understanding of time series and historical data
- Understanding of OLTP and OLAP systems
- Familiarity with various encodings like ASCII and UNICODE
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn