Senior Data Engineer
Data Integration
& 9 others
Choose an option
As a Senior Data Engineer, you will be instrumental in enhancing our analytical frameworks and accelerating data processing quality and speed.
Your role involves crafting robust data pipelines, facilitating ad hoc analyses, and developing tools that empower the broader organization. Join us to advance impactful data-driven strategies.
Responsibilities
- Create and sustain scalable data pipelines using ETL/ELT methodologies
- Develop and refine data integration solutions leveraging Databricks and PySpark
- Partner with analysts and engineers to design self-service analytical platforms
- Conduct ad hoc data investigations to support business insights and market analysis
- Maintain comprehensive documentation and manage code repositories on GitHub
- Convert business objectives into practical technical implementations and analytical frameworks
- Manage priorities to ensure timely delivery of high-quality outcomes
- Enforce data quality procedures to guarantee data accuracy and dependability
- Enhance SQL query performance and scalability
- Collaborate with cross-functional teams to unify data sources
- Assist in data visualization initiatives using Tableau and Salesforce tools
- Oversee and resolve issues in data workflows managed by Apache Airflow
- Adhere to data security and compliance regulations
Requirements
- Extensive experience with Databricks and SQL including query tuning (3+ years)
- Proficiency in PySpark or Spark/Scala for processing large datasets
- Hands-on knowledge of cloud environments, particularly AWS
- Familiarity with ETL/ELT processes and data integration methods
- Capability to write clear, maintainable code accompanied by documentation
- Strong analytical and problem-solving skills
- Experience with web-scale databases such as Snowflake or BigQuery
- Excellent spoken English skills at B2 level or higher
- Effective time management and task prioritization abilities
- Experience using GitHub for code management and collaboration
- Ability to translate broad objectives into effective technical strategies
- Experience with data visualization platforms like Tableau
- Self-driven with capability to work independently and collaboratively
Nice to have
- Background in gaming industry data analytics
- Understanding of Salesforce data integration techniques
- Knowledge of Apache Airflow for orchestration of workflows
- Experience in constructing predictive models or conducting hypothesis tests
- Relevant certifications in data engineering or cloud services