Back to SearchSenior Big Data Engineer
Remote in Colombia
Data Software Engineering
& 7 others
Choose an option
We are looking for a Senior Big Data Engineer to join our team and help us create and adjust analytics data pipelines. The ideal candidate should have hands-on experience in Cloud computing on AWS, developing scripts using Python and developing ETL processes whilst displaying a strong understanding of query execution plans and query optimization.
Responsibilities
- Develop analytics data pipelines
- Develop ETL processes and scripts in Python for data integration, from multiple sources
- Optimize and tune both SQL and NoSQL queries to ensure efficient and seamless data processing and delivery across our data pipelines
- Develop and maintain data architecture standards, principles, and models for efficient data integration and management
- Effectively communicate with stakeholders to understand business needs and translate them into technical requirements
Requirements
- 2+ years of experience in Cloud computing on AWS
- Experience with Spark
- Knowledge of Databricks
- 2+ years of experience in developing scripts using Python
- Strong knowledge and expertise with SQL and NoSQL Databases
- Experience with Data architecture