Lead Data DevOps Engineer
Data DevOps
& 16 others
Choose an option
We are looking for a Lead Data DevOps Engineer to spearhead the creation, enhancement, and upkeep of a robust AWS data platform.
You will work closely with fellow engineers in a collaborative setting that emphasizes teamwork, problem resolution, and leveraging individual skills. Join us if you are driven by cloud innovations and data pipeline excellence and want to lead impactful projects.
Responsibilities
- Create, enhance, and manage scalable data platforms and pipelines leveraging AWS technologies
- Develop and refine data ingestion methods to improve data reliability and system efficiency
- Produce clean, maintainable Python code adhering to coding best practices
- Set up and administer AWS infrastructure components such as ECS, RDS, IAM, CloudWatch, VPC, Serverless, Glue, DynamoDB, EMR using Terraform
- Oversee, diagnose, and automate workflows for data processing
- Maintain and update documentation and knowledge repositories to facilitate team synergy
- Promote AI technology integration and Agile methodologies within the group
- Guide and mentor junior engineers to support their growth
Requirements
- Bachelor’s degree in Computer Science or related discipline, or equivalent experience
- 5+ years of experience in enterprise cloud application development with emphasis on AWS and Terraform
- Advanced proficiency with AWS data services including Glue, Athena, S3, ETL/ELT, Python, and infrastructure as code
- Excellent problem-solving, troubleshooting, and team collaboration abilities
- Proven track record mentoring junior engineers and thriving in Agile environments
- Strong communication skills in English (B2 level or higher)
- Flexibility to work varying hours up to 11 PM EST
Nice to have
- Hands-on experience with AWS Lambda, DynamoDB, ECS, and RDS
- Knowledge of monitoring and analytics platforms such as New Relic, Splunk, Cribl Stream, and Metabase