Back to Search
We are seeking a skilled remote Senior Data Software Engineer to join our remote team, working with a leading provider of cloud-based solutions for data management and analytics. As a Senior Data Software Engineer, you will be responsible for building and maintaining secure and compliant production data processing pipelines, ensuring high-performing, efficient, organized, and reliable data stores. You will work closely with SMEs and Tech Leads to ensure delivery on commitments and design and implement data engineering, ingestion, and curation functions on Azure cloud using Azure native or custom programming. If you are passionate about data engineering and have extensive experience in Microsoft Azure, we invite you to apply.
Responsibilities
- Provide partnership and support to SMEs and Tech Leads to ensure delivery on commitments
- Build and maintain secure and compliant production data processing pipelines by using different tools and techniques (cloud services, Python/Scala)
- Ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a set of business requirements and constraints. They deal with unanticipated issues swiftly, and they minimize data loss
- Design, implement, monitor, and optimize data platforms to meet the data pipelines needs
- Design and implement data engineering, ingestion, and curation functions on Azure cloud using Azure native or custom programming. Create data transformation and loading workflows
- Responsible for data-related implementation tasks that include provisioning data storage services, ingesting streaming, and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data sources
Requirements
- A minimum of 3 years of experience in Data Software Engineering, demonstrating your proficiency in building and maintaining production data processing pipelines
- Expertise in Microsoft Azure, including Azure Databricks, Azure Cosmos DB, and Microsoft Purview
- Strong programming skills in Scala or Python, enabling you to design and implement data engineering, ingestion, and curation functions
- Experience in designing and implementing data platforms to meet the data pipelines needs, ensuring high-performing, efficient, organized, and reliable data stores
- Hands-on experience in creating data transformation and loading workflows, utilizing Azure native or custom programming
- Strong focus on teamwork and exceptional interpersonal skills, allowing you to collaborate effectively with cross-functional teams
- Ability to work independently and manage stress effectively, maintaining a high level of performance even under pressure
- Fluent spoken and written English at an Upper-Intermediate level or higher
Nice to have
- Knowledge of Big Data technologies (e.g., Hadoop, Spark, Kafka)
- Experience with Agile and DevOps methodologies
- Familiarity with data modeling and data warehousing concepts and techniques
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn