Back to SearchSenior Data Engineer (Scala)
Data Software Engineering, Databricks, Scala, Microsoft Azure, Azure Cosmos DB, Azure Data Factory, Azure Stream Analytics, Azure Synapse Analytics, Microsoft Purview
Sorry, this position is no longer available
Our company is looking for a remote Senior Big Data Engineer to join our team and work on a cutting-edge project in the healthcare industry.
In this position, you will be responsible for designing, developing, and maintaining data pipelines and data infrastructure, ensuring that we can process and analyze large amounts of data efficiently and accurately. You will work closely with cross-functional teams to identify data requirements, design data models, and develop scalable solutions to meet our business needs.
Responsibilities
- Design, develop, and maintain scalable data pipelines and infrastructure to support our data-driven business needs
- Collaborate with cross-functional teams to ensure the quality and reliability of our data platforms
- Provide technical leadership to junior team members, mentoring and guiding them in their professional development
- Develop and implement data governance policies and procedures, ensuring data quality and compliance with regulatory requirements
- Troubleshoot complex data issues and provide effective solutions to ensure data accuracy and integrity
- Monitor and optimize data pipelines and infrastructure to ensure optimal performance and scalability
- Stay up-to-date with emerging trends and technologies in Big Data Engineering, recommending and implementing improvements to our data platforms
Requirements
- A minimum of 3 years of experience in Data Software Engineering, demonstrating your proficiency in designing, developing, and maintaining scalable data pipelines and infrastructure
- Expertise in Databricks, Scala, Microsoft Azure, Azure Cosmos DB, Azure Data Factory, Azure Stream Analytics, Azure Synapse Analytics, and Microsoft Purview, enabling you to build and maintain data platforms that meet business requirements
- Experience in developing and implementing data governance policies and procedures
- Proficiency in SQL and NoSQL databases, as well as data modeling and schema design
- Strong analytical and problem-solving skills, allowing you to troubleshoot complex data issues and provide effective solutions
- Excellent communication and interpersonal skills, enabling you to collaborate effectively with cross-functional teams
- Ability to work independently and manage multiple projects simultaneously, maintaining a high level of performance even under pressure
- Fluent spoken and written English at an Upper-Intermediate level or higher (B2+)
Nice to have
- Experience with other Big Data technologies such as Hadoop, Spark, or Kafka
- Knowledge of cloud-based data warehousing solutions such as Amazon Redshift or Google BigQuery
- Experience with data visualization tools such as Tableau or Power BI
- Certifications in Big Data technologies or cloud platforms
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn