Back to SearchSenior Data Software Engineer
Join our remote team as a Senior Data Software Engineer within a global leader in providing solutions for complex data needs. We are currently looking for an individual who can work closely with the architects, technical leads, and other key individuals within our functional groups to design, develop and implement reusable DataBricks components for data ingestion and analytics. As a Senior Data Software Engineer, you will be responsible for ensuring that data is ingested via batch, streaming, or replication into a data lake, establishing security controls, and ensuring integration with data governance. You will also be responsible for building collaborative partnerships with stakeholders to ensure that the data is available for reporting and predictive modeling.
- Design and develop reusable DataBricks components for data ingestion and analytics
- Collaborate with architects, technical leads, and other key individuals within our functional groups to deliver customer-centric solutions.
- Establish security controls and ensure integration with data governance to achieve clear auditable data lineage
- Participate in code review and test solutions to ensure they meet best practice specifications
- Write project documentation for all phases of the software development lifecycle
- Create and maintain technical documentation for the data ingestion pipelines, Data Warehouse or Database architecture
- Work with stakeholders to ensure data availability for reporting and predictive modeling
- Ensure continuous improvement by staying abreast of industry trends and emerging technologies
- Drive the implementation of solutions aligned with business objectives.
- Mentor and guide less experienced team members, helping them enhance their skills and grow their careers
- Collaborate with cross-functional teams to achieve project goals
- 3+ years of experience in building data ingestion pipelines, Data Warehouse or Database architecture
- Expertise in Python and PySpark for data processing and analysis
- Experience with DataBricks for building scalable and high-performance applications
- Hands-on experience with SQL Azure for designing and managing database schema, including procedures, triggers, and views
- Experience with Microsoft Azure for designing, deploying and administering scalable, available and fault-tolerant systems
- Familiarity with data modeling and modern Big Data components
- Experience with ADLS, Power BI, Azure Synapse Analytics for cloud-based infrastructure and application management
- Familiarity with compliance awareness such as PI, GDPR, HIPAA
- Excellent communication skills in spoken and written English, at an upper-intermediate level or higher
- Experience with other Cloud platforms such as AWS and GCP is a plus
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn