Data Engineer - Distribution Factory

Abacus Insights is a mission-driven, growth-stage technology company focused on transforming the healthcare industry, ultimately creating a more personalized patient experience, improving health outcomes, and lowering the overall cost of healthcare. Abacus Insights provides a flexible, efficient, and secure platform that organizes and exchanges healthcare data from various sources and formats. Our platform allows our customers to uncover differentiated insights that address their client's needs. In addition, our employees know they play an active role in keeping our customers' data safe and are responsible for ensuring that our comprehensive policies and practices are met.

With our deep expertise in cloud-enabled technologies and knowledge of the healthcare industry, we have built an innovative data integration and management platform that allows healthcare payers access to historically siloed and inaccessible data. Through our platform, these healthcare organizations can ingest and manage all the data they need to transform their business by supporting their analytical, operational, and financial needs.

Since our founding in 2017, Abacus has built a highly successful SaaS business, raising $100 Million from leading VC firms with deep expertise in the healthcare and technology industries. We are solving problems of massive scale and complexity in a sector ready for disruption. We're growing quickly and would love for you to be a part of it!

About the Role:

We are looking for data engineers who will play an essential role in developing and maintaining our data pipelines and workflows. Working under the guidance of senior engineers and the Data Distribution Team Lead, you will help ensure our data solutions are robust, scalable, and meet our clients' needs. This role offers an excellent opportunity to build on your existing skills and grow within a supportive and innovative environment. Your contributions will help us deliver high-quality data solutions that drive better healthcare outcomes. 

You Will: 

• Develop Data Pipelines: Collaborate with the Data Distribution Team to design, develop, and maintain data pipelines and ETL processes using Databricks, Snowflake, SQL, and PySpark. 

• Optimize Data Assets: Assist in creating and optimizing data assets to ensure data quality, performance, and reliability. 

• Monitor and Troubleshoot: Support the monitoring and troubleshooting of data pipelines to ensure smooth and efficient data distribution. 

• Collaborate with Teams: Work with the Data Distribution Team and cross-functional teams to understand client data requirements and translate them into scalable data solutions. 

• Leverage Agile Methodologies: Utilize Agile methodologies and best practices to deliver incremental improvements and respond to changing requirements. 

• Communicate Effectively: Maintain clear communication with stakeholders to gather and clarify requirements and provide regular project updates. 

• Ensure Data Privacy and Compliance: Uphold a strong commitment to data privacy, security, and regulatory compliance, considering the sensitive nature of healthcare data. 

What We're Looking For: 

• Educational Background:  Bachelor’s degree in computer science or a related field. 

• Relevant Experience: Minimum of 2 years of experience in data engineering, software engineering, or a related role. 

• Technical Proficiency: Experience with Databricks, Snowflake, SQL, and PySpark. 

• Healthcare Data Knowledge: Basic understanding of US healthcare data and terminology is a plus. 

• Problem-Solving Skills: Ability to work on data engineering projects and solve problems efficiently. 

• Big Data and Cloud Technologies: Familiarity with big data technologies, data processing frameworks, and cloud-native architecture. 

• Agile Methodologies: Experience with Agile methodologies and project delivery. 

• Communication and Collaboration: Strong communication skills with the ability to collaborate effectively with team members and stakeholders. 

Bonus Points: 

Advanced Certifications: Relevant certifications in data engineering, cloud computing, or specific technologies such as Databricks, Snowflake, or AWS. 

Equal Opportunity Employer 

As a mission-led technology company that is helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. Therefore, we proudly dedicate extensive time and resources to building diverse teams and providing equal employment opportunities to all applicants. Abacus prohibits discrimination and harassment of any type regarding race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.