Data Integration Engineer

AI overview

Focus on designing and maintaining data integration processes across a hybrid IT landscape to enhance data quality and support organizational needs.

This is a fully remote position

This job will focus on creating, maintaining, transforming, and decommissioning various systems that cross a wide hybrid IT landscape. As part of this role, it is vital that data flows smoothly, accurately, and completely to ensure general performance and that internal & security project requirements are met. The engineer will also work through optimizing (or changing) existing data workflows & pipelines that are relied on by multiple internal stakeholders.

A complex IT landscape that ranges from on-premises, SaaS, and multiple cloud providers (primarily AWS) is integrated into business processes that need modernizing or re-integrating into modern systems & processes. The goal is to increase the resiliency, data quality, observability, and completeness of these integrations to support the needs of the organization.

While this role does rely on automation/integration between systems, the right candidate will be able to work with internal stakeholders to ensure today's requirements are met with tomorrow's integrations in mind. This person should be able to gather requirements and own the end-to-end process/delivery of a solution. They'll also be able to see a larger data pipeline picture of several integrations and communicate effectively to those involved on possible solutions (as well as eventual pitfalls based on technical decisions/paths), understanding that some changes may rely on future product enhancements and their implementation priority within a development cycle.

Responsibilities:

  • Design, develop, and maintain data integration processes using ETL tools and frameworks.
  • Collaborate with cross-functional teams to establish data integration requirements and ensure that data flows align with business objectives.
  • Implement data transformation, cleansing, and enrichment processes to enhance data quality and usability.
  • Monitor and troubleshoot data integration workflows to identify and resolve issues promptly.
  • Document data integration processes, data flows, and operational procedures for reference and future improvements.
  • Evaluate new data integration technologies and tools to improve existing processes and ensure scalability.
  • Provide technical support and training to team members on data integration best practices.
  • Work closely with data engineers to optimize data storage and retrieval strategies.

Requirements

The ideal candidate will be able to write/edit/maintain code that originates in Python/Bash/PowerShell/etc., as well as use DevOps tooling in CI/CD workflows to check into source control systems. Using Linux, Windows, Containers, and cloud infrastructure is required. Being able to integrate, develop, and troubleshoot Splunk (and Splunk Apps, generally Python-based) is highly desired. 

  • Proven experience as a Data Integration Engineer, ETL Developer, or similar role.
  • Strong proficiency in SQL and experience with database systems (e.g., MySQL, PostgreSQL, SQL Server).
  • Familiarity with ETL tools such as Talend, Informatica, Apache NiFi, or similar.
  • Experience with data modeling and design, data warehousing concepts, and data governance.
  • Strong programming skills in scripting languages such as Python, Java, or similar.
  • Excellent problem-solving skills and the ability to work with complex data structures.
  • Strong communication and collaboration skills, with experience working in cross-functional teams.
  • Ability to work independently and manage multiple tasks in a remote environment.

Benefits

  • Competitive salary
  • Opportunity to work in a dynamic and innovative environment.
  • Professional development and growth opportunities.
  • Flexible work schedule and remote work options

Perks & Benefits Extracted with AI

  • Flexible Work Hours: Flexible work schedule and remote work options

Partner One Capital is a long-term investment group specialized in the acquisition and growth of successful software companies. We are owned by one of the largest pension funds in North-America with over $15 Billion in Net Assets. In business for over 23 years, we own some of the fastest growing enterprise software companies in the world. Over 600 of the world's largest corporations and governments rely on our software for their most critical operations and to safeguard their most valuable data.

View all jobs
Get hired quicker

Be the first to apply. Receive an email whenever similar jobs are posted.

Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Integration Engineer Q&A's
Report this job
Apply for this job