Principal Data Engineer

New York , United States
Hybrid

AI overview

Lead the architectural strategy for DriveWealth's data ecosystem, ensuring scalability and reliability while mentoring engineers and driving modernization efforts.

DriveWealth is a global B2B financial technology organization dedicated to democratizing access to financial independence around the world. Our mission is realized through an API-based platform, empowering our partners to offer seamless investing and trading experiences to clients worldwide, all from their mobile devices.

Our technology provides partners with a modern, extensible toolkit, enabling traditional investment workflows and innovative techniques like fractional share ownership. DriveWealth has evolved into a global platform offering trading of US equities, mutual funds, ETFs, fixed income, and options.

We seek enthusiastic professionals to contribute diverse perspectives and experiences to our Brokerage-as-a-Service platform. Our culture blends the pace and opportunity of a tech start-up with the impact, stability, and significance of Wall Street. We encourage creativity and experimentation while ensuring institutional-grade execution and regulatory compliance in everything we do. We value diversity and inclusion, celebrating the unique differences of our employees as we scale and grow together. We’re guided by operating principles grounded in accountability, teamwork, integrity, and solutions built to scale. Join us!

About the Role

We are looking for a Principal Data Engineer who thrives on solving the most complex data problems, and enjoys working cross-functionally with product, engineering and analytics teams to deliver trusted, high-impact data solutions. The ideal candidate is excited to take strategic ownership of complex data challenges and help evolve our data platform to the next stage of scale and maturity, driving architectural vision and execution. 

The Data & Analytics organization at DriveWealth powers the company’s data ecosystem end-to-end. Within it, the Data Platform Engineering team owns two critical pillars:

  • Data Ingestion - building reliable pipelines that bring data from diverse internal and external sources
  • Semantic Data Layer - creating curated, consistent and reliable datasets that enable analytics, reporting and decision making

What You’ll Do

  • Define the architectural vision and strategy for our data ecosystem, ensuring scalability, reliability, and security. 
  • Design, build and maintain mission-critical robust data pipelines (batch, streaming and replication) that power analytics, reporting and compliance use-cases. 
  • Translate business needs into comprehensive data solutions, acting as a technical leader partnering with product managers, engineering teams and business stakeholders. 
  • Proactively identify major architectural challenges and opportunities, anticipate scaling, performance and quality needs before they become blockers.
  • Establish and champion company-wide best practices, including documentation, code reviews and standards for data modelling, orchestration and tooling. 
  • Mentor and coach other engineers, raising the bar for data engineering craft and helping grow team and organizational capabilities. 
  • Contribute to self-service data products, enabling data consumers with curated datasets, semantic layers and tools that accelerate insight generation.
  • Drive the full lifecycle of data platform modernization initiatives, from ideation to successful rollout.

What You’ll Need

  • 7+ years of professional experience in data engineering or related fields, with a proven track record of building and scaling data platforms and ecosystems from 0 to 1 and leading modernization efforts. 
  • Technical Skills:
    • Strong proficiency in Python and SQL
    • Expert-level hands-on experience with Spark (PySpark and SparkSQL) and distributed data processing. 
    • Expertise with orchestration and transformation tools (e.g. Airflow, DBT)
    • Deep Proficiency with Databricks and AWS 
    • Familiarity with infrastructure as code (e.g.Terraform or equivalent)
    • Fluent in shell scripting and command line tooling (e.g. Databricks CLI)
  • Proven ability to drive technical strategy, work independently, and lead complex projects cross-functionally with product, engineering and business teams. 
  • Experience working in teams with CI/CD pipelines, Git-based workflows and Agile methodologies
  • Curiosity, accountability and a drive to improve data quality, scalability and usability across the company
  • BS in Computer Science or equivalent

Applicants must be authorized to work for any employer in the U.S. DriveWealth is unable to sponsor an employment Visa at this time.

Special Knowledge (Nice to Have, But Not Required)

  • Fintech or capital market experience
  • Familiarity with regulatory and compliance-driven reporting (e.g. FINRA, GDPR)
  • Previous experience as a Software Engineer (SWE)
  • Exposure to and understanding of ML and AI data pipelines and MLOps
  • Experience mentoring other engineers or leading a small team

Compensation
Compensation package offerings are based on candidate experience and technical qualifications, as it relates to the role. These are identified and determined throughout your interviewing experience.

Please note
: this role is expected to come into our office on a cadence set by the Hiring Manager/Team.

New York, NY (Hybrid) Pay Range
$250,000$290,000 USD

Benefits

  • Competitive medical, dental, and vision insurance options
  • Mental health resources 
  • Generous paid time off with observed holidays (varies per country)
  • Paid parental leave for biological and adoptive parents
  • Up to $2,500 or local equivalent each year to invest in continued education and personal development
  • Up to $900 each year or local equivalent for fitness and wellness reimbursement
  • Company-provided phone (varies by country)
  • For HQ in-office employees, a daily lunch stipend, unlimited snacks, and engaging office space in the Financial District
  • Pre-tax commuter benefits (US only)
  • Employer 401K match (US only)

Benefit offerings vary based on country and are subject to change. 

Equal Employment Opportunity

To build technology and products that are used and loved by people and solve real-world problems, we need to build a team with many different perspectives and experiences. We are an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We encourage candidates from all backgrounds to apply. Applicants in need of special assistance or accommodation during the interview process or in accessing our website may contact us at [email protected].

Agency Disclaimer

DriveWealth does not accept agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. DriveWealth is not responsible for any fees related to unsolicited resumes.

Perks & Benefits Extracted with AI

  • Health Insurance: Competitive medical, dental, and vision insurance options
  • Learning Budget: Up to $2,500 or local equivalent each year to invest in continued education and personal development
  • Employer 401K match: Employer 401K match (US only)
  • Paid Parental Leave: Paid parental leave for biological and adoptive parents
  • Paid Time Off: Generous paid time off with observed holidays (varies per country)
  • Wellness Stipend: Up to $900 each year or local equivalent for fitness and wellness reimbursement
Salary
$250,000 – $290,000 per year
Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Principal Data Engineer Q&A's
Report this job
Apply for this job