Senior Data Engineer

Role Overview

We are seeking a highly skilled Senior Data Engineer with strong expertise in SQL development, ETL processes, database optimization, and enterprise data integration. The ideal candidate has hands-on experience working with large datasets, optimizing performance, and enabling data flows across heterogeneous systems and platforms.

Key Responsibilities

• Design, develop, and optimize robust data pipelines and ETL workflows.

• Write complex SQL queries, stored procedures, and performance-optimized transformations across large datasets.

• Develop and maintain data views, schemas, indexing strategies, and database objects for optimal query execution.

• Lead and execute data migration initiatives across heterogeneous systems (on-prem, cloud, legacy, modern).

• Implement data transformation logic to support business rules, data enrichment, cleansing, and aggregation.

• Integrate external data sources through RESTful APIs, including authentication, pagination, error handling, and ingestion orchestration.

• Collaborate with cross-functional teams to ensure data models, pipelines, and integrations support analytical and operational requirements.

• Ensure data quality, consistency, reconciliation, and validation across environments.

• Participate in cut-over planning, testing cycles, and controlled deployment processes.

• Contribute to data governance, metadata management, and technical documentation.

Required Skills & Experience

Strong SQL Proficiency (6–7 years)

• Expert in complex SQL queries (joins, subqueries, window functions, stored procedures).

• Hands-on experience with performance tuning and handling large datasets.

SQL Optimization (3+ years)

• Demonstrated experience optimizing database queries and improving performance across large-scale data environments.

ETL Development (6–7 years)

• Experience with ETL tools such as Informatica, Datastage, or ODI (any is acceptable).

Database Engineering (6–7 years)

• Must have: PostgreSQL and/or Oracle experience including:

  • schema design

  • views

  • indexing

  • stored procedures

  • database optimization

Data Migration (5+ years)

• Experience migrating data between heterogeneous systems (on-prem to cloud, legacy to modern).

• Involvement in validation, reconciliation, testing, and cut-over planning.

Data Transformation (5+ years)

• Experience implementing complex transformation rules with focus on data consistency, cleansing, enrichment, and aggregation.

REST API Integration (3+ years)

• Experience consuming REST APIs for data ingestion.

• Ability to handle authentication (OAuth/API Keys), pagination, rate limits, JSON parsing, and error handling.

• Bonus: Exposure to building lightweight REST APIs to expose curated datasets.