Take ownership of the technical aspects of implementing data pipeline & migration requirements, ensuring that the platform is being used to its fullest potential through designing and building applications around business stakeholder needs.
Interface directly with stakeholders to gather requirements and own the automated end-to-end data engineering solutions.
Implement data pipelines to automate the ingestion, transformation, and augmentation of both structured, unstructured, real time data, and provide best practices for pipeline operations
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
Troubleshoot and remediate data quality issues raised by pipeline alerts or downstream consumers.
Implement Data Governance best practices. Comprehensive knowledge of Functional and technical impact analysis.
Provide advice and ideas for technical solutions and improvements to data systems
Create and maintain clear documentation on data models/schemas as well as transformation/validation rules
Implement tools that help data consumers to extract, analyse, and visualize data faster through data pipelines
Leading the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for batch ETL's.
Work directly with our internal product/technical teams to ensure that our technology infrastructure is seamlessly and effectively integrated Migrate current data applications & pipelines to Cloud (AWS) leveraging PaaS te
7 to 12+ years of hands-on experience in SQL database design, data architecture, ETL, Data Warehousing, Data Mart, Data Lake, Big Data, Cloud (AWS) and Data Governance domains.
Hudson Manpower Inc. specializes in recruitment and project staffing for the Oil, Gas, Petrochemical, Power Plant, and Construction industries, supplying quality manpower to reduce training costs and bridge the gap between employers and employees.
Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!
Be the first to apply. Receive an email whenever similar jobs are posted.
Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.
Head of Human Resources Q&A's