Responsibilities:
Assemble large, complex data that meet functional/non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing transformation for greater scalability, etc.
Use the infrastructure/services required for optimal extraction, transformation, and loading of data from a wide variety of data sources using GCP services.
Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data requirement needs.
Requirements:
Bachelor’s degree with Minimum 1.5+ years of experience working in globally distributed teams successfully
Must have experience working on Python and data handling frameworks(spark, beam, etc)
Apply experience with cloud storage and computing for data pipelines in GCP (GCS, BQ, composer, etc)
Write pipelines in Airflow to orchestrate data pipelines
Experience handling data from 3rd party providers is a great plus: Google Analytics, Google Ads etc.
Experience in manipulating, processing and extracting value from large disconnected datasets.
Experience with software engineering practices in data engineering, e.g. release management, testing, etc and corresponding tooling (dbt, great expectations, …)
Basic knowledge on dbt is a good to have
Knowledge on data privacy and security
Excellent verbal and written communication skills
Perks:
● Monthly long weekends — every third Friday off
● Wellness reimbursement to support your health and balance
● Paid parental leave
● Remote-first with flexibility and trust
● Work with a world-class data and marketing team inside a globally recognized brand
Forbes Advisor is looking for a Data Research Engineer - Data Extraction to join the Forbes Marketplace Performance Marketing team with a focus on supporting one of Forbes business verticals. If you're looking for challenges and opportunities similar to those of a start-up, with the benefits of an established, successful company read on.We are an experienced team of industry experts dedicated to helping readers make smart decisions and choose the right products with ease. Marketplace boasts decades of experience across dozens of geographies and teams, including Content, SEO, Business Intelligence, Finance, HR, Marketing, Production, Technology and Sales. The team brings rich industry knowledge to Marketplace’s global coverage of consumer credit, debt, health, home improvement, banking, investing, credit cards, small business, education, insurance, loans, real estate and travel.The Data Extraction Team is a brand new team who plays a crucial role in our organization by designing, implementing, and overseeing advanced web scraping frameworks. Their core function involves creating and refining tools and methodologies to efficiently gather precise and meaningful data from a diverse range of digital platforms. Additionally, this team is tasked with constructing robust data pipelines and implementing Extract, Transform, Load (ETL) processes. These processes are essential for seamlessly transferring the harvested data into our data storage systems, ensuring its ready availability for analysis and utilization.A typical day in the life of a Data Research Engineer will involve acquiring and integrating data from various sources, developing and maintaining data processing workflows, and ensuring data quality and reliability. They collaborate with the team to identify effective data acquisition strategies and develop Python scripts for data extraction, transformation, and loading processes. They also contribute to data validation, cleansing, and quality checks. The Data Research Engineer stays updated with emerging data engineering technologies and best practices.
Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!
Be the first to apply. Receive an email whenever similar jobs are posted.
Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.
Data Engineer Q&A's