As a Senior Data Engineer, you’ll be part of a team of smart, highly skilled engineers who are proud to partner with some of the world’s leading retailers on challenging, cutting-edge, data driven solutions - all powered by our exceptional technology and people.
Our core technologies currently include Python, Databricks and Azure, and we continue to adopt the best of breed in modern data stack technologies. Our team is co-located and agile, with a central hub in Toronto.
Responsibilities:
- Responsible for leading data onboarding workstreams with new customers / pilots / POCs.
- Work directly with customers’ data teams on data interfaces, specifications and integration projects.
- Design, implement and maintain performance of reliable data pipelines and interfaces that feed various analytics applications.
- Design, develop, and maintain ETL from various data streams via multiple consumption methods (e.g. Blob, Kafka, SFTP, SQL connectors, REST API).
- Design, development, and implementation of new and existing data processing solutions; enabling teams to be more efficient and effective in analyzing data and getting to insights faster.
- Create, implement, and maintain data transformation and data validation processes.
- Perform data validation activities, normalize and explore datasets, investigate and solve data related problems.
- Support data architecture efforts in support of key analytics innovations that involve multiple internal and/or external (client) stakeholders.
- 5+ years of experience working as a data engineer in ETL and data integration.
- 5+ years of experience in client facing consultation role, project management expertise, managing customer expectations and deadlines and excellent communication skills.
- Strong Python – Pyspark development experience.
- Strong SQL with experience in querying large, complex data sets.
- Databricks, Spark, Airflow, and Scala development experience.
- Experience working with retailer and supplier analytics data.
- Experience with Cloud platforms – Azure strongly preferred.
- Experience in data integration design, development and maintenance, data lakes/hubs.
- Result-driven, pragmatic, and innovative.
- Experience with developing REST APIs and microservices.
- Computer Science, Engineering, Information Systems, Statistics, Math degree (or equivalent combination of skill and experience).
- Experience with SingleStore, Snowflake, BI tools i.e. PowerBI – nice to have.
Canada Benefits
- Extended Health and Dental Care
- Health and/or Personal Spending Account
- Basic Life Insurance
- Optional Life Insurance, AD&D, and Critical Illness
- Disability Insurance
- Defined Contribution Pension Plan (with company matching contributions)
- Optional RRSP and TFSA
- Tuition Reimbursement
Our Benefits
- Flexible working environment
- Volunteer time off
- LinkedIn Learning
- Employee-Assistance-Program (EAP)
Our Benefits
- Flexible working environment
- Volunteer time off
- LinkedIn Learning
- Employee-Assistance-Program (EAP)
About NIQ
NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.
For more information, visit NIQ.com
Want to keep up with our latest updates?
Follow us on: LinkedIn | Instagram | Twitter | Facebook
Our commitment to Diversity, Equity, and Inclusion
NIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class. Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide. Learn more about how we are driving diversity and inclusion in everything we do by visiting the NIQ News Center: https://nielseniq.com/global/en/news-center/diversity-inclusion
