Senior Data Engineer Health - ACX

Overview

Our vision is to transform data into value for everyone. Our data products and analytical services enable marketers to recognize, better understand, and then deliver highly applicable messages to consumers across any available channel. Our solutions enable true people-based marketing with identity resolution and rich descriptive and predictive audience segmentation. We are seeking a Senior Data Engineer with a versatile skill set to undertake data engineering efforts to build the next-generation ML infrastructure for our business.

As part of the Data Science and Analytics Team, the Senior Data engineer will partner with Data Scientists and work hands-on with Big Data technologies and build a scalable infrastructure to support development of machine learning based Audience Propensity Models and solutions for our domestic and global businesses. The Senior Data engineer’s responsibilities include collaborating with internal and external stakeholders to identify data ingestion, processing, ETL, data warehousing requirements and developing appropriate solutions using modern data engineering tools in cloud. We want this person to help us build a scalable data lake and EDW using modern tech stack from the ground up. Success in this role comes from combining a strong data engineering background with product and business acumen to deliver scalable data pipeline and database solutions that can enable & support a high-performance, large-scale modeling infrastructure. The Senior Data Engineer will be a champion of the latest Cloud database technologies & data engineering tools and will lead by example in influencing adoption and migration to the new stack.

Key Responsibilities

• Partner with ML Architects, Data scientists to drive POCs to build a scalable, next generation model development, model management and governance infrastructure in Cloud
• Be a thought leader and champion for adoption of new cloud-based database technologies and enable migration to new cloud-based modeling stack
• Collaborate with other data scientists and team leads to define project requirements & build the next generation data source ingestion, ETL, data pipelining, data warehousing solutions in Cloud
• Build data-engineering solutions by developing strong understanding of business and product data needs.
• Managing environment security permissions and enforcing role based compliance
• Build expert knowledge of the various data sources brought together for audience propensities solutions – survey/panel data, 3rd-party data (demographics, psychographics,lifestyle segments), media content activity (TV, Digital, Mobile), and product purchase or transaction data and develop solutions for seamless ingestion and process of the data • Resolves defects/bugs during QA testing, pre-production, production, and post-release patches.
• Contributes to the design and architecture of services across the data landscape
• Participation in development of the integration team, contributing to reviews of methodologies, standards, and processes.
• Comprehensive internal documentation of designs and service components

Requirements

• Background in data pipelining, warehousing, ETL development solutions for data science and other Big Data applications
• 5 years of Snowflake Expertise – Strong experience developing data engineering/ETL/Dataware housing solutions
• 5 years of experience with distributed, columnar and/or analytic oriented databases or distributed data processing frameworks.
• Minimum of 5 years of experience with Cloud databases –Snowflake, Azure SQL database, AWS Redshift, Google Cloud SQL or similar. Experience with NoSQL databases such as mongoDB, Cassandra or similar
• Minimum of 5 years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, data lake and data warehouse solutions
• Minimum of 5 years of hands-on experience in Big Data technologies such as Hadoop, Spark, PySpark, Spark/SparkSQL, Hive, Pig, Oozie and streaming technologies such as Kafka, Spark Streaming Ingestion API, Unix shell/Perl scripting etc.
• Strong programming skills using Java, Python, PySpark, Scala or similar
• 5 years of experience with public cloud architecture, pros/cons, and migration considerations.
• 5 years of Experience with container-based application deployment frameworks (Kubernetes, Docker, ECS/EKS or similar)
• Experience with Data Visualization tools such as Tableau, Looker or similar
• Outstanding troubleshooting, attention to detail, and communication skills (verbal/written) in a fast-paced setting.
• Bachelor’s degree in Computer Science or relevant discipline or 7+ years of relevant work experience.
• Solid communication skills: Demonstrated ability to explain complex technical issues to technical and non- technical audiences.
• Strong understanding of the Software design/architecture process.
• Experience with unit testing and data quality checks.

What will set you apart:

• Snowflake and databricks certification will be a plus
• Ability to work in white space and be able to develop solutions independently.
• Prior experience with Cloud based ETL tools such as AWS Glue, AWS Data pipeline or similar
• Experience with building real-time and streaming data pipelines a plus
• Experience with MLOps tools such as Apache MLFlow/KubeFlow is a plus
• Exposure to E2E ML platform such as AWS Sagemaker, Azure ML studio, Google AI/ML, Datarobot, Databricks or similar a plus
• Experience with ingestion, processing and management of 3rd party data

About KINESSO 

KINESSO is a technology-driven performance marketing agency within IPG Mediabrands, providing actionable growth through optimization, analytics, AI, and experimentation. With a blend of performance marketing and data technology, KINESSO empowers clients to unlock the full potential of their consumer insights. As a unified entity composed of Matterkind, Reprise, and Kinesso, we are a global leader with over 6,000 employees operating in more than 60 countries. Learn more at www.KINESSO.com.

Why Join Us?

At KINESSO, we value trust, freedom, and ownership. We offer flexible working hours, allowing employees to manage their time effectively. We believe in the power of productivity, ability, and attitude, and offer a unique opportunity to shape the future of a rapidly growing organization.