Product Manager - Experiments Team

AI overview

Lead the evolution of a critical internal experimentation platform to validate hypotheses and support decision-making at scale for a company focused on metrics.

About You

We are looking for a Product Manager to lead Constructor’s internal experimentation platform — a critical foundation for how we validate hypotheses, improve customer key business metrics, and make product decisions at scale.

You are comfortable operating in highly technical, data-heavy environments and enjoy working at the intersection of product, experimentation, analytics, and engineering. At the same time, you are able to clearly explain the value of experimentation and its outcomes to customer-facing teams and, when needed, directly to retailers, translating complex results into narratives that build trust and confidence.

You are equally effective partnering with ML and engineering teams on complex systems as you are collaborating with analysts, customer success, and product leaders to ensure that experiment-driven improvements are visible, understandable, and meaningful for customers.

You thrive in environments with many stakeholders, diverse expectations, and occasional ambiguity. Rather than being slowed down by this, you bring structure, prioritization, and clarity, helping teams move faster while maintaining high standards of rigor and reliability.

You believe experimentation is not just a methodology, but a product capability – the one that should be scalable, automated, and genuinely enjoyable to use, both internally and in how its impact is perceived by customers.

About Us

Constructor powers product search and discovery for some of the largest retailers in the world. We serve billions of requests every week, and you’ve probably seen our results somewhere and used our product without knowing it. We differentiate ourselves by focusing on metrics over features, and reinventing search and discovery from the ground up as a machine learning challenge with the specific goal of improving metrics like revenue. We’re approximately doubling year over year despite the market slow down and have customers in every eCommerce vertical. We’re a passionate team of technologists who love solving problems and want to make our customers’ and coworkers’ lives better. We value empathy, openness, curiosity, continuous improvement, and are excited by metrics that matter. We believe that empowering everyone in a company to do what they think is best can lead to great things.

We’re a passionate team of technologists who love solving problems and want to make our customers’ and coworkers’ lives better. We value empathy, openness, curiosity, continuous improvement, and are excited by metrics that matter. We believe that empowering everyone in a company to do what they think is best can lead to great things.

About the Position

As a Product Manager for the Internal Experiments Platform, you will:

  • Own the end-to-end evolution of the Constructor internal experimentation platform, enabling scalable, rigorous, and efficient hypothesis testing across teams.
  • Develop platform capabilities that connect internal experiments to customer-visible value, ensuring improvements and revenue impact are clearly understood, trusted, and communicated at scale.
  • Build and automate experimentation workflows end-to-end, reducing manual effort for analysts, product teams, and Customer Success, including one-click reporting and customer-facing outputs.
  • Partner closely with Data Science, Machine Learning, Engineering, Product, and Customer Success teams to design experimentation frameworks, evaluation logic, and certification flows.
  • Drive adoption of the experimentation platform across the organization, ensuring it becomes the default, trusted tool for running experiments and making decisions.
  • Balance short-term platform improvements with long-term experimentation strategy, aligning technical investments with customer impact and business priorities.
  • Continuously improve experimentation quality, coverage, and reliability by strengthening methodology, metrics, data quality, and review processes.
  • Act as a thought partner to other product teams, applying experimentation expertise to help shape high-impact, customer-loved features.

Requirements

  • 4+ years of experience in Product Management, ideally in data-heavy, technical, or platform-oriented environments.
  • Strong understanding of experimentation concepts, analytics, metrics, and data-driven decision-making (hands-on statistical expertise is not required, but conceptual fluency is).
  • Proven ability to work effectively with engineering, ML, and data science teams on complex systems and trade-offs.
  • Demonstrated experience managing multiple stakeholders with diverse and sometimes conflicting priorities, and aligning them around a shared strategy.
  • Strong communication skills, with the ability to translate complex technical topics into clear product decisions and narratives.
  • Comfort operating in ambiguity, with the ability to bring structure, prioritization, and momentum.
  • Experience working in environments where experimentation, measurement, or optimization play a central role.
  • Nice to have: experience building or contributing to an experimentation platform or internal analytics tooling.
  • Nice to have: background in data-first product teams, experimentation-heavy organizations, or optimization-focused domains.

Benefits

  • 🏝️ Unlimited vacation time - we strongly encourage all of our employees take at least 3 weeks per year
  • 💰 A competitive compensation package including stock options
  • 👨‍⚕️ Company sponsored US health coverage (100% paid for employee)
  • 🌎 Fully remote team - choose where you live
  • 🛋️ Work from home stipend! We want you to have the resources you need to set up your home office
  • 💻 Apple laptops provided for new employees
  • 🧑‍🎓 Training and development budget for every employee, refreshed each year
  • 👪 Parental leave for qualified employees
  • 🧠 Work with smart people who will help you grow and make a meaningful impact

This position is fully remote - Constructor.io is a remote-first company.

Diversity, Equity, and Inclusion at Constructor

At Constructor.io we are committed to cultivating a work environment that is diverse, equitable, and inclusive. As an equal opportunity employer, we welcome individuals of all backgrounds and provide equal opportunities to all applicants regardless of their education, diversity of opinion, race, color, religion, gender, gender expression, sexual orientation, national origin, genetics, disability, age, veteran status or affiliation in any other protected group. Studies have shown that women and people of color may be less likely to apply for jobs unless they meet every one of the qualifications listed. Our primary interest is in finding the best candidate for the job. We encourage you to apply even if you don’t meet all of our listed qualifications.

Perks & Benefits Extracted with AI

  • Health Insurance: Company sponsored US health coverage (100% paid for employee)
  • Home Office Stipend: Work from home stipend! We want you to have the resources you need to set up your home office
  • Learning Budget: Training and development budget for every employee, refreshed each year
  • Paid Parental Leave: Parental leave for qualified employees
  • Paid Time Off: Unlimited vacation time - we strongly encourage all of our employees take at least 3 weeks per year

Constructor Search improves ecommerce revenue and relevance. Deliver superior onsite and in-app search experiences with AI, NLP, data and personalization. AI-first site search that increases conversions and revenue. Constructor.io

View all jobs
Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Product Manager Q&A's
Report this job
Apply for this job