article thumbnail

The Dark Side of Product KPI

Oren Steinberg

How to set product KPI without being limited by data? Why do we base product KPI on data to begin with . Product KPI is defined so we can measure how well the new feature works or resolve an AB testing. Defining product KPI based on existing data is like looking for the solution under spotlight.

KPI 64
article thumbnail

Operationalize Getting Insights from Metrics: Tips for Product People

The Product Coalition

A useful approach to providing clear business context is to build and maintain a KPI Tree, which is an easy-to-understand map of all the key KPIs rolled up from the lowest level to the top-line metrics (e.g. re-usable) and backed by tests. Tests should be run whenever the tables update.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

What’s the Definition of Success for a Success Metric?

The Product Coalition

Photo by Javier Allegue Barros on Unsplash “PM”ing your KPIs In Beyond Vanity Metrics , I issued a call to action to pick a KPI that is unmeasurable. By my personal definition of better. But let’s test whether these metrics meet their own goals as stated above. You can only test what you have decided to implement.

article thumbnail

The Dark Side of Product KPIs

The Product Coalition

Why can data generated KPIs limit your product? Product KPI is defined so we can measure how well the new feature works or resolve an AB testing. That’s why it is only natural that when we come to set the KPI for a new product or feature, we start by looking at the data. That helps us to define the product KPI.

KPI 60
article thumbnail

Offline Experimentation in Machine Learning Teams

The Product Coalition

It is both quicker and cheaper than doing A/B testing, and often gives more (and different) information than UX Research studies. It allows teams to align early on a given problem to solve, hypothesis to test, and a set of metrics to evaluate success. If a 10% offline increase in a KPI only translates to a 0.1%

article thumbnail

Davide Vitiello – Focus vs Product Team Structures

Mind the Product

Davide puts forward a simple definition of focus: “To do less activity in parallel and do all activities in the same direction.” ” Here he talks about the ideas of A/B testing and reverse A/B testing. 3) Embed the Mission and KPI Within the Teams. The What and Why of Focus. Maximize impact.

KPI 91
article thumbnail

Optimizing internal product communications

Folding Burritos

How’s that KPI doing?”. ” Including this type of questions into our “catalog” of internal communications definitely makes aligning different teams across the organization easier. “Why are we working on this?”. Why is that taking so long?”. “Is Is that thing fixed already?”. How long will we be down for?”.