Test-Driven Product Management at an Early-Stage Startup


Today, it’s common to hear people talk about testing early-stage products like it’s a bad thing. You can’t build a better product just by A/B testing button colors, no. Clarify and test your company’s values. You do this through testing.

Getting Better At Product Testing

The Product Coalition

I’m starting a short series on testing over the next few months. The first few questions are some of the key questions that I’ve been asked regularly around best practices for testing: [link] What’s the most effective method for testing products?

Have a Clear Hypothesis and Focus Area Before You Start A/B Testing

The Product Coalition

[link] I’m continuing with my video series on A/B testing. Is there anything that should be done before you can start A/B testing? Before you can start A/B testing, it’s really important that you have a clear understanding of what you’re actually testing.

Establishing a Culture of A/B Testing

The Product Coalition

[link] I’m continuing some short videos about A/B Testing and how to improve it at your company. The transcripts for the video are below: How many rounds of testing should a company plan for before they are successful? I never advise companies that they need to plan for a certain number of rounds of testing. One is it’s really important to have a system in place that enables your company to run a high volume of tests. Most times a test has a 10–20% success rate.

Startup Dust

Oren Steinberg

The biggest asset any startup has is the time of its entrepreneurs and key talents. The success or failure of the startup often hinges on their ability to focus their efforts on the critical path at any given time. As the startup grows and faces scalability and growth challenges the issue of focus becomes even more challenging. 2 unexperienced entrepreneurs have a great idea for their first startup. The post Startup Dust appeared first on Oren Steinberg - blog.

The Lean Startup Trap

The Product Coalition

The Big 3 ‘Lean Startup’ Mistakes Companies Still Make Are you spending a ridiculous amount of time working on a product, and getting nowhere? If this sounds like you, you’re probably stuck in the lean startup trap. Lean startup sucks at discovering your customer needs.

Value Based Pricing for Saas Startup

The Product Coalition

Value Based Pricing for SaaS Startup We don’t make movies to make money, we make money to make more movies.– your startup won’t last long without monetization. startup pricing-strategy saas value-based-pricing saas-marketing

Why an MVP Needs to Be a Product and Not Just a Test

280 Group

It has been popularized by Lean Startup for nearly a decade. Although Eric Ries, the founder of Lean Startup, did not invent the term MVP, I credit him for its adoption into the standard lexicon of product teams. Interestingly, during the early days of Lean Startup, the whole.[continue

How Startups Can Do Better Cohort Analyses · Philosophical Hacker

The Product Coalition

For example, Eric Reis, in The Lean Startup , recounts how cohort analysis helped his startup realize that their efforts at improving their product weren’t working: Thanks to the power of cohort analysis, we could not blame this failure on…external market conditions, or any other excuse.

How important is product management for your startup?

The Product Coalition

So the product management is the only one function that is offering business startups the significant advantages such as in setting up business objectives, targeting markets to deliver measurable products and services, and prioritizing the goals of startups.

Most startups don’t starve, they drown. Here is why, and how to survive.

The Product Coalition

Startups don’t starve, they drown. It was 2010 when I watched the online stream of the Startup Lessons Learned conference, initiated by Eric Ries. At some stage the now famous Shawn Carolan quote came up: Startups don’t starve, they drown. Most startups don’t starve, they drown.

Disney's PM Director on Lean Startup and the Media Industry

PMLesson's Ace the PM Interview

In this Path to PM blog post, Sanaz and I discuss applying lean startup principles to media products. You’ve moved quite a bit in your PM journey, from Zynga to the first PM at a startup, and now you’re a PM at Disney. Zynga is also very data driven and I spent about 30% of my time testing and reporting on the performance of the features I was building. The most important lesson I have learned as a startup PM is to measure twice and cut once.

How to Communicate When You’re Founding a Startup

Mind the Product

As such, for their team of startup experts, communication is absolutely key. Once you’ve got your startup or project up and running, resist the urge to ‘get building’ and take a minute to speak to people.

Passing the GDPR test; or how we learned to stop worrying and love the EU

Inside Intercom

The EU was kind enough to provide a stress test for our email delivery pipeline during the GDPR surge on a scale that I doubt our engineering team as a whole would have agreed to, and we passed. Startups Uncategorized email Engineering european regulations gdpr

How startups die from their addiction to paid marketing

Andrew Chen

Many of the biggest implosions in recent history – especially ecommerce – have been due to startups getting addicted to paid marketing while fooling themselves on Customer Acqusition Costs. [Originally tweetstormed at @andrewchen , Follow me for more!].

4 Key Data Points A/B Testing Reveals

Generation Focus

A/B testing is a crucial element in any startup foundation. Six months later an engineer saw the project, and noticing the low cost of writing the code for it, decided to do a bit of A/B testing. Thanks to the test, Microsoft went on to earn massive returns.

How we get our product just right with focus group tests

The Product Coalition

Pexels Essence of the Article: Focus group tests can give valuable customer feedback during development stage. One of the methods to get structured and usable feedback are focus group test. A successful focus group test leans on three core activities: 1.

9 essential sales steps you need to grow your SaaS startup

Inside Intercom

In the early stages of most SaaS startups’ lives, the CEO or founder often acts as the initial head of sales. Are they keen to test it out? The post 9 essential sales steps you need to grow your SaaS startup appeared first on Inside Intercom.

Consumer startups are awesome, and here’s what I’m looking for at a16z (70 slide deck)

Andrew Chen

Dear readers, I’m often asked- so what kind of startups are you investing in at Andreessen Horowitz? The most exciting new technologies coming around the corner, and how to evaluate them for producing new startups. Above: New technology has always captivated consumers!

The Testing Mindset – How to Find Product/Market fit

Mind the Product

You have to invest skillfully to test these assumptions. The smarter your investment in testing, the better your chances of product success. Here’s what we’ve learned based on our experience of adopting a testing mindset and seeing your way through innovative product development. Instead, many small tests have to be carried out in order to find your way towards product/market fit. And the less money you need to test an assumption the more bets you can make.

Startups are cheaper to build, but more expensive to grow – here’s why

Andrew Chen

Startups should be getting cheaper to build. Some providers, such as Microsoft, have started providing their services free to startups, in the hope of turning them into paying customers as they grow. Startups are raising more money to get to traction.

Startups and big cos should approach growth differently (Video)

Andrew Chen

I recently did a video interview on the topic of how your growth strategy changes from being a small startup versus becoming a larger company. New startups have to focus on underrated acquisition channels for early growth efforts [0:00]. Any small channels that allow interaction with the audience, will allow you to do testing. Test for the responsiveness of your audience. Scale up to the next, bigger channels, by starting with tests to optimize your performance [3:58].

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included!

Andrew Chen

Growing startups and evaluating startups share common skills. Earlier this year, I joined Andreessen Horowitz as a General Partner, where I focus on a broad spectrum of consumer startups: marketplaces, entertainment/media, and social platforms. Startups aren’t spreadsheets.

Product to Product: Ellen Chisa on how product prepares you to be an early-stage startup founder


Most recently, Ellen left Lola to launch her own startup that will make it possible to build a complete scalable app in an afternoon. While her startup is still in very early stages, Ellen is completely in founder mode. Latif: I would love to hear a little bit about your new startup.

Betterment Tested Three Performance Management Systems So You Don't Have To

First Round Review

As Founder and CEO of Betterment, Jon Stein realized startups can't just establish one way to measure employee performance — they have to continually iterate as they grow.

Conservation of Intent: The hidden reason why A/B tests aren’t as effective as they look

Andrew Chen

OK, this is an infuriating startup experience: You ship an experiment that’s +10% in your conversion funnel. This is why you can’t add up your A/B test results. When a +10% isn’t really a +10%.

8 Keys to Getting Started

Product Management Lessons from the Trenches

all the ingredients of a great startup experience! In a pay-it-forward kind of way, my team and I are sharing what we have learned to-date in a series of posts that hopefully will be useful to you whether you are at a startup or a larger organization.

B2C 195

TEI 080: Innovate like a startup – with Michael Docherty - The Everyday Innovator – Resources for Product Managers and Innovators

Product Innovation Educators

When established companies decide they need to be more innovative, they often talk in terms of acting more like a startup. But acting like a startup is much more challenging in reality, especially for larger organizations. Instead, established companies can partner with startups.

What is a Product?

The Product Coalition

It has a strong suite of automated regression tests. It has a strong suite of automated regression tests It’s always amazed me how changing a feature in one place manages to impact features on the other end of the product. Scalability, Measurability, Deployability.

Podcast: Too Many Product Managers with Ken Norton

Mind the Product

When the opportunity came up to chat with him, we wanted to cover something new – the idea that startups are hiring too many product managers. Should you go work at a startup? Lily enjoys working as a consultant product manager with early stage and growing startups and as a mentor to other product managers. Lily has spent 13 years in the tech industry working mainly with startups in the SaaS and mobile space. Should you go work at a startup?

Mastering Design Sprints – Kai Haley on The Product Experience

Mind the Product

Lily enjoys working as a consultant product manager with early stage and growing startups and as a mentor to other product managers. Lily has spent 13 years in the tech industry working mainly with startups in the SaaS and mobile space.

Product Operations Dashboard

Product Management Lessons from the Trenches

Normally you may have different tools for messaging, attribution, a/b testing, etc that generate critical data points and you have to make sure all this data is either in the same repository and/or connected. product-management product-strategy analytics startup growth

Events 212

What Should Product Managers Do When Their Main Product Fails?

The Accidental Product Manager

They are a Silicon Valley startup that attracted a lot of attention. They claimed that they had invented a product that with just a minute amount of blood from an individual could run a large number of health tests. This blood testing device was called Edison. A report in the Wall Street Journal newspaper brought up some concerns about the accuracy of the Edison testing device. Theranos is in bad shape, but they have introduced a new product Image Credit: Wikipedia.

Square’s Rohini Pandhi on spotting and solving customer problems

Inside Intercom

She’s worked in product from early-stage startups all the way up to publicly traded companies like Rackspace and Square, a company with the sensitive task of handling customers’ money. If we’re doing an A/B test, our analyst is heavily involved in looking at that data.

Auckland, 28-29 August: Scaling SaaS

Mironov Consulting

Callaghan Innovation , New Zealand’s innovation agency, is sponsoring a two-day conference for NZ startups and tech firms. Day Two is all workshops, including Rich’s session on customer discovery and testing product concepts before building them.

9 Startups to Help You Build Your Virtual Economy

Sachin Rekhi

The great news is there are a variety of startups out there waiting to help you! Given that there are already so many different offer providers and more coming, a solution is needed to easily A/B test them to select which work best for your site in each country. Since every offer provider will tell you that they are confident they are better than their competition, the only way to know for sure is to test and find out!

How The Lean Principle Became Profound · Philosophical Hacker

The Product Coalition

Eric Reis’ The Lean Startup and Marty Cagan’s Inspired both come to mind. Because it’s fundamental to all the lean and lean-like ideas in much of the content on startups and product management, let’s call it “the lean principle.” Notes Eric Reis, The Startup Way , 22–23 (emphasis mine).

Books 85

Product Growth = People Growth by Nilan Peiris

Mind the Product

If you’re simply testing everything you possibly could, that’s a sign that you don’t understand your customers. Product Management Conference Product Management Skills Product Strategy #Mtpengage Kpis mission-driven startups mtpengage manchester Problem-Solving TransferWise

Hypermetricemia: A dangerous product disease that you can avoid

The Product Coalition

A/B test it. Today the universally accepted model for building products is Build, Test, Learn, Scale. Our current model of building products (Build, Test, Learn, Scale), misses an important first step: defining the change you want to create in this world.

Vision 104

Lessons in Product Management.

The Product Coalition

It is the place to learn about cool tech products that people are creating and testing. There are so many people that want to start a startup and whether or not they want to quit their jobs, they never begin.”?—?Dalton side-project startup product-management motivation product-hunt