Test-Driven Product Management at an Early-Stage Startup


Today, it’s common to hear people talk about testing early-stage products like it’s a bad thing. You can’t build a better product just by A/B testing button colors, no. Clarify and test your company’s values. You do this through testing.

Getting Better At Product Testing

The Product Coalition

I’m starting a short series on testing over the next few months. The first few questions are some of the key questions that I’ve been asked regularly around best practices for testing: [link] What’s the most effective method for testing products?

Startup Dust

Oren Steinberg

The biggest asset any startup has is the time of its entrepreneurs and key talents. The success or failure of the startup often hinges on their ability to focus their efforts on the critical path at any given time. As the startup grows and faces scalability and growth challenges the issue of focus becomes even more challenging. 2 unexperienced entrepreneurs have a great idea for their first startup. The post Startup Dust appeared first on Oren Steinberg - blog.

The Lean Startup Trap

The Product Coalition

The Big 3 ‘Lean Startup’ Mistakes Companies Still Make Are you spending a ridiculous amount of time working on a product, and getting nowhere? If this sounds like you, you’re probably stuck in the lean startup trap. Lean startup sucks at discovering your customer needs.

Nine companies share 30+ best practices for creating embedded analytics products

and tested way to quantify the potential of the product is to. case like a startup with lean startup concepts. experience working with our clients helped make our testing. during your design, implementation, beta testing, launch, and production use?

Value Based Pricing for Saas Startup

The Product Coalition

Value Based Pricing for SaaS Startup We don’t make movies to make money, we make money to make more movies.– your startup won’t last long without monetization. startup pricing-strategy saas value-based-pricing saas-marketing

How Startups Can Do Better Cohort Analyses · Philosophical Hacker

The Product Coalition

For example, Eric Reis, in The Lean Startup , recounts how cohort analysis helped his startup realize that their efforts at improving their product weren’t working: Thanks to the power of cohort analysis, we could not blame this failure on…external market conditions, or any other excuse.

Disney's PM Director on Lean Startup and the Media Industry

PMLesson's Ace the PM Interview

In this Path to PM blog post, Sanaz and I discuss applying lean startup principles to media products. You’ve moved quite a bit in your PM journey, from Zynga to the first PM at a startup, and now you’re a PM at Disney. Zynga is also very data driven and I spent about 30% of my time testing and reporting on the performance of the features I was building. The most important lesson I have learned as a startup PM is to measure twice and cut once.

How important is product management for your startup?

The Product Coalition

So the product management is the only one function that is offering business startups the significant advantages such as in setting up business objectives, targeting markets to deliver measurable products and services, and prioritizing the goals of startups.

Most startups don’t starve, they drown. Here is why, and how to survive.

The Product Coalition

Startups don’t starve, they drown. It was 2010 when I watched the online stream of the Startup Lessons Learned conference, initiated by Eric Ries. At some stage the now famous Shawn Carolan quote came up: Startups don’t starve, they drown. Most startups don’t starve, they drown.

Passing the GDPR test; or how we learned to stop worrying and love the EU

Inside Intercom

The EU was kind enough to provide a stress test for our email delivery pipeline during the GDPR surge on a scale that I doubt our engineering team as a whole would have agreed to, and we passed. Startups Uncategorized email Engineering european regulations gdpr

How to Communicate When You’re Founding a Startup

Mind the Product

As such, for their team of startup experts, communication is absolutely key. Once you’ve got your startup or project up and running, resist the urge to ‘get building’ and take a minute to speak to people.

4 Key Data Points A/B Testing Reveals

Generation Focus

A/B testing is a crucial element in any startup foundation. Six months later an engineer saw the project, and noticing the low cost of writing the code for it, decided to do a bit of A/B testing. Thanks to the test, Microsoft went on to earn massive returns.

How startups die from their addiction to paid marketing

Andrew Chen

Many of the biggest implosions in recent history – especially ecommerce – have been due to startups getting addicted to paid marketing while fooling themselves on Customer Acqusition Costs. [Originally tweetstormed at @andrewchen , Follow me for more!].

9 essential sales steps you need to grow your SaaS startup

Inside Intercom

In the early stages of most SaaS startups’ lives, the CEO or founder often acts as the initial head of sales. Are they keen to test it out? The post 9 essential sales steps you need to grow your SaaS startup appeared first on Inside Intercom.

Consumer startups are awesome, and here’s what I’m looking for at a16z (70 slide deck)

Andrew Chen

Dear readers, I’m often asked- so what kind of startups are you investing in at Andreessen Horowitz? The most exciting new technologies coming around the corner, and how to evaluate them for producing new startups. Above: New technology has always captivated consumers!

The Testing Mindset – How to Find Product/Market fit

Mind the Product

You have to invest skillfully to test these assumptions. The smarter your investment in testing, the better your chances of product success. Here’s what we’ve learned based on our experience of adopting a testing mindset and seeing your way through innovative product development. Instead, many small tests have to be carried out in order to find your way towards product/market fit. And the less money you need to test an assumption the more bets you can make.

Startups are cheaper to build, but more expensive to grow – here’s why

Andrew Chen

Startups should be getting cheaper to build. Some providers, such as Microsoft, have started providing their services free to startups, in the hope of turning them into paying customers as they grow. Startups are raising more money to get to traction.

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included!

Andrew Chen

Growing startups and evaluating startups share common skills. Earlier this year, I joined Andreessen Horowitz as a General Partner, where I focus on a broad spectrum of consumer startups: marketplaces, entertainment/media, and social platforms. Startups aren’t spreadsheets.

Startups and big cos should approach growth differently (Video)

Andrew Chen

I recently did a video interview on the topic of how your growth strategy changes from being a small startup versus becoming a larger company. New startups have to focus on underrated acquisition channels for early growth efforts [0:00]. Any small channels that allow interaction with the audience, will allow you to do testing. Test for the responsiveness of your audience. Scale up to the next, bigger channels, by starting with tests to optimize your performance [3:58].

Product to Product: Ellen Chisa on how product prepares you to be an early-stage startup founder


Most recently, Ellen left Lola to launch her own startup that will make it possible to build a complete scalable app in an afternoon. While her startup is still in very early stages, Ellen is completely in founder mode. Latif: I would love to hear a little bit about your new startup.

Betterment Tested Three Performance Management Systems So You Don't Have To

First Round Review

As Founder and CEO of Betterment, Jon Stein realized startups can't just establish one way to measure employee performance — they have to continually iterate as they grow.

Conservation of Intent: The hidden reason why A/B tests aren’t as effective as they look

Andrew Chen

OK, this is an infuriating startup experience: You ship an experiment that’s +10% in your conversion funnel. This is why you can’t add up your A/B test results. When a +10% isn’t really a +10%.

Podcast: Too Many Product Managers with Ken Norton

Mind the Product

When the opportunity came up to chat with him, we wanted to cover something new – the idea that startups are hiring too many product managers. Should you go work at a startup? Lily enjoys working as a consultant product manager with early stage and growing startups and as a mentor to other product managers. Lily has spent 13 years in the tech industry working mainly with startups in the SaaS and mobile space. Should you go work at a startup?

8 Keys to Getting Started

Product Management Lessons from the Trenches

all the ingredients of a great startup experience! In a pay-it-forward kind of way, my team and I are sharing what we have learned to-date in a series of posts that hopefully will be useful to you whether you are at a startup or a larger organization.

B2C 195

What is a Product?

The Product Coalition

It has a strong suite of automated regression tests. It has a strong suite of automated regression tests It’s always amazed me how changing a feature in one place manages to impact features on the other end of the product. Scalability, Measurability, Deployability.

TEI 080: Innovate like a startup – with Michael Docherty - The Everyday Innovator – Resources for Product Managers and Innovators

Product Innovation Educators

When established companies decide they need to be more innovative, they often talk in terms of acting more like a startup. But acting like a startup is much more challenging in reality, especially for larger organizations. Instead, established companies can partner with startups.

Product Operations Dashboard

Product Management Lessons from the Trenches

Normally you may have different tools for messaging, attribution, a/b testing, etc that generate critical data points and you have to make sure all this data is either in the same repository and/or connected. product-management product-strategy analytics startup growth

Events 212

What Should Product Managers Do When Their Main Product Fails?

The Accidental Product Manager

They are a Silicon Valley startup that attracted a lot of attention. They claimed that they had invented a product that with just a minute amount of blood from an individual could run a large number of health tests. This blood testing device was called Edison. A report in the Wall Street Journal newspaper brought up some concerns about the accuracy of the Edison testing device. Theranos is in bad shape, but they have introduced a new product Image Credit: Wikipedia.

Lawrence of Arabia, the Original Agile Disruptor, Had Sore Feet

The Product Coalition

… And what that means for startups and innovators today [We were] just sentient puppets on God’s stage: indeed, our taskmaster was merciless, merciless, so long as our bruised feet could stagger forward on the road … so very brief and sore was life with us. Startups, though, are vaporous?—?they

Agile 95

Dispelling 3 myths stopping B2B Product Managers using B2C product research tactics — Terem…

The Product Coalition

Rather than make large investments based on opinions, they form a hypothesis then get something live that tests that hypothesis as fast as possible. For example, a (fictitious) tech company aiming to disrupt the coffee industry might come up with a new app idea they want you to test.

B2C 85

How The Lean Principle Became Profound · Philosophical Hacker

The Product Coalition

Eric Reis’ The Lean Startup and Marty Cagan’s Inspired both come to mind. Because it’s fundamental to all the lean and lean-like ideas in much of the content on startups and product management, let’s call it “the lean principle.” Notes Eric Reis, The Startup Way , 22–23 (emphasis mine).

Books 85

Square’s Rohini Pandhi on spotting and solving customer problems

Inside Intercom

She’s worked in product from early-stage startups all the way up to publicly traded companies like Rackspace and Square, a company with the sensitive task of handling customers’ money. If we’re doing an A/B test, our analyst is heavily involved in looking at that data.

Auckland, 28-29 August: Scaling SaaS

Mironov Consulting

Callaghan Innovation , New Zealand’s innovation agency, is sponsoring a two-day conference for NZ startups and tech firms. Day Two is all workshops, including Rich’s session on customer discovery and testing product concepts before building them.

Good Products Start With Good Questions

Nir Eyal

Nir’s Note: My friend Jake Knapp just published a fantastic book titled, Sprint: How to Solve Big Problems and Test New Ideas in Just Five Days. The book details a process he and his colleagues at Google Ventures use to quickly go from idea, to prototype, to live test. Building Better Products Design Entrepreneurship product management startup

Books 128

Podcast: Marketplace Thinking and Fur Babies with Christopher Nheu

Mind the Product

His presentation, Product Thinking for Marketplace Startups , does an amazing job of documenting the differences between pipes and platforms, the three fundamental forces of marketplaces, and the specific challenges of catering to customers concerned with the well-being of their fur babies.

B2C 109

Move fast and optimize for the long term

Inside Intercom

The best model is production and the best test cases are your customers. Startups building intercom development Engineering events productivity startups valuesAs a student of engineering you’re incentivised to write a lot and to read a lot.

Optimizely’s Claire Vo on the power of product experimentation

Inside Intercom

It was a classic startup PM role where I was the employee number 13. P is for potential: the potential of the test to increase whatever your metric is; how likely you think it is to win? I is for impact: If the test does win, how high of an impact does it have on the business?

9 Startups to Help You Build Your Virtual Economy

Sachin Rekhi

The great news is there are a variety of startups out there waiting to help you! Given that there are already so many different offer providers and more coming, a solution is needed to easily A/B test them to select which work best for your site in each country. Since every offer provider will tell you that they are confident they are better than their competition, the only way to know for sure is to test and find out!

How great Product Managers contribute to great engineering cultures

The Product Coalition

It’s very important to have Design representation to clarify requirements from wireframes, and QA representation to gain an understanding of the context around functionality and propose appropriate testing. entrepreneurship product-management leadership software-development startup