Tracking your A/B tests

Mind the Product

This is the second of two posts that deep dive on A/B tests, expanding on a talk I gave at Google Playtime 2016 in London. As mentioned in the first post, if you plan to run a lot of A/B tests then you should think about using a document to store test information, which I call the tracker.

Stepping up Your A/B Tests

Mind the Product

This is the first of two posts that deep dive on A/B testing, expanding on a talk I gave at Google Playtime 2016 in London. In this post I share some of the learnings we’ve had after running 60+ A/B tests at Peak , looking at each step of the A/B testing cycle in turn.

3 Tests for Great Product Messaging

280 Group

Fortunately Bill is here to provide us with three tests that.[continue The post 3 Tests for Great Product Messaging appeared first on 280 Group Product Management. In this new video and blog post we discuss something that is exceedingly important in the product world: messaging.

Separate Quality Testing from Availability

Under10 Playbook

Quality testing identifies anomalies or defects that are not working as expected. “Alpha” is a testing phase where a release candidate (or potentially shippable increment) is tested on client systems (such as devices and browsers) and data by VENDOR employees.

The Top 5 Most Common Rapid Prototyping Mistakes

Speaker: Teresa Torres, Product Discovery Coach, Product Talk

We need to know what to prototype and when, who to test our prototypes with, and how to conduct those tests in a way to get reliable feedback. When you think of "rapid prototyping", what comes to mind?

Accessibility Testing: Tips & Best Practices From Industry Leaders

Userzoom

Learn about best practices for accessibility testing from two leading companies in their industries. Lots of companies want to conduct accessibility evaluations by conducting usability testing for people with disabilities. Before running an accessibility test, you can make sure your site meets fundamental accessibility guidelines. Furthermore, be aware that one of the toughest parts of accessibility testing is knowing how to recruit participants.

The Testing Mindset – How to Find Product/Market fit

Mind the Product

You have to invest skillfully to test these assumptions. The smarter your investment in testing, the better your chances of product success. Here’s what we’ve learned based on our experience of adopting a testing mindset and seeing your way through innovative product development. Instead, many small tests have to be carried out in order to find your way towards product/market fit. And the less money you need to test an assumption the more bets you can make.

Rebooting Product Usability Testing for Much Better Insights

bpma ProductHub

Usability Testing – Something Has Always Seemed Off… Something has never seemed quite right to us about how product usability testing is done. No matter what is being tested, from software to cereal to screwdrivers, there is always a herd of elephants – in the room.

Test-Driven Product Management at an Early-Stage Startup

Amplitude

Today, it’s common to hear people talk about testing early-stage products like it’s a bad thing. You can’t build a better product just by A/B testing button colors, no. Clarify and test your company’s values. You do this through testing.

Q&A on User Testing

Under10 Playbook

Most product managers recognize the value of user testing. So it is often hard to fit in testing and design iteration before the sprint deadline. Steven Cohn , the Founder of Validately and a user testing expert, gives some practical advice on how to balance the time pressures of product management and conducting proper user testing. (SJ Why should a product team allocate its limited time to user testing? SJ: What are the different testing options?

Get to Know Gauge, the New Cross-Browser Testing Framework

Amir Rozenberg

” Just like Rihanna, you might think there are too many frameworks to learn in the testing arena! Now there is a new cross-browser test framework gaining adoption in the community: Gauge , a framework sponsored by ThoughtWorks. Note that the tests will run serially.

Why an MVP Needs to Be a Product and Not Just a Test

280 Group

The post Why an MVP Needs to Be a Product and Not Just a Test appeared first on 280 Group Product Management. Language is dynamic, and terms in product management are subject to the same forces. Meanings evolve, and this can lead to ambiguity.

How to Hook Users in 3 Steps: An Intro to Habit Testing

Nir Eyal

Changing user habits isn’t easy — but understanding how to conduct Habit Testing will increase your odds of success. In this video, I provide a brief introduction to the three steps of Habit Testing.

Multivariate Testing vs A/B Testing: Which Works Better?

UX Studio

Deciding between multivariate testing vs A/B testing without knowing their advantages and limitations can pose extreme challenges. When optimizing a website’s conversion rate, A/B testing usually comes up first. Sometimes testing more alternatives proves necessary, for which multivariate testing performs well as a method. So which to choose, multivariate testing or A/B testing? What is A/B testing? How can you set up a test?

Mobile Testing on iPhoneX – What Developers Need to Know

Amir Rozenberg

Testing your app on the iPhoneX presents even more difficulties. If you cannot see the real-time website or app in your testing, you will find issues late, which will require you to redo the code you wrote, possibly undo code that’s built on top of it, and fix it all.

Mobile Testing on iPhoneX – What Developers Need to Know

Amir Rozenberg

Testing your app on the iPhoneX presents even more difficulties. If you cannot see the real-time website or app in your testing, you will find issues late, which will require you to redo the code you wrote, possibly undo code that’s built on top of it, and fix it all.

Increase Performance in Cross-Browser Testing with Zero Effort – Here’s How

Amir Rozenberg

Introduction Are you used to getting a certain amount of data from your testing practices? Did you know that today you can extract more data from your existing testing practice…with zero additional effort. Looking for more information on performance testing?

iPhone 8 on iOS 11 is Out – Are You Testing on it Today? You Can….

Amir Rozenberg

Perfecto is excited to announce the availability of iPhone 8, 8+, running iOS 11 GA, as of today, Sep 22nd, 2017, 8AM EST. iPhone 8 and iOS 11 pack a number of new features and changes that require intensive testing for all applications, web and mobile. Happy Testing!

The 3 Big C’s of Agile Development and Testing

Amir Rozenberg

When thinking about adoption of agile schemes, some of the common concepts that come to mind are Continuous Integration (CI), Continuous Delivery (CD) and Continuous Testing (CT). Using test automation, they are able to ensure the integration actually works.

4 Key Data Points A/B Testing Reveals

Generation Focus Blog: Perspective on Customer Dis

A/B testing is a crucial element in any startup foundation. Six months later an engineer saw the project, and noticing the low cost of writing the code for it, decided to do a bit of A/B testing. Thanks to the test, Microsoft went on to earn massive returns.

3 Things I Learned About Usability Testing By Looking at Customers in Their Underwear

Joe Cotellese

Back in my days with the apparel company, the inescapable fact was that I needed try our fit-testing body scanner on real humans. Today, working for an email marketing company, I rarely have to ask people to strip down to their underwear to test out a product. Still, that awkward experience from many years ago taught me several important things about usability testing. During our fit testing experiment, we had one guy come in who swore he had a 32” waist.

Increase Performance in Cross-Browser Testing with Zero Effort – Here’s How

Amir Rozenberg

Introduction Are you used to getting a certain amount of data from your testing practices? Did you know that today you can extract more data from your existing testing practice…with zero additional effort. Looking for more information on performance testing?

Betterment Tested Three Performance Management Systems So You Don't Have To

First Round Review

As Founder and CEO of Betterment, Jon Stein realized startups can't just establish one way to measure employee performance — they have to continually iterate as they grow. Here's how to do it well. Continue reading at First Round Review »

The 3 Big C’s of Agile Development and Testing

Amir Rozenberg

When thinking about adoption of agile schemes, some of the common concepts that come to mind are Continuous Integration (CI), Continuous Delivery (CD) and Continuous Testing (CT). Using test automation, they are able to ensure the integration actually works.

iPhone 8 on iOS 11 is Out – Are You Testing on it Today? You Can….

Amir Rozenberg

Perfecto is excited to announce the availability of iPhone 8, 8+, running iOS 11 GA, as of today, Sep 22nd, 2017, 8AM EST. iPhone 8 and iOS 11 pack a number of new features and changes that require intensive testing for all applications, web and mobile. Happy Testing!

4 Battle-Tested Ways to Improve Corporate Learning

Good Product Manager

Here are four battle-tested tips to improve corporate learning so your talent is ready for the technology-driven future that seems to be coming their way: #1. The post 4 Battle-Tested Ways to Improve Corporate Learning appeared first on LSA Global.

Perfecto Offers the Fastest Web Test Automation in the Cloud

Amir Rozenberg

This isn’t unique to Perfecto’s customers: we see a clear intensification of the test activities, whether managed within the test team, development team or both. Can the lab execute a large amount of test cases, achieve the needed capacity and provide the relevant reporting?

Sprint: Solve problems and test ideas in five days

Product Bookshelf

The process moves through identifying questions, creating solutions, storyboarding, prototyping, and testing with customers. Sprint: How to Solve Big Problems and Test New Ideas in Just Five Days by Jake Knapp. Over the course of a week: ideate and flesh out, prototype, and test it.

Increase Test Automation with Touch ID & Fingerprint Authentication Simulations

Amir Rozenberg

The test flow needs to include a successful authentication,an unsuccessful one with limited retries, and eventual failure. Figure 2: fingerprint authentication drives test case growth It is estimated the increase in test cases with the new fingerprint authentication is between 10%-30%.

Increase Test Automation with Touch ID & Fingerprint Authentication Simulations

Amir Rozenberg

The test flow needs to include a successful authentication,an unsuccessful one with limited retries, and eventual failure. Figure 2: fingerprint authentication drives test case growth It is estimated the increase in test cases with the new fingerprint authentication is between 10%-30%.

How Do You Test Automated Data Entry for Mobile Web Apps? A Tip We Gave to Our Customer

Amir Rozenberg

An end-to-end approach for testing mobile web app imaging is made possible through leveraging preloaded images onto the device. This test automation, in turn, enables rapid feedback and scaling of code coverage.

What is card sorting and why is it important to your site’s UX?

Userzoom

Hence we’re bringing you these regular UX beginner’s guides, aimed to help all the newbies of the UX testing world. Card sorting is a test you can run to improve the navigation of your website, and like all the best methods of UX testing it puts the user at the centre of your observations.

UX 70

5 Cross-browser Testing Mistakes You Might be Making Right Now

Amir Rozenberg

So, you’d like the recipe for cross-browser testing success? Let’s take a look at a handful of examples of mistakes we commonly see with browser testing- and solutions to deal with them. Engineering should no longer separate coding and testing between desktop and mobile.

The next generation automation testing for video streaming apps by Perfecto & Accenture S3

Amir Rozenberg

Teams need automated, stable and scalable methods to continuously test and monitor video services on every phone, tablet and browser and in any environment; at home, on the road, inside a plane, etc.

Why Data Science and UX Research Teams are Better Together

Mind the Product

Chris shares real-world examples and lessons learned as User Testing established its Product Insights team, a team which is made up of UX researchers, data scientists and data engineers. User Testing’s research and data science teams working together.

UX 230

What’s the difference between quantitative and qualitative research?

Userzoom

In my first few weeks of working for a UX testing company I was put under a rigorous training programme. Every facet of UX testing was explained to me in detail, with practical examples and demos delivered along with a reading list of all the key UX texts.

The next generation automation testing for video streaming apps by Perfecto & Accenture S3

Amir Rozenberg

Teams need automated, stable and scalable methods to continuously test and monitor video services on every phone, tablet and browser and in any environment; at home, on the road, inside a plane, etc.

UserZoom Enhances Their Pre-Study Checklist With Storage Check

Userzoom

When it comes to getting valuable, i.e. actionable and quality, insights from your UX research and usability testing, everyone knows that who you recruit matters. Mobile Usability Testing Usability Testing Tools User Experience Research

5 Cross-browser Testing Mistakes You Might be Making Right Now

Amir Rozenberg

So, you’d like the recipe for cross-browser testing success? Let’s take a look at a handful of examples of mistakes we commonly see with browser testing- and solutions to deal with them. Engineering should no longer separate coding and testing between desktop and mobile.

What We’ve Learned From Using Kanban

Mind the Product

To reduce the amount of time spent in regression testing. Team-based automation testing. We used to have a separate team responsible for writing automation tests. This has frequently extended our pre-release regression tests. Introduction.