April 24, 2006 Group testing: The best of both worlds Posted by at 10:37 AM | Categories: Usability Methods

A number of methods are currently available to assist in developing and testing applications. Group testing kills two birds with one stone. A mixture including focus groups and usability delivers the best of both worlds and provides an efficient way to gather important data on users and their behaviours.

What method is best for you, focus groups or usability testing?

A focus group can be very effective at gathering opinions, but it has nothing to say about performance. According to usability guru Jakob Nielsen, http://www.useit.com, the proper role of a focus group is not to assess interaction styles or design usability, but to discover what users want from the system. The opposite can be applied to usability testing: It is an excellent technique for evaluation, but inadequate for assessing user needs. Knowing this, imagine what these two techniques could produce together!

You get a better result when practicing both!
A more efficient way to determine user needs and evaluate the product is group testing, a mixture of both focus groups and usability testing. Group testing is a cost-efficient way to get a lot of information in a short amount of time. An experienced researcher with previous knowledge of both usability testing in general and case-specific guidelines, not to mention the underlying technology, is a prerequisite for successful testing. Group testing is best when conducted in application prototyping phase, but it is suitable also when the product needs updating to a newer version or its quality needs to be verified.

Group testing can provide a wealth of usable information. For example, it yields product information about the efficiency and ease-of-use of a product, as well as marketing information about consumer behaviour, pricing, and models of use. Conducted in larger groups, the test also gives insight into whether the product can be adapted to the processes of various groups and communities. In group testing, the real focus group users provide information while using the products and discussing them with their peers. In addition to offering feedback about new product features and qualities, the test reveals issues related to cultural usability and applicability to existing behavioural models.

To sum up:
* Group testing is cost-efficient
* You get a wealth of usable information by the real focus group users in a short amount of time
* The results can be used in several product development phases


Permalink |

Comments

I’ll be short and I’ll say something from the user point of view..

I have very good cooperation with almost all reliable S60 developers since first models of 7650 and with years and years of experience on my back I can say that just a single power user as a beta tester worth more than the numerous groups of average users.. ..

Posted by: Apocalypso™ | April 26, 2006 09:06 AM

I don't disagree that a beta tester is useful but think about it. What are the characteristics of a beta tester? How do developers find a beta tester? Isn't this power user going to miss a lot of the small details that an everyday user would find and reveal? There are a lot of ways to test, including "friendly testing" with people you know, but perhaps the most important question is how well do you want your product to work in the market? If the product is meant for a small group of advanced users, then these users are going to be happy. However, if others will be using this device, non-power users, then beta testers may not be the only or best way to test.

Posted by: Wendy | April 26, 2006 09:50 AM

> beta testers may not be the only or best way to test.

Agreed. But sometimes it might be the fastest and most cost-efficient way.

Posted by: Tommi Vilkamo | April 26, 2006 12:12 PM


Post a comment







«Back to previous page