Think Aloud Test: pros and cons
The Think Aloud Methodology, also known as TAP (Think Aloud Protocol) is used to understand more precisely the choices made by users during user testing. As the name itself implies, “think aloud”, the test involves the user commenting out loud on what they are doing and what their impressions, sensations, considerations and frustrations are about the browsing experience. The user navigates and along the way explains the objective and the reasons for their choices, as well as their questions, doubts, concerns, etc. (explicit thoughts). Everything they say is recorded.
People are asked to talk as they work or solve problems. The information they give can be relevant feedback for product improvement, allows you to understand how people use critical thinking to solve problems and gather information about how they think and act.
The aim of the Think Aloud Test is to bring to light the mental pattern that the user uses during the development of the set task and this information will then be used to improve the interface.
The information obtained is qualitative in nature. This is why we can say that Think Aloud belongs to the qualitative research methods. (Read more: Quantitative and qualitative research: pros and cons).
With this test you get direct information about how users react when they interact with the interface of your product. Isn’t it the hidden dream of every UI Designer to read the thoughts of users?
For the correct execution of this process, an environment with minimal distractions has to be created to control the variables. The user who participates in the test is assigned tasks such as using a manual, interacting with an unknown object or testing software.
An observer is in charge of explaining the purpose of the test, stressing the importance of collecting information as naturally as possible. He/she is present during the execution of the test without influencing. This method requires a neutral observer who does not comment or interact during the Think Aloud protocol.
When we talk about Think Aloud methodology we think of a digital product, a website, an app… but in reality this method adapts to any type of product.
The user test with the Think Aloud methodology can be completed by analysing the user’s eye path through qualitative Eye Tracking, in order to detect also those difficulties that people may not express verbally, due to fear or uncertainty.
Benefits of the Think Aloud Test
The verbalisation on the part of the users makes it possible to understand not only the problems that the user encounters in the use of a product, but also the reason for its existence. It can be said that it is a good methodology for obtaining a large amount of information with the participation of a small number of people.
In our Specialisation Programmes we provide an in-depth study of all research methodologies (these trainings are in spanish):
Briefly, we could say that the advantages of the Think Aloud Test are these:
- Inexpensive. No specific tool is required. It is enough to sit next to the user and take notes while the person talks. One day is enough to collect the data of all the users we listen to and with that we get the most important insights.
- Reliable. Even when the methodology is not followed 100% correctly, the information extracted is valuable.
- Flexible. It is possible to use this methodology at any stage of the process, from the first paper prototypes to the implementation systems. Thinking out loud is very interesting for Agile projects. It is possible to use this method to assess any type of user interface with any form of technology.
- Convincing. Attending a couple of think-aloud sessions doesn’t take much time and is the best way to motivate developers to pay attention
- Easy to teach. It takes no more than three days to teach it to a team of developers, and there is no material needed to be “learned”.
Disadvantages of the Think Aloud Test
- On the three aspects strictly related to usability: effectiveness, efficiency, satisfaction, the Think Aloud does not cover the efficiency aspect, as the conditions of the test execution influence the user’s performance. Some experiments have shown that TAP increases the efficiency of the user in carrying out the assigned tasks.
- Related to efficiency, users may be tempted to want to give a rational explanation for all their actions, because they do not want to create an image of themselves as a person who reacts instinctively.
- The context of use that is created during such a test cannot be compared to others.
- With this methodology, the user is required to do two actions at the same time: use the digital product and verbalise their actions, which can increase the cognitive load.
Read more: How to prepare a Think Aloud Test
The Think Aloud methodology is also used in scientific research that does not necessarily require testing a product. It is used to improve the treatment of patients with cognitive deficits or for the development of programmes for people with learning difficulties.
In short, Think Aloud Test is a qualitative research technique to understand the thoughts and motivations of users.
This is a translation of the following article published in our corporate website:
