Research methods

Research points of view

As we mentioned earlier, there are three ways we can approach research, referring to user research regarding user experience, which are the following:

  • Qualitative versus quantitative: On the first one the results obtained will be subjective, and on the second these will be measurable and comparable.
  • Context of use: On many occasions carrying out research with both previous points of view is not enough and we will need to test the digital product in the context of use where the company or the potential users will actually handle it so we can see possible changes or improvements we can make in the design purpose based on context.
Research method ranking chart. © Norman Nielsen/Christian Rohrer

Research methods

Now, we will list the summary of 20 research methods which appear in Norman Nielsen’s graphic and article:

  1. Ethnographic Field Studies: Researchers meet the study participant in their environment (either their workplace or home), where they use the product. This kind of study helps to have into account keys about user types and the environments in which our users move around.
  2. Participatory Design: Participants are given some basic design elements or creative materials and they build up their ideal experience with the given digital product, indicating which things are most important and why.
  3. Focus groups: Groups between 3 and 12 participants that are encouraged to talk about different topics related to the digital product and also to share their opinions and points of view in a vocal and strict way through different exercises.
  4. Interviews: A researcher debates one on one with the participant about topics that are related to the digital product which is object to the study. Read our Guide for user interviews. 2022 Edition.
  5. Eye Tracking: An eye tracking device correctly calibrated can observe where the participant is looking while they are executing the tasks that they were assigned or how they normally interact with a digital product.
  6. Usability Benchmarking: These are usability studies with several participants with different profiles where parameters are strictly scripted so they develop correctly and the digital product’s performance test can be as accurate as possible, and we can see where improvements can be made.
  7. Moderated Remote Usability Studies: Same as a usability study just moderated remotely, by using different tools such as screen sharing or remote control.
  8. Unmoderated Remote Panel Studies: A user panel is recorded with a camera and a data collection software while they use a digital product and comment aloud, which can be analysed at the moment or after.
  9. Concept Testing: A researcher shares a concept idea that they have that has a value proposition for users and clients and we try to determine if the idea has a potential market or not. This study can be carried out with a few or many participants, online or offline.
  10. Diary/Camera Studies: These are similar to a User Journey, where participants record with a camera or take down notes in a diary the impressions that they have while continuously using the digital product, and also the feelings they have in the meantime. These are usually longitudinal and have to be easily recordable data by the users. With the recorded information in the chosen medium an expert can arrange a user journey which synthesises all the experiences.
  11. Customer Feedback: Closed or open information- depending on the kind of question they are asked- of a selected group of customers usually through mail, a link or social media.
  12. Desirability Studies: Participants receive some visual alternatives and are asked about their preferences- which one would they prefer or which one do they find more appropriate-, and they are asked to rate each one, just as a justification about the emotions that each of the alternatives transfer from a given list.
  13. Card Sorting: A quantitative or qualitative method that asks participants to organise a series of concepts into groups and to assign them a category to each of them. This method helps to improve Information Architecture by exposing the user’s mental models.
  14. Clickstream Analysis: Analysing the screen records from those screens the users navigate through and analysing where they click on and what they look at while using a digital product. This requires that the site has the appropriate instruments or that the app has data telemetry in order to do so and be able to reach conclusions.
  15. A/B Testing: Also known as Multivariant Testing if it is carried out with more than one alternative, this is a scientific method through which different designs are tested, by randomly assigning each of them to a group of users so that they interact with them and measure the effectiveness of changes in users.
  16. Unmoderated UX Studies: This is an automatic method for qualitative and quantitative analysis which uses a specific research tool to record conducts (through an application on their computer) and attitudes (through embedded surveys), usually providing users with goals or objectives to reach in the digital product (or a prototype).
  17. True-Intent Studies: A method that asks randomly selected users what is their purpose for using the digital product and asks about their experience on the site when they achieve it before leaving.
  18. Intercept Survey: This survey is activated while the user navigates through the site so that they answer it.
  19. Email Survey: This survey is sent to participants that are recruited through email.

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Torresburriel Estudio

Torresburriel Estudio

User Experience & User Research agency focused on services and digital products. Proud member of @UXalliance