3.1 - Best Practices for Moderating
Enroll to start learning
Youβve not yet enrolled in this course. Please enroll for free to listen to audio lessons, classroom podcasts and take practice test.
Interactive Audio Lesson
Listen to a student-teacher conversation explaining the topic in a relatable way.
Building Rapport
π Unlock Audio Lesson
Sign up and enroll to listen to this audio lesson
One of the first things we need to do is build rapport with the participants. Why do you think this is important?
Maybe so they feel comfortable sharing their thoughts?
Exactly! When users feel comfortable, they're more likely to give honest and useful feedback. Can you think of an example of how we might build rapport?
We can start with some icebreaker questions or just chat a bit before we begin.
Great point! Remember, this helps make them feel the focus is on the prototype, not their personal abilities.
So, the takeaway here is to always create a welcoming environment at the start of your sessions.
Encouraging Think-Aloud Protocol
π Unlock Audio Lesson
Sign up and enroll to listen to this audio lesson
Another best practice is encouraging participants to think aloud. What do you think this involves?
Like, they should say what they're thinking while they use the prototype?
That's right! By verbalizing their thoughts, we can gain insights into their decision-making process. How can we prompt them to do this?
We could ask questions like 'What are you thinking right now?'
Perfect! This method helps us capture their emotions and reasoning in real-time, which is invaluable.
Always remind them that there are no right or wrong answersβjust share their honest thoughts.
Neutrality in Moderation
π Unlock Audio Lesson
Sign up and enroll to listen to this audio lesson
A critical part of moderation is staying neutral. Why do you think that matters?
So we donβt influence how they respond?
Exactly! If we bias their responses, the feedback could be skewed. Instead, we should only guide them when theyβre truly stuck.
What if they just donβt know what to say?
In that case, we can use gentle prompts to encourage them without leading them. Remember, keep it open-ended.
Using Open-Ended Questions
π Unlock Audio Lesson
Sign up and enroll to listen to this audio lesson
Whatβs the difference between open-ended and closed questions, and why do we prefer the former?
Open-ended questions let them explain more, right?
Correct! They provide richer insights. For example, instead of asking, 'Did you like this feature?' we could ask, 'What did you think about this feature?'
Does that help get more feedback?
Absolutely! This can reveal user experiences and perspectives that are hidden with simple yes/no questions.
Summarizing this, prioritize open-ended questions during testing to foster deeper engagement.
Introduction & Overview
Read summaries of the section's main ideas at different levels of detail.
Quick Overview
Standard
In this section, best practices for moderating user feedback sessions are discussed, emphasizing the importance of building rapport, encouraging open dialogue, and capturing rich qualitative data without biasing responses. The methods ensure participants feel comfortable and provide valuable insights during testing.
Detailed
Best Practices for Moderating
Effective moderation is crucial during user testing as it shapes the quality of the feedback collected. This section emphasizes several key practices:
- Building Rapport: Establish a connection with participants, clarifying that the focus is on the prototype rather than their abilities. This helps ease anxiety and encourages open, honest feedback.
- Encouraging Think-Aloud Protocol: Prompt participants to narrate their thoughts while interacting with the prototype, revealing their reasoning and feelings during the process.
- Staying Neutral: Moderators should avoid leading questions or assistance that could influence results, only stepping in when participants are genuinely stuck.
- Gently Prompting: If participants hesitate or pause, moderators should encourage them to share their thoughts at that moment with guiding phrases to maintain the flow of feedback.
- Avoiding Closed Questions: Instead of yes/no questions, moderators should ask open-ended questions to gather deeper insights, such as asking for the reasoning behind a specific action.
The significance of these practices lies in enhancing the quality of data captured during user testing, leading to more effective design iterations.
Audio Book
Dive deep into the subject with an immersive audiobook experience.
Building Rapport
Chapter 1 of 5
π Unlock Audio Chapter
Sign up and enroll to access the full audio experience
Chapter Content
β Begin with rapport: Clarify goals and reassure users it's the prototypeβnot themβthat's being tested.
Detailed Explanation
It's important to start the testing session by establishing a comfortable environment for the participants. This means clearly explaining the objectives of the test and emphasizing that the only thing under review is the prototype, not the users themselves. This approach helps to alleviate any nerves or pressure the users may feel, allowing for more open and honest feedback.
Examples & Analogies
Imagine youβre trying out for a play. If the director reassures you that theyβre just looking at how the scenes play out, rather than judging your performance, you would likely feel more relaxed and perform better. Similarly, testing a prototype works best when users arenβt worried about being judged.
Encouraging Think-Aloud
Chapter 2 of 5
π Unlock Audio Chapter
Sign up and enroll to access the full audio experience
Chapter Content
β Encourage think-aloud: Ask βWhat are you thinking?β if theyβre silent.
Detailed Explanation
Encouraging participants to vocalize their thoughts while they interact with the prototype provides insight into their decision-making processes. By prompting users to express what's on their mind, researchers can gather valuable data regarding user reactions, confusion, and overall interactions with the prototype. This practice can highlight areas in the design that may not be intuitive or engaging.
Examples & Analogies
Think of a teacher encouraging students to explain their problem-solving steps in math class. When a student says, 'I chose to add these numbers first because...', the teacher can see their thought process more clearly and help them where needed.
Staying Neutral
Chapter 3 of 5
π Unlock Audio Chapter
Sign up and enroll to access the full audio experience
Chapter Content
β Stay neutral: Donβt offer help that biases resultsβguide only if theyβre truly stuck.
Detailed Explanation
As a moderator, it's crucial to maintain neutrality to avoid influencing the participantsβ responses. If a user struggles with a task, the moderator should offer minimal assistance only when it's necessary. This approach ensures that the data collected reflects the user's genuine interaction with the prototype, providing true insight into usability issues.
Examples & Analogies
Consider a sports coach observing players during practice. If they jump in to correct a playerβs technique too quickly, they might alter how the player approaches the game. Instead, waiting to see how the player handles the situation independently can provide better feedback on areas needing improvement.
Gentle Prompting
Chapter 4 of 5
π Unlock Audio Chapter
Sign up and enroll to access the full audio experience
Chapter Content
β Prompt gently: If they pause, say: βTell me whatβs happening in your mind right now.β
Detailed Explanation
When participants hesitate or pause during the session, gently prompting them can help bring their thoughts to the surface. This technique allows the moderator to understand how users interpret tasks and identify moments of confusion, which can be critical in improving the prototype.
Examples & Analogies
Think of a friend whoβs presenting a project. If they stumble, a supportive comment like, 'What were you thinking there?' helps them regain their confidence and share their thought process, enriching the discussion.
Avoiding Closed Questions
Chapter 5 of 5
π Unlock Audio Chapter
Sign up and enroll to access the full audio experience
Chapter Content
β Avoid closed questions: Use prompts like βWhy did you do that?β or βWhat do you expect next?β
Detailed Explanation
Closed questions often lead to simple 'yes' or 'no' answers that donβt provide much information. Instead, open-ended prompts encourage participants to elaborate on their thoughts and experiences, thus yielding richer insights into user behavior and expectations.
Examples & Analogies
Imagine asking someone about their favorite movie. Instead of simply asking, 'Did you enjoy it?' which might get a 'yes' or 'no', asking 'What did you enjoy most about the movie?' invites a much more thorough and insightful response.
Key Concepts
-
Building Rapport: Establishing a relationship with participants to foster openness.
-
Think-Aloud Protocol: Encouraging users to verbalize their thoughts while interacting with prototypes.
-
Staying Neutral: Moderating without bias to obtain authentic feedback.
-
Open-Ended Questions: Using questions that invite expansive responses for deeper insights.
-
Gentle Prompts: Subtle reminders to help participants articulate their thoughts.
Examples & Applications
During a user testing session, the moderator starts with light conversations to ease participants into the process; this builds rapport.
Instead of asking 'Do you like this feature?', the moderator asks, 'What are your thoughts on this feature?' to gather in-depth feedback.
Memory Aids
Interactive tools to help you remember key concepts
Rhymes
To build rapport, make it fun, users share more, and data's won.
Stories
Once upon a time in a land of prototypes, a moderator helped users feel safe and shared their thoughts like little birds.
Memory Tools
BENG: Build rapport, Encourage think-aloud, Neutrality is key, Gentle prompts help.
Acronyms
R.T.A
Rapport
Think-aloud
Ask open-ended questions.
Flash Cards
Glossary
- Rapport
A positive relationship and connection between the moderator and the user that encourages open communication.
- ThinkAloud Protocol
A method where participants verbalize their thoughts while interacting with the prototype, providing insights into their decision-making and emotional responses.
- Neutrality
The practice of moderating without bias, ensuring that responses are not influenced by the moderatorβs suggestions or reactions.
- OpenEnded Questions
Questions that allow for expansive responses rather than simple yes or no answers, enabling deeper feedback.
- Gentle Prompts
Subtle suggestions made by the moderator to encourage participants to think or elaborate on their responses without leading them.
Reference links
Supplementary resources to enhance your learning experience.