Usability Testing Results Round 1

Summary

High Level Observations

Users use MWW with others who already know how the platform work. Users are less likely to use MWW with a guest due to the effort it takes for guests to sign up or learn how to use the product.

Users are used to a specific flows when creating a group meeting and deviating from that can cause momentary confusion

Specific Items

Move role column to calendar connection column

Change copy of calendar connection to something to do with availability of calendar

Move add a new member button to the top by schedule button

Remove required column from contact management page

Altering or deciding which scheduling version we will move forward with

Adding a where to the scheduling screen

Main Insights

All said they would use it in their daily life. M said he wouldn’t use it with people who aren’t familiar with product because of the process of creating a wallet. T said the more people that use it the more valuable it would be to him & suggested making it an activity hub

Action item - review process for guests, ask participants how they’ve sent links to guests, possibly prioritizing another way to login to an account, possibly adding calendar element so it is like a hub

how to show that creating a group is saving time and used repeatedly

All had confusion about the difference between creating a group and scheduling a meeting (participants weren’t separating the tasks in their heads and assumed they were making a group meeting and creating a group with the create a group flow instead of creating a group that will be used repeatedly and then creating a meeting)

Action item - explain the distinction between creating a group and scheduling a meeting OR explaining the steps OR create the option to schedule a meeting and create a group in the same flow

possibly offering scheduling a meeting and then creating a group with the ppl who were invited

2/3 were confused about calendar connection column and assumed that having a connected calendar meant the individual accepted the invite to the group

Action item - explain/distinguish calendar connection from accepting into group OR get rid of column and have something showing only when a team members calendar isn’t connected

say something about availability, possibly moving role over 1

2/3 confused about what required column meant and both wondered if required/optional can change week to week

Action item - clarity of what required means and what the symbols mean

remove and only have in process of scheduling meeting

2/3 users liked option B over A because of the distinction between the two options

Action item - decide which version to use, maybe ask more people?

All participants looked at the top for a button to “add a member”

Action item - changing placement of add new member button for easier access? (this could depend on how often members are being added)

2/3 completed task 1 (creating group)

3/3 completed task 2 (adding member to group)

0/3 completed task 3 (scheduling meeting)

Users assume that the date and time on the schedule Option A is the exact time that the meeting would be occurring

2/3 realized after they saw the description box in the scheduling flow that the scheduling was different from creating the group

2/3, in scheduling flow, confused about “MWW Product” in participant box because it doesn’t match with TogetherCrew Growth group name on contact management page

1/3 for the B option preferred, going back to the starting page so they can exclude/add users if they want, after choosing the time

Raw Data

Sepehr

Creating Group Task 1	Pass or Fail	Notes
clicking create group button	Yes	Mentioned changing copy of button and make it actionable like “create group call, create group meeting, create group event” Unsure what ‘individuals’ tab next to ‘groups’ is.
clicking group name	Yes	Was unsure if he was creating the event now or creating a group and then adding the event Didn’t know what group calendar link meant, used tool tip and assumed it meant you can book meetings with the group through the link OR link can be sent to people not in the group and a meeting can be scheduled through the link by showing available times for meetings to the individuals who aren’t in the group
clicking next	Yes	Thought title was misleading and suggested “invite group members” After reading directions wasn’t sure what type of identifier should be used and suggested having example in box
clicking contact box twice for 2 people to appear	No	Read tool tip for role Didn’t think message was editable and that it would send that message automatically
clicking create group	Yes	ㅤ

Adding Group Member Task 2	Pass or Fail	Notes
clicking add new member at bottom of page or through settings icon	Yes	Suggested changing title to “group or team management” or something that describes page better because it doesn’t give him understanding of the page Assumed that my contacts (on side menu) means scheduling 1-on-1 Moved mouse past “create group” before going to “add new member” suggested having the button at the top in header
clicking contact box	Yes	Didn’t realize right away that new contact had been added below
clicking invite	Yes	Noticed success banner and pending under contact Liked send reminder for if there was a link that would be deactivated in a time range Liked easy modification of roles
Thoughts on Calendar connection	ㅤ	Helpful and assumed that it means the person has checked their email Assumed that connected meant that people have joined the group and that not connected meant they haven’t joined the group then thought it meant wallet connection
Thoughts on required column	ㅤ	People with darker icon are mandatory attendance and people with lighter icon are optional

Scheduling Meeting Task 3	Pass or Fail	Notes
clicking schedule button	Yes	ㅤ
clicking title	Yes	ㅤ
clicking duration	Yes	- Wants to type in participants box instead of clicking button - Word add makes more sense to have than edit because he correlates edit with X for delete - Didn’t know that participants in edit/add were team members of the group in the participants box
click discover a time	Yes	- Clicked on “select a time” first and when it did nothing went to discover a time - Thought both whens meant the date and time he wanted. - Thought it was weird that it provided times not on chosen date and said selecting a date is redundant before clicking discover time button and realized that checkmark meant he could exclude people from meeting if needed - wasn’t sure how to add an extra person who isn’t in team already
clicking 1:30pm time option	No	ㅤ
clicking schedule	No	ㅤ

A/B Test Thoughts

A:

Was confusing and wondered if the times that show up were actually based on the input and wasn’t sure how the logic worked

B:

Feels easier and more understandable because of OR making the distinction between discovering a time and manually selecting the time

Clearer about the information input

Expects that meeting time would be on the date and time selected when input manually

Likes this flow better excepts wants to flip back the original screen after selecting a time where edits can be made and then go to confirmation page

Question Responses:

Would use it to set up different teams and send the link to people he would like to join the meeting instead of manually doing it, likes it because it simplifies the process by him having a team created and then outside people can be sent the link and schedule a meeting based on the teams availability because the teams availability has already been synced up

same as above

Anything missing? - nope

Confusing parts? - Individuals under contact management, wasn’t sure what that would mean

Mehrdad

Creating Group Task 1	Pass or Fail	Notes
clicking create group button	Yes	Thought creating a group was to set up a call
clicking group name	Yes	ㅤ
clicking next	Yes	ㅤ
clicking contact box twice for 2 people to appear	Yes	- Thought that message was prefilled and was what would be sent out - if he had an agenda for meeting he would include it in message
clicking create group	Yes	- Flow was good for this scenario - thought it may not be efficient for him because he has meetings with different people frequently and would have a lot of groups in contact management and not remember why they were created

Adding Group Member Task 2	Pass or Fail	Notes
clicking add new member at bottom of page or through settings icon	Yes	- initially didn’t see it and said he was looking for it in header by schedule button
clicking contact box	Yes	- Confused because thought message in flow 1 was for meeting and whole group and wasn’t sure if he could change it or if only that individual person would receive message (unsure of what message means and where it’s going)
clicking invite	Yes	- success banner and pending confirmed that invite was sent
Thoughts on Calendar connection	ㅤ	- confused by a group member being apart of the group even though their calendar isn’t connected
Thoughts on required column	ㅤ	- liked feature and understood it (after reading the info box)

Scheduling Meeting Task 3	Pass or Fail	Notes
clicking schedule button	Yes	ㅤ
clicking title	Yes	ㅤ
clicking duration	No	ㅤ
click discover a time	Yes	- Clicked 330p meeting because it was the earliest option for Jan 15 (pre-selected date)
clicking 1:30pm time option	No	- Only looked at icons in when boxes to understand meaning - clock shows the exact time of the meeting - realized that previous message was just for invitation not the meeting
clicking schedule	Yes	- wanted to know if guest would need to create an account and connect calendar to attend meeting

A/B Test Thoughts

A:

B:

Likes this better cause it’s cleaner and the distinction between the two options of setting specific time or system finding a time

Question Responses:

Use in daily life? - yes, would use to schedule individual meetings and his main team but not for meetings with people he doesn’t really know because of the hassle of logining in and connecting wallet

Really liked? - Contact management page except confused about connected calendars. Informative and can gather needed info in one glance

Anything missing? - nope

Confusing parts? - the required column, wasn’t sure if required meant that calendar availability had to be shared or if it was optional and was unsure if it meant for that week or all the time. Link under group name he thought it could be sent to random people to have a meeting but realized that the link is for the team

Requested the feature to invite non MWW users to a meeting set through groups using an Email

Trigs

Creating Group Task 1	Pass or Fail	Notes
clicking create group button	Yes	ㅤ
clicking group name	Yes	ㅤ
clicking next	Yes	ㅤ
clicking contact box twice for 2 people to appear	Yes	- liked roles and thought it’d be helpful to assign responsibilities - assumed message was auto filled and would add info about the purpose of meeting or agenda
clicking create group	Yes	ㅤ

Adding Group Member Task 2	Pass or Fail	Notes
clicking add new member at bottom of page or through settings icon	Yes	- initially went to “create group” button then saw “add new member” button
clicking contact box	Yes	- assumed it was same default message as before and knew it was customizable - suggested having a required and optional column (so didn’t know what our design meant)
clicking invite	Yes	- Didn’t see send reminder and commented it’d be nice to have the option to send people messages to connect their calendar
Thoughts on Calendar connection	ㅤ	- likes it because then he can see everyone’s availability and doesn’t want to wait and rely on someone to manually fill availability - doesn’t think it needs to be as predominant in middle
Thoughts on required column	ㅤ	- guess that it was who’s required and who’s not - concluded that connected calendars means that filled calendar icons indicated that calendars are connected - didn’t know what heading required meant

Scheduling Meeting Task 3	Pass or Fail	Notes
clicking schedule button	Yes	ㅤ
clicking title	Yes	ㅤ
clicking duration	No	- unsure what participant box was at first and thought it was selecting groups - assumed that the edit/add would be groups - went through flow again and then it made sense to have individual members to exclude if needed - it’d be more intuitive to know that the schedule button was for that specific group if there were multiple groups
click discover a time	Yes	ㅤ
clicking 1:30pm time option	Yes	- realized this is where specific meeting info would go in description and that the message in the create a group floe was a message specific to the group and inviting people to it - assumed time defaults to local time - Suggested having “where” for meeting, could be specific platform or place
clicking schedule	Yes	- Wondered what rescheduling would be like

A/B Test Thoughts

A:

Immediately made sense when he looked at it

B:

Confused by OR and took a min to realize the distinction between discovering time or manually selecting time

Wasn’t sure the point of having manual option when if date and time are known a regular calendar invite could be sent

Question Responses:

Use in daily life? - schedule regular meetings and would have more value with more people using platform

Really liked? - available time overlay and knowing everyone’s calendar’s are synced and not having to think of time zones

Anything missing? - suggested having available times colour coded with one colour meaning everyone can attend and another colour for only required people can attend. Make this an activity hub that people interact with regularly so they understand how to use it

Confusing parts? - said maybe doesn’t make much sense to have required and optional in group under contact management because it could change with each meeting

https://www.notion.so/rndadocs/Usability-Testing-Results-fa46d8b8a75b48d9bfda5bbb1b96ffe9?pvs=4