Usability Testing Results Round 2

Summary

High level observations

Privacy of the wallet does not make users more likely to use our product and the ease of use is more important than privacy

2/3 noticed the group feature as being different from what other scheduling platforms offer but 1/3 are more likely to use MWW because of the group feature. The others won’t use it because there are other barriers surrounding the MWW product

Specific changes

We need to focus suggesting groups to people as the main flow because it is not natural for users to create a group that is separate from scheduling a meeting. When asked to create a group they think they are creating a meeting. My assumption is that users think that creating a group requires more mental work than the group automatically being created after participants are added

Incorporating a group suggestion when adding participants when scheduling a meeting - “Make this a group” when 3+ people are added

Remove the listed participants below the text box and change to a drop down that shows other contacts as the contact is being typed and then have the added contact or group to the text box - how a common text box functions when adding people

Remove filter and sort buttons on “my groups” page for MVP cause users didn’t see the value in them

Incorporate clarity of how the group link can be used because users aren’t sure what it does - does it invite people to join group or schedule meetings with someone outside group

Main insights

All 3 went to “new meeting” button first when asked to create a group then went to groups as a second option - users are used their common user flows of scheduling a meeting and don’t think of creating a group before scheduling the meeting

All 3 did not expect the invited participants to appear in a list below the text box - a couple suggested a drop down when typing a contact or group and expected the contact/group to be added to the text box

2/3 like option B better for scheduling options because there is a distinction between the two actions and it is more obvious that “discovering a time” is an option. 1 user expected one more step before the schedule step in case they needed to edit any other info (1 user suggested the same in round 1)

Scheduling option A - 1 user suggested that their attention goes to “schedule” before “discover a time” and “discover a time” doesn’t look clickable

All agree that ease of use for a non-transactional product is more important than privacy/security

3 users said that the privacy/security doesn’t make them any more likely to use the product over other scheduling platforms

2/3 would not use this feature because they have a small team and the UX is confusing, wants basic functions of other apps

2/3 noticed the group feature as being different from what other scheduling platforms offer

1/3 are more likely to use the product because of the group scheduling feature while the others think the wallet integration is a barrier and would use it if i was integrated with other mediums

All suggested that suggestions of groups with people who they frequently meet - this requires less mental work from the user going and creating the group before hand

2/3 didn’t see reason for filter and sort options under “my groups” page

2/3 users unsure/confused of how the group link would be used

Individual suggestions to possibly explore:

Make send reminder prompt more obvious (1 other user didn’t notice it last testing)

The wording of “2 invitees” confused 1 user and thought that it meant a group of 2 people

1 user was unclear of how people would be added to the group. Do people need to RSVP and then added or they are added automatically and notified

Adding the option to create a group when adding/editing the participants when scheduling a meeting

Use different colour for checkmark on meeting confirmation screen because orange is close to red

Adding platform that will be used for meeting

Incorporate an indicator like an icon on the meeting confirmation page that it is a group meeting

RAW DATA

Red = pain point they struggled with

Green = common suggestion from users

Yellow = singular suggestions from user to incorporate in new design

Blue = Patterns in responses from follow-up questions

Jaski

Creating Group Task 1	Pass or Fail	Notes
click “my groups”	No	- went to new meeting first, suggested toning down colour of profile box above new meeting cause it’s distracting
click “create new group”	Yes	ㅤ
click group name text box	Yes	- wasn’t clear if he could modify group calendar link
click “next”	Yes	- took a minute to read instructions - expected to see a drop down with saved addresses - wasn’t sure where the message would be going to - would it be email
click contact text box twice	Yes	- suggested having a link for the group that could be sent to people and then they join from that
click “create group”	Yes	ㅤ
click “view group”	Yes	- liked seeing connections, send reminder prompt wasn’t obvious to him and suggested changing it to be more obvious like an icon - wasn’t sure what schedule would do - didn’t know what the icon was beside daniel’s name (leave group icon) thought it went somewhere else

Can you please add a person who is an admin member

added member without issue and changed their role

Scheduling Meeting Task 2	Pass or Fail	Notes
click “new meeting”	Yes	- said he would also access it through “my groups”
click title text box	Yes	ㅤ
click “add/edit groups”	ㅤ	- expected participants text box to be a drop down - doesn’t seem like there’s an option to add individuals and wants a clear signal for groups vs individuals
click toggle for “RnDAO marketing”	ㅤ	- said it wasn’t good UX cause letting people edit groups there is having users focus on more than 1 thing - suggested having an indicator of if people have connected to group - suggested having an option to create a group
click “save”	Yes	ㅤ
click “discover a time”	Yes	- understood this
click “1:30 - 2:30pm”	Yes	- complicated UX and wants to see how schedules are overlapping, wants to see into others availabilites/calendars - suggested removing discover a time once a time is chosen
click “schedule”	Yes	- suggested different colour for checkmark cause orange is close to red

What do you think of this screen? How would you navigate through this screen to schedule a meeting?

Option B - it’s better UX and very clear that the product is discovering a time and there’s another option to complete it manually. Was expecting 1 more step to be able to edit info. said user flow was easier

Follow Up Questions:

Is the ease of use of a platform more important than the security of the product?

In web3 in general no but for non-transactional platforms the ease of use is because we’ve gotten used to easy to use platforms

Would you use this group scheduling feature over the platforms your currently using for scheduling group meetings?

Being able to share links creates a seamless experience might start using it but would be more likely to with a link option and if it offered basic functions as other apps and if UX was fixed

Does the security of MWW increase your chances of using the group feature over the platforms you’re currently using for group scheduling/other platforms like calendly?

not sure because he can create fake accounts if he was concerned about it so maybe not with security and privacy but if he was dealing with crypto and able to message other ENS then it would

Do you notice any features from our product that are different from other group scheduling platforms?

ease of access of group meeting feature, integration of wallet, being web3

Do the features you listed make you any more likely to use our product?

if he can access MWW through other mediums he’d start using it more, if platform is good enough thinks people will use it

Would it be helpful to your work flow to have groups of people already made that you could have meetings with?

wasn’t sure what this would look like and I re-worded the question to ask again

Thought that it could be confusing but wants easy access to frequent groups - showing top 3 groups of showing people frequently scheduling with

said to suggest groups could be a good idea but may become to random unless there’s parameters around the suggestions like only suggesting a group for people who are frequently meeting

Is there anything that you thought was missing in the design?

use emojis or icons more, nothing else

Is there anything that you really liked with this design?

liked easy access to groups and said good experience, likes logo

Yatan

Creating Group Task 1	Pass or Fail	Notes
click “my groups”	No	- went to and said “new meeting” is first choice and expected a pop up to add guests - then went to “my groups”
click “create new group”	Yes	ㅤ
click group name text box	Yes	ㅤ
click “next”	Yes	ㅤ
click contact text box twice	Yes	- expected to type email or name because doesn’t know other peoples wallet addresses - suggested to have section of people you meet with often - wanted to see the platform that meeting on
click “create group”	Yes	ㅤ
click “create group”	Yes	- wording of 2 invitees made it seem like there’s only 2 ppl in group

Thoughts on my groups page

didn’t see himself in group - there’s no indication that he is in group, he always concerned with calendar not syncing, wouldn’t know what to do with sort or filter, after looking at settings options thought that this group is a group that guests can schedule a meeting with via the link and didn’t think link is useful for internal uses, liked settings options

Scheduling Meeting Task 2	Pass or Fail	Notes
click “new meeting”	Yes	ㅤ
click title text box	No	- went to adding people first
click “add/edit groups”	Yes	- was confused by participants in group cause they weren’t the same as people who were listed in group initially, thought design was logical and easy with toggle, assumed toggle would add groups,
click toggle for “RnDAO marketing”	Yes	ㅤ
click “save”	Yes	ㅤ
click “discover a time”	Yes	- possibly change date format to more common world format, unsure and assumed he chose 60 min
click “1:30 - 2:30pm”	No	- liked 3 day options instead of clicking though, suggested colour code for AM/PM, somehow of including meeting preference times,
click “schedule”	Yes	- add team name and topic, unsure how invitees will receive/join the group - are they automatically added to the group and notified or do they have to RSVP to be apart of group

What do you think of this screen? How would you navigate through this screen to schedule a meeting?

Option B - likes better - likes that discover a time is more obvious and reminds him of google flights, not clear that scheduling a group meeting, suggested having separate options for adding groups and individuals, likes having discover a time instead of coordinating times with individuals, indicator that this is a group meeting after selecting time possibly an icon, title is too vague and needs more context when appearing in calendar

Follow Up Questions:

Is the ease of use of a platform more important than the security of the product?

Yes - won’t use if not easy to use

Would you use this group scheduling feature over the platforms your currently using for scheduling group meetings?

Yes - doesn’t have to coordinate, used similar feature on calendly but it’s too expensive, would ask people to use MWW so he doesn’t have to do coordination

Does the security of MWW increase your chances of using the group feature over the platforms you’re currently using for group scheduling/other platforms like calendly?

doesn’t matter to him

Do you notice any features from our product that are different from other group scheduling platforms?

discover a time between several people

Do the features you listed make you any more likely to use our product?

much more likely and would be reason why he’d use it

Would it be helpful to your work flow to have groups of people already made that you could have meetings with?

Yes - would like suggestions of making groups of people who are met with frequently

Is there anything that you thought was missing in the design?

Is there anything that you really liked with this design?

Paul Malin

Tasks: 

Creating Group Task 1	Pass or Fail	Notes
click “my groups”	No	- Initially went to new meeting button and this is his preference, said he’d usually do that if wanting to meet with two people and second thought was to go to my groups - said he’s not trying to create a group ever and said he only would if he had a bunch of reports to review and had nothing better to do with his time - because people are busy and they procrastinate. Suggested that MWW automatically asks to create a group if there is a meeting with more than 2 people and that the more natural the flow is the better
click “create new group”	Yes	ㅤ
click group name text box	Yes	ㅤ
click “next”	Yes	ㅤ
click contact text box twice	Yes	- for adding people to group he didn’t read anything on page and knew to click contact box cause of UI. Didn’t know why and didn’t think that contacts being added below in list format meant that they were added to group. List just looked like a list instead of people in group. Suggested having a drop down menu
click “create group”	Yes	ㅤ
click “view group”	Yes	initial said it looked okay and knew what majority of buttons communicated but wasn’t sure of need for filter, sort, and search. Like pending statuses, reminders, clicked on all buttons

Can you please add a person who is an admin member

didn’t like ux of adding contacts appearing in a list and suggested drop down and then the chosen contact being added to text box

Scheduling Meeting Task 2	Pass or Fail	Notes
click “new meeting”	Yes	- was in meeting category, hovered on my groups then selected new meeting, added group easily, said looks good
click title text box	Yes	ㅤ
click “add/edit groups”	Yes	- showed some hesitation for clicking on add/edit groups
click toggle for “RnDAO marketing”	Yes	ㅤ
click “save”	Yes	ㅤ
click “discover a time”	Yes	ㅤ
click “1:30 - 2:30pm”	Yes	Liked that it populated times
click “schedule”	Yes	liked icons
ㅤ	ㅤ	ㅤ

What do you think of this screen? How would you navigate through this screen to schedule a meeting?

Option B first instinct is to select schedule now, didn’t notice time wasn’t selected and was unsure why date was chosen already and wasn’t sure of next step and forcing him to think. Wouldn’t be as confused about discover a time if the date wasn’t auto populated and since the date is chosen it makes him think a time was already selected. “discover a time” button is demanding to be clicked and can’t click schedule until time is chosen

confused by both - a lot happening and unsure of next step

Option A prefilled date made sense based on the way his eyes scan the info so time and discover a time after after the date and each other

looks like “discover a time” button isn’t clickable and wants to click schedule

Follow Up Questions:

Is the ease of use of a platform more important than the security of the product?

Ease of use over security because not as worried about being hacked with scheduling

Would you use this group scheduling feature over the platforms your currently using for scheduling group meetings?

I am not a member of a large team or set of teams (2 person team right now) so when I am scheduling a group it tends to be best for me to ask them to find times that work on their side... IF I was managing a big team in a larger org etc. I would definitely use it.

Does the security of MWW increase your chances of using the group feature over the platforms you’re currently using for group scheduling/other platforms like calendly?

security for me is table stakes. the idea that MWW has better security than calendly would never cross my mind. feels like a solution in search of a problem. what's wrong with calendly's and other scheduling apps' security?

Do you notice any features from our product that are different from other group scheduling platforms?

wallet integration is different. feels cool and feels like the place the puck is GOING so to speak. maybe great for anons... can't remember other features!

Do the features you listed make you any more likely to use our product?

unfortunately, I worry that wallet integration makes me LESS likely to use the product for now. I feel like it needs to be secondary to the email integration - like make is full web2 with email etc. and IF you add your wallet then additional wallet related features are added to the UX. I say this, but Cambrian Protocol (my project) ONLY works with a wallet ;) we'll get there

Would it be helpful to your work flow to have groups of people already made that you could have meetings with?

I think it is an interesting concept - like autofilling once you add one name, it autofills the rest of the group and you can hit TAB or something to have it go from a suggestion in grey to added in black font

Is there anything that you thought was missing in the design?

nope - said he’d be confident about knowing what buttons do after 1 -2 uses

Is there anything that you really liked with this design?

I like the design - logo, color scheme, layout etc. serious but still fun.

Usability Testing Results Round 2

Summary

High level observations

Privacy of the wallet does not make users more likely to use our product and the ease of use is more important than privacy

2/3 noticed the group feature as being different from what other scheduling platforms offer but 1/3 are more likely to use MWW because of the group feature. The others won’t use it because there are other barriers surrounding the MWW product

Specific changes

We need to focus suggesting groups to people as the main flow because it is not natural for users to create a group that is separate from scheduling a meeting. When asked to create a group they think they are creating a meeting. My assumption is that users think that creating a group requires more mental work than the group automatically being created after participants are added

Incorporating a group suggestion when adding participants when scheduling a meeting - “Make this a group” when 3+ people are added

Remove the listed participants below the text box and change to a drop down that shows other contacts as the contact is being typed and then have the added contact or group to the text box - how a common text box functions when adding people

Remove filter and sort buttons on “my groups” page for MVP cause users didn’t see the value in them

Incorporate clarity of how the group link can be used because users aren’t sure what it does - does it invite people to join group or schedule meetings with someone outside group

Main insights

All 3 went to “new meeting” button first when asked to create a group then went to groups as a second option - users are used their common user flows of scheduling a meeting and don’t think of creating a group before scheduling the meeting

All 3 did not expect the invited participants to appear in a list below the text box - a couple suggested a drop down when typing a contact or group and expected the contact/group to be added to the text box

2/3 like option B better for scheduling options because there is a distinction between the two actions and it is more obvious that “discovering a time” is an option. 1 user expected one more step before the schedule step in case they needed to edit any other info (1 user suggested the same in round 1)

Scheduling option A - 1 user suggested that their attention goes to “schedule” before “discover a time” and “discover a time” doesn’t look clickable

All agree that ease of use for a non-transactional product is more important than privacy/security

3 users said that the privacy/security doesn’t make them any more likely to use the product over other scheduling platforms

2/3 would not use this feature because they have a small team and the UX is confusing, wants basic functions of other apps

2/3 noticed the group feature as being different from what other scheduling platforms offer

1/3 are more likely to use the product because of the group scheduling feature while the others think the wallet integration is a barrier and would use it if i was integrated with other mediums

All suggested that suggestions of groups with people who they frequently meet - this requires less mental work from the user going and creating the group before hand

2/3 didn’t see reason for filter and sort options under “my groups” page

2/3 users unsure/confused of how the group link would be used

Individual suggestions to possibly explore:

Make send reminder prompt more obvious (1 other user didn’t notice it last testing)

The wording of “2 invitees” confused 1 user and thought that it meant a group of 2 people

1 user was unclear of how people would be added to the group. Do people need to RSVP and then added or they are added automatically and notified

Adding the option to create a group when adding/editing the participants when scheduling a meeting

Use different colour for checkmark on meeting confirmation screen because orange is close to red

Adding platform that will be used for meeting

Incorporate an indicator like an icon on the meeting confirmation page that it is a group meeting

RAW DATA

Red = pain point they struggled with

Green = common suggestion from users

Yellow = singular suggestions from user to incorporate in new design

Blue = Patterns in responses from follow-up questions

Jaski

Creating Group Task 1	Pass or Fail	Notes
click “my groups”	No	- went to new meeting first, suggested toning down colour of profile box above new meeting cause it’s distracting
click “create new group”	Yes	ㅤ
click group name text box	Yes	- wasn’t clear if he could modify group calendar link
click “next”	Yes	- took a minute to read instructions - expected to see a drop down with saved addresses - wasn’t sure where the message would be going to - would it be email
click contact text box twice	Yes	- suggested having a link for the group that could be sent to people and then they join from that
click “create group”	Yes	ㅤ
click “view group”	Yes	- liked seeing connections, send reminder prompt wasn’t obvious to him and suggested changing it to be more obvious like an icon - wasn’t sure what schedule would do - didn’t know what the icon was beside daniel’s name (leave group icon) thought it went somewhere else

Can you please add a person who is an admin member

added member without issue and changed their role

Scheduling Meeting Task 2	Pass or Fail	Notes
click “new meeting”	Yes	- said he would also access it through “my groups”
click title text box	Yes	ㅤ
click “add/edit groups”	ㅤ	- expected participants text box to be a drop down - doesn’t seem like there’s an option to add individuals and wants a clear signal for groups vs individuals
click toggle for “RnDAO marketing”	ㅤ	- said it wasn’t good UX cause letting people edit groups there is having users focus on more than 1 thing - suggested having an indicator of if people have connected to group - suggested having an option to create a group
click “save”	Yes	ㅤ
click “discover a time”	Yes	- understood this
click “1:30 - 2:30pm”	Yes	- complicated UX and wants to see how schedules are overlapping, wants to see into others availabilites/calendars - suggested removing discover a time once a time is chosen
click “schedule”	Yes	- suggested different colour for checkmark cause orange is close to red

What do you think of this screen? How would you navigate through this screen to schedule a meeting?

Follow Up Questions:

Is the ease of use of a platform more important than the security of the product?

In web3 in general no but for non-transactional platforms the ease of use is because we’ve gotten used to easy to use platforms

Would you use this group scheduling feature over the platforms your currently using for scheduling group meetings?

Being able to share links creates a seamless experience might start using it but would be more likely to with a link option and if it offered basic functions as other apps and if UX was fixed

Does the security of MWW increase your chances of using the group feature over the platforms you’re currently using for group scheduling/other platforms like calendly?

not sure because he can create fake accounts if he was concerned about it so maybe not with security and privacy but if he was dealing with crypto and able to message other ENS then it would

Do you notice any features from our product that are different from other group scheduling platforms?

ease of access of group meeting feature, integration of wallet, being web3

Do the features you listed make you any more likely to use our product?

if he can access MWW through other mediums he’d start using it more, if platform is good enough thinks people will use it

Would it be helpful to your work flow to have groups of people already made that you could have meetings with?

wasn’t sure what this would look like and I re-worded the question to ask again

Thought that it could be confusing but wants easy access to frequent groups - showing top 3 groups of showing people frequently scheduling with

said to suggest groups could be a good idea but may become to random unless there’s parameters around the suggestions like only suggesting a group for people who are frequently meeting

Is there anything that you thought was missing in the design?

use emojis or icons more, nothing else

Is there anything that you really liked with this design?

liked easy access to groups and said good experience, likes logo

Yatan

Creating Group Task 1	Pass or Fail	Notes
click “my groups”	No	- went to and said “new meeting” is first choice and expected a pop up to add guests - then went to “my groups”
click “create new group”	Yes	ㅤ
click group name text box	Yes	ㅤ
click “next”	Yes	ㅤ
click contact text box twice	Yes	- expected to type email or name because doesn’t know other peoples wallet addresses - suggested to have section of people you meet with often - wanted to see the platform that meeting on
click “create group”	Yes	ㅤ
click “create group”	Yes	- wording of 2 invitees made it seem like there’s only 2 ppl in group

Thoughts on my groups page

Scheduling Meeting Task 2	Pass or Fail	Notes
click “new meeting”	Yes	ㅤ
click title text box	No	- went to adding people first
click “add/edit groups”	Yes	- was confused by participants in group cause they weren’t the same as people who were listed in group initially, thought design was logical and easy with toggle, assumed toggle would add groups,
click toggle for “RnDAO marketing”	Yes	ㅤ
click “save”	Yes	ㅤ
click “discover a time”	Yes	- possibly change date format to more common world format, unsure and assumed he chose 60 min
click “1:30 - 2:30pm”	No	- liked 3 day options instead of clicking though, suggested colour code for AM/PM, somehow of including meeting preference times,
click “schedule”	Yes	- add team name and topic, unsure how invitees will receive/join the group - are they automatically added to the group and notified or do they have to RSVP to be apart of group

What do you think of this screen? How would you navigate through this screen to schedule a meeting?

Follow Up Questions:

Is the ease of use of a platform more important than the security of the product?

Yes - won’t use if not easy to use

Would you use this group scheduling feature over the platforms your currently using for scheduling group meetings?

Yes - doesn’t have to coordinate, used similar feature on calendly but it’s too expensive, would ask people to use MWW so he doesn’t have to do coordination

Does the security of MWW increase your chances of using the group feature over the platforms you’re currently using for group scheduling/other platforms like calendly?

doesn’t matter to him

Do you notice any features from our product that are different from other group scheduling platforms?

discover a time between several people

Do the features you listed make you any more likely to use our product?

much more likely and would be reason why he’d use it

Would it be helpful to your work flow to have groups of people already made that you could have meetings with?

Yes - would like suggestions of making groups of people who are met with frequently

Is there anything that you thought was missing in the design?

Is there anything that you really liked with this design?

Paul Malin

Tasks: 

Creating Group Task 1	Pass or Fail	Notes
click “my groups”	No	- Initially went to new meeting button and this is his preference, said he’d usually do that if wanting to meet with two people and second thought was to go to my groups - said he’s not trying to create a group ever and said he only would if he had a bunch of reports to review and had nothing better to do with his time - because people are busy and they procrastinate. Suggested that MWW automatically asks to create a group if there is a meeting with more than 2 people and that the more natural the flow is the better
click “create new group”	Yes	ㅤ
click group name text box	Yes	ㅤ
click “next”	Yes	ㅤ
click contact text box twice	Yes	- for adding people to group he didn’t read anything on page and knew to click contact box cause of UI. Didn’t know why and didn’t think that contacts being added below in list format meant that they were added to group. List just looked like a list instead of people in group. Suggested having a drop down menu
click “create group”	Yes	ㅤ
click “view group”	Yes	initial said it looked okay and knew what majority of buttons communicated but wasn’t sure of need for filter, sort, and search. Like pending statuses, reminders, clicked on all buttons

Can you please add a person who is an admin member

didn’t like ux of adding contacts appearing in a list and suggested drop down and then the chosen contact being added to text box

Scheduling Meeting Task 2	Pass or Fail	Notes
click “new meeting”	Yes	- was in meeting category, hovered on my groups then selected new meeting, added group easily, said looks good
click title text box	Yes	ㅤ
click “add/edit groups”	Yes	- showed some hesitation for clicking on add/edit groups
click toggle for “RnDAO marketing”	Yes	ㅤ
click “save”	Yes	ㅤ
click “discover a time”	Yes	ㅤ
click “1:30 - 2:30pm”	Yes	Liked that it populated times
click “schedule”	Yes	liked icons
ㅤ	ㅤ	ㅤ

What do you think of this screen? How would you navigate through this screen to schedule a meeting?

confused by both - a lot happening and unsure of next step

Option A prefilled date made sense based on the way his eyes scan the info so time and discover a time after after the date and each other

looks like “discover a time” button isn’t clickable and wants to click schedule

Follow Up Questions:

Is the ease of use of a platform more important than the security of the product?

Ease of use over security because not as worried about being hacked with scheduling

Would you use this group scheduling feature over the platforms your currently using for scheduling group meetings?

Does the security of MWW increase your chances of using the group feature over the platforms you’re currently using for group scheduling/other platforms like calendly?

Do you notice any features from our product that are different from other group scheduling platforms?

wallet integration is different. feels cool and feels like the place the puck is GOING so to speak. maybe great for anons... can't remember other features!

Do the features you listed make you any more likely to use our product?

Would it be helpful to your work flow to have groups of people already made that you could have meetings with?

Is there anything that you thought was missing in the design?

nope - said he’d be confident about knowing what buttons do after 1 -2 uses

Is there anything that you really liked with this design?

I like the design - logo, color scheme, layout etc. serious but still fun.