Wonderland - User Testing

Usability Test

This time I used the observation method for user testing. After briefing users on my project overview, I let them put on VR and explore on their own. I only explain to users how to proceed to the next scene if they can't get to the next scene.


The following video is the complete process that this usability test should go through.


After they've tested it, I ask them to fill out this feedback form. Most of the questions on this feedback form are about their views on the project and what goes inside their hearts when they encounter problems.

Menu

Opening

Woods

Rabbit Hole

Time Zone

Hall

The Flowers


Tea Party

Rabbit House

Alice Room


Others

Besides the feedback on the form, I also based my observations to spot the problems that users encountered in this VR project. I list out these problems and propose solutions. These will be resolved in future versions.

  • 80% users didn't realise there is a pocket watch on the ground after they touch the rabbit in the Woods (add sfx and indicator)

  •  80% did't complete the using finger to adjust the clock hands task. (Don't make the clock floating; make the clock hands not so smooth; enlarge the finger collider)  

  • 100% users what to do after they get the magnifying glass, and they didn't realise those flowers were growing. (adjust the flow; lat the cat to instruct them where to grow and remind they how to grow; make the growing effect more sharp)  

  • 20% users try to interact with character (add additonal reaction when they throw something on them or punch them)  

  • 80% users don't know need to give rabbit and OK hand sign in Rabbit House (Rabbit need to remind user to give him an OK hand sign)   

  • 40% users don't know where is the Sense when they appear (add sfx) 

  •  100% don't know the letter appear in the Alice Room (add sfx and indicator) 


User Acceptance Test

This time I still used the observation method for user testing. After briefing users on my project overview (new users only), I let them put on VR and explore on their own. I only explain to users how to proceed to the next scene if they can't get to the next scene.


The following video is the complete process that this usability test should go through. 


After they had tested it, I prepared some questions to ask them verbally. Because in the last usability test, I collected quite enough data for improvement. Therefore, this time User Acceptance Test, I ask some questions related to the last time existing problems.


The questions I prepared to ask as the following:

  1. Do you notice that you can punch the girl? Why?
  2. What do you feel about the girl's animation (when she runs)?
  3. Did you notice that some of the elements in the Rabbit Hole are interactable?
  4. Do you think the way to interact with the clock hands is hard or easy?
  5. Did the process of the magnifying glass make you understand what you need to do?
  6. Have you noticed that the Tea Party overall scene has become normal and stable?
  7. Did you know what to do when the rabbit asks your response? How did you know?
  8. What was the main reason you knew you were back in the real world?
  9. What do you think of the characters' voiceover?
  10. Is your VR experience going well this time? Is there any discomfort or not going well? If so, what is it?


The results sequences will be shown as the following questions above:

  1. 100% of the users know that they can punch those characters, but they can't understand the punch instruction immediately because the instruction used "it".

  2. 100% of users will not notice the animations of the little girl because she ran too fast.
  3. 40% of users tried to interact with the item in the rabbit hole. However, some of the items are too far to interact with.
  4. 100% of users found that the clock hands are easy to interact with.
  5. 100% of users know what to do and the flow ran smoothly when they were grabbing the magnifying glass.
  6. 80% of users notice there are differences after they get back the visual sense.
  7. 100% of users know how to respond to the rabbit because the rabbit will remind them what to do.
  8. 100% of users know they are back in the real world because of the shader used, and the scene outside of the window.
  9. 40% of users think that the voiceover of those characters is a bit flat. (Hatter, Rabbit, Cat)
  10. 100% of users said that the VR experience this time is good, and there is nothing particularly difficult or unsmooth. They can basically complete this VR story.

One of the concerns is the font used in the project. So I also asked for their feeling about the font used.

100% of users actually don't really pay attention to the fonts used in the projects. However, when I asked this question, 20% of users said it could be better.


I also based my observations to spot the problems that users encountered in this VR project. I list out these problems and propose solutions. These will be resolved in the final versions.

  • There is some chance that when the user inserts the key into the lobby door, the door won't open because the detection doesn't cover enough areas.

  •  60% of the users didn't know what to do after gaining hearing in The Flowers scene, because the caterpillar didn't tell them that they could go back to the lobby. 

  •  The instructions in the menu scene are too dark to read.

Comments

Post a Comment