VR Collaboration Evaluation

Created by Dave Song Spring 2023 

<After Evaluation Activity>

[Individual Evaluation]

Collaboration Task Load

Likert Scale of 1-10

Mental Demand

• How much mental and perceptual activity was required to collaborate(verbal and nonverbal) with other users in the same environment? Was the collaboration process easy or demanding, simple or complex?

Physical Demand

• Was the VR collaboration physically easy or demanding, slack or strenuous compared to in-person collaboration?

Effort

• How hard did you have to work to communicate and collaborate with other users in the space?

Frustration Level

• How irritated, stressed, and annoyed versus content, relaxed, and complacent did you feel while communicating and collaborating with other users in the environment? Did the plans and agenda you planned go as you wish?

System Usability for Collaboration

Likert Scale of 1-10

1. I think that I would like to use this system frequently for future VR collaboration.

2. I thought the system was easy to use to collaborate with others.

3. I found the various functions in this system were well integrated to support the flow of natural collaboration and communication.

4. I would imagine that most people would learn to use this system very quickly.

5. I found the system very cumbersome to use.

6. I felt very confident using the system for effective collaboration and communication.

Interaction Evaluation

Likert Scale of 1-10

1. I could collaborate with others in the system without noticeable latency

2. I could collaborate with others without noticeable bugs

3. Verbal communication(volume, quality, latency) resembled and satisfied what is required for the team to complete successful collaboration. (if the software supports 3D audio, the score starts from 7)

4. Body tracking for the avatars was accurate. From avatar motion tracking, I could tell exactly what other users are doing in the environment.

5. Through the system’s hand-tracing feature, I was able to tell what other users are doing. It was able to track all ranges of dexterity.

6. Face expression was tracked and displayed through the avatar representation of my collaborators.

Additional Qualitative Questions

1. Which features support the natural flow of collaboration that resembles a successful collaboration done in person?

2. Which features(or lack of them) the system failed to support successful collaboration in the VR system?

3. Which visualization or annotating tool you found most helpful when finding insights?

4. How often did you know where your collaborators are located?

5. During the collaboration, how often did you know what your partner could see?

6. How often did you know what your partner is directly looking at?

For Google Form Template, Click Here.

To use the template, please make a copy and edit.