**Google Drive Links are shared within Brown. If it does not work, please try Brown gmail. Thanks!
Project 1 Proposal <Project 1 Plan>
Presentation for Project 1 Proposal <Project 1 Proposal Presentation>
In-class Activity <2D and 3D network>
In-class Activity Wiki Handout <Activity 1 Handout>
In-class Activity Feedback Form Results<Network Visualization Activity Feedback>
End Presentation for Project 1 <Project 1 Final Presentation: Visualizing Community Network Graphs in 2D vs. 3D>
Project 2 Proposal <Project 2 Proposal and Plan>
Presentation for Project 2 Proposal <Project2 Plan&Proposal>
In-class Activity Feedback Form Result 1<In-person Charades Feedback>
In-class Activity Feedback Form Result 2 <SpatialVR Collaboration Feedback>
In-class Activity<Activity 2 Handout>
Flash Talk Presentation<Link>
Public Demo <ADD LINK>
ALL OTHER WIKI CONTRIBUTIONS
CONTRIBUTION 1 [2023 Updates on Twitter API] <Twitter API Update Contribution>
CONTRIBUTION 2 [Redirected all the children pages under Student research page] <Student Research>
CONTRIBUTION 3 [wrote a tutorial/introduction page on 2D network visualization using Gephi] <2D Network Visualization>
CONTRIBUTION 4 [Wrote an informative wiki page on community network visualization in Unity] <Network Visualization in VR>
CONTRIBUTION 5[Wrote a project 1 report reviewing in-class activity feedback/VR application evaluation] <Project 1 Final Report & Software evaluation>
CONTRIBUTION 6[Wrote VR Collaboration page] <VR Collaboration: collaborative VR systems>
CONTRIBUTION 7[Combined and updated the list/evaluation of collaborative workspaces] <VR Collaboration>
CONTRIBUTION 9 [Spatial VR evaluation report from in-class activity] <Evaluating Collaboration in SpatialVR>
CONTRIBUTION 10 [evaluating collaboration in XR: research and related work portion of Project 2] <Evaluating VR collaboration>
CONTRIBUTION 11[Journal Article Review 1] <Insight Based Method for Evaluating VR Visualization>
CONTRIBUTION 12[Journal Article Review 2] <Advanced Evaluation of VR Collaboration>
CONTRIBUTION 13[Journal Article Review 3] <Ontology of Evaluation>
CONTRIBUTION 14[Journal Article Review 4] <Fully Expressive Avatar in VR Collaboration>
CONTRIBUTION 15[Journal Article Review 5] <Evaluation of a Multi-user VR System for Collaborative Layout Planning Process>
CONTRIBUTION 16[Journal Article Review 6] <Evaluation of Mixed-Space Collaboration >
CONTRIBUTION 17[Updated Comparison Matrix from previous semesters + added collaborative feature evaluation] <Comparison Matrix[Google Sheets]>
CONTRIBUTION 18 [added evaluating vr systems page: Lists existing evaluation tools, collaboration evaluation forms developed as project 2] <Evaluating VR Systems>
CONTRIBUTION 19 [a short wiki page on NASA TLX] <NASA Task Load Index>
CONTRIBUTION 20 [a short wiki page on SUS] <SUS Evaluation Tool>
Total: 143 hours
1/29/23 - 4 Hours
Set up student journal, joined course slack, reviewed and explored the wiki as well as course homepage
9 Changes to Wiki
2/1/23 - 2 Hours
Followed Quest 2 Setup Guide, Paperspace setup
Explored Oculus and VR earth
Attended Jakobi's office hour to ask questions regarding Virtual Desktop
2/2/23 - 1.5 hours
2/5/23 - 3hrs
Finished in-class Google Earth VR Activities and Objectives (for both VR and Web) + Google Form.
Learned how to format using Google Site for journals
screenshots and recording of three landmarks(via VR): 1st - home, 2nd: Metcalf Hall, 3rd: video from Metcalf to Bethel, Maine
Finished downloading DinoVR on the Paperspace machine. Shared the experience with colleagues in CIT for 7-10 min
2/6/23 - 3hrs
Read some background papers
Read "The History of Digital Realities" , "VR in pop culture" pages on the wiki
Read "TiltBrush, Virtual Music, and Spotify for Audio Visualization in AR" page on the wiki
Tilt Brush: paint feature with audio reactive features
Spotify Web API
Spotify's audio analysis data -> audio manipulation feature
Looked at potential collaborative VR software on the wiki
Free roaming immersive environment to support team-based analysis
Developed in Unity3D
Key: users to author/generate visualizations and place them in space around them
Visualization generated using Immersive Analytics Toolkit (IATK)
IATK supports 3D visualization. However, the authors moved it back to 2D for efficiency (learning time and confusion)
More on the FIESTA system
How users "collaborate when given complete freedom to organize their workspace"
Related Work key points
Physical environment: three types of territories were implicitly created
personal, shared, and storage territories
Users would arrange the contents and analytics egocentrically in body-fixed like fashion while working
Linear or circular layout
10 groups of 3 participants. 2 groups ( A: 2D visualization B: virtual table, 3D visualizations )
Presence of 3D visualization
participants use egocentric layouts to organize the data visualizations
2D and 3D -> difference in user workflow and organization
VR collaborative tabletop metaphor: participants saw no benefit in using the table in an environment where visualization can be placed anywhere.
2/6/23 - 3 hrs
HW due 2/7
MRI Imaging Data
Twitter Community Detection Data
3~5 Project Idea
Utilizing Covid Travel Data From the Wiki, the project evaluates software and UX comparison of VR-Viz and other data visualization software.
3 things I'll do during the project
besides Given Covid Dataset, work with the Covid case number trend and number
Visualize given covid travel data in VR with a map
Make the viewing and analyzing experience collaborative (2+ users)
Generate 2D or web data plots as well as VR demo(sample data) to compare and evaluate the difference.
What defines a good type of dataset for VR/immersive data visualization?
Add the international Covid Travel dataset to the dataset section
Find similar dataset working with other
Comparing and Evaluating Collaborative 3D architecture modeling(structure, interior) visualization software. (visi draft, unreal engine, arki, and potentially gravity sketch as well)
3 things I'll do during the project
Use and evaluate at least 2 software and review how well each can represent spacial elements
Review and read VR user experience research to evaluate egocentric data/workflow as well as the collaborative aspect
Review how these software(supporting more refined visualizations as well as UI experience) could potentially be used to better provide collaborative data visualization space for scientific research purposes
Students get paired up in a group of two. After seeing a provided sample shape, each group try to make the same/similar shape using different software options.
Software Analysis and comparisons for VR architecture under VR for architecture section
Generating a 3D visualization of Twitter community detection results depending on selected communities. (Not sure about datasets. )
3 things I'll do during the project
Get or make a community detection algorithm-produced dataset (had a link to a public project but the dataset link seems to be invalid)
Generate a 3D version of the result(if possible, for different versions depending on different topics in interest)
Make the dataset viewing and analyzing experience collaborative with Photon engine (research needed for details)
Using a simple collaborative workspace, grouping and creative Twitter communities collaboratively (this can be as simple as 30 snapshots potentially evaluating which visualization software suits the best)
Addition to Twitter API/ dataset section of the WIKI. as well as a page on Twitter community detection algorithms
Software Evaluation Metrics
How intuitive is it to learn and use?
How easy it is to collaborate with another user (editing the same virtual object, communication, space)
How easy it is to learn the software's advanced features online?
It is compatible with several operating systems and devices?
How was the quality of the rendering of the space(frames per sec, color saturation, user feedback, etc.)
2/8/23 - 3.5 hrs
Finished DinoVR activities and survey
Tried DinoVR with different features enabled
Watched a course video on Community detection
Girvan-Newman Algorithm, edge betweenness values, high edge betweenness means high possibility of holding edges together.
how does information flow through the network? Social network. How do people find out about new jobs? : Mark Grannovetter's work in 1960s.
Contacts were often acquaintances rather than closer friends
Two perspectives on friendships: 1. structural -- spanning different parts of the network 2. Interpersonal -- can be strong or weak
Strength and structure of the friendships. Information flow: long-range edges allow you to gather information from different parts of the network and get a job. -> access from different communities
Social network evolve to naturally form communities -> triadic closure. = high clustering coefficient
Empirical study by Bearman and Moody: Teenage girls with low clustering coefficient are more likely to contemplate suicide
proves the natural tendency and dependency of a person to be deeply embedded in the network/clusters
However, Granovetter's theory was not tested. -> 2007 this was evaluated based on 20% of EU population
2/11/23 - 4hrs
read articles on Community detection algorithms and networks
Watched tutorials on Gephi and Force Atlas 3d for 3d visualization of the network
Force Directed Graph
Gephi's clustering algorithms for Modularity seem to be the most widely used algorithm for the community detection for social media accounts and similar datasets
Found a step-by-step tutorial on Sample datasets(2)
Have not found a way to get the resulting file from Gephi to Unity Yet.
Phonton seems to be the most reliable collaboration tool.
2/12/23 - 3.5hrs
Was stuck finding ways to make Gephi graphs into 3D and turn that into VR experience in Unity
Jakobi redirected me to check out the force-directed approach which is another way of displaying closeness among nodes
Unity has a physics engine as well as tools to develop force-directed graph representation in 3D
Downloaded unity hub
Found some other Github repo for 3D force-directed graphs
2/13/2023 - 3 hrs
Found wiki tutorial for Unity Photon
HW for 2/14
Evaluation of Project Plan
Here is an evaluation rubric for projects:
o The proposed project clearly identifies deliverable additions to our VR Software Wiki:4
o The proposed project involves collaboration in VR:4
o The proposed project involves large scientific data visualization along the lines of the "Scientific Data" wiki page and identifies the specific data type and software that it will use:5
o The proposed project has a realistic schedule with explicit and measurable milestones at least each week and mostly every class:3
o The proposed project explicitly evaluates VR software, preferably in comparison to related software:4
o The proposed project includes an in-class activity, which can be formative (early in the project) or evaluative (later in the project):3
o The proposed project has resources available with sufficient documentation:4
First Milestone for Feb. 14th
2/17/2023 - 4.5 hours
Lost the original Gephi file for some reason
Found some bugs regarding workspace and data management for Mac
Reinstalled Gephi and recreated the project.
Recreated the community detection from dataset one(1000 nodes and 14,116 edges)
Also explored Gephi functionalities. Created a 2 mode nework from a dataset containing 110 nodes and 142 edges
2/22/2023 - 2.5 hrs
Completed installation steps for both Paraview and Ben's Volume Rendering applications
Played with different functionalities of Paraview(section, contour, color edits, etc.)
2/26/2023 - 5hr
worked on unity and unity tutorial to create force directed graphs
A few tutorials I followed caused errors with the script I was running.
Followed this series of Youtube tutorials for setting up the vr app setting.
Debugging and trouble shooting
created a small example force directed graph with 5 example nodes
2/27/2023 - 2.5 hrs
worked on project1 update presentation for Tuesday.
Found a professional VR network visualization tool Aviar Graph
Reached out the CEO and got a permission for one-off software demo
Also researched about the current state of net work visualization software and technologies (both VR and desktop) and found Neo4j graph database which Aviar Graph utilizes in order to generate it's 3D visualization of networks.
3/1/2023 - 1 hrs
finished Melvin's in-class activity
class in class activities prep
had some issues with sidequest working with my personal computer.
3/3/2023 - 4hrs
Debugging the graph problem. At the moment, the graph get's generated. However, it disappears into the void.
Tried to work with the collider as well as mass and gravity setting for the node prefab.
3/5/2023 -9 hrs
Found the bug. It was happening due to the fact that the generated graph when I start the application (from the script) collides with the plane in the scene, causing the nodes and the graph to "bounce" off and disappear at high speed.
worked with gravity and graph script setting.
Larger dataset was getting buggy. For the in-class activity on 3/7, decided to work with dataset from Les Misérables.
Generated Gephi comparison graph on the same dataset
Generated 3d VR force directed graph
worked on the in-class handout
Generated step by step tutorials for generating a bigger net work community/cluster graphs using gephi
3/6/2023 - 2hrs
worked on the in-class activities handout.
Tried out HackMD for the first time (originally tried to make a handout with a google doc. However, I saw hackMD handout and decided to learn how to use it and make one for my in-class activity).
My in-class activity handout can be found here.
The dataset and the apk file I used for the in-class activity can be found here.
3/8/2023 -2.5 hrs
tried generating a larger graph with new setting and it seems like the graph is a bit more stable.
However, the force directed graph is always moving in contrast to the Gephi algorithm which finds nodes stable positions
Reflection on the VR software with bigger graphs
I have been trying to implement scaling the environment(mainly the graph) using the two congrollers (similar to what we did during the in-class activities on other vr software). However, some of the script I found on the internet have been not working.
One of the example I found was this script.
3/11/2023 - 2.5hrs
Worked on deliverables - Gephi Wiki page as well as Unity Page
Tried to make the nodes responsive to the number of nodes connected. Encountered some errors. making progress.
3/15/2023 - 2hrs
worked on the Project 1 Reflection wiki page content
made project 1 presentation
Wrote self evaluation of my progress
3/19, 20 / 2023 - 2hrs
fixed some visualizations for FDG network visualization. Played with gravity and mass since I could not prevent it from flying away.
Enabling gravity and light mass ended up working well
worked on revised self-evaluation
3/20/2023 - 4hrs
Updated Project Final Report page
Read HW paper
worked on project 2 ideation
3/21/2023 - 2hrs
4/2/2023 - 2.5hrs
read multiple wiki pages related to UX evaluations or software evaluation metrics
revisited the seven scenarios paper in order to get relevant questions + general direction to develop my VR collaboration evaluation project.
4/3/2023 - 2hrs
Looked through more wiki pages
fixed a link under A-frame section of "webVR collaboration tutorial" of "WebVR: overview" page.
Evaluated Current Wiki Page "Collaborative Workspaces" and their metrics
Cleared some of ambiguity regarding the goal of project 2
HW for 4/4
Project Description: Develop evaluation metrics for Collaborative User Experience in VR Data Storytelling and evaluate three software: Glue, MeetingVR, and FlowImmersive
4/9/2023 - 3.5 hours
Read "evaluation of a multi-user VR system for collaborative layout planning processes"
Read "evaluation of Mixed Space Collaboration"
Reviewed NASA Task Load Index
Read and learned about Nielsen's Heuristics
Read and learned about System Usability Scale.
4/10/2023 - 0.5 hours
Prepared Lexi's in-class activity
Read two articles on Hyundai and Kia's new VR/AR design evaluation system
4/12/2023 - 6.5 hrs
journal articles, research papers on evaluation of XR systems
"Evaluation of a multi-user VR system for collaborative layout planning processes "
"Using Fully Expressive Avatar to Collaborate in Virtual Reality: evaluation of Task performance, presence, and attraction"
"Evaluating the effect of collaboration and competition in navigation tasks and spatial knowledge acquisition within virtual reality environments"
"An Ontology for Evaluation of remote collaboration using AR"
Towards Advanced Evaluation of Collaborative XR Spaces
Read wiki pages on collaborative workspaces and created collaboration in XR page under Applications of VR
Here's the project timeline (pivoted and updated version)
4/13/2023 - 2.5hrs
VR workspace software to use and review for the project
Meta Horizon Workrooms
Worked on project 2 progress presentation
4/16/2023 - 1.5 hrs
explored Meta Horizon Workrooms
learned about Flow Immersive
revisited Engage VR features
Brainstorm/ideation for in class activity
4/17/2023 - 5 hrs
Finished Reading journal articles and drafted Journal Article reviews on Notion
Ontology of Evaluation
4/18/2023 - 2.5 hrs
In-class activity design
Designed in person and vr activities based charades. With difficulty controlled.
Worked on standard collaboration XR rubric (added more contextual guide to the evaluation form).
4/19/2023 - 4hrs
changed the in-class activity
Decided to use SpatialVR.
4/22/2023 - 3hrs
finished reading journal articles and wrote a review wiki page draft on Notion
advanced evaluation of VR collaboration
4/24/2023 - 1.5 hrs
4/28/2023 - 2hr
encountered problems with paperspace machine during in-class activity. finished Liza's in-class activity.
Finished Melvin's in-class activity
5/1/2023 - 4.5hrs
finished reading "Insight based method for evaluating VR visualization" and made wiki draft on Notion
finished drafting Evaluation tools
Added insight based evaluation portion to collaborative vr data visualization
5/4/2023 - 1hr
Worked on Project 2 End Presentation
5/5/2023 - 3hrs
worked on wiki contributions
moved journal article review pages to Course Wiki from notion drafts
worked on In-class activity & SpatialVR evaluation Analysis page
5/8/2023 - 1.5 hrs
flash talk presentation
Poster Draft 1 for class on Tuesday
5/13/2023 - 1hr
fixed contribution links and completed adding wiki contributions.
additional wiki pages on SUS, NASA Task Load Index
Added google form templates to previous wiki contributions
total of 133.5 hours so far
5/15/2023 - 6hrs
Evaluated collaboration features of Horizon Worlds and Workrooms (different from collaboration evaluation. It is for updated comparison matrix)<link>
Interested in AR collaboration and tools, I looked up some AR devices including NReal AR Glasses
Revised Flash Talk Presentation
Final Version of project poster
5/16 - 17 / 2023 - 3.5 hrs
Printed poster for the final presentation
practiced flash talk
finished and shared my self-evaluation with Prof. Laidlaw and Jakobi
Checked my demo
Finalized Wiki contributions