Shashidhar Pai's Journal

PROPOSALS

Presentation for Project 2 Proposal: Visualising Medical Data In Virtual Reality

Presentation for Project 2 Update Slides: Virtual Reality In Medicine and Healthcare Update

Poster: VR in Medicine and HealthCare Poster

In-class Activity: https://sites.google.com/view/brown-vr-sw-review-2018/course-home-page/journals/shashidhar-pais-journal/shashidhars-in-class-engage?authuser=1

Link to flash talk presentation: Shashidhar's VR Flash Talk

Link to your final poster: Shashidhar's VR Journey

ALL OTHER WIKI CONTRIBUTIONS

CONTRIBUTION 1 [Included tutorial links for diff python libraries for visualizations] <https://sites.google.com/view/brown-vr-sw-review-2018/vr-modeling-software/python >

CONTRIBUTION 2 [Added the page for Rhino in VR modeling softwares] <https://www.vrwiki.cs.brown.edu/vr-modeling-software/rhino>

CONTRIBUTION 3 [Added the comparative study for VR Sketch vs Rhino] <https://www.vrwiki.cs.brown.edu/vr-modeling-software/rhino/comparative-study>

CONTRIBUTION 4 [Added the tutorial page to install Rhino] <https://www.vrwiki.cs.brown.edu/vr-modeling-software/rhino/rhino-installation>

CONTRIBUTION 5[Updated the page for VR Sketch] <https://www.vrwiki.cs.brown.edu/vr-modeling-software/vr-sketch>

CONTRIBUTION 6 [Added controls guide page for VR Sketch ] <https://www.vrwiki.cs.brown.edu/vr-modeling-software/vr-sketch/vr-sketch-controls>

CONTRIBUTION 7 [Cadmapper - Load accurate 3D cityscape data ] <https://sites.google.com/view/brown-vr-sw-review-2018/related-technology/cadmapper>

CONTRIBUTION 8 [VR in Medicine] <https://www.vrwiki.cs.brown.edu/applications-of-vr/vr-in-medicine>

CONTRIBUTION 9 [Slicer Basics] <https://www.vrwiki.cs.brown.edu/vr-modeling-software/slicer/basics-of-slicer>

HW1: 9 CHANGES TO 2021 WIKI

10 mins:

a. Update the broken links on the wiki

b. Change the background color to something dark for better contrast

c. Include tutorials links on using different Python libraries - matplotlib and cv2 for visualization

1 hr:

a. Change the navigation bar such that the sub-menu opens upon hovering the mouse on the arrow

b. Improve the comparison table on VR Modeling Software. This is to compare more softwares based on the same factors that Maya and Sketchup are compared.

c. Add Google calendar to the course website to make the display the deadlines in a more organized fashion.

10 hrs:

a. Include tutorials for other VR hardware such as HTC Vive

b. Update the literature review to explore applications of VR in fashion industry such as visiting a virtual fashion show, personalized shopping experience and more.

c. Provide tables and more information to help students gain better understanding of the differences between AR and VR. More literature review on the differences can be shared

HW2: SETUP and Explore

Setup:

a. Set up VR

b. Set up Virtual Desktop

c. Installed Virtual Desktop, SteamVR on Oculus and explored avaiable options

Project Ideas and Softwares

a. Gastrointestinal Endoscopy Visualization

b. Social Network Analysis

c. Retail Analytics

Exploring Google Earth

Review: I absolutely loved the experience. The application is very well built and the use of the hand held controllers are very well integrated into the UI. The controls are very intuitive and easy to learn. The option lay the map/the earth view flat on the ground(X axis) or have it in front of you, like projecting on a wall(Z axis) and the bubble on the controller which when viewed through gives the 3D street view where the highlights.

1) Home in India - No 3D view yet

2) Home away from Home

3) Dream destination

4) Another Home away from home

5) CIT and "the library"

Exploring Dino VR

Exploring Project Ideas

1) Compare VR Software to load 3D model of maps, cities, buildings

a. Things I would do

Install and test multiple softwares capable of loading and editing 3D maps/models
Test loading different data types, models, limiations, collaborative capabilities
Contribute to wiki

b. Class activity

Explore one of the softwares/models

c. Deliveables

Detailed survey of top 4 softwares (install and build times, software compatibility )
Tutorials on how to setup and run basic instructions

d. Evaluation metrics

Capabilities within software to modify or edit the models --> tailor the model to suit data Visualization
Test loading different data types, models, limiations, collaborative capabilities

2) Compare VR applications for Mental health improvement

a. Things I would do

Install and test current industry standard applications available in the market
Contribute to wiki
Contribute to adding additional features to existing applicaitons

b. Class activity

Explore one of the softwares, modes

c. Deliveables

Detailed survey of top 4 applications (install and build times, software compatibility )
Tutorials on how to setup and run basic instructions

d. Evaluation metrics

User experience, rating review
Collaboration experince

Project Proposal and Milestones

Decided on project: Visualise EMS Call Patterns in VR
This project will be divided into Three phases
- Milestones:
- Phase 1 - Getting Started :
  - 2/15/22: Test Intial set up for Enscape and SketchUP - COMPLETE
  - 2/17/22:
    - - Load 1kmX1km 3D models of cities, - COMPLETE
        Find and load larger city files - In Progress
- Phase 2 - Getting hands on with Data
  - 2/22/22: Prepare, clean and analyse data for data viz
    - Based on evaluation, consider possible softwares
    - Integrate 2D data into 3D models and 3D space
    - Add funationality - select, filter, group, order
  - 3/01/22: Add/Explore functionality for collaborators
- Phase 3 - Integrating and Demo
  - 3/03/22: Prepare for in class activity, build tutorial
  - 3/08/22: IN - CLASS ACTIVITY - (To be confirmed)
  - 3/08/22: Project proposal report, publish tutorial
  - 3/10/22: Final presentation and publish report

Peer Review

Journal Peer Review - Beatrice Hoang: https://sites.google.com/view/brown-vr-sw-review-2018/course-home-page/journals/beatrice-hoangs-journal?authuser=1

Self Evaluation

Project (27th Feb 2022)

The proposed project clearly identifies deliverable additions to our VR Software Wiki: 5
The proposed project involves collaboration in VR: 4
The proposed project involves large scientific data visualization along the lines of the "Scientific Data" wiki page and identifies the specific data type and software that it will use: 5
The proposed project has a realistic schedule with explicit and measurable milestones at least each week and mostly every class: 4
The proposed project includes an in-class activity: 5
The proposed project has resources available with sufficient documentation: 3

Journal (27th Feb 2022)

Journal activities are explicitly and clearly related to course deliverables: 4
Deliverables are described and attributed in wiki: 4
Report states total amount of time: 4
Total time is appropriate: 5

Key for each criterion:

5 == exceeds expectations

4 == meets expectations

3 == mostly solid with some gaps

2 == shows some progress

1 == some attempt

0 == not found

Exploring ParaView and Volume Rendering

HOURS SUMMARY

Total: 141 hours

HOURS journal

1/29/22 - 4 Hours

Read the course home page
Gained understanding of the history of VR, different VR hardwares and softwares
Researched 9 fixes to be made on the previous wiki

1/30/2022 - 4 Hours

Joined the slack
Made changes to https://sites.google.com/view/brown-vr-sw-review-2018/vr-modeling-software/python to include more tutorials on how different libraries can be used for visualization
Researched project ideas on VR applications in biology data visualization:
- Read about softwares such as Chimera for data visualization
- Garnered basic idea of some common features of these softwares

2/02/2022 - 5 Hours

Set up VR - apps, steamVR, google earth
Set up Desktop
Explored software options

2/08/2022 - 6 Hours

Explore Project Ideas
Explore VR softwares (Sketchbox, Foretell Reality, Frame VR, EchoVR, vTime XR)
Setup Dino VR (failed - paperspace error)

2/9/22 - 6 Hours

Researched into software to render 3D landscape, SketchUp, Ensacpe
Researched availability of 3D renders for cities
Setup Dino VR

2/15/22 - 7 hours

Watched more software demos and read up on documentation
- Phase 1 - Gettind started
  - Software
    - Enscape
      - Installation - Completed
      - Reveiw - In progress
    - Para view
      - Installation - Completed
    - SketchUp
      - Installation - Completed
      - Reveiw - In progress
    - Evaluate Software based on usability, collaboration, effectiveness, scientific visualization
  - Data
    - Get data
      - 3D models
        1kmX1km 3D city render - Complete
        Larger City scape - Issue - Paid
      - 2D data
        Montogomery Conty,PA - Complete Data found
        Other Major cities - In progress
Weekly Deliverables
- 2/15/22: Test Intial set up for Enscape and SketchUP - COMPLETE
- 2/17/22: Load 1kmX1km 3D models of cities, Find and load larger city files - COMPLETE

2/27/22 - 7 hours

Paraview and Volume Rendering
- Caught up with class as I missed on 02/24/22

2/27/22 - 7 hours

Rhino Software installation, Set up and basic modelling .
Data hunt, find and load
- 2D real world data on EMS calls for Detroit, Dallas, Montgomery County PA.
- 3D cityscape from cadmapper
Prep for In Class activity

3/06/22 - 10 hours

SketchUp installation, Set up and modelling on 3D cityscape
Loaded data in Python, Cleaned data and plotted data on 2d city map using plotly, took longer than expected
Plotting data in SketchUP, Rhino
Exploring VR software integration with Modelling software
Prep for in class activity

3/08/22 - 10 hours

SketchUp and Rhino, Grouping, Layers, Plotting Overlay of images - Steep Learning Curve
Sentio VR, SketchVR single and collaborative views
SentioVR vs SketchVR comparative study
Prep for Proejct 1 in-class activity

3/12/22 - 12 hours

Prep for Project 1 in-class activity
Worked on Final Presentation
Write Tutorials on Rhino, SketchVR, Comparative Study

3/16/22 - 06 hours

Completed Wiki contribution
- Page on Rhino
- Page on Comparative Study between Rhino and SketchUp
Summarized In-Class Activity Responses
Worked on Project Final Presentation for Project 1

3/20/22 - 06 hours

Research into Visualizing Medical Data In Virtual Reality
Built Project #2 Proposal

4/03/22 - 04 hours

Set-Up for Project 2 In-Class activity
Research into Medical Research in VR
The Stanford Virtual Heart – Revolutionizing Education on Congenital Heart Defects
Volumetric Medical Data Visualization for Collaborative VR Environments

4/13/22 - 04 hours

Journal Update/Correction
Updated Peer Journal Review

4/16/22 & 4/17/22 - 10 hours

Worked on Project 2
Finalized VR applications for Project 2
- Engage
- Slicer3D and paraview
Installed Engage and explored the tutorials and tools available
Worked on project 2 progress report

4/23/22 & 4/27/22 - 10 hours

Set-Up Project 2 In-class activity
- Setup Engage collaborative rooms
- Installed and Setup IFX, for in-class activity
- Worked on Inclass activity guide and feedback form

5/2/22 & 5/5/22 - 10 hours

- Drafted Wiki Contributions
  - Updated home page for VR in medicine and healthcare
  - A critical review of Engage application as a Tool for collaboration in an educative environment
- Explored visualizing medical data in VR Slicer 3D
  - Installed Slicer
  - Explore available open-source medical data sets
  - Explored Tutorials on Slicer3D

5/9/22 - 5 hours

- Worked on Project2 Poster and Flash talk

5/14/22 & 5/15/22 - 10 hours

- Completed Wiki Contributions
  - Added Data set guide and Slicer tutorial
  - Added using python to visualize 3D medical data(slicer package and kernel)
- Worked on wrapping up Wiki entries, Journal, and project codebase
- Worked on creating the Final VR journey Poster

Peer Review of Journal (by Beatrice Hoang)

Journal activities are explicitly and clearly related to course deliverables

5 - Yes, activities are clearly expressed and related to deliverables

deliverables are described and attributed in wiki

3 - Deliverables are mentioned in the project presentation and missing in the wiki

report states total amount of time

5 - Yes