Eunjin Hong's Journal
PROPOSALS
Presentation for Project 1 Proposal
End Presentation for Project 1
Presentation for Project 2 Proposal <ADD LINK>
Poster <ADD LINK>
In-class Activity <ADD LINK>
Public Demo <ADD LINK>
ALL OTHER WIKI CONTRIBUTIONS
CONTRIBUTION 1 : Replace with another link in VR in the performing arts page.
CONTRIBUTION 2 : Artivive as platform for creatives example in VR in the performing arts page.
CONTRIBUTION 3 : Added Cinema4D to VR modeling software page.
CONTRIBUTION 4 : Added AR for real world sensing page.
CONTRIBUTION 5 : Added Comparison page. (OpenXR VS Meta XR SDK Package Comparison)
CONTRIBUTION 6 : Added Capture Passthrough Camera Frames in Unity page.
CONTRIBUTION 7 : Added Passthrough Brightness Controller Tutorial page.
CONTRIBUTION 8 : Added Passthrough Brightness control by creating lighting spheres page. ( Step by step tutorial, resources, How to make the brightness layer more natural? What does 0.5f convert to in lux light intensity? User experience of lighting modification using lighting spheres in AR)
CONTRIBUTION 9 : Added URP VS Standard Render Pipeline in Comparison page.
LEARNING GOALS
before after
---- ----
| 1 | 4 | Goal 1: articulate AR/VR visualization software tool goals, requirements, and capabilities;
| 3 | 4 | Goal 2: construct meaningful evaluation strategies for software libraries, frameworks, and applications; strategies include surveys, interviews, comparative use, case studies, and web research;
| 2 | 4 | Goal 3: execute tool evaluation strategies;
| 1 | 3 | Goal 4: build visualization software packages;
| 1 | 3 | Goal 5: comparatively analyze software tools based on evaluation;
| 1 | 4 | Goal 6: be familiar with a number of AR/VR software tools and hardware;
| 1 | 4 | Goal 7: think critically about software;
| 4 | 5 | Goal 8: communicate ideas more clearly;
| 1 | 4 | Goal 9: Know when/where VR&AR data visualization would be effective
HOURS SUMMARY
Total: 76.5 hours (added by 3/19)
HOURS journal
3/19/25 - 1.5 hour
Prepare project 2 presentation
3/17/25 - 2.5 hours
Read Seven Scenarios paper
Draft project 2 plan here
Project Evaluation
I can use...
1. Understanding Environments and Work Practices (UWP)
I can research and analyze how lighting decisions are currently made in different environments (e.g., offices, classrooms, homes).
I can talk to RISD interior architecture students / architecture student / students who moved recently to understand their pain points and expectations when making decisions on lighting.
2. Evaluating User Performance (UP)
I can give a task to users ( for instance to aim for a certain lux number) and measure task efficiency and accuracy in adjusting lighting in passthrough environment. Time taken to achieve a target light intensity could be the metric.
3. Evaluating User Experience (UE)
User experience will be qualitatively assessed through surveys and discussions. (Similar to project 1 surveys)
I will collect feedback on ease of use, clarity of UI, and overall satisfaction.
4. Evaluating Visualization Algorithms (VA)
The accuracy and computational efficiency of light intensity detection could be tested.
How precisely the tool detects lighting conditions would be the key performance metric.
3/16/25 - 2 hours
Project 2 ideation & Research
3/14/25 - 1 hour
Catch up with class activity
3/12/25 - 5.5 hours
Prepare final presentation
Add wiki page Passthrough Brightness control by creating lighting spheres
Catch up with class activity
3/10/25 - 1 hours
Catch up with class activity
Conner, Aarav
3/9/25 - 4 hours
Prepare class activity
2/27/25 - 7 hours
Work on project
adjust lighting by creating and deleting light source
2/27/25 - 3 hours
Work on project
create lighting spheres using controller
2/26/25 - 2 hours
Work on project
Try out building blocks
2/24/25 - 3.5 hours
Add Which option is better, URP vs Standard Render Pipeline? to the wiki
Prepare presentation
2/21/25 - 4.5 hours
Start a new test on using the right controller joystick to increase and decrease the lighting of passthrough mode
Failed after few trials..
Added Passthrough Brightness Controller Tutorial page
2/20/25 - 3.5 hours
https://github.com/t-34400/QuestMediaProjection?tab=readme-ov-file
Tried using plugin above on previous project with pass through already set up
Alternatives
Connect a photoresistor + arduino + unity to collect data through photoresistor and visualize in unity
How would I map that?
Use the controller as the trigger (time) to get the data from arduino?
2/19/25 - 2 hours
Unity AVP lab
2/18/25 - 5 hours
Work on project
Look for other method to capture passthrough mode
https://github.com/t-34400/QuestMediaProjection?tab=readme-ov-file
Followed tutorial and managed to get access to Quest 3 Android camerabuilt successfully but not sure if it's working..?
Then tried to use OVRCameraRig but errors appeared.
Log journal
Think of alternatives...
2/17/25 - 5 hours
Work on project
Check frame capture : The method used to capture the camera frame (via RenderTexture and reading pixels) might be capturing a static image if the camera’s feed isn’t updating as expected.
Troubleshooting 1 : To ensure that the camera is actually updating its frame I added debugging logs in the capture routine to verify that new textures are being captured.
Logged not just the average light intensity, but also captured time, sample pixel color and light intensity.
Found out that it gave sample pixel color and light intensity only once. (Frame capture is done every second.)
This could be happening because Texture2D object might not be refreshing as expected or there could be issues with how the pixel data is being accessed or updated in the texture.
Also Quest Headset kept giving me errors that there was not enough memory to run my project???
Troubleshooting 2 : Reduced texture resolution to decrease memory usage and tried to check if every time I capture a frame, a new Texture2D is created and populated.
--> Releasing render texture that is set to be RenderTexture.active! UnityEngine.RenderTexture:Release () LightEstimator:CaptureCameraFrame (UnityEngine.Camera) (at Assets/LightEstimator.cs:87) LightEstimator/<CaptureLightIntensity>d__4:MoveNext () (at Assets/LightEstimator.cs:36) UnityEngine.SetupCoroutine:InvokeMoveNext (System.Collections.IEnumerator,intptr)
Order of operations was wrong..?
(Also after switching to Standard Render Pipeline the box turned pink)
2/16/25 - 2 hours
Complete installation steps for both Paraview and Ben's Volume Rendering applications
Work on project
Research methods for debugging
2/12/25 - 7 hours
Journal review
Journal activities are explicitly and clearly related to course deliverables - 5
deliverables are described and attributed in wiki - 3 (New deliverables need to be organized then be uploaded)
report states total amount of time - 5
total time is appropriate - 5
Work on project
Set up development mode in Meta Quest
Test passthrough with unity
Enable Passthrough API in Meta Quest
Capture Passthrough Camera Frames in Unity___bug...
Questions & Troubleshooting I had that could be potentially added to wiki
- Switched to Standard Render Pipeline to URP in the middle and everything is an error...
Enable Passthrough API in Meta Quest
Capture Passthrough Camera Frames in Unity
(Before switching to Standard Render Pipeline)
2/10/25 - 4 hours
Project evaluation
Add AR for real world sensing page and a comparison table of Available Software for Lux Detection (Phone Sensors vs. Meta Quest Light Estimation)
2/09/25 - 2 hours
Refine project plan and prepare presentation
dino VR activity
2/05/25 - 2 hours
Refine project plan and deliverables
Research on software for project
2/03/25 - 5.5 hours
Bezi lab
Download DinoVR
Read Dino VR paper
Q. Considering that people's conditions like low vision and color blindness could vary so much, I'm curious more of how you got the certainty to establish a guide. For me it feels like the most challenging aspect of universal design is satisfying everyone, making it difficult to find a single stand point. Do you have any specific standards or methods you use for data collection or analysis?Review wiki / web to solidify your 3-5 project ideas
1. Tool for detecting lighting conditions and recommending optimized lighting ; Part 1. detecting light information and displaying UI on pass through.
three things you will do during the project :
1. Lighting detection to measure real-time lighting conditions in the user’s environment (lux levels) through phone sensor.
2. Lighting detection to measure real-time lighting conditions in the user’s environment (lux levels) through Meta Quest and Unity. Then compare Accuracy.
3. AR Visualization of Lighting Conditions (adding UI). Display lighting details in numbers.one class activity we might do for the project :
- Scanning different places with pass through mode and get lighting data in numbers.potential deliverables :
- Tutorial on how to implement light estimation using AR Foundation.
- Comparison of light detection accuracy(?) between mobile and and headset.
2. Tool for detecting lighting conditions and recommending optimized lighting ; Part 2. Recommend lighting and simulate.
three things you will do during the project :
1. Use optimal lighting guideline to compare real-time lighting information and recommended number.
2. Simulate recommended lighting on pass through.
3. Survey on before and after preference.one class activity we might do for the project :
- Students could experiment with different lighting adjustments (e.g., brighter, dimmer, warmer) and observe how the lighting affects the room's ambiance.potential deliverables :
- Comparative Report on Real-Time Lighting vs. Recommended Lighting
- Lighting Adjustment Algorithm
3. UX Improvements with Haptic Feedback for immersive Interaction ; Combining heart rate data with haptic feedback
https://www.kaggle.com/datasets/shayanfazeli/heartbeat
three things you will do during the project :
1. Visualize hear rate data in AR environment. (Real time if possible)
2. Design different haptic patterns for different rates.
3. Map haptic patterns to heart rate data and display.
one class activity we might do for the project :
- Try different amplitude and frequencypotential deliverables :
- Tutorial of designing haptic feedback
https://developers.meta.com/horizon/documentation/native/android/mobile-openxr-haptic/Brainstorm software evaluation metrics
Comparison with current tool for designing and simulating lighting in architectural projects. (Dialux)
Optimization suggestions
Lighting simulation accuracy
Real-Time feedback (time)
User's pick from before & after ( What if recommended lighting is uncomfortable? Other unexpected concerns?)
Continue adding potential software / data to the wiki
Add Cinema4D to VR modeling software page - work in progress
2/01/25 - 1 hour
Explore Google Earth VR & Web
Submit Google Earth comparison form
Google Earth VR
Home on campus
Undergrad-gate
Undergrad
Sci-Li
Google Earth Web
Home on campus
Undergrad-gate
Undergrad
Sci-Li
1/29/25 - 5 hours
Set up meta quest
Pick 2-5 potential pieces of software to explore and evaluate for your research project
Unity
ArcGIS CityEngine
Blender-Python
ParaView
See previous projects
Project ideas
Elderly people's home activity range - understanding qualitative data for new quantitative data
Situated visualization
Urban lighting
Sunlight(window placement) simulation
UX improvements
haptic feedback for a more intuitive interaction
Collaborative environment (Be in others' shoes)
Add Artivive as platform for creatives example in VR in the performing arts page
Set learning goals
1/27/25 - 1 hour
Look up project ideas
1/26/25 - 2 hours
Went through wiki
Look up project ideas
Read Kenny Gruchalla's bio and add question
10 min change - replace link
9 change suggestions on wiki
Add VR in entertainment and drop VR in social media under the page. - 10 min
Add Artivive as platform for creatives example in VR in the performing arts page - 10 min ✅
What is VR for? - VR in the performing arts - Creating Immersive Performances Using Virtual Reality Technologies - University Of Worcester - page not found. Replace with another link. - 10 min ✅
What is VR for? Could be combined with Applications of VR B - 1 hour
Add Cinema4D to VR modeling software page - 1 hour ✅
Add XR,AR and VR Conference info page - 1 hour
Organized hierarchy of VR Development Software page. -10 hours
Overview (Move Comparison here)
Each Software info pageChange side navigation bar to dual-tier side navigation bar since when there are lots of pages under, it's hard to navigate. - 10 hours
Some pages open in a new tab, and some opens in the current page. Make it coherent & review all links - 10 hours
1/24/25 - 2 hours
Created journal page
Went through course timeline
Set up slack and introduced myself
Read through project ideas