ICAT-EGVE2017 - Posters and Demos

Permanent URI for this collection

https://diglib.eg.org/handle/10.2312/2631903

Browse

Now showing 1 - 20 of 22

3D Ground Reaction Force Visualization onto Training Video for Sprint Training Support System
(The Eurographics Association, 2017) Taketomi, Takafumi; Yoshitake, Yasuhide; Yamamoto, Goshiro; Sandor, Christian; Kato, Hirokazu; Tony Huang and Arindam Dey
We propose a method for visualizing 3D ground reaction forces for sprint training. Currently, sprinters can check their 3D ground force data using a 2D graph representation. In order to check the relationship between 3D ground force and their sprint form, they must check the 2D graph and a training video repeatedly. To allow simultaneous observation of the 2D graph and the training video, we use a mixed reality technology to overlay 3D ground reaction force onto the training video. In this study, we focus on 2D-3D registration between the image sequence and 3D ground reaction data. We achieved 2D-3D registration by using a constrained bundle adjustment approach. In the experiment, we apply our method to the training videos. The results confirm that our method can correctly overly 3D ground reaction force onto the videos.
3D Model Deformation in VR Using CUBE
(The Eurographics Association, 2017) Lim, Seong-Jae; Hwang, Bon-Woo; Yoon, Seung-Uk; Choi, Jin Sung; Park, Chang-Joon; Tony Huang and Arindam Dey
We propose an easy and simple method that deforms a 3D model in VR. The proposed method easily manipulates 3D models which are difficult to handle in VR environment by using semantic shape deformation technique and NUI which is easy to operate with one hand.
An Adaptive AR Tutor For Cabling a Network Topology
(The Eurographics Association, 2017) Herbert, B. M.; Weerasinghe, A.; Ens, Barrett; Billinghurst, Mark; Tony Huang and Arindam Dey
We present an Augmented Reality (AR) network cabling tutor that provides visual annotations for improving learning in psychomotor tasks. Unlike many existing AR learning systems, our system combines AR with an intelligent tutoring system (ITS) that should enhance learning over existing desktop solutions. We intend to use this prototype as a test-bed for evaluating learning differences between a desktop web-based user interface, a hand-held AR display and a Head Mounted Display (HMD) AR display.
An AR Network Cabling Tutoring System for Wiring a Rack
(The Eurographics Association, 2017) Herbert, B. M.; Weerasinghe, A.; Ens, Barrett; Billinghurst, Mark; Wigley, G.; Tony Huang and Arindam Dey
We present a network cabling tutoring system that guides learners through cabling a network topology by overlaying virtual icons and arrows on the ports. The system determines the network state by parsing switch output and does not depend on network protocols being functional. A server provides a web-based user interface and communicates with an external intelligent tutoring system called The Generalized Intelligent Framework for Tutoring. Users use a tablet to view AR annotations, though support for HoloLens HMD will be added soon.
Automatic Face Texture Generation from Irregular Texture in 3-D Character Creation Applications
(The Eurographics Association, 2017) Yoon, Seung-Uk; Lim, Seong-Jae; Hwang, Bon-Woo; Park, Chang-Joon; Choi, Jin Sung; Tony Huang and Arindam Dey
In this paper, we propose a novel face texture generation algorithm to enhance compatibility and reusability of 3-D face reconstruction results of real-world 3-D character creation applications. Our approach can handle irregular types of input textures of 3-D reconstructed face models using the proposed multi-projection texture generation technique. We automatically calculate exact pixel values of the frontal face region in the template texture map by finding correspondences between input and template 3-D models and textures, respectively. After matching tones of the frontal face region and the remaining parts, the final texture of a 3-D face model is successfully generated without manual editing or post-processing of textures.
Can Face Swapping Technology Facilitate Mental Imagery Training?
(The Eurographics Association, 2017) Matsumura, Haruka; Watanabe, Hironori; Chen, Tai Chih; Taketomi, Takafumi; Yoshitake, Yasuhide; Plopski, Alexandor; Sandor, Christian; Kato, Hirokazu; Tony Huang and Arindam Dey
In this research, we conducted a preliminary study to investigate the effectiveness of face swapping technology for mental imagery training. To confirm its effectiveness, we used transcranial magnetic stimulation for measuring motor evoked potential (MEP) as brain excitability during mental imagery training. In the experiment, we used three motions: wrist dorsiflexion as an easy-to-perform motion, and pen spinning and baoding balls rotating motions as difficult motions. In each target motion, we compared MEPs when watching own motion video, another person's motion video, and another person's motion video with the face swapped with own face. The results showed that there was a difference between MEPs in difficult motion video observations. Watching another person's motion video with face swapping showed higher MEP than simply watching another person's video.
Comparative Evaluation of Sensor Devices for Micro-Gestures
(The Eurographics Association, 2017) Simmons, H.; Devi, R.; Ens, Barrett; Billinghurst, Mark; Tony Huang and Arindam Dey
This paper presents a comparative evaluation of two hand gesture recognition sensors and their ability to detect small, sub millimeter movement. We explore the capabilities of these devices by testing if users can reliably use the sensors to select a simple user interface element in 1D space using three distinct gestures a small movement of the thumb and forefinger representing a slider, the slightly larger movement of moving a finger up and down and a large gesture of moving the whole hand up and down. Results of our preliminary study reveal that the palm provides the fastest and most reliable input. While not conclusive, data from our initial study indicates that the Leap sensor provides lower error, difficulty and fatigue than the Soli sensor with our test gesture set.
Comparative Evaluation of Sensor Devices for Micro-Gestures
(The Eurographics Association, 2017) Simmons, H.; Devi, R.; Ens, Barrett; Billinghurst, Mark; Tony Huang and Arindam Dey
This paper presents a comparative evaluation of two gesture recognition sensors and their ability to detect small, movements known as micro-gestures. In this work we explore the capabilities of these devices by testing if users can reliably use the sensors to select a target using a simple 1D user interface element. We implemented three distinct gestures, including a large gesture of moving the whole hand up and down; a smaller gesture of moving a finger up and down and; and a small movement of the thumb against the forefinger to represent a virtual slider. Demo participants will be able to experience these three gestures with to sensing devices, a Leap Motion and Google Soli.
Continuous Dial User Interaction to Reduce Task Complexity in Designing Physical User Interfaces in Spatial Augmented Reality
(The Eurographics Association, 2017) Stone, Daniel T.; Thomas, Bruce H.; Tony Huang and Arindam Dey
This paper presents an investigation into the use of continuous physical dial interaction to specify the placement of controls on designs of physical interfaces. The designs are projected on white substrates with Spatial Augmented Reality technology. The inspiration is direct physical interaction is more intuitive to the designer than the traditional CAD-based specification approach. The paper presents our initial Spatial Augmented Reality prototype.
Electrical Stimulation Method Capable of Presenting Visual Information Outside the Viewing Angle
(The Eurographics Association, 2017) Akiyama, Hayato; Aoyama, Kazuma; Maeda, Taro; Ando, Hideyuki; Tony Huang and Arindam Dey
Galvanic sight stimulation (GSS) is a lightweight and wide-viewing-angle visual information presentation method. In the GSS method, electrodes are placed on the skin around the eyeball to perform noninvasive electrical stimulation, thereby causing a white flash called phosphene. While the viewing angle of a head-mounted display is a maximum of approximately 110°, the extent to which the GSS can present visual information is not known. In this study, we demon-strate the advantages and usefulness of GSS via the quantitative measurement of viewing angle that can be visually presented by GSS, and a comparison with the viewing angle of the existing optical visual presentation method.
Estimation of 3D Finger Postures with wearable device measuring Skin Deformation on Back of Hand
(The Eurographics Association, 2017) Kuno, Wakaba; Sugiura, Yuta; Asano, Nao; Kawai, Wataru; Sugimoto, Maki; Tony Huang and Arindam Dey
We propose a method for reconstructing hand posture by measuring the deformation of the back of the hand with a wearable device. Our method constructs a regression model by using the data on hand posture captured by a depth camera and data on the skin deformation of the back of the hand captured by several photo-reflective sensors attached to the wearable device. By using this regression model, the posture of the hand is reconstructed from the data of the photo-reflective sensors in real-time. The posture of fingers can be estimated without hindering the natural movement of the fingers since the deformation of the back of the hand is measured without directly measuring the position of the fingers. In our demonstration, users can reflect his / her own finger posture in a virtual environment.
A Gaze-depth Estimation Technique with an Implicit and Continuous Data Acquisition for OST-HMDs
(The Eurographics Association, 2017) Lee, Youngho; Piumsomboon, Thammathip; Ens, Barrett; Lee, Gun A.; Dey, Arindam; Billinghurst, Mark; Tony Huang and Arindam Dey
The rapid development of machine learning algorithms can be leveraged for potential software solutions in many domains including techniques for depth estimation of human eye gaze. In this paper, we propose an implicit and continuous data acquisition method for 3D gaze depth estimation for an optical see-Through head mounted display (OST-HMD) equipped with an eye tracker. Our method constantly monitoring and generating user gaze data for training our machine learning algorithm. The gaze data acquired through the eye-tracker include the inter-pupillary distance (IPD) and the gaze distance to the real and virtual target for each eye.
A Haptic Augmented Virtuality System for Immersive VR Plant Training
(The Eurographics Association, 2017) Bae, Yoosung; Baek, Sang-Yun; Kim, Young-Ho; Dunn, Gregory; ElSharkawy, Ahmed; Ryu, Jeha; Tony Huang and Arindam Dey
The risk to life and property posed by lack of trained employees in industrial facilities is an issue to which a wide re-search base has been applied to solve. This paper presents an on-going development of a haptic augmented virtuality system using an encounter type haptic display system and the Unity3D engine to provide fully immersive VR plant safety operation training. Since there are many different types of physical tools such as levers, valves, and buttons as well as these are installed in many diverse locations and orientations in plant facilities, an encounter type haptic display system is proposed. In the proposed system, many different types of physical tools are collocated in the fully immersed environment with the corresponding visual virtual tools for providing full haptic (kinesthetic) sensation. The collocation is made by a robot that can provide physical tools in arbitrary poses. For good collocation accuracy, a new calibration method is being developed and evaluated.
Holo Worlds Infinite: Procedural Spatial Aware AR Content
(The Eurographics Association, 2017) Lawrence, Louise M.; Hart, Jonathon Derek; Billinghurst, Mark; Tony Huang and Arindam Dey
We developed an Augmented Reality (AR) application that procedurally generates content which is programmatically placed on the floor. It uses its awareness of its spatial surroundings to generate and place virtual content. We created a prototype that can be used as the basis of a city simulation game that can be played on the floor of any room space, but the approach could also be used for many other applications.
Holo Worlds Infinite: Procedural Spatial Aware AR Content
(The Eurographics Association, 2017) Lawrence, Louise M.; Hart, Jonathon Derek; Billinghurst, Mark; Tony Huang and Arindam Dey
We developed an Augmented Reality (AR) application that procedurally generates content which is programmatically placed on the floor. It uses its awareness of its spatial surroundings to generate and place virtual content. We created a prototype that can be used as the basis of a city simulation game that can be played on the floor of any room space, but the approach could also be used for many other applications.
ICAT-EGVE 2017 - Posters and Demos: Frontmatter
(Eurographics Association, 2017) Huang, Tony; Dey, Arindam; Tony Huang and Arindam Dey
A Pilot Study of Altering Depth Perception with Projection-Based Illusions
(The Eurographics Association, 2017) Schmidt, S.; Bruder, G.; Steinicke, F.; Tony Huang and Arindam Dey
We present first approaches to manipulate perceived spatial relationships between the user and real-world objects by introducing perceptual illusions to a projection-based augmented reality (AR) environment. Therefore, we analyzed the effect of three monoscopic illusions, which are inspired by visual arts, i. e., (i) color temperature, (ii) luminance contrast and (iii) blur. The results provide positive indications that computer-generated projected illusions can influence the human depth perception in such an environment, even in the presence of additional conflicting depth cues.
A Projection-Based Augmented Reality Setup for Blended Museum Experiences
(The Eurographics Association, 2017) Schmidt, S.; Steinicke, F.; Tony Huang and Arindam Dey
Most traditional museums still rely on physical artifacts since their authenticity and uniqueness foster an emotional engagement with the objects themselves and the stories they are supposed to tell the visitor. However, the context of the exhibition space makes it difficult to vividly present information that are closely related to the origin of the artifact. In this regard, we propose a 3D projection-based augmented reality setup, which keeps the focus on a physical exhibit and at the same time allows visitors to seamlessly switch to virtual representations of the exhibit's original appearance and context.
Selecting Moving Targets in AR using Head Orientation
(The Eurographics Association, 2017) Matsumoto, Keigo; Muta, Masahumi; Cheng, Kelvin; Masuko, Soh; Tony Huang and Arindam Dey
Along with the spread of augmented reality (AR) using head-mounted display or smart glass, attempts have been made to present information by superimposing information on people and things. In general, people are always moving about and usually do not stay stationary, so it is conceivable that the superimposed AR information also moves with them. However, it is often difficult to follow and select moving targets.We propose two novel techniques, TagToPlace and TagAlong, which help users select moving targets using head orientation. We conducted a user study to compare our proposed techniques to a conventional gaze selection method - DwellTime. The results showed that our proposed techniques are superior to a conventional one in terms of throughput when selecting moving targets.
Social Dining Experience using Mixed Reality for Older Adults
(The Eurographics Association, 2017) Hart, Jonathon Derek; Lee, Gun A.; Smith, Ashleigh E.; Hull, Melissa; Haren, Matthew T.; Paquet, Catherine; Hill, Julie-Ann; Lomax, Zack; Ashworth, Travis; Smith, Ross T.; Tony Huang and Arindam Dey
This project investigates a novel method of engaging older adults in meaningful mealtime social interactions through the use of Mixed Reality technology. We propose a novel dining system that aims to facilitate interpersonal interactions and enhance meal consumption in socially isolated older adults. We created a prototype which allowed the target audience to test and discuss our concept so we can iteratively improve a user oriented design.

Browse

Browsing ICAT-EGVE2017 - Posters and Demos by Title

Results Per Page

Sort Options