Accurate Real-time 3D Gaze Tracking Using a Lightweight Eyeball Calibration

dc.contributor.authorWen, Quanen_US
dc.contributor.authorBradley, Dereken_US
dc.contributor.authorBeeler, Thaboen_US
dc.contributor.authorPark, Seonwooken_US
dc.contributor.authorHilliges, Otmaren_US
dc.contributor.authorYong, Jun-Haien_US
dc.contributor.authorXu, Fengen_US
dc.contributor.editorPanozzo, Daniele and Assarsson, Ulfen_US
dc.date.accessioned2020-05-24T12:53:50Z
dc.date.available2020-05-24T12:53:50Z
dc.date.issued2020
dc.description.abstract3D gaze tracking from a single RGB camera is very challenging due to the lack of information in determining the accurate gaze target from a monocular RGB sequence. The eyes tend to occupy only a small portion of the video, and even small errors in estimated eye orientations can lead to very large errors in the triangulated gaze target. We overcome these difficulties with a novel lightweight eyeball calibration scheme that determines the user-specific visual axis, eyeball size and position in the head. Unlike the previous calibration techniques, we do not need the ground truth positions of the gaze points. In the online stage, gaze is tracked by a new gaze fitting algorithm, and refined by a 3D gaze regression method to correct for bias errors. Our regression is pre-trained on several individuals and works well for novel users. After the lightweight one-time user calibration, our method operates in real time. Experiments show that our technique achieves state-of-the-art accuracy in gaze angle estimation, and we demonstrate applications of 3D gaze target tracking and gaze retargeting to an animated 3D character.en_US
dc.description.number2
dc.description.sectionheadersImages and Videos
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume39
dc.identifier.doi10.1111/cgf.13945
dc.identifier.issn1467-8659
dc.identifier.pages475-485
dc.identifier.urihttps://doi.org/10.1111/cgf.13945
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13945
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectHuman
dc.subjectcentered computing
dc.subjectInteraction techniques
dc.subjectComputing methodologies
dc.subjectMotion capture
dc.titleAccurate Real-time 3D Gaze Tracking Using a Lightweight Eyeball Calibrationen_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
v39i2pp475-485.pdf
Size:
6.75 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
video_v4.mp4
Size:
144.44 MB
Format:
Unknown data format
Collections