Augury and Forerunner: Real-Time Feedback Via Predictive Numerical Optimization and Input Prediction

Simple item page
dc.contributor.authorGraus, J.en_US
dc.contributor.authorGingold, Y.en_US
dc.contributor.editorWimmer, Michaelen_US
dc.contributor.editorAlliez, Pierreen_US
dc.contributor.editorWestermann, Rüdigeren_US
dc.date.accessioned2025-11-07T08:32:42Z
dc.date.available2025-11-07T08:32:42Z
dc.date.issued2025
dc.description.abstractIn many interactive systems, user input initializes and launches an iterative optimization procedure. The goal is to provide assistive feedback to some creation/editing process. Examples include constraint-based GUI layout and complex snapping scenarios. Many geometric problems, such as fitting a shape to data, involve optimizations which may take seconds to complete (or even longer), yet require human guidance. In order to make these optimization routines practical in interactive sessions, simplifications or sacrifices must be made. Canonically, non-convex optimization problems are solved iteratively by taking a series of steps towards a solution. By their nature, there are many locally optimal solutions; which solution is found is highly dependent on an initial guess. There is a fundamental conflict between optimization and interactivity. Interrupting and restarting the optimization every time the user, e.g. moves the mouse prevents any solution from being computed until the user ceases interaction. Continuing to run the optimization procedure computes a perpetually outdated solution. This presents a particular unsolved challenge with respect to direct manipulation. Every time the user, e.g. moves the mouse, the entire optimization must be re-started with the new user input, since returning a stale result associated with the previous user state is undesirable. We propose predictive short-circuiting to reduce this fundamental tension. Our approach memoizes paths in the optimization's configuration space and predicts the trajectory of future optimization in real time, leveraging common C1 continuity assumptions. This enables direct manipulation of formerly sluggish interactions. We demonstrate our approach on geometric fitting tasks. Additionally, we evaluate complementary mouse motion prediction algorithms as a means to discard or skip optimization problems that are irrelevant to the user's intended initial configuration for a targeted optimization procedure. Predicting where the mouse cursor will be located at the end of an operation, such as dragging a model of an engine component into scanned point cloud data to perform geometric alignment, allows us to pre-emptively begin solving the targeted problem before the user finishes their movement. We take advantage of the fact that the prediction indicates the approximate energy basin the optimization procedure will need to explore.en_US
dc.description.number6
dc.description.sectionheadersOriginal Article
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume44
dc.identifier.doi10.1111/cgf.70091
dc.identifier.issn1467-8659
dc.identifier.pages14 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.70091
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf70091
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectinteraction
dc.subjectinteraction techniques
dc.subjectmethods and applications
dc.subjectnumerical analysis
dc.subjectnonlinear optimization
dc.subjectMathematics of computing → Mathematical optimization
dc.subjectComputing methodologies → Modelling and simulation
dc.subjectHuman centered computing
dc.subjectInteraction design process and methods
dc.titleAugury and Forerunner: Real-Time Feedback Via Predictive Numerical Optimization and Input Predictionen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
01_cgf70091.pdf
Size:
3.64 MB
Format:
Adobe Portable Document Format
Download
Collections
44-Issue 6