SBM12: Sketch Based Interfaces and Modeling 2012

Permanent URI for this collection

https://diglib.eg.org/handle/10.2312/414

Browse

Browsing SBM12: Sketch Based Interfaces and Modeling 2012 by Issue Date

Filter results by year or month
Now showing 1 - 13 of 13
  • Thumbnail Image
    Item
    SetPad: A Sketch-Based Tool For Exploring Discrete Math Set Problems
    (The Eurographics Association, 2012) Cossairt, Travis J.; Jr., Joseph J. LaViola; Karan Singh and Levent Burak Kara
    We present SetPad, a new application prototype that lets computer science students explore discrete math problems by sketching set expressions using pen-based input. Students can manipulate the expressions interactively with the tool via pen or multi-touch interface. Likewise, discrete mathematics instructors can use SetPad to display and work through set problems via a projector to better demonstrate the solutions to the students. We discuss the implementation and feature set of the application, as well as results from a formal user study measuring the effectiveness of the tool for students solving set proof problems. The results indicate that SetPad allows for efficient solutions to proof problems, and has the potential to have a positive impact when used as an individual student application or as an instructional tool.
  • Thumbnail Image
    Item
    I Don't Believe My Eyes! Geometric Sketch Recognition for a Computer Art Tutorial
    (The Eurographics Association, 2012) Cummmings, Danielle; Vides, Francisco; Hammond, Tracy; Karan Singh and Levent Burak Kara
    Drawing is a common form of communication and a means of artistic expression. Many of us believe that the ability to draw accurate representations of objects is a skill that either comes naturally or is the result of hours of study or practice or both. As a result many people become intimidated when confronted with the task of drawing. Many books and websites have been developed to teach people step-by-step skills to draw various objects, but they lack the live feedback of a human examiner. We designed EyeSeeYou, a sketch recognition system that teaches users to draw eyes using a simple drawing technique. The system automatically evaluates the freehand drawn sketch of an eye at various stages during creation. We conducted frequent evaluations of the system in order to take an iterative development approach based on user feedback. Our system balances the flexibility of free-hand drawing with step-by-step instructions and realtime assessment. It also provides rigorous feedback to create a constructive learning environment to aid the user in improving her drawing. This paper describes the implementation details of the sketch recognition system. A similar implementation method could be used to provide sketching tutorials for a wide number of images.
  • Thumbnail Image
    Item
    Exploiting Artistic Cues to obtain Line Labels for Free-hand Sketches
    (The Eurographics Association, 2012) Bonnici, Alexandra; Camilleri, Kenneth P.; Karan Singh and Levent Burak Kara
    Artistic cues help designers to communicate design intent in sketches. In this paper, we show how these artistic cues may be used to obtain a line labelling interpretation of freehand sketches, using a cue-based genetic algorithm to obtain a labelling solution that matches design intent. In the paper, we show how this can be achieved from off-line or paper based sketches, thereby allowing designers greater flexibility in the choice of sketching medium.
  • Thumbnail Image
    Item
    RedDog: A Smart Sketch Interface for Autonomous Aerial Systems
    (The Eurographics Association, 2012) Cummmings, Danielle; Fymat, Stephane; Hammond, Tracy; Karan Singh and Levent Burak Kara
    In order to decrease the number of casualties and limit the number of potentially dangerous situations that Soldiers encounter, the US military is exploring the use of autonomous Unmanned Aircraft Systems (UAS) to fulfill air support requests (ASR) from the field. The interface for such a system must provide interaction in modes that facilitate the completion of the support request in various scenarios, and it must be usable by operators of all skill levels, without requiring extensive training or considerable expertise. Sketches are a simple and natural way to exchange graphical information and ideas. In this paper we present the development of an interface that that allows the user to plan an ASR using sketch and other inputs while conforming to the user's mental model of natural interaction.
  • Thumbnail Image
    Item
    JustDrawIt: A 3D Sketching System
    (The Eurographics Association, 2012) Grimm, Cindy; Joshi, Pushkar; Karan Singh and Levent Burak Kara
    We present ''JustDrawIt'', a sketch-based system for creating 3D curves suitable for surfacing. The user can sketch in a free-form manner from any view at any time, and the system infers how those sketch strokes should be added to the drawing. Specifically, existing curves are projected to 2D and analyzed to see if the stroke edits or extends an existing curve, or if the stroke should make a new curve. In the former case the 2D stroke is promoted to 3D using the position of the existing curve, and then joined to that curve. In the latter case, we use additional spatial information (e.g. temporary 3D surfaces) to create a new curve in 3D. All non-sketching interactions are based on unintrusive context-aware, in-screen pie menus designed for rapid pen-based input. We also provide novel rendering styles and aides for interpreting and working with 3D sketches. Finally, we support snapping together curve networks and specifying normals in order to create surface models.
  • Thumbnail Image
    Item
    Mobile Vision-Based Sketch Recognition with SPARK
    (The Eurographics Association, 2012) Browne, Jeffrey; Sherwood, Timothy; Karan Singh and Levent Burak Kara
    The sketch community has, over the past years, developed a powerful arsenal of recognition capabilities and interaction methods. Unfortunately, many people who could benefit from these systems lack pen capture hardware and are stuck drawing diagrams on traditional surfaces like paper or whiteboards. In this paper we explore bringing the benefits of sketch capture and recognition to traditional surfaces through a common smart-phone with the Sketch Practically Anywhere Recognition Kit (SPARK), a framework for building mobile, image-based sketch recognition applications. Naturally, there are several challenges that come with recognizing hand-drawn diagrams from a single image. Image processing techniques are needed to isolate marks from the background surface due to variations in lighting and surface wear. Further, since static images contain no notion of how the original diagram was drawn, we employ bitmap thinning and stroke tracing to transform the ink into the abstraction of strokes commonly used by modern sketch recognition algorithms. Since the timing data between points in each stroke are not present, recognition must remain robust to variability in both perceived drawing speed and even coarse ordering between points. We have evaluated Rubine's recognizer in an effort to quantify the impact of timing information on recognition, and our results show that accuracy can remain consistent in spite of artificially traced stroke data. As evidence of our techniques, we have implemented a mobile app in SPARK that captures images of Turing machine diagrams drawn on paper, a whiteboard, or even a chalkboard, and through sketch recognition techniques, allows users to simulate the recognized Turing machine on their phones.
  • Thumbnail Image
    Item
    TreeSketch: Interactive Procedural Modeling of Trees on a Tablet
    (The Eurographics Association, 2012) Longay, Steven; Runions, Adam; Boudon, Frédéric; Prusinkiewicz, Przemyslaw; Karan Singh and Levent Burak Kara
    TreeSketch is a system for modeling complex trees that look natural yet are creatively designed. The system integrates procedural tree generation with a multi-touch tablet interface that provides detailed control of tree form. The procedural component is based on the concept of tree self-organization and simulates competition of branches for space and light as the tree develops from a seedling. The modeler can control this process by directing growth with a procedural brush, changing parameters as the tree grows, interleaving controlled and autonomous growth, and editing generated forms. Complex trees can be created in a matter of seconds.
  • Thumbnail Image
    Item
    Automated Labeling of Ink Stroke Data
    (The Eurographics Association, 2012) Zhen, Jacky (Shunjie); Blagojevic, Rachel; Plimmer, Beryl; Karan Singh and Levent Burak Kara
    Labeled ink stroke data is essential to the development and evaluation of sketch recognizers. Manually labeling strokes is a tedious, time-consuming, and error prone task; and very few tools are available to facilitate this. We propose a new and intuitive method of automatic labeling for single stroke primitives. This involves building a recognizer from a partially labeled dataset. This recognizer is then used to identify and automatically label the remaining data, therefore reducing the amount of manual labeling required by researchers. An evaluation comparing manual labeling against our new auto labeling method shows that users are able to label significantly faster and produce less errors using auto labeling. Furthermore, users found auto labeling easier and more preferable.
  • Thumbnail Image
    Item
    Sketch Modeling of Seismic Horizons from Uncertainty
    (The Eurographics Association, 2012) Amorim, Ronan; Brazil, Emilio Vital; Patel, Daniel; Sousa, Mario Costa; Karan Singh and Levent Burak Kara
    Petroleum reservoir model building is a fundamental but complex task present in all stages of oil/gas exploration and production (E&P). Reservoir models are built incrementally using multi-disciplinary data (e.g. from geophysics, geology, reservoir engineering) and the domain expert interpretation of that data. The first reservoir models are constructed at the appraisal stage, where the available data presents inaccuracies and a high degree of uncertainty. In this paper we present a set of sketch-based interface and modeling operators integrated in a system for the early appraisal stage in oil/gas E&P for the tasks of seismic interpretation and reservoir model building. Our system allows the user to sketch directly over the raw seismic reflection volume and its derived data. These data guide the expert in the key tasks of seismic interpretation and building the structural framework of the reservoir. We propose a novel set of sketch-based modeling operators designed by specific domain requirements from geophysics and geology. A novel architecture using adaptive meshes is also developed to create a more flexible sketch-based system.
  • Thumbnail Image
    Item
    Geological Storytelling - Graphically Exploring and Communicating Geological Sketches
    (The Eurographics Association, 2012) Lidal, Endre M.; Hauser, Helwig; Viola, Ivan; Karan Singh and Levent Burak Kara
    Developing structural geological models from exploratory subsea imaging is difficult and an ill-posed process. Therefore, in practice several experts generate a larger number of geological interpretations. This leads to the situation that a number of geological sketches are prepared and examined for the next steps in the oil and gas exploration pipeline. In this paper, we present Geological Storytelling, a novel graphical approach for performing rapid and expressive geomodeling of a multitude of model variations. The solution builds on a flip-over metaphor for sketching the individual steps in a story that externalizes the mental steps the modeler performs when developing the model. The stories, through the discrete story steps, are then visualized in a Story Tree for easy access and management. This tree also provides the interface for individual story playback and examination, or comparative visualization of several stories. With our approach, the experts can rapidly sketch geological stories that both visualize the proposed model of today's geology and visualize how the expert derived this model. Presenting the model as a visual story helps the peers to evaluate the geological soundness of the model. We have developed geological storytelling in collaboration with domain experts that work with such challenges on a daily basis. Our focus of this work has been on models derived from single seismic slices. We have implemented a prototype of Geological Storytelling to demonstrate our concept and to get domain expert feedback.
  • Thumbnail Image
    Item
    Newtons Pen II: An Intelligent, Sketch-Based Tutoring System and its Sketch Processing Techniques
    (The Eurographics Association, 2012) Lee, Chia-Keng; Jordan, Josiah; Stahovich, Thomas F.; Herold, James; Karan Singh and Levent Burak Kara
    We present a pen-based intelligent tutoring system (ITS) for undergraduate Statics which scaffolds students in the construction of free body diagrams and equilibrium equations. Most existing ITSs rely on traditional WIMP (Windows, Icons, Menus, Pointers) interfaces, which often require the student to select the correct answer from among a set of predefined choices. Our system, by contrast, guides students in constructing solutions from scratch, mirroring the way they ordinarily solve problems, which recent research suggests is important for effective instruction. Our system employs several new techniques for sketch understanding, including a simple-to-implement stroke merging technique, a stroke clustering technique, and a technique that uses a Hidden Markov Model to correct interpretation errors in equations. Our tutoring system was deployed in an undergraduate Statics course at our university. Attitudinal surveys indicate that the tutoring system is preferable to traditional WIMP-based systems and is an effective educational tool.
  • Thumbnail Image
    Item
    Concepture: A Regular Language Based Framework for Recognizing Gestures with Varying and Repetitive Patterns
    (The Eurographics Association, 2012) Donmez, Nilgun; Singh, Karan; Karan Singh and Levent Burak Kara
    We present Concepture, a framework based on regular language grammars for the authoring and recognition of sketched gestures with infinitely varying and repetitive patterns. Such gestures, while often seen in gesture based applications are currently hard-coded and not customizable. We endorse an example-based workflow, where users author gestures by sketching one or more example instances of the gesture. We de-construct these examples into perceptible stroke segments. Adjacent segment-pairs further capture local spatial relationships between segments and these segment-pairs form the alphabet of a regular language. We then initialize a grammar for our gesture by admitting strings that represent the user provided examples. Grammar refinement is user-friendly, in that we automatically generate new candidate gestures that are visually presented to the user for verification as instances of the gesture. We show Concepture to be effective in efficiently authoring a number of common, yet difficult to recognize gestures, and illustrate it using clip-art and image annotation applications.
  • Thumbnail Image
    Item
    The One Cent Recognizer: A Fast, Accurate, and Easy-to-Implement Handwritten Gesture Recognition Technique
    (The Eurographics Association, 2012) Herold, James; Stahovich, Thomas F.; Karan Singh and Levent Burak Kara
    We present the One Cent Recognizer, an easy-to-implement, efficient, and accurate handwritten gesture recognizer. By applying time series recognition techniques, we have developed a minimally complex technique that is both much faster than and at least as accurate as the Dollar Recognizer. Additionally, the One Cent Recognizer is much easier to implement than the Dollar Recognizer. Our technique is primarily enabled by a simple and novel one-dimensional representation of handwritten pen strokes. This representation is intrinsically rotation invariant, allowing our technique to avoid costly rotate-and-check searches typically employed in prior template-based gesture recognition techniques. In experiments, our technique has proven to be two orders of magnitude faster than the Dollar Recognizer.