A volumetric display for visual, tactile and audio presentation using acoustic trapping

Hirayama, Ryuji, Martinez Plasencia, Diego, Masuda, Nobuyuki and Subramanian, Sriram (2019) A volumetric display for visual, tactile and audio presentation using acoustic trapping. Nature, 575 (7782). pp. 320-323. ISSN 0028-0836

[img] PDF - Accepted Version
Download (571kB)
[img] PDF (Supplementary information/figures) - Supplemental Material
Download (1MB)

Abstract

Science-fiction movies such as Star Wars portray volumetric systems that not only provide visual but also tactile and audible 3D content. Displays, based on swept volume surfaces, holography, optophoretics, plasmonics, or lenticular lenslets, can create 3D visual content without the need for glasses or additional instrumentation. However, they are slow, have limited persistence of vision (POV) capabilities, and, most critically, rely on operating principles that cannot also produce tactile and auditive content.

Here, we present for the first time a Multimodal Acoustic Trap Display (MATD): a mid-air volumetric display that can simultaneously deliver visual, auditory, and tactile content, using acoustophoresis as the single operating principle. Our system acoustically traps a particle and illuminates it with red, green, and blue light to control its colour as it quickly scans through our display volume. Using time multiplexing with a secondary trap, amplitude modulation and phase minimization, the MATD delivers simultaneous auditive and tactile content. The system demonstrates particle speeds of up to 8.75m/s and 3.75m/s in the vertical and horizontal directions respectively, offering particle manipulation capabilities superior to other optical or acoustic approaches demonstrated to date. Beyond enabling simultaneous visual, tactile and auditive content, our approach and techniques offer opportunities for non-contact, high-speed manipulation of matter, with applications in computational fabrication and biomedicine.

Item Type: Article
Additional Information: View a video representation of this paper at: https://www.youtube.com/watch?v=Tm8JRlJ1q50
Keywords: Acoustic Levitation, Volumetric Display, 3D user interfaces, Human-computer interaction
Schools and Departments: School of Engineering and Informatics > Informatics
Research Centres and Groups: Centre for Computer Graphics
Subjects: T Technology > T Technology (General)
Related URLs:
Depositing User: Sriram Subramanian
Date Deposited: 11 Nov 2019 14:52
Last Modified: 15 May 2020 01:00
URI: http://sro.sussex.ac.uk/id/eprint/86930

View download statistics for this item

📧 Request an update
Project NameSussex Project NumberFunderFunder Ref
User Interaction with self-supporting free-form physical objectsG1747EPSRC-ENGINEERING & PHYSICAL SCIENCES RESEARCH COUNCILEP/N014197/1
Interactive Technologies Using MetamaterialsG2349ROYAL ACADEMY OF ENGINEERING (BEIS)CIE1718\14
Levitation with localised tactile and audio feedback for mid-air interactionsG1987Horizon 2020 research and innovation programmeGrant number 737087