University of Sussex
Browse
1/1
2 files

A volumetric display for visual, tactile and audio presentation using acoustic trapping

journal contribution
posted on 2023-06-09, 19:17 authored by Ryuji Hirayama, Diego Martinez Plasencia, Nobuyuki Masuda, Sriram Subramanian
Science-fiction movies such as Star Wars portray volumetric systems that not only provide visual but also tactile and audible 3D content. Displays, based on swept volume surfaces, holography, optophoretics, plasmonics, or lenticular lenslets, can create 3D visual content without the need for glasses or additional instrumentation. However, they are slow, have limited persistence of vision (POV) capabilities, and, most critically, rely on operating principles that cannot also produce tactile and auditive content. Here, we present for the first time a Multimodal Acoustic Trap Display (MATD): a mid-air volumetric display that can simultaneously deliver visual, auditory, and tactile content, using acoustophoresis as the single operating principle. Our system acoustically traps a particle and illuminates it with red, green, and blue light to control its colour as it quickly scans through our display volume. Using time multiplexing with a secondary trap, amplitude modulation and phase minimization, the MATD delivers simultaneous auditive and tactile content. The system demonstrates particle speeds of up to 8.75m/s and 3.75m/s in the vertical and horizontal directions respectively, offering particle manipulation capabilities superior to other optical or acoustic approaches demonstrated to date. Beyond enabling simultaneous visual, tactile and auditive content, our approach and techniques offer opportunities for non-contact, high-speed manipulation of matter, with applications in computational fabrication and biomedicine.

Funding

Interactive Technologies Using Metamaterials; G2349; ROYAL ACADEMY OF ENGINEERING (BEIS); CIE1718\14

User Interaction with self-supporting free-form physical objects; G1747; EPSRC-ENGINEERING & PHYSICAL SCIENCES RESEARCH COUNCIL; EP/N014197/1

Levitation with localised tactile and audio feedback for mid-air interactions; G1987; Horizon 2020 research and innovation programme; Grant number 737087

History

Publication status

  • Published

File Version

  • Accepted version

Journal

Nature

ISSN

0028-0836

Publisher

Nature Publishing Group

Issue

7782

Volume

575

Page range

320-323

Department affiliated with

  • Informatics Publications

Research groups affiliated with

  • Centre for Computer Graphics Publications

Notes

View a video representation of this paper at: https://www.youtube.com/watch?v=Tm8JRlJ1q50

Full text available

  • Yes

Peer reviewed?

  • Yes

Legacy Posted Date

2019-11-11

First Open Access (FOA) Date

2020-05-15

First Compliant Deposit (FCD) Date

2019-11-21

Usage metrics

    University of Sussex (Publications)

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC