ChrisKieferNIME2009Paper.pdf (352.87 kB)
Phalanger: controlling music software with hand movement using a computer vision and machine learning approach
conference contribution
posted on 2023-06-08, 10:18 authored by Chris KieferChris Kiefer, Nick Collins, Geraldine FitzpatrickPhalanger is a system which facilitates the control of music software with hand and finger motion, with the aim of creating a fluid style of interaction that promotes musicality. The system is purely video based, requires no wearables or accessories and uses affordable and accessible technology. It employs a neural network for background segmentation, a combination of imaging techniques for frame analysis, and a support vector machine (SVM) for recognition of hand positions. System evaluation showed the SVM to reliably differentiate between eight different classes. An initial formative user evaluation with ten musicians was carried out to help build a picture of how users responded to the system; this highlighted areas that need improvement and lent some insight into useful features for the next version.
History
Publication status
- Published
File Version
- Published version
Journal
Proceedings of the 2009 Conference on New Interfaces For Musical Expression; Pittsburgh, USA; 4th June - 6th June 2009ISSN
2220-4806Publisher
NIMEPublisher URL
Volume
2009Page range
246-249Event name
New Interfaces For Musical Expression NIME 2009Event location
Pittsburgh, USAEvent type
conferenceEvent date
4th June - 6th June 2009Department affiliated with
- Informatics Publications
Full text available
- Yes
Peer reviewed?
- Yes
Legacy Posted Date
2012-02-20First Open Access (FOA) Date
2018-03-20First Compliant Deposit (FCD) Date
2018-03-20Usage metrics
Categories
No categories selectedKeywords
Licence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC