University of Sussex
Browse
J - Wang - Enabling Reproducible Research in Sensor-Based Transportation Mode Recognition with the Sussex-Huawei Dataset (IEEE Access, 2019).pdf (9.23 MB)

Enabling reproducible research in sensor-based transportation mode recognition with the Sussex-Huawei dataset

Download (9.23 MB)
journal contribution
posted on 2023-06-09, 16:26 authored by Lin Wang, Hristijan GjoreskiHristijan Gjoreski, Mathias Ciliberto, Sami Mekki, Stefan Valentin, Daniel RoggenDaniel Roggen
Transportation and locomotion mode recognition from multimodal smartphone sensors is useful to provide just-in-time context-aware assistance. However, the field is currently held back by the lack of standardized datasets, recognition tasks and evaluation criteria. Currently, recognition methods are often tested on ad-hoc datasets acquired for one-off recognition problems and with differing choices of sensors. This prevents a systematic comparative evaluation of methods within and across research groups. Our goal is to address these issues by: i) introducing a publicly available, large-scale dataset for transportation and locomotion mode recognition from multimodal smartphone sensors; ii) suggesting twelve reference recognition scenarios, which are a superset of the tasks we identified in related work; iii) suggesting relevant combinations of sensors to use based on energy considerations among accelerometer, gyroscope, magnetometer and GPS sensors; iv) defining precise evaluation criteria, including training and testing sets, evaluation measures, and user-independent and sensor-placement independent evaluations. Based on this, we report a systematic study of the relevance of statistical and frequency features based on information theoretical criteria to inform recognition systems. We then systematically report the reference performance obtained on all the identified recognition scenarios using a machine-learning recognition pipeline. The extent of this analysis and the clear definition of the recognition tasks enable future researchers to evaluate their own methods in a comparable manner, thus contributing to further advances in the field. The dataset and the code are available online.

Funding

Activity Sensing Technologies for Mobile Users; G2015; Huawei Technologies; Activity Sensing Technologies for Mobile Users

History

Publication status

  • Published

File Version

  • Published version

Journal

IEEE Access

ISSN

2169-3536

Publisher

Institute of Electrical and Electronics Engineers

Volume

7

Page range

10870-10891

Department affiliated with

  • Engineering and Design Publications

Research groups affiliated with

  • Sensor Technology Research Centre Publications

Full text available

  • Yes

Peer reviewed?

  • Yes

Legacy Posted Date

2019-01-09

First Open Access (FOA) Date

2019-01-09

First Compliant Deposit (FCD) Date

2019-01-07

Usage metrics

    University of Sussex (Publications)

    Categories

    No categories selected

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC