University of Sussex
Browse
C - Richoz - Human and Machine Recognition of Transportation Modes from Body-Worn Camera Images (Accepted, ABC, 2019).pdf (2.23 MB)

Human and machine recognition of transportation modes from body-worn camera images

Download (2.23 MB)
conference contribution
posted on 2023-06-07, 06:35 authored by Sebastien Richoz, Mathias Ciliberto, Lin Wang, Phil BirchPhil Birch, Hristijan GjoreskiHristijan Gjoreski, Andres Perez-Uribe, Daniel RoggenDaniel Roggen
Computer vision techniques applied on images opportunistically captured from body-worn cameras or mobile phones offer tremendous potential for vision-based context awareness. In this paper, we evaluate the potential to recognise the modes of locomotion and transportation of mobile users, by analysing single images captured by body-worn cameras. We evaluate this with the publicly available Sussex-Huawei Locomotion and Transportation Dataset, which includes 8 transportation and locomotion modes performed over 7 months by 3 users. We present a baseline performance obtained through crowd sourcing using Amazon Mechanical Turk. Humans infered the correct modes of transportations from images with an F1-score of 52%. The performance obtained by five state-of-the-art Deep Neural Networks (VGG16, VGG19, ResNet50, MobileNet and DenseNet169) on the same task was always above 71.3% F1-score. We characterise the effect of partitioning the training data to fine-tune different number of blocks of the deep networks and provide recommendations for mobile implementations.

History

Publication status

  • Published

File Version

  • Accepted version

Journal

International Conference on Activity and Behavior Computing

Publisher

Institute of Electrical and Electronics Engineers

Volume

1

Page range

67-72

Event name

International Conference on Activity and Behavior Computing

Event location

Spokane, Eastern Washington University, USA

Event type

conference

Event date

May. 30 - Jun. 2, 2019

Department affiliated with

  • Engineering and Design Publications

Research groups affiliated with

  • Sensor Technology Research Centre Publications

Full text available

  • Yes

Peer reviewed?

  • Yes

Editors

Sozo Inoue, Atiqur Rahman Ahad

Legacy Posted Date

2019-06-24

First Open Access (FOA) Date

2019-06-25

First Compliant Deposit (FCD) Date

2019-06-21

Usage metrics

    University of Sussex (Publications)

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC