Hirokatsu KATAOKA, Ph.D.
National Institute of Advanced Industrial Science and Technology (AIST), Japan

[Top] [Research] [Curriculum Vitae] [Publications]

"Human Action Recognition without Human"
Yun He (Univ. of Tsukuba, AIST), Soma Shirakabe (Univ. of Tsukuba, AIST), Yutaka Satoh (AIST), Hirokatsu Kataoka (AIST)

The objective of this paper is to evaluate "human action recognition without human". Motion representation is frequently discussed in human action recognition. We have examined several sophisticated options, such as dense trajectories (DT) and the two-stream convolutional neural network (CNN). However, some features from the background could be too strong, as shown in some recent studies on human action recognition. Therefore, we considered whether a background sequence alone can classify human actions in current large-scale action datasets (e.g., UCF101). In this paper, we propose a novel concept for human action analysis that is named "human action recognition without human". An experiment clearly shows the effect of a background sequence for understanding an action label. The setting is shown below:

To the best of our knowledge, this is the first study of human action recognition without human. However, we should not have done that kind of thing. The motion representation from a background sequence is effective to classify videos in a human action database. We demonstrated human action recognition in with and without a human settings on the UCF101 dataset. The results show the setting without a human (47.42%; without human setting) was close to the setting with a human (56.91%; with human setting). We must accept this reality to realize better motion representation.


- Yun He, Soma Shirakabe, Yutaka Satoh, Hirokatsu Kataoka, "Human Action Recognition without Human", ECCV 2016 Workshop on Brave New Ideas for Motion Representations in Videos (BNMW), Oct. 2016. (Oral, Best Paper) [PDF] [Project] [Slide] [Poster]

Copyright Hirokatsu Kataoka