TY - GEN
T1 - CFAD
T2 - 16th European Conference on Computer Vision 2020
AU - Li, Yuxi
AU - Lin, Weiyao
AU - See, John
AU - Xu, Ning
AU - Xu, Shugong
AU - Yan, Ke
AU - Yang, Cong
N1 - Funding Information:
Acknowledgement. The paper is supported in part by the following grants: China Major Project for New Generation of AI Grant (No. 2018AAA0100400), National Natural Science Foundation of China (No. 61971277). The work is also supported by funding from Clobotics under the Joint Research Program of Smart Retail.
Publisher Copyright:
© 2020, Springer Nature Switzerland AG.
Copyright:
Copyright 2020 Elsevier B.V., All rights reserved.
PY - 2020/10/10
Y1 - 2020/10/10
N2 - Most current pipelines for spatio-temporal action localization connect frame-wise or clip-wise detection results to generate action proposals, where only local information is exploited and the efficiency is hindered by dense per-frame localization. In this paper, we propose Coarse-to-Fine Action Detector (CFAD), an original end-to-end trainable framework for efficient spatio-temporal action localization. The CFAD introduces a new paradigm that first estimates coarse spatio-temporal action tubes from video streams, and then refines the tubes’ location based on key timestamps. This concept is implemented by two key components, the Coarse and Refine Modules in our framework. The parameterized modeling of long temporal information in the Coarse Module helps obtain accurate initial tube estimation, while the Refine Module selectively adjusts the tube location under the guidance of key timestamps. Against other methods, the proposed CFAD achieves competitive results on action detection benchmarks of UCF101-24, UCFSports and JHMDB-21 with inference speed that is 3.3 faster than the nearest competitor.
AB - Most current pipelines for spatio-temporal action localization connect frame-wise or clip-wise detection results to generate action proposals, where only local information is exploited and the efficiency is hindered by dense per-frame localization. In this paper, we propose Coarse-to-Fine Action Detector (CFAD), an original end-to-end trainable framework for efficient spatio-temporal action localization. The CFAD introduces a new paradigm that first estimates coarse spatio-temporal action tubes from video streams, and then refines the tubes’ location based on key timestamps. This concept is implemented by two key components, the Coarse and Refine Modules in our framework. The parameterized modeling of long temporal information in the Coarse Module helps obtain accurate initial tube estimation, while the Refine Module selectively adjusts the tube location under the guidance of key timestamps. Against other methods, the proposed CFAD achieves competitive results on action detection benchmarks of UCF101-24, UCFSports and JHMDB-21 with inference speed that is 3.3 faster than the nearest competitor.
KW - Coarse-to-fine paradigm
KW - Parameterized modeling
KW - Spatiotemporal action detection
UR - http://www.scopus.com/inward/record.url?scp=85092911883&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-58517-4_30
DO - 10.1007/978-3-030-58517-4_30
M3 - Conference contribution
AN - SCOPUS:85092911883
SN - 9783030585167
T3 - Lecture Notes in Computer Science
SP - 510
EP - 527
BT - Computer Vision. ECCV 2020
A2 - Vedaldi, Andrea
A2 - Bischof, Horst
A2 - Brox, Thomas
A2 - Frahm, Jan-Michael
PB - Springer
Y2 - 23 August 2020 through 28 August 2020
ER -