Online detection and classification of in-corrected played strokes in table tennis using IR depth camera

No Thumbnail Available

Date

2020-05

Journal Title

Journal ISSN

Volume Title

Type

Article

Publisher

Elsevier B.V.

Series Info

Procedia Computer Science;Volume 170, 2020, Pages 555-562

Abstract

Table tennis is a complex sport with a distinctive style of play. Due to the rising interest in this sport the past years, attempts have been targeted towards enhancing the training experience and quality through various techniques. Technology has been used to support training sessions for table tennis players before, with a focus on players’ performance measures rather than technique. In this paper, we propose a methodology based on IR depth camera for detecting and classifying the efficiency of strokes performed by players in order to enhance the training experience. Our system is to based on analyzing depth data collected from IR depth camera and recognized using fastDTW algorithm. The results show an average accuracy of 88% - 100%. This is the first paper to address the usage of IR depth camera on the table tennis player to detect and classify the strokes played

Description

Scopus

Keywords

Table tennis, stroke detection, stroke classification, hand gestures, IR depth camera

Citation

Atia, A., Shorim, N. (2019) Hand Gestures Classification with Multi-core Dtw, pp. 91-96. 2 Blank, P., Groh, B.H., Eskofier, B.M. Ball speed and spin estimation in table tennis using a racket-mounted inertial sensor (2017) Proceedings - International Symposium on Wearable Computers, ISWC, Part F130534, pp. 2-9. Cited 4 times. ISBN: 978-145035188-1 doi: 10.1145/3123021.3123040 View at Publisher 3 Blank, P., Hoßbach, J., Schuldhaus, D., Eskofier, B.M. Sensor-based stroke detection and stroke type classification in table tennis (2015) ISWC 2015 - Proceedings of the 2015 ACM International Symposium on Wearable Computers, pp. 93-100. Cited 22 times. ISBN: 978-145033578-2 doi: 10.1145/2802083.2802087 View at Publisher 4 Boyer, E., Bevilacqua, F., Phal, F., Hanneton, S. Low-cost motion sensing of table tennis players for real time feedback (2013) Int. J. Table Tennis Sci., 8. Cited 6 times. 5 Caifeng, Y. (2018) 2018 World Team Championships the Most Followed Table Tennis Team Event in History http://www.ittf.com/2018/09/13/2018-world-team-championships-followed-table-tennis-team-event-history/ 6 Chatterjee, A., Govindu, V. (2015) Noise in Structured-light Stereo Depth Cameras: Modeling and Its Applications. Cited 3 times. 7 Chen, Y., Luo, B., Chen, Y.-L., Liang, G., Wu, X. A real-time dynamic hand gesture recognition system using kinect sensor (2015) 2015 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015, art. no. 7419071, pp. 2026-2030. Cited 24 times. ISBN: 978-146739674-5 doi: 10.1109/ROBIO.2015.7419071 View at Publisher 8 Das, P., Chakravarty, K., Chowdhury, A., Chatterjee, D., Sinha, A., Pal, A. Improving joint position estimation of Kinect using anthropometric constraint based adaptive Kalman filter for rehabilitation (2018) Biomedical Physics and Engineering Express, 4 (3), art. no. 035002. Cited 3 times. http://iopscience.iop.org/article/10.1088/2057-1976/aaa371/pdf doi: 10.1088/2057-1976/aaa371 View at Publisher 9 Heaton, J. (2009) Table Tennis: Skills, Techniques, Tactics Crowood Sports Guides Crowood Press 10 Huang, D.-Y., Hu, W.-C., Chang, S.-H. Gabor filter-based hand-pose angle estimation for hand gesture recognition under varying illumination (2011) Expert Systems with Applications, 38 (5), pp. 6031-6042. Cited 57 times. doi: 10.1016/j.eswa.2010.11.016 View at Publisher 11 Hudetz, R. Taktik im Tischtennis: Mit dem Kopf gewinnen (2004) Tibhar 12 (2019) Table Tennis Started As a Genteel, After-dinner Game, but Is Now a Fast, High-tech Sport. It Also Has the Most Participants of Any Sport in the World Ioc http://www.olympic.org/table-tennis 13 Kos, M., Ženko, J., Vlaj, D., Kramberger, I. Tennis stroke detection and classification using miniature wearable IMU device (2016) International Conference on Systems, Signals, and Image Processing, 2016-June, art. no. 7502764. Cited 10 times. http://ieeexplore.ieee.org/xpl/conferences.jsp ISBN: 978-146739555-7 doi: 10.1109/IWSSIP.2016.7502764 View at Publisher 14 Kownacki, C. Optimization approach to adapt Kalman filters for the real-time application of accelerometer and gyroscope signals' filtering (2011) Digital Signal Processing: A Review Journal, 21 (1), pp. 131-140. Cited 48 times. http://www.elsevier.com/inca/publications/store/6/2/2/8/1/8/index.htt doi: 10.1016/j.dsp.2010.09.001 View at Publisher 15 Larcombe, B. (2018) The Four Basic Table Tennis Strokes http://www.experttabletennis.com/basic-table-tennis-strokes/ 16 Le, T.-L., Nguyen, M.-Q., Nguyen, T.-T.-M. Human posture recognition using human skeleton provided by Kinect (2013) 2013 International Conference on Computing, Management and Telecommunications, ComManTel 2013, art. no. 6482417, pp. 340-345. Cited 70 times. ISBN: 978-146732087-0 doi: 10.1109/ComManTel.2013.6482417 View at Publisher 17 Li, G., Tang, H., Sun, Y., Kong, J., Jiang, G., Jiang, D., Tao, B., (...), Liu, H. Hand gesture recognition based on convolution neural network (2019) Cluster Computing, 22, pp. 2719-2729. Cited 27 times. http://www.kluweronline.com/issn/1386-7857 doi: 10.1007/s10586-017-1435-x View at Publisher 18 Lindsay, D., Cox, S. Effective probability forecasting for time series data using standard machine learning techniques (2005) Lecture Notes in Computer Science, 3686 (PART I), pp. 35-44. Cited 11 times. View at Publisher 19 Lock, S. (2017) Table Tennis: Number of Participants U.s. 2017. URL http://www.statista.com/statistics/191959/participants-in-table-tennis-in-the-us-since-2006/ 20 McAfee, R. (2009) Table Tennis Steps to Success, Human Kinetics 21 Molchanov, P., Yang, X., Gupta, S., Kim, K., Tyree, S., Kautz, J. Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks (2016) Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2016-December, art. no. 7780825, pp. 4207-4215. Cited 178 times. ISBN: 978-146738850-4 doi: 10.1109/CVPR.2016.456 View at Publisher 22 Nurwanto, F., Ardiyanto, I., Wibirama, S. Light sport exercise detection based on smartwatch and smartphone using k-Nearest Neighbor and Dynamic Time Warping algorithm (2016) Proceedings of 2016 8th International Conference on Information Technology and Electrical Engineering: Empowering Technology for Better Future, ICITEE 2016, art. no. 7863299. Cited 4 times. ISBN: 978-150904139-8 doi: 10.1109/ICITEED.2016.7863299 View at Publisher 23 Pernek, I., Hummel, K.A., Kokol, P. Exercise repetition detection for resistance training based on smartphones (2013) Personal and Ubiquitous Computing, 17 (4), pp. 771-782. Cited 31 times. doi: 10.1007/s00779-012-0626-y View at Publisher 24 Popa, M. (2011) Hand Gesture Recognition Based on Accelerometer Sensors 25 Raheja, J., Chaudhary, A. Robust gesture recognition using kinect: A comparison between dtw and hmm (2015) Optik - International Journal for Light and Electron Optics 26 Salvador, S., Chan, P. Toward accurate dynamic time warping in linear time and space (2007) Intelligent Data Analysis, 11 (5), pp. 561-580. Cited 605 times. View at Publisher 27 Sempena, S., Maulidevi, N.U., Aryan, P.R. Human action recognition using Dynamic Time Warping (2011) Proceedings of the 2011 International Conference on Electrical Engineering and Informatics, ICEEI 2011, art. no. 6021605. Cited 99 times. ISBN: 978-145770752-0 doi: 10.1109/ICEEI.2011.6021605 View at Publisher 28 Sieluzycki, C., Kaczmarczyk, P., Sobecki, J., Witkowski, K., Maslinski, J., Cieslinski, W. Microsoft kinect as a tool to support training in professional sports: Augmented reality application to tachi-waza techniques in judo (2016) Proceedings - 2016 3rd European Network Intelligence Conference, ENIC 2016, art. no. 7838059, pp. 153-158. Cited 4 times. ISBN: 978-150903455-0 doi: 10.1109/ENIC.2016.030 View at Publisher 29 Switonski, A., Josinski, H., Wojciechowski, K. Dynamic time warping in classification and selection of motion capture data (2019) Multidimensional Systems and Signal Processing, 30 (3), pp. 1437-1468. Cited 2 times. doi: 10.1007/s11045-018-0611-3 View at Publisher 30 Tebbe, J., Klamt, L., Gao, Y., Zell, A. (2019) Spin Detection in Robotic Table Tennis http://arXiv:1905.07967 31 Triamlumlerd, S., Pracha, M., Kongsuwan, P., Angsuchotmetee, P. A table tennis performance analyzer via a single-view low-quality camera (2017) 2017 International Electrical Engineering Congress, iEECON 2017, art. no. 8075888. Cited 2 times. ISBN: 978-150904666-9 doi: 10.1109/IEECON.2017.8075888 View at Publisher 32 Viyanon, W., Kosasaeng, V., Chatchawal, S., Komonpetch, A. SwingPong: Analysis and suggestion based on motion data from mobile sensors for table tennis strokes using decision tree (2016) ACM International Conference Proceeding Series, art. no. 18. http://portal.acm.org/ ISBN: 978-145034799-0 doi: 10.1145/3028842.3028860 View at Publisher 33 Yasser, A., Tariq, D., Samy, R., Hassan, M.A., Atia, A. Smart coaching: Enhancing weightlifting and preventing injuries (2019) International Journal of Advanced Computer Science and Applications, 10 (7), pp. 686-691. https://thesai.org/Downloads/Volume10No7/Paper_89-Smart_Coaching_Enhancing_Weightlifting.pdf 34 Yeo, H.-S., Koike, H., Quigley, A. Augmented learning for sports using wearable head-worn and wrist-worn devices (2019) 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings, art. no. 8798054, pp. 1578-1580. http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8787730 ISBN: 978-172811377-7 doi: 10.1109/VR.2019.8798054

Full Text link