This paper is published in Volume-7, Issue-3, 2021
Area
Machine Learning
Author
Sankeerthana Rajan Karem, Sai Prathyusha Kanisetti, Dr. K. Soumya, J. Sri Gayathri Seelamanthula, Madhurima kalivarapu
Org/Univ
Andhra University College of Engineering for Women, Visakhapatnam, Andhra Pradesh, India
Pub. Date
30 June, 2021
Paper ID
V7I3-2223
Publisher
Keywords
Body Landmarks, MediaPipe, Body Language, Prediction, Accuracy, Real-time on-device Tracking, Pose Estimation, Recognition

Citationsacebook

IEEE
Sankeerthana Rajan Karem, Sai Prathyusha Kanisetti, Dr. K. Soumya, J. Sri Gayathri Seelamanthula, Madhurima kalivarapu. AI Body Language Decoder using MediaPipe and Python, International Journal of Advance Research, Ideas and Innovations in Technology, www.IJARIIT.com.

APA
Sankeerthana Rajan Karem, Sai Prathyusha Kanisetti, Dr. K. Soumya, J. Sri Gayathri Seelamanthula, Madhurima kalivarapu (2021). AI Body Language Decoder using MediaPipe and Python. International Journal of Advance Research, Ideas and Innovations in Technology, 7(3) www.IJARIIT.com.

MLA
Sankeerthana Rajan Karem, Sai Prathyusha Kanisetti, Dr. K. Soumya, J. Sri Gayathri Seelamanthula, Madhurima kalivarapu. "AI Body Language Decoder using MediaPipe and Python." International Journal of Advance Research, Ideas and Innovations in Technology 7.3 (2021). www.IJARIIT.com.

Abstract

Body language are visual languages produced by the movement of the hands, face and body. In this project we evaluate representations based on skeleton poses, as these are explainable, person-independent, privacy-preserving, low-Dimentional representations. Basically skeletal representations generalize over an individual’s appearance and background, allowing us to focus on the recognition of motion. We present a real-time on-device body tracking pipeline that predicts hand skeleton and the whole body notion. It is implemented via MediaPipe, a framework for building cross-platform ML solutions. We perform using pose estimation systems and analyze the applicability of the estimation systems to body language recognition by evaluating failure cases of the existing models. The proposed system and architecture demonstrates real-time inference and high prediction quality.