Improved Behavior Monitoring and Classification Using Cues Parameters Extraction from Camera Array Images
DOI:
https://doi.org/10.9781/ijimai.2018.07.003Keywords:
Body posture recognition system, Activity recognition, SmartCities, Pattern ClusteringAbstract
Behavior monitoring and classification is a mechanism used to automatically identify or verify individual based on their human detection, tracking and behavior recognition from video sequences captured by a depth camera. In this paper, we designed a system that precisely classifies the nature of 3D body postures obtained by Kinect using an advanced recognizer. We proposed novel features that are suitable for depth data. These features are robust to noise, invariant to translation and scaling, and capable of monitoring fast human bodyparts movements. Lastly, advanced hidden Markov model is used to recognize different activities. In the extensive experiments, we have seen that our system consistently outperforms over three depth-based behavior datasets, i.e., IM-DailyDepthActivity, MSRDailyActivity3D and MSRAction3D in both posture classification and behavior recognition. Moreover, our system handles subject's body parts rotation, self-occlusion and body parts missing which significantly track complex activities and improve recognition rate. Due to easy accessible, low-cost and friendly deployment process of depth camera, the proposed system can be applied over various consumer-applications including patient-monitoring system, automatic video surveillance, smart homes/offices and 3D games.Downloads
References
H. Chaminda, V. Klyuev and K. Naruse, “A smart reminder system for complex human activities,” in International Conference on Advanced Communication Technology, 2012, pp. 235-240.
V. B. Semwal, N. Gaud and G. C. Nandi, “Human Gait State Prediction Using Cellular Automata and Classification Using ELM,” in International Conference on Machine Intelligence and signal processing, 2017.
A. Jalal and A. Shahzad, “Multiple facial feature detection using VertexModeling structure,” in International Conference on Interactive Computer Aided Learning (ICL), 2007, pp. 1-7.
M. Mehmood A. Jalal, and H. A. Evans, “Facial Expression Recognition in Image Sequences Using 1D Transform and Gabor Wavelet Transform,” in IEEE International Conference on Applied and Engineering Mathematics, 2018.
M. Raj, V. B. Semwal, and G. C. Nandi. “Bidirectional association of joint angle trajectories for humanoid locomotion: the restricted Boltzmann machine approach,” Neural Computing and Applications, pp. 1-9, 2016.
A. Jalal and I. Uddin, “Security architecture for third generation (3G) using GMHS cellular network,” in IEEE Conference on Emerging Technologies, 2007, pp. 74-79.
A. Jalal and Y. Rasheed, “Collaboration achievement along with performance maintenance in video streaming,” in Proceedings of the IEEE conference on Interactive computer aided learning, pp. 1-8, 2007.
V. B. Semwal and G. C. Nandi, “Toward developing a computational model for bipedal push recovery–a brief,” IEEE Sensors Journal, vol. 15, no. 4, pp. 2021-2022, 2015.
A. Jalal, and M. A. Zeb, “Security enhancement for e-learning portal,” International Journal of Computer Science and Network Security, vol. 8, no. 3, pp. 41-45, 2008.
A. Jalal and S. Kim, “Global security using human face understanding under vision ubiquitous architecture system,” World Academy of Science, Engineering, and Technology, vol. 13, pp. 7-11, 2006.
V. B. Semwal, J. Singha, P. K. Sharma, A. Chauhan and B. Behera, “An optimized feature selection technique based on incremental feature analysis for bio-metric gait data classification,” Multimedia tools and applications, vol. 76, no. 22, pp. 24457-24475, Nov. 2017.
A. Jalal and S. Kim, S, “Advanced performance achievement using multi-algorithmic approach of video transcoder for low bit rate wireless communication,” ICGST International Journal on graphics, vision and image processing, vol. 5, no. 9, pp. 27-32, 2005.
A. Jalal and S. Kim, “The Mechanism of Edge Detection using the Block Matching Criteria for the Motion Estimation,” Proc. Human Computer Interaction, pp.484-489, Jan. 2005.
G. C. Nandi, V. B Semwal, M. Raj and A. Jindal, “Modeling bipedal locomotion trajectories using hybrid automata,” Proc. IEEE Region 10 Conference (TENCON), pp. 1013-1018, 2016.
A. Jalal, N. Sharif, J. T. Kim and T. S. Kim, “Human activity recognition via recognized body parts of human depth silhouettes for residents monitoring services at smart home,” Indoor and Built Environment, vol. 22, no. 1, pp. 271-279, January, 2013.
P. Turaga, R. Chellappa, V. S. Subrahmanian and O. Udrea, “Machine recognition of human activities: A survey,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 18, no. 11, pp. 1473-1488, November, 2008.
X. Yang, C. Yang and Y. Tian, “Recognizing actions using depth motion maps-based histograms of oriented gradients,” in International Conference on Multimedia (ICM), 2012, pp. 1057-1060.
A. Jalal, Y. Kim, and D. Kim, “Ridge body parts features for human pose estimation and recognition from RGB-D video data,” in Conference on computing, communication and networking technologies, 2014, pp. 1-6.
O. Oreifej and Z. Liu, “Hon4d: Histogram of oriented 4d normal for activity recognition from depth sequences,” in Conference on Computer Vision and Pattern Recognition, 2013, pp. 716-723.
A. Jalal, S. Kamal and D. Kim, “A depth video sensor-based life-logging human activity recognition system for elderly care in smart indoor environments,” Sensors, vol. 14, no. 7, pp. 11735-11759, July, 2014.
A. Jalal, Y.-H. Kim, Y.-J. Kim, S. Kamal and D. Kim, “Robust human activity recognition from depth video using spatiotemporal multi-fused features, Pattern recognition, vol. 61, pp. 295-308, 2017.
A. Jalal and Y. Kim, “Dense Depth Maps-based Human Pose Tracking and Recognition in Dynamic Scenes Using Ridge Data,” in Conference on Advanced Video and Signal-Based Surveillance, 2014, pp. 119-124.
V. B. Semwal and G. C. Nandi, “Generation of joint trajectories using hybrid automate-based model: a rocking block-based approach,” IEEE Sensors Journal, vol. 16, no. 14, pp. 5805-5816, May, 2016.
M. Raj, V. B. Semwal and G. C. Nandi, “Multiobjective optimized bipedal locomotion,” International Journal of Machine Learning and Cybernetics, pp. 1-17, 2017.
A. Jalal, S. Y. Lee, J. T. Kim, T. S. Kim, “Human activity recognition via the features of labeled depth body parts,” in International Conference on Smart Homes and Health Telematics, 2012, pp. 246-249.
J. Wang, Z. Liu, Y. Wu, J. Yuan, “Mining actionlet ensemble for action recognition with depth cameras,” in International Conference on Computer Vision and Pattern Recognition, 2012, pp. 1290-1297.
W. Li, Z. Zhang and Z. Liu, “Action recognition based on a bag of 3D points,” in International Workshop on Computer Vision and Pattern Recognition, 2010, pp. 9-14.
A. Jalal, J. T. Kim, and T.-S Kim, “Development of a life logging system via depth imaging-based human activity recognition for smart homes,” in Proceedings of the International Symposium on Sustainable Healthy Buildings, 2012, pp. 91-95.
A. Jalal, S. Kamal and D.-S. Kim, “Detecting Complex 3D Human Motions with Body Model Low-Rank Representation for Real-Time Smart Activity Monitoring System,” KSII Transactions on Internet and Information Systems, vol. 12, no. 3, pp. 1189-1204, 2018.
A. Jalal, J. T. Kim, and T.-S. Kim, “Human activity recognition using the labeled depth body parts information of depth silhouettes,” in Proceedings of the 6th international symposium on Sustainable Healthy Buildings, 2012, pp. 1-8.
M. Muller and T. Roder, “Motion templates for automatic classification and retrieval of motion capture data,” in SIGGRAPH/Eurographics symposium on computer animation, 2006, pp. 137-146.
X. Seidenari, C. Varano, Y. Berretti, C. Bimbo and Y. Pala, “Recognizing actions from depth cameras as weakly aligned multi-part bag-of-poses,” in Conference on Computer Vision and Pattern Recognition Workshops, 2013, pp. 479-485.
B. Ni, G. Wang and P. Moulin, “RGBD-HuDaAct: A color-depth video database for human daily activity recognition,” in Conference on Computer Vision Workshops, 2011, pp. 1147-1153.
A. Jalal, S. Kamal and D. Kim, “Depth Silhouettes Context: A new robust feature for human tracking and activity recognition based on embedded HMMs,” in International Conference on Ubiquitous Robots and Ambient Intelligence, 2015, pp. 294-299.
A. Jalal, Y. Kim, S. Kamal, A. Farooq and D. Kim, “Human daily activity recognition with joints plus body features representation using Kinect sensor,” in International Conference on Informatics, electronics and vision, 2015, pp. 1-6.
X. Yang and Y. Tian, “Eigenjoints-based action recognition using naivebayes-nearest-neighbor,” in Conference on Computer vision and pattern recognition workshops, 2012, pp. 14-19.
A. Jalal, S. Kamal and D. Kim, “Human depth sensors-based activity recognition using spatiotemporal features and hidden markov model for smart environments, J. of computer networks and communications, pp. 1-11, 2016.
L. Xia and J. Aggarwal, “Spatio-Temporal Depth Cuboid Similarity Feature for Activity Recognition Using Depth Camera,” in International Conference on Computer Vision and Pattern Recognition, 2013, pp. 2834-2841.
F. Lv and R. Nevatia, “Recognition and segmentation of 3-D human action using HMM and multi-class adaboost,” in European Conference on Computer Vision, 2006, pp. 359-372.
A. Jalal, S. Kamal and D. Kim, “Shape and motion features approach for activity tracking and recognition from Kinect video camera,” in International Conference on Advanced Information Networking and Applications Workshops, 2015, pp. 445-450.
Shaharyar Kamal and Ahmad Jalal, “A hybrid feature extraction approach for human detection, tracking and activity recognition using depth sensors,” Arabian J. of Science and Engineering, vol. 41, no. 3, pp. 1043-1051, 2016.
C. Wang, Y. Wang and A. Yuille, “An Approach to Pose-Based Action Recognition,” in International Conference on Computer Vision and Pattern Recognition, 2013, pp. 915-922.
M. Zanfir, M. Leordeanu and C. Sminchisescu, “The Moving Pose: An Efficient 3D Kinematics Descriptor for Low-Latency Action Recognition and Detection,” in International Conference on Computer Vision, 2013, pp. 2752-2759.
V. B. Semwal, J. Singha, P. K. Sharma, A. Chauhan and B. Behera, “An optimized feature selection technique based on incremental feature analysis for bio-metric gait data classification,” Multimedia Tools and Applications, vol. 76, no. 22, pp. 24457-24475, 2017.
V. B. Semwal, M. Raj, and G. C. Nandi, “Biometric gait identification based on a multilayer perceptron,” Robotics and Autonomous Systems, vol. 65, pp. 65-75, 2015.
V. B. Semwal, K. Mondal, and G. C. Nandi, “Robust and accurate feature selection for humanoid push recovery and classification: deep learning approach,” Neural Computing and Applications, vol. 28, no. 3, pp. 565-574, 2017.
Downloads
Published
-
Abstract68
-
PDF42
Submit Article
Information
