A Depth Video-based Human Detection and Activity Recognition using Multi-features and Embedded Hidden Markov Models for Health Care Monitoring Systems

TitleA Depth Video-based Human Detection and Activity Recognition using Multi-features and Embedded Hidden Markov Models for Health Care Monitoring Systems
Publication TypeJournal Article
Year of Publication2017
AuthorsJalal, A., S. Kamal, and D. Kim
JournalInternational Journal of Interactive Multimedia and Artificial Intelligence
ISSN1989-1660
IssueRegular Issue
Volume4
Number4
Date Published06/2017
Pagination54-62
Abstract

Increase in number of elderly people who are living independently needs especial care in the form of healthcare monitoring systems. Recent advancements in depth video technologies have made human activity recognition (HAR) realizable for elderly healthcare applications. In this paper, a depth video-based novel method for HAR is presented using robust multi-features and embedded Hidden Markov Models (HMMs) to recognize daily life activities of elderly people living alone in indoor environment such as smart homes. In the proposed HAR framework, initially, depth maps are analyzed by temporal motion identification method to segment human silhouettes from noisy background and compute depth silhouette area for each activity to track human movements in a scene. Several representative features, including invariant, multi-view differentiation and spatiotemporal body joints features were fused together to explore gradient orientation change, intensity differentiation, temporal variation and local motion of specific body parts. Then, these features are processed by the dynamics of their respective class and learned, modeled, trained and recognized with specific embedded HMM having active feature values. Furthermore, we construct a new online human activity dataset by a depth sensor to evaluate the proposed features. Our experiments on three depth datasets demonstrated that the proposed multi-features are efficient and robust over the state of the art features for human action and activity recognition.

KeywordsFeature Extraction, Hidden Markov Models, Human Detection Activity, Monitoring
DOI10.9781/ijimai.2017.447
URLhttp://www.ijimai.org/journal/sites/default/files/files/2016/12/ijimai20174_4_7_pdf_14110.pdf
AttachmentSize
ijimai20174_4_7.pdf1.39 MB