Weakly structured information aggregation for upper-body posture assessment using ConvNets

Authors

Zewei Ding, University of WollongongFollow
Wanqing Li, University of WollongongFollow
Pichao Wang, University of WollongongFollow
Philip O. Ogunbona, University of WollongongFollow
Ling Qin, Guangxi People's Hospital

RIS ID

116795

Publication Details

Ding, Z., Li, W., Wang, P., Ogunbona, P. & Qin, L. (2017). Weakly structured information aggregation for upper-body posture assessment using ConvNets. IEEE International Conference on Multimedia and Expo (ICME) (pp. 1512-1517). United States: IEEE.

Abstract

Posture assessment aims to determine the risk associated with poor posture and thus avoid injury in subjects. Upper-body posture assessment from images offers an attractive alternative to manual methods by directly extracting relevant features for classification. A deep convolutional neural network is proposed to extract structured features from different body parts and learn shared features that are used to determine the appropriate assessment. The structured features are learned with triplet-based rank constraints based on head and torso separately. The shared feature and assessment function are learned with soft-max constraints based on posture risk measurements. Experimental evaluation on a self-collected upper-body posture dataset has verified the efficacy of the proposed method and network architecture.