کد مقاله کد نشریه سال انتشار مقاله انگلیسی نسخه تمام متن
529392 869652 2014 8 صفحه PDF دانلود رایگان
عنوان انگلیسی مقاله ISI
Recognizing object manipulation activities using depth and visual cues
موضوعات مرتبط
مهندسی و علوم پایه مهندسی کامپیوتر چشم انداز کامپیوتر و تشخیص الگو
پیش نمایش صفحه اول مقاله
Recognizing object manipulation activities using depth and visual cues
چکیده انگلیسی


• An algorithm that parses 3D-cloud representing the human body into torso and arms.
• A technique to locate the held object, and incorporate size into a recognizer.
• A temporal smoothing scheme to improve object and activity recognition.

We propose a framework, consisting of several algorithms to recognize human activities that involve manipulating objects. Our proposed algorithm identifies objects being manipulated and models high-level tasks being performed accordingly. Realistic settings for such tasks pose several problems for computer vision, including sporadic occlusion by subjects, non-frontal poses, and objects with few local features. We show how size and segmentation information derived from depth data can address these challenges using simple and fast techniques. In particular, we show how to robustly and without supervision find the manipulating hand, properly detect/recognize objects and properly use the temporal information to fill in the gaps between sporadically detected objects, all through careful inclusion of depth cues. We evaluate our approach on a challenging dataset of 12 kitchen tasks that involve 24 objects performed by 2 subjects. The entire framework yields 82%/84% precision (74%/83%recall) for task/object recognition. Our techniques outperform the state-of-the-art significantly in activity/object recognition.

ناشر
Database: Elsevier - ScienceDirect (ساینس دایرکت)
Journal: Journal of Visual Communication and Image Representation - Volume 25, Issue 4, May 2014, Pages 719–726
نویسندگان
, , , ,