Method and device for estimating shielded fingertip, posture recognition system and storage medium

A posture and fingertip technology, which is applied in the field of finger movement and posture processing, can solve problems such as scaling deviation

Inactive Publication Date: 2019-10-25
CANON KK
View PDF1 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, skeletal model-based methods only guarantee that occluded body parts are located in invisible regions
Regarding estimating the occluded fingertip position for a pose, estimating an occluded fingertip for a rotation pose or a zoom pose is very challenging and may affect pose recognition results (e.g., zoom Scale, rotation angle) bring large deviation (deviation)

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for estimating shielded fingertip, posture recognition system and storage medium
  • Method and device for estimating shielded fingertip, posture recognition system and storage medium
  • Method and device for estimating shielded fingertip, posture recognition system and storage medium

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0049] image 3 is a block diagram illustrating the configuration of the occluded fingertip estimation device 300 according to the present invention. in, image 3 Some or all of the modules shown in may be implemented by dedicated hardware. Figure 4 The flowchart shown in 400 is image 3 The corresponding process of the apparatus 300 shown in .

[0050] Such as image 3 As shown in , the apparatus 300 for occluded fingertip estimation includes a fingertip detection unit 310 , an occluded fingertip determination unit 320 and an occluded fingertip estimation unit 330 .

[0051] In this embodiment, first as described above, figure 2 The input device 250 shown in may acquire a depth image from an image acquisition device such as a depth sensor. Here, the depth image may contain the hand object and the fingertips may appear or be invisible or occluded. Secondly, the input device 250 may transmit the acquired depth image to the fingertip detection unit 310 via the system bu...

no. 2 example

[0092] In a real scene, the position of the pose center changes during pose processing, regardless of whether the pose is scaled or rotated. Therefore, according to the second embodiment of the present invention, the present invention proposes another method for estimating the positions of the center of the rotation pose and the center of the zoom pose as follows, which will be referred to below Figure 6A to Figure 6E to describe. Wherein, the occluded fingertip estimation unit 330 is configured to estimate a new pose center based on the fingertip, finger joint and finger midline, and then use the new pose center to estimate the position of the occluded fingertip in the current frame. Other steps are the same as those in the above-mentioned first embodiment, and detailed description will not be repeated. Therefore, in this embodiment, the present invention provides an alternative way to achieve similar effects to the first embodiment.

[0093] Figure 6A The flowchart 600 ...

no. 3 example

[0130] Through experiments, the inventors found that the occluded fingertip estimation unit 330 can not only estimate the position of the occluded fingertip based on the pose center and the visible fingertip as described in the first embodiment, but also based on the distance between the visible fingertip and the occluded fingertip. The relative motion relationship of estimating the position of the occluded fingertip. Therefore, according to the third embodiment of the present invention, the occluded fingertip estimating unit 330 can combine or combine the estimated positions of the occluded fingertips to improve the estimation accuracy, which will be referred to below Figure 7A to Figure 7C to describe. Other steps are the same as those in the first embodiment above, and will not be described in detail again.

[0131] Figure 7A The flowchart 700 shown in is according to the third embodiment of the present invention Figure 4 The corresponding process of the occluded finger...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and device for estimating a shielded fingertip, a posture recognition system and a storage medium. The method comprises: a fingertip detection step for detecting a fingertip from a current frame of a video image; a shielded fingertip determination step for determining a shielded fingertip and a visible fingertip from the detected fingertip; and a shielded fingertipestimation step for estimating a first position of the shielded fingertip according to the visible fingertip and a posture center determined by the visible fingertip. The accuracy of text detection is improved.

Description

technical field [0001] The present invention relates to finger motion gesture processing in touch-based systems, and more particularly to methods and devices for estimating, for example, invisible or occluded fingertips. Background technique [0002] Currently, with the recent introduction of low-cost consumer depth sensors, depth-based gesture interaction has become a hot topic in the field of human-computer interaction. For example, in a touch-table system, a depth sensor captures and detects the position of the user's fingertip. While the depth sensor is detecting motion gestures of the fingertip, touching the fingertip is sometimes obscured by other fingers or the palm. For example, when a user performs a rotate gesture or a zoom gesture (ie, a zoom-in and zoom-out gesture) with two fingers of one hand, his / her thumb is sometimes obscured by the palm. Setting multiple sensors at different locations is a solution to the problem, but the difficulty and cost of setting th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/042G06F3/0488G06K9/00
CPCG06F3/0425G06F3/04883G06V40/28
Inventor 李建杰刘贺飞
Owner CANON KK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap