Unlock instant, AI-driven research and patent intelligence for your innovation.

An operation prompting method and glasses

A technology of operation prompts and operation modes, applied in the field of data processing, can solve problems such as cumbersome operations, low efficiency, and errors, and achieve the effect of improving learning efficiency

Inactive Publication Date: 2019-05-21
SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
View PDF7 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In view of this, the embodiment of the present invention provides an operation prompt method and glasses to solve the problems in the prior art that users need a large number of manual operations to check and compare before they can determine the errors in their own operations, and the problems of cumbersome operations and low efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An operation prompting method and glasses
  • An operation prompting method and glasses
  • An operation prompting method and glasses

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 2

[0049] As a specific implementation of 3D semantic map construction in Embodiment 1 of the present invention, in the embodiment of the present invention, the environmental images to be collected include color images and depth images of the environment, such as figure 2 As shown, Embodiment 2 of the present invention includes:

[0050] S201. Based on the color image and the depth image, obtain the user's position information and posture information, as well as the position information and item information of the items in the user's environment.

[0051] In the embodiment of the present invention, the smart glasses use an RGB-D camera as a sensor to acquire color images and depth images, and use the visual SLAM algorithm to complete the autonomous positioning and pose estimation and optimization of the smart glasses (that is, the user's position information and attitude information acquisition). ), and at the same time carry out item detection to obtain the semantic information...

Embodiment 3

[0109] As a specific implementation of the user's gaze behavior recognition in Embodiment 1 of the present invention, such as Figure 3A As shown, the third embodiment of the present invention includes:

[0110] S301. Acquire an eye image of the user, perform pupil positioning on the eye image, and determine the gaze area of ​​the user in the 3D semantic map based on the obtained pupil position information.

[0111] In the embodiment of the present invention, the user's line of sight is tracked based on the user's pupil and Purchin's spot, and the area where the user gazes is determined. Therefore, it is first necessary to determine the position of the pupil in the eye. Among them, the specific pupil recognition algorithm can be set by the technicians according to the needs, including but not limited to using the neural network model to train the sample data of the pupil image, and to identify the pupil in the eye image, or refer to the fourth embodiment of the present inventi...

Embodiment 4

[0118] As an implementation of pupil positioning in Embodiment 3 of the present invention, such as Figure 4A As shown, Embodiment 4 of the present invention includes:

[0119] S401. Divide the eye image into N×M area images, and binarize the gray levels of all the area images to obtain corresponding N×M eye gray values, where N and M are both positive integers.

[0120] Such as Figure 4B As shown, the eye features in the embodiment of the present invention are described in detail as follows, the basic rectangular blocks in the figure are of the same size, ABCD is the most primitive rectangular feature in the figure, E is composed of 3 basic rectangles, and F is composed of 9 rectangles , G is a rectangle, H and I are composed of 4 basic rectangles, J is composed of 12 rectangles, K and L are composed of 4 rectangles, the calculation of the characteristics of each rectangle is the black part of the picture and the subtraction of the white part Pixel sum, the feature G here ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an operation prompting method and device and a pair of glasses, which are suitable for the technical field of data processing, and the method comprises the steps: obtaining an image of an environment where a user is located, and constructing a 3D semantic map of the environment where the user is located based on the image; Performing eye movement recognition on the user, andjudging whether the user watches articles contained in the 3D semantic map or not; If the user watches the articles contained in the 3D semantic map, obtaining an operation mode corresponding to the3D semantic map, the operation mode comprising an operation step of one or more articles; Monitoring whether the operation of the user on the article meets the requirements of operation steps or not;And if the operation of the user on the article does not meet the requirements of the operation steps, outputting an operation prompt corresponding to the operation steps. A user does not need to carry out any manual operation input and does not need to constantly and actively watch towards a screen, so that problems in the operation of the user can be known in time, intelligent matching of user operation courses is realized, and the determination efficiency of the user on operation errors is greatly improved.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to an operation prompt method and glasses. Background technique [0002] In real life and work, users often need to search for some operation tutorials on the Internet to guide whether some of their operations are correct, such as searching for some cooking graphic tutorials and checking whether their cooking methods are wrong according to the cooking graphic tutorials, or searching for Some equipment operation tutorials are used to judge whether the equipment operation is wrong. In the existing technology, users manually enter some keywords through computers, mobile phones and other devices to search, get corresponding graphic and video tutorials, and then use these graphic and video tutorials to The comparison is carried out step by step, but these all require the user to perform a large amount of manual operation input, and the user is required to actively com...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/01G06K9/00G06T7/11G06T7/73
CPCG06F3/01G06T7/11G06T7/73
Inventor 程俊王鹏
Owner SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI