Unlock instant, AI-driven research and patent intelligence for your innovation.

Head-mounted foldable eye movement tracking operation assisted intelligent device

An eye-tracking and intelligent device technology, applied in the field of assembly and manufacturing, can solve the problems of easy fatigue, distraction, and mistakes of staff, and achieve the effect of improving work efficiency and quality, avoiding space occupation, and freeing hands

Inactive Publication Date: 2019-12-03
SHANGHAI UNIV
View PDF14 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Such as large-scale aircraft, high-speed rail trains, ships and other complex assembly and manufacturing cycle is long, the working conditions are complicated, and there are many quality problems caused by human factors. There is an urgent need for new tools and methods to assist operations to improve work efficiency and quality.
In large-scale assembly manufacturing industries such as airplanes and high-speed rail trains, assembly workers need to read through a large number of drawings and process documents carefully when working on site. They cannot free their hands, and the efficiency is low. Moreover, the staff are prone to fatigue, nervousness or distraction. Mistakes in work cause assembly quality problems and affect the assembly cycle
According to statistics, the assembly and manufacturing quality accidents caused by human factors account for more than 60% of the assembly quality accidents of large aircraft. Especially in some narrow spaces where paper drawings cannot be viewed and tablet devices cannot free hands, working in a closed environment often causes problems. Abnormal changes in the mood and mood of the workers can also cause quality accidents
There are also studies on information retrieval with the help of smart glasses. Wearable glasses have reduced the frequency of frequent checking of drawings by operators to a certain extent, but the display screen of the existing equipment is too small, and only partial browsing of actual drawings is possible, and the efficiency of information retrieval is still low.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Head-mounted foldable eye movement tracking operation assisted intelligent device
  • Head-mounted foldable eye movement tracking operation assisted intelligent device
  • Head-mounted foldable eye movement tracking operation assisted intelligent device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] see Figure 1-Figure 5, this head-mounted eye-tracking operation-assisted intelligent device includes a communication module (I), a display module (II), an interaction module (III), a monitoring module (VI), an image acquisition module (IV), and a physiological information monitoring module (Ⅴ), projection attitude adjustment module (Ⅶ), video monitoring attitude adjustment module (Ⅶ), processor (Ⅸ), head-mounted foldable bracket (Ⅹ), characterized in that the processor (Ⅸ) is connected to the communication Module (I), Display Module (II), Interaction Module (III), Monitoring Module (VI), Image Acquisition Module (IV), Physiological Information Monitoring Module (V), Projection Attitude Adjustment Module (VII) and Video Monitoring Attitude Adjustment module (Ⅶ), and installed on the head-mounted foldable bracket (Ⅹ). The display module (Ⅱ) is connected to the output of the processor (Ⅸ) to display auxiliary operation information. One of the micro projectors (14) can ad...

Embodiment 2

[0035] This embodiment is basically the same as Embodiment 1, and the special features are as follows: the display module (II), including the micro-projector (14) and the display screen (11) contain multiple display modes, such as display screen display, projection display, and external output interface . The micro-projector (14) can adaptively adjust the projection angle; the micro-projector (14) is connected to a second steering gear (13) in the attitude adjustment module (Ⅲ), and the second steering gear (13) is connected to the A headband (12) in the head-mounted foldable bracket (Ⅹ) is fixedly connected, and the second steering gear (13) transmits the torque to the micro-projector (14) through forward and reverse rotation, according to the pitching posture of the user's head Realize adjusting the pitch angle of the miniature projector (14). The acquisition angle of the image acquisition module (Ⅳ) can be adaptively adjusted; the physiological information monitoring modul...

Embodiment 3

[0037] Such as figure 1 As shown, the head-mounted eye-tracking operation-assisted intelligent device can realize the liberation of hands and provide necessary eye protection devices. Such as figure 2 As shown, the device of the present invention includes: an eye-tracking video monitoring attitude adjustment module composed of a first steering gear (1) and an image acquisition module (8), an adaptive attitude perception module (gyroscope) (6), an interaction module ( Including: eye tracker (10), touch panel (2), voice module (23), display screen (11), micro projector (14), processor (7), communication module (including: Bluetooth, Wi- Fi, USB interface), physiological information monitoring module (including: eye tracker (10), physiological information sensor (17)), adjustable goggles device (including: guide rod (18), carrying frame (19), goggles Eyepiece (20), connecting rod (9), shell armor (3), support frame (22), battery compartment (16), battery compartment cover (15)...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a head-mounted foldable eye movement tracking operation assisted intelligent device. The device comprises a communication module, a display module, an interaction module, a monitoring module, an image acquisition module, a physiological information monitoring module, a projection attitude adjusting module, a video monitoring attitude adjusting module, a processor and a head-mounted foldable support. An image acquisition angle can be automatically adjusted according to different head postures, so that it is guaranteed that an acquired image is located in the center of the sight line of a user; a projection angle is automatically adjusted to ensure that a projected image does not deform. According to the device, the working state of the user can be monitored, and effective reminding can be given out, so that errors caused by inefficient operation of the user can be reduced. In addition, the device also provides goggles and folding functions.

Description

technical field [0001] The invention relates to an auxiliary tool in the field of assembly and manufacturing, in particular to a head-mounted intelligent device for eye-tracking operation assistance. Background technique [0002] With the continuous development of information technology and intelligent technology and their application in the manufacturing industry, new methods and ideas are provided to solve the problems of large-scale and complex assembly processing and manufacturing processes. For example, large-scale aircraft, high-speed rail trains, ships, etc. have long assembly and manufacturing cycles, complex working conditions, and many quality problems caused by human factors. There is an urgent need for new tools and methods to assist operations to improve work efficiency and quality. In large-scale assembly manufacturing industries such as airplanes and high-speed rail trains, assembly workers need to read through a large number of drawings and process documents ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G02B27/01G02B27/00
CPCG02B27/0172G02B27/0176G02B27/0093G02B2027/0154
Inventor 徐凯赵其杰孔耀辉韩书航
Owner SHANGHAI UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More