HUD (head up display) device combining voice and video recognition

A technology for video recognition and display devices, applied in transportation and packaging, optical observation devices, vehicle parts, etc., to improve traffic efficiency

Inactive Publication Date: 2015-09-02
SHENZHEN GUANGYUN NETWORK TECH
View PDF6 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to overcome the shortcomings of the existing technology, the HUD display system cannot combine the actual environment and can only display limited content. The driver cannot effectively interact and control the content displayed on the HUD during driving. If the driver is required to respond to the content displayed on the HUD It is necessary to look away from the front and manually touch the relevant operation interface, so that the driver's application of the system is limited and it is difficult to ensure driving safety. The present invention provides a HUD display device that combines voice and video to solve the problems in the prior art. technical problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • HUD (head up display) device combining voice and video recognition
  • HUD (head up display) device combining voice and video recognition
  • HUD (head up display) device combining voice and video recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] Reference attached figure 2 And attached image 3 , a HUD display device combined with voice and video recognition provided by the present invention, an in-vehicle installation method of the HUD display device:

[0033] The projection module 13 and the front projection imaging film 14 in the HUD module 1 are suspended below the sun visor 7 of the vehicle, the optical lens 9 is suspended on the rear side of the projection module 13, and the color camera 10 is arranged at an angle 6 directly in front of the windshield 5 for The environment state around the vehicle is photographed, and the infrared camera 11 is arranged at an angle 8 facing the driver to monitor the driver's gestures and eye blinking actions. The peripheral side of the infrared camera 11 has an LED infrared light source, and an infrared light source is arranged below the LED infrared light source to be made of an infrared-transmitting polycarbonate material. The infrared see-through layer 12 is used to ...

Embodiment 2

[0035] A HUD display device combined with voice and video recognition provided by the present invention, the working process of the HUD display device:

[0036] Start the HUD display device, the color camera in the camera module shoots the road conditions, the infrared camera shoots the driver's gestures and eye movements, and the GPU in the circuit module processes the image signal sent by the camera module in real time; while the microphone monitors the voice of the driver, The ARM processor in the circuit module matches the voice signal sent by the voice module in real time; the acceleration sensor and GPS sensor collect vehicle condition and location data in real time; the HUD display device is connected to the mobile phone through wireless wifi or bluetooth. All the above data are finally sent to the ARM processor of the circuit module for calculation, and the obtained status data is sent to the HUD module to form a projection and display it outside the windshield through th...

Embodiment 3

[0038] The driver drives the vehicle carrying the device of the present invention to travel on the road, and stops when the intersection is a red light. The driver is above the steering wheel, within the collection range below the infrared camera, and according to the prompts on the HUD display interface, raises his index finger and slides left and right. The infrared camera of the HUD display device continuously records all the driver's behaviors, matches the action command corresponding to the action through the GPU and the ARM processor, and knows that the driver wants to open the WeChat on the mobile phone, and the device transmits the command to the connected device through Bluetooth. mobile phone. After the mobile phone installed with WeChat opens WeChat, it also pushes WeChat messages to the HUD module through Bluetooth. After the HUD module obtains the information, it projects the WeChat information to the outside of the windshield for display through the projection mo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an HUD (head up display) device combining voice and video recognition. The HUD device combining voice and video recognition comprises an HUD module, a camera-shooting module, a voice module and a circuit module. The circuit module integrates a GPU (graphics processing unit), an ARM (advanced RISC machine) processor, an acceleration sensor, a GPS (global positioning system) sensor, WIFI (wireless fidelity) and a Bluetooth module, wherein the GPU acquires image signals transmitted by the camera-shooting module to match the image signals with preset image signals, or the ARM processor acquires voice signals transmitted by the voice module to match the voice signals with preset voice signals so as to obtain a matched action command; the ARM processor receives the action command, executes relative in-vehicle actions automatically and outputs the actions to the HUD module to display finally. The HUD device combining voice and video recognition has the advantages that HUD display content is enriched greatly by the aid of voice and data such as acceleration sensor data; a driver can always concentrate on the roadways by watching the HUD display content and can obtain vehicle and peripheral information safely and timely, and accordingly, man-machine interaction, rapidity and convenience are achieved.

Description

technical field [0001] The invention belongs to the technical field of vehicle-mounted HUD displays, and in particular relates to a HUD display device combined with voice and video recognition. Background technique [0002] HUD (Heads Up Display), also known as head-up display system, can project important information, such as speed, navigation, and time, onto the windshield or small screen of the car by using the principle of optical mirror reflection. The sensory image is within a few meters in front of the car, so that the driver can see important information clearly without bowing his head. There is also a lens added to the original windshield imaging to magnify the displayed content to a farther place. The driver can see the HUD display in parallel while seeing the road ahead without adjusting the focal length of the line of sight during driving. vehicle condition information. [0003] The existing HUD display system cannot be combined with the actual environment and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): B60R1/00
CPCB60R1/00B60R2300/20
Inventor 何杰莫冰韩宇
Owner SHENZHEN GUANGYUN NETWORK TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap