A vehicle assisted driving control system and method based on VIG

Abstract

The present application discloses a vehicle assisted driving control system and method based on VIG, which relates to the field of intelligent driving assistance technology, including VIG and IVI. A processing module, a micro-motion sensor, and an infrared camera are provided on the VIG. The micro-motion sensor is used to collect vibration acceleration values. When the processing module determines that the vibration acceleration value exceeds the set threshold value multiple times within a specified time period, it outputs fatigue driving warning information. The infrared camera is used to collect environmental images. When the processing module determines that multiple environmental images within a specified time period contain the same vehicle component, it outputs opening and closing control information for the corresponding vehicle component. IVI is used to receive the opening and closing control information and control the corresponding vehicle component to perform opening and closing operations. The present application uses VIG for fatigue warning and intelligent control of vehicle components, organically combines VIG and vehicle driving assistance, facilitates the use of drivers, and improves the utilization rate of VIG.

Description

Technical Field

[0001] The present application relates to the field of intelligent driving assistance technology, and specifically to a vehicle assisted driving control system and method based on VIG. Background Art

[0002] With the continuous development of human science and technology, technologies such as VR (Virtual Reality), AR (Augmented Reality) and AI (Artificial Intelligence) are emerging one after another. Now all walks of life are studying Metaverse technology as a direction for future development. Among them, smart wearable electronic products such as smart glasses and smart watches, which are part of the hardware facilities of Metaverse technology, are also developing rapidly, but most traditional smart wearable devices have a single usage scenario, mainly used in entertainment, sports and health monitoring.

[0003] How to integrate smart wearable products with intelligent driving assistance systems and realize the organic combination of smart wearable products and vehicle intelligent control to greatly facilitate drivers and passengers and improve product utilization is a technical problem that urgently needs to be solved. Summary of the invention

[0004] In view of the defects existing in the prior art, the purpose of this application is to provide a vehicle assisted driving control and method based on VIG, using VIG (Vehicle Intelligent Glasses) for fatigue warning and intelligent control of vehicle components, organically combining VIG and vehicle driving assistance, facilitating the use of drivers and improving the utilization rate of VIG.

[0005] In order to achieve the above objectives, the technical solutions adopted are:

[0006] The first aspect of the present application provides a vehicle assisted driving control based on VIG, including:

[0007] The vehicle-mounted smart glasses VIG are provided with a processing module, a micro-motion sensor, and an infrared camera; the micro-motion sensor is used to collect vibration acceleration values, and the processing module outputs fatigue driving warning information when it determines that the vibration acceleration value exceeds the set threshold value multiple times within a specified time period; the infrared camera is used to collect environmental images, and the processing module outputs opening and closing control information for the corresponding vehicle component when it determines that multiple environmental images within a specified time period contain the same vehicle component;

[0008] The in-vehicle infotainment system IVI is used to receive opening and closing control information and control corresponding vehicle components to perform opening and closing operations.

[0009] In some embodiments, the VIG is also provided with a speaker for playing fatigue driving warning information;

[0010] The IVI is also used to receive fatigue driving warning information and display it.

[0011] In some embodiments, the IVI controls the corresponding vehicle component to perform an opening and closing operation through the body controller BCM; when the current state of the corresponding vehicle component is open, the opening and closing operation is to control the component to be closed; when the current state of the corresponding vehicle component is closed, the opening and closing operation is to control the component to be opened;

[0012] The vehicle components include a tailgate, door locks, windows, and interior lights.

[0013] In some embodiments, the VIG is further provided with a light sensor for collecting the current light intensity;

[0014] The processing module is also used to compare the current light intensity with a set threshold, and adjust the transmittance of the lens to make the light intensity passing through the VIG meet the preset threshold.

[0015] In some embodiments, the VIG is also provided with a microphone and an electrical interface;

[0016] After the processing module detects that the electrical interface is electrically connected to the data interface, it controls the infrared camera to collect the road image in front of the vehicle. The processing module sends the collected road image to the IVI. The IVI performs image recognition on the road image and displays obstacle warning information when it is determined that an obstacle appears on the road in front of the vehicle.

[0017] When the processing module detects that the electrical interface is electrically connected to the data interface and the vibration acceleration exceeds a set threshold, the processing module controls the infrared camera to collect a road video in front of the vehicle and sends the collected road video to the IVI;

[0018] When detecting that the electrical interface is electrically connected to the data interface and the microphone collects the video collection voice command input by the user, the processing module controls the infrared camera to collect the road video in front of the vehicle and sends the collected road video to the IVI.

[0019] In some embodiments, the system further comprises:

[0020] A mobile phone terminal is connected to the VIG through the IVI communication, and is used to exchange data with the IVI and the VIG respectively;

[0021] The cloud server is connected to the mobile phone terminal and the IVI for communicating with the mobile phone terminal, the IVI, and the VIG for data exchange.

[0022] In some embodiments, the data interaction between the cloud server and the VIG includes sending version update information to the VIG and receiving a version update request sent by the VIG or a mobile phone to update the version of the VIG; after the cloud server sends the version update information to the VIG, the VIG sends a version update application to the IVI or a mobile phone terminal, and after the user approves the version update application through the IVI or the mobile phone terminal, the VIG performs a version update according to the version update information;

[0023] The data interaction between the cloud server and the VIG further includes sending a command photo update data packet to the VIG, and the VIG updates a built-in command photo according to the command photo update data packet, wherein the command photo includes vehicle parts;

[0024] The data interaction between the mobile terminal and the VIG further includes sending a command photo update data packet to the VIG, and the VIG updates a built-in command photo according to the command photo update data packet, wherein the command photo includes vehicle components.

[0025] In some embodiments, the VIG is also provided with a function switch and a status indicator light;

[0026] The function switch is used to turn on and off the enhanced mode of VIG to achieve different functions;

[0027] The status indicator light is used to indicate whether the enhanced mode is turned on and whether the VIG is communicating with the IVI.

[0028] In some embodiments, the IVI is also used to obtain the environmental image collected by the user wearing the VIG and the opening and closing control information input by the user through the IVI when the user clicks on the new function learning interface, and bind the vehicle components in the environmental image with the opening and closing control information.

[0029] In some embodiments, a VIG-based vehicle assisted driving control method is provided, based on the VIG-based vehicle assisted driving control system; the method comprises:

[0030] The vibration acceleration value is collected by VIG, and when it is judged that the vibration acceleration value exceeds the set threshold value multiple times within a specified time period, a fatigue driving warning message is output;

[0031] VIG is used to collect environmental images, and when it is determined that multiple environmental images within a specified time period contain the same vehicle component, opening and closing control information for the corresponding vehicle component is output, and the corresponding vehicle component is controlled to perform opening and closing operations according to the opening and closing control information.

[0032] The beneficial effects of the technical solution provided by this application include:

[0033] VIG is used for fatigue warning and intelligent control of vehicle components, and IVI is used to implement intelligent control. VIG and vehicle driving assistance are organically combined to facilitate driver use and improve the utilization rate of VIG.

[0034] The VIG light transmittance is adjustable, and the light intensity threshold is adjustable, which can meet the usage needs of different users, so that the light intensity felt by the user when wearing the VIG is in the optimal range, thereby improving comfort.

[0035] VIG can also be used as an image and video acquisition component for intelligent driving. When connected to IVI by wire, it collects images of the road ahead and outputs them to IVI for image recognition to determine whether there are obstacles ahead, thereby improving driving safety and expanding the application scenarios of VIG.

[0036] VIG can also interact with mobile phones or the cloud to upgrade its version through mobile phones or the cloud, flexibly update the vehicle components that VIG can identify, and expand the vehicle components that VIG can intelligently control.

[0037] VIG can also learn new functions on IVI, flexibly update the vehicle components that VIG can recognize, and expand the vehicle components that VIG can intelligently control. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 FIG. 4 is a front view schematic diagram of a VIG in an embodiment of the present invention.

[0039] Figure 2 Schematic diagram of the left temple of the VIG in an embodiment of the present invention.

[0040] Figure 3 Flow chart of the right temple of VIG in an embodiment of the present invention.

[0041] Figure 4 Schematic diagram of the functional modules of the vehicle assisted driving control system in an embodiment of the present invention.

[0042] Figure 5 Schematic diagram of the application of the vehicle assisted driving control system in an embodiment of the present invention.

[0043] Reference numerals:

[0044] 101-fixed locking mechanism; 102-instrument panel guard plate; 103-data interface; 104-VIG body; 105-IVI; 106-IC; 107-BCM; 108-back door controller; 109-door lock actuator; 110-window actuator; 111-interior lights; 112-cloud server; 113-mobile phone terminal; 201-upper body; 202-lens; 203-photosensitive sensor; 204-photosensitive camera; 205-electrical interface; 206-hinge interface between temple and mirror body; 207-function switch; 208-microphone; 209-left temple; 210-right temple; 211-speaker; 212-status indicator light. DETAILED DESCRIPTION

[0045] The present application is further described in detail below with reference to the accompanying drawings and embodiments.

[0046] like Figure 1 As shown, an embodiment of the present invention provides a vehicle assisted driving control system based on VIG, including VIG and IVI 105 (In-VehICle Infotainment). A processing module, a micro-motion sensor, and an infrared camera are provided on the VIG. The micro-motion sensor is used to collect vibration acceleration values, and when the processing module determines that the vibration acceleration value exceeds the set threshold value multiple times within a specified time period, it outputs fatigue driving warning information. The infrared camera is used to collect environmental images, and when the processing module determines that multiple environmental images within a specified time period contain the same vehicle component, it outputs opening and closing control information for the corresponding vehicle component. IVI105 is used to receive the opening and closing control information, and control the corresponding vehicle component to perform opening and closing operations.

[0047] In this embodiment, VIG is used for fatigue warning and intelligent control of vehicle components, and IVI 105 is used to specifically implement intelligent control, so that VIG and vehicle driving assistance are organically combined to facilitate the use of drivers and improve the utilization rate of VIG.

[0048] like Figures 1 to 4 As shown, in a specific embodiment of the present invention, VIG includes an upper body 201, a lens 202, a photosensitive sensor 203, a photosensitive camera 204, an electrical interface 205, a temple and a mirror body hinge interface 206, a function switch 207, a left temple 209, a right temple 210, a speaker 211, a status indicator light 212, and a microphone 208.

[0049] Specifically, the upper body 201 is the main part of the smart glasses, which is used to support the lens 202, connect the left temple 209 and the right temple 210, and the surface texture and text are consistent with the vehicle appearance. The acquisition control circuit, storage chip, two batteries, and micro-motion sensor are embedded inside. The battery is used to power the VIG, which is rechargeable and non-removable. The micro-motion sensor is an important input signal for monitoring fatigue driving. The control module includes an acquisition control circuit, a storage chip, and two batteries.

[0050] The lens 202 can be configured via a mobile phone or IVI 105 , so that the VIG can adapt to the user's preferences and automatically adjust the transmittance and filtering performance of the lens 202 .

[0051] The light sensor 203 is used to collect the intensity of ambient light so as to adjust the light transmission / polarization of the lens 202.

[0052] A photosensitive camera 204 (generally an infrared camera) is embedded in each of the left and right sides of the upper body 201, and each camera has an infrared enhancement function.

[0053] The electrical interface 205 is a female end, and is located in the middle of the upper body 201. It has a waterproof rubber plug cap for waterproofing, and has an anti-reverse connection limit structure. The entire electrical interface 205 adopts a magnetic attraction design.

[0054] The hinge interface 206 between the temple and the mirror body is used to disassemble and replace the left temple 209 and the right temple 210.

[0055] Function switch 207 (generally arranged on the right temple 210), the function switch 207 is used to turn on and off the enhanced mode of VIG to achieve different functions. For example, it is used to activate / disable voice control command collection and vehicle auxiliary function, manual photo triggering and manual short video recording. Long press for more than 3 seconds to activate / disable voice control command collection and vehicle auxiliary function. After activating the vehicle auxiliary function, (voice) short press can manually trigger the photo function, and continuous short press twice can manually trigger the short video recording function. Short press again to turn off the short video recording function.

[0056] A speaker 211 is provided on each of the left temple 209 and the right temple 210 .

[0057] The status indicator light 212 is used to indicate whether the enhanced mode is turned on and whether the VIG is in communication connection with the IVI 105. For example, different working scenarios of the VIG can be indicated. The light is displayed in red to indicate that the VIG is abnormal, such as low voltage, disconnection between the VIG and the vehicle, the light is displayed in green to indicate that the VIG is in enhanced mode, such as the vehicle auxiliary function is activated and the connection with the vehicle network (via WIFI or data cable) is normal or charging is completed, and no indication indicates that the VIG is in normal mode.

[0058] Microphone 208, embedded in the left temple 209, is used to collect relevant instructions for voice control.

[0059] like Figures 1 to 4 As shown, in a specific embodiment of the present invention, a vehicle assisted driving control system based on VIG includes VIG and its accessories, IVI 105 and its interface, cloud server 112, and mobile terminal 113. The data interface 103 connecting VIG and the whole vehicle is designed above the dashboard on the driver's side. After VIG is connected to the dashboard through the electrical interface 205, the charging data cable, and the data interface 103, it can be charged and can also interact with IVI 105. In the vehicle, the user can wear VIG or place VIG forward and connect it to the dashboard. VIG can interact with IVI 105 through the charging data cable, and can also interact with IVI 105 through WIFI. VIG not only has the functional characteristics of general glasses to meet the user's daily use, but also meets the functional characteristics required for special driving scenarios.

[0060] Specifically, the fixed locking mechanism 101 is a magnetic buckle structure, which is convenient for users to flexibly plug and use the VIG. After the VIG is placed on the guard plate 102 on the instrument panel, it can be connected to the guard plate 102 on the instrument panel through the fixed locking mechanism 101.

[0061] The guard plate 102 on the instrument panel is made of plastic material.

[0062] The data interface 103 has a female end on the VIG side and a male end on the vehicle body side, and is provided with a DC / DC conversion module and a data transmission interface for VIG charging and data exchange.

[0063] The VIG body 104 is plugged into the data interface 103 in a forward direction, that is, the VIG temple points toward the driver.

[0064] IVI 105, the host has t-box function, VIG exchanges data through WIFI / charging / data cable, and IVI 105 displays a large screen for human-computer interaction, which can be used to set VIG personal preferences (prompt sound volume, lens 202 parameters, voice commands, version upgrades, image and video processing and viewing).

[0065] IC 106 (Instrument Cluster) is used to display some vehicle auxiliary functions.

[0066] BCM 107 (Body Control Module) is used to receive and judge the control request instructions of VIG, such as unlocking instructions, opening the back door instructions, etc.

[0067] The back door controller 108 is used to open / close the back door.

[0068] The door lock actuator 109 is used to execute the unlocking / locking action of the vehicle door lock.

[0069] The window actuator 110 is used to perform the window lifting action.

[0070] The interior light 111 is used to turn on / off the interior light 111 .

[0071] The cloud server 112 is used for VIG software version management and update, as well as the storage, upload and download of user pictures, short videos and personal data.

[0072] The mobile terminal 113 can control the VIG through App (ApplICation, mobile phone software), synchronize VIG photos and short videos in real time through WIFI, or download related pictures and short videos from the cloud server 112.

[0073] In this embodiment, the VIG is further provided with a speaker 211 for playing fatigue driving warning information.

[0074] The IVI 105 is also used to receive fatigue driving warning information and display it.

[0075] Specifically, IVI 105 uses its embedded micro-motion sensor as a perception module to participate in the fatigue driving warning function. The micro-motion sensor can collect the user's head movements, determine whether the user is driving fatigued, and enhance the accuracy of the system's fatigue driving warning function. If the function switch 207 is off, VIG will not participate in the fatigue driving warning function.

[0076] The main judgment software module of the fatigue driving warning function is embedded in the IVI 105 host, that is, the IVI 105 host summarizes the perception information to make a fatigue driving warning judgment, and then issues a fatigue driving warning message, and finally warns on the IC 106 and triggers the built-in speaker 211 for a sound warning.

[0077] Further, the IVI 105 controls the corresponding vehicle component to perform opening and closing operations through the vehicle body controller BCM 107. When the current state of the corresponding vehicle component is open, the opening and closing operation is to control the component to be closed. When the current state of the corresponding vehicle component is closed, the opening and closing operation is to control the component to be opened.

[0078] The vehicle components include a tailgate, door locks, windows, and interior lights 111 .

[0079] Specifically, VIG can be used as a vehicle key to unlock the vehicle and can control the vehicle such as raising and lowering windows, opening the back door, etc. The user wears VIG and sets VIG to enhanced mode through function switch 207. When the user approaches the target vehicle, VIG will connect to IVI 105 via WIFI. At this time, function switch 207 beeps twice to indicate successful connection. The user visually observes the door lock area on the driver's side for 3 seconds. VIG compares the collected environmental image with the pre-built-in instruction photo. If the components in multiple environmental images are compared with the vehicle components in the instruction photo, it means that the user is wearing VIG and looking at the vehicle component with the intention of opening or closing it. According to whether the current state of the vehicle component is open or closed, opening and closing control information is generated. VIG encrypts the opening and closing control information and sends it to IVI 105. IVI 105 verifies the signature of the data packet and decrypts the opening and closing control information. If the decryption and verification are successful, BCM 107 will be awakened and the decrypted information will be transmitted to BCM 107 through the vehicle bus. BCM 107 will control the vehicle component to open or close. After the opening or closing is completed, BCM 107 sends a signal to IVI 105 Feedback of the completed operation VIG triggers the function switch 207 to emit a sound effect of successful unlocking to inform the user.

[0080] Taking the control of window lifting as an example, the user wears VIG and sets VIG to enhanced mode. When the user keeps visually viewing the lower half of the window area for more than 3 seconds, VIG will trigger the sending of the opening and closing control information of the corresponding window opening. BCM 107 receives the opening and closing control information forwarded by IVI 105 and verifies that it is correct, and drives the door and window lifting motor to open the corresponding window until it is fully opened. Similarly, if the user keeps visually viewing the upper half of the window area for more than 3 seconds, VIG will be triggered to send the opening and closing control information of the corresponding window closing. BCM 107 receives the request instruction forwarded by IVI 105 and verifies that it is correct, and drives the door and window lifting motor to close the corresponding window until it is fully closed.

[0081] Taking the control of the opening and closing of the tailgate as an example, the user wears VIG and sets VIG to enhanced mode. When the user looks at the tailgate mark area of ​​the target vehicle for 3 seconds, VIG will trigger the sending of the corresponding tailgate opening and closing control information. BCM 107 receives the opening and closing control information forwarded by IVI 105 and verifies it. If it determines that the vehicle speed is 0 and other restrictions are met, it will drive the tailgate motor to open the tailgate.

[0082] Furthermore, a light sensor 203 is provided on the VIG for collecting current light intensity.

[0083] The processing module is also used to compare the current light intensity with a set threshold, and adjust the transmittance of the lens 202 to make the light intensity passing through the VIG meet the preset threshold.

[0084] Furthermore, after the detection data interface 103 is electrically connected to the electrical interface 205, the processing module controls the infrared camera to collect the road image in front of the vehicle, and the processing module sends the collected road image to the IVI 105. The IVI 105 performs image recognition on the road image and displays obstacle warning information when it is determined that an obstacle appears on the road in front of the vehicle.

[0085] When the processing module detects that the data interface 103 is electrically connected to the electrical interface 205 and the vibration acceleration exceeds a set threshold, the processing module controls the infrared camera to collect a road video in front of the vehicle and sends the collected road video to the IVI 105 .

[0086] When the processing module detects that the data interface 103 is electrically connected to the electrical interface 205 and the microphone 208 collects the video collection voice command input by the user, it controls the infrared camera to collect the road video in front of the vehicle and sends the collected road video to the IVI 105 .

[0087] Specifically, the VIG is placed and plugged into the data interface 103 on the guard plate 102 on the dashboard of the target vehicle, and two built-in infrared enhanced photosensitive cameras 204 can be used to capture the visual information in front of the target vehicle, that is, the road image in real time, and the road image is transmitted to the IVI 105 using a data transmission line. The IVI 105 can display the road image on the large screen of the vehicle or hide it. The IVI 105 analyzes the road image and issues an early warning when an obstacle is detected in front.

[0088] When the user wants to store the road image as a short video, the short video can be started through the video capture voice command, or the user can manually tap the top of the guard plate 102 on the dashboard to make the vibration collected by the micro-motion sensor. The video recording time can be set according to the user's preference, and the default is 3 minutes. The IVI 105 will store the recorded video and upload it to the cloud server 112 via 4G / 5G when it is idle. The user can access the cloud server 112 through the mobile terminal 113 to download and share.

[0089] Furthermore, the mobile terminal 113 is connected to the VIG through the IVI 105 for communicating with the IVI 105 and the VIG, respectively.

[0090] The cloud server 112 is in communication connection with the mobile terminal 113 and the IVI 105, and is used for data exchange with the mobile terminal 113, the IVI 105, and the VIG respectively.

[0091] Specifically, the user needs to use the mobile phone terminal 113 to download the official App to bind the VIG, and then input the mobile phone terminal information, VIG information, and vehicle information through the IVI 105, and finally, perform two-way authentication confirmation with the cloud server 112 to complete the communication connection.

[0092] Furthermore, the data interaction between the cloud server 112 and the VIG includes sending version update information to the VIG and receiving a version update request sent by the VIG or the mobile phone to update the version of the VIG; after the cloud server 112 sends the version update information to the VIG, the VIG sends a version update application to the IVI 105 or the mobile phone terminal 113, and after the user approves the version update application through the IVI 105 or the mobile phone terminal 113, the VIG performs a version update according to the version update information.

[0093] The data interaction between the cloud server 112 and the VIG further includes sending a command photo update data packet to the VIG, and the VIG updates the built-in command photos according to the command photo update data packet, and the command photos include vehicle parts.

[0094] The data interaction between the mobile terminal 113 and the VIG also includes sending a command photo update data packet to the VIG, and the VIG updates a built-in command photo according to the command photo update data packet, wherein the command photo includes vehicle components.

[0095] Specifically, the OEM (Original Equipment Manufacturer) distributes different software installation packages to the VIG and IVI 105 of different vehicle models according to the target vehicle models. Users can obtain the initial database, such as the function sound effect, command photo database, etc., by downloading and installing, and can directly use the relevant functions after opening them. In the subsequent use process, users can make personalized changes and add functions. After obtaining the user's consent, the OEM can also perform remote updates and push new functions through the cloud server 112.

[0096] The sound effect of the function switch 207 when the VIG and IVI 105 are successfully connected can be set through the mobile terminal 113 or the IVI 105 , and the sound effects of other functions of the VIG can also be set through the mobile terminal 113 or the IVI 105 .

[0097] Furthermore, the IVI 105 is also used to obtain the environment image collected by the user wearing the VIG and the start and close control information input by the user through the IVI 105 when the user clicks on the new function learning interface, and bind the vehicle components in the environment image with the start and close control information.

[0098] Specifically, VIG can learn new vehicle-assisted driving action libraries through the vehicle side, and can also perform personalized configuration and upgrades through the cloud.

[0099] VIG can enter the driving assistance personalized action learning mode through the mobile terminal 113. First, name the new personalized action, and then follow the operation prompts of the mobile terminal 113 to perform the next action. For example, the newly added driving assistance function is to control the opening and closing of the air conditioner by gazing at the image of the air conditioner through VIG. The specific setting steps are that the user wears VIG, ensures that the network connection with IVI 105 is normal, and ensures that the network signal of the mobile terminal 113 is normal. Enter the IVI 105 driving assistance personalized learning interface, click on the new action learning, and click on start learning. When the VIG prompt sound is heard, the user wears VIG and stares at the air conditioner, and the user manually starts the air conditioner. After the operation is completed, long press the function switch 207. When the IVI 105 display configuration is completed, release the function switch 207, and click on the IVI 105 display page to upload the new action. Wait for the cloud server 112 to transmit the new function setting completion information to the mobile terminal 113. Finally, confirm on the mobile terminal 113 to complete the new function learning. In this way, VIG has the function of remotely turning on the air conditioner. The setting method for automatically turning off the air conditioning function is the same as the setting method for automatically turning on the function.

[0100] The embodiment of the present invention also provides a vehicle assisted driving control method based on VIG, including collecting vibration acceleration values ​​by using VIG, and outputting fatigue driving warning information when it is determined that the vibration acceleration values ​​exceed the set threshold value multiple times within a specified time period. Collecting environmental images by using VIG, when it is determined that multiple environmental images within the specified time period contain the same vehicle component, outputting opening and closing control information for the corresponding vehicle component, and controlling the corresponding vehicle component to perform opening and closing operations according to the opening and closing control information.

[0101] In this embodiment, a variety of sensors on the VIG are used to perceive environmental information. On the one hand, the VIG automatically adjusts the transmittance of its eyeglass lens 202 and monitors the driver's fatigue according to the external scene. On the other hand, the VIG processes the collected environmental information and interacts with other vehicle controllers or bound user mobile phones through WIFI or bus to assist the vehicle in performing driving assistance warnings, keyless entry, automatic back door opening / closing, automatic window lifting and other vehicle assistance functions. The VIG can also perform personalized learning and upgrades through the cloud, upload, download and share short videos and photos, and improve the user's driving pleasure.

[0102] Specifically, IVI 105 uses its embedded micro-motion sensor as a perception module to participate in the fatigue driving warning function. The micro-motion sensor can collect the user's head movements, determine whether the user is driving fatigued, and enhance the accuracy of the system's fatigue driving warning function. If the function switch 207 is off, VIG will not participate in the fatigue driving warning function.

[0103] The main judgment software module of the fatigue driving warning function is embedded in the IVI 105 host, that is, the IVI 105 host summarizes the perception information to make a fatigue driving warning judgment, and then issues a fatigue driving warning message, and finally warns on the IC 106 and triggers the built-in speaker 211 for a sound warning.

[0104] Further, the IVI 105 controls the corresponding vehicle component to perform opening and closing operations through the vehicle body controller BCM 107. When the current state of the corresponding vehicle component is open, the opening and closing operation is to control the component to be closed. When the current state of the corresponding vehicle component is closed, the opening and closing operation is to control the component to be opened.

[0105] The VIG is placed and plugged into the data interface 103 on the guard plate 102 on the dashboard of the target vehicle. Two built-in infrared enhanced photosensitive cameras 204 can be used to capture the visual information in front of the target vehicle, that is, the road image, in real time, and the road image is transmitted to the IVI 105 using a data transmission line. The IVI 105 can display the road image on the large screen of the vehicle or hide it. The IVI 105 analyzes the road image and issues an early warning when an obstacle is detected in front.

[0106] When the user wants to store the road image as a short video, the short video can be started through the video capture voice command, or the user can manually tap the top of the guard plate 102 on the dashboard to make the vibration collected by the micro-motion sensor. The video recording time can be set according to the user's preference, and the default is 3 minutes. The IVI 105 will store the recorded video and upload it to the cloud server 112 via 4G / 5G when it is idle. The user can access the cloud server 112 through the mobile terminal 113 to download and share.

[0107] The vehicle components include a tailgate, door locks, windows, and interior lights 111 .

[0108] The control method of this embodiment is applicable to the above-mentioned control systems.

[0109] The present application is not limited to the above-mentioned implementation modes. For ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications are also considered to be within the scope of protection of the present application.

Claims

1. A vehicle assisted driving control system based on VIG, characterized in that: include: The vehicle-mounted smart glasses VIG are provided with a processing module, a micro-motion sensor, and an infrared camera; the micro-motion sensor is used to collect vibration acceleration values, and the processing module outputs fatigue driving warning information when it determines that the vibration acceleration value exceeds the set threshold value multiple times within a specified time period; the infrared camera is used to collect environmental images, and the processing module outputs opening and closing control information for the corresponding vehicle component when it determines that multiple environmental images within a specified time period contain the same vehicle component; In-vehicle infotainment system IVI, which is used to receive opening and closing control information and control the corresponding vehicle components to perform opening and closing operations; The VIG is also provided with a microphone and an electrical interface; after detecting that the electrical interface is electrically connected to the data interface, the processing module controls the infrared camera to collect the road image in front of the vehicle, and the processing module sends the collected road image to the IVI, and the IVI performs image recognition on the road image, and displays obstacle warning information when it is determined that an obstacle appears on the road in front of the vehicle; When the processing module detects that the electrical interface is electrically connected to the data interface and the vibration acceleration exceeds a set threshold, the processing module controls the infrared camera to collect a road video in front of the vehicle and sends the collected road video to the IVI; When detecting that the electrical interface is electrically connected to the data interface and the microphone collects the video collection voice command input by the user, the processing module controls the infrared camera to collect the road video in front of the vehicle and sends the collected road video to the IVI.

2. The VIG-based vehicle assisted driving control system according to claim 1, characterized in that: The VIG is also provided with a speaker for playing fatigue driving warning information; The IVI is also used to receive fatigue driving warning information and display it.

3. The VIG-based vehicle assisted driving control system according to claim 1, characterized in that: The IVI controls the corresponding vehicle components to perform opening and closing operations through the body controller BCM; when the current state of the corresponding vehicle component is open, the opening and closing operation is to control the component to be closed; when the current state of the corresponding vehicle component is closed, the opening and closing operation is to control the component to be opened; The vehicle components include a tailgate, door locks, windows, and interior lights.

4. The VIG-based vehicle assisted driving control system according to claim 1, characterized in that: The VIG is also provided with a light sensor for collecting the current light intensity; The processing module is also used to compare the current light intensity with a set threshold, and adjust the transmittance of the lens to make the light intensity passing through the VIG meet the preset threshold.

5. The VIG-based vehicle assisted driving control system according to claim 1, characterized in that: The system further comprises: A mobile phone terminal is connected to the VIG through the IVI communication, and is used to exchange data with the IVI and the VIG respectively; The cloud server is connected to the mobile phone terminal and the IVI for communicating with the mobile phone terminal, the IVI, and the VIG for data exchange.

6. The VIG-based vehicle assisted driving control system as claimed in claim 5, characterized in that: The data interaction between the cloud server and the VIG includes sending version update information to the VIG and receiving version update requests sent by the VIG or the mobile phone to update the version of the VIG; After the cloud server sends the version update information to the VIG, the VIG sends a version update application to the IVI or mobile terminal. After the user approves the version update application through the IVI or mobile terminal, the VIG performs a version update according to the version update information. The data interaction between the cloud server and the VIG further includes sending a command photo update data packet to the VIG, and the VIG updates a built-in command photo according to the command photo update data packet, wherein the command photo includes vehicle parts; The data interaction between the mobile terminal and the VIG further includes sending a command photo update data packet to the VIG, and the VIG updates a built-in command photo according to the command photo update data packet, wherein the command photo includes vehicle components.

7. The VIG-based vehicle assisted driving control system according to claim 1, characterized in that: The VIG is also provided with a function switch and a status indicator light; The function switch is used to turn on and off the enhanced mode of VIG to achieve different functions; The status indicator light is used to indicate whether the enhanced mode is turned on and whether the VIG is communicating with the IVI.

8. The VIG-based vehicle assisted driving control system according to claim 1, characterized in that: The IVI is also used to obtain the environmental image collected by the user wearing the VIG and the opening and closing control information input by the user through the IVI when the user clicks on the new function learning interface, and bind the vehicle components in the environmental image with the opening and closing control information.

9. A VIG-based vehicle assisted driving control method, based on the VIG-based vehicle assisted driving control system according to any one of claims 1 to 8; characterized in that: The method comprises: The vibration acceleration value is collected by VIG, and when it is judged that the vibration acceleration value exceeds the set threshold value multiple times within a specified time period, a fatigue driving warning message is output; VIG is used to collect environmental images, and when it is determined that multiple environmental images within a specified time period contain the same vehicle component, opening and closing control information for the corresponding vehicle component is output, and the corresponding vehicle component is controlled to perform opening and closing operations according to the opening and closing control information.

Images