Vehicle rearview mirror intelligent interaction and control method and system

Abstract

The invention relates to a vehicle rearview mirror intelligent interaction and control method and system.The system comprises a position acquisition module, an instruction acquisition module, an intelligent interaction module and an instruction execution module, when a user enters a preset distance from a vehicle, the rearview mirror is controlled to swing and / or send out a double-flash light signal, and the intelligent interaction module is controlled to interact with the instruction execution module; wherein swinging of the rearview mirror is similar to interaction between an owner and a pet, so that the man-machine interaction effect of the rearview mirror is achieved. Besides, the intelligent interaction module is used for defining a conversion mapping relation between an interaction instruction and an operation instruction, and when the rearview mirror receives the interaction instruction of gestures and / or voice sent by a user, conversion between the interaction instruction and a control instruction of vehicle actions is achieved through the intelligent interaction module. Intelligent control over automatic starting, vehicle door opening, air conditioner starting and the like is achieved, the man-machine interaction effect of the rearview mirror is further enhanced, and a brand-new vehicle man-machine interaction feeling is brought to a user.

Description

Technical Field

[0001] The present invention relates to the field of rearview mirrors, and particularly to an intelligent interaction and control method and system for vehicle rearview mirrors. Background Art

[0002] Automobile rearview mirrors are located on the left and right sides of the front of the vehicle, reflecting the situations on the sides and below the vehicle, enabling the driver to indirectly see clearly the situations in these positions. It plays the role of a "second pair of eyes", expanding the driver's field of vision. Existing rearview mirrors are mainly used to assist the driver in observing the field of vision and do not have an interaction function.

[0003] To meet the user's human-computer interaction experience, current vehicles are provided with a human-computer interaction interface on the center console, realizing multi-modal interaction inside the vehicle through touch, gesture, voice, etc. However, all are limited to in-vehicle human-computer interaction, that is, the relevant interaction modes are only activated after the user enters the cockpit, lacking the out-of-vehicle human-computer interaction experience. Moreover, most of the existing welcome systems use a single welcome light to achieve welcome, with a single welcome method, lacking interactive actions similar to those between a master and a pet, having a weak human-computer interaction feeling, and there is no relevant technology using the rearview mirror to achieve human-computer interaction. Summary of the Invention

[0004] Embodiments of the present invention provide an intelligent interaction and control method and system for vehicle rearview mirrors to solve the problems in the related technology of lacking out-of-vehicle human-computer interaction experience, single welcome method, and weak interaction feeling.

[0005] In a first aspect, an intelligent interaction and control method for vehicle rearview mirrors is provided. The method includes:

[0006] Obtain the distance information between the user and the vehicle;

[0007] When the user enters within a preset distance from the vehicle, identify whether the approaching target belongs to a pre-stored user identity; if so, control the rearview mirror to execute a preset operation instruction; if not, control the vehicle to enter a locked state and send an alarm prompt to the user terminal through the vehicle network;

[0008] The preset operation instruction includes one or more of the following: controlling the rearview mirror to execute at least one swinging action; controlling the rearview mirror to execute at least one turn signal lighting; based on the real-time information obtained through the vehicle network, controlling the voice module of the rearview mirror to broadcast the current time, weather information, and wearing tips to the user; based on the memo information pre-stored by the user through the in-vehicle control terminal or the user terminal, controlling the voice module of the rearview mirror to broadcast this information to the user;

[0009] Obtain the interaction instruction of the user;

[0010] Parse the interaction instruction and output a control instruction that has a mapping relationship with the interaction instruction; the mapping relationship is used to define the interaction operation relationship between user gestures and / or user voices and vehicle actions.

[0011] Execute corresponding control operations according to the control instruction.

[0012] In some embodiments, the preset operation instructions include: an operation instruction for controlling the rearview mirror to perform at least one swinging action, and an operation instruction for controlling the rearview mirror to turn on the turn signal at least once.

[0013] Through this embodiment, when a device with a wireless communication function enters within a preset distance from the vehicle, the rearview mirror can swing and emit light for welcoming guests. Among them, the swinging of the rearview mirror is similar to the interaction between the owner and the pet, enhancing the sense of interaction. It not only realizes the welcome outside the vehicle but also gives the user a brand-new pet welcome feeling.

[0014] In some embodiments, the preset operation instructions further include: based on the real-time information obtained through the vehicle network, controlling the voice module of the rearview mirror to broadcast the current time, weather information, and dressing tips to the user.

[0015] Through this embodiment, the interaction items and the sense of interaction with the user can be increased. At the same time, the weather and dressing information are prompted to the user, providing better travel preparation and travel experience for the user.

[0016] In some embodiments, the preset operation instructions further include: based on the memo information pre-stored by the user through the in-vehicle control terminal or the user terminal, controlling the voice module of the rearview mirror to broadcast the information to the user.

[0017] Through this embodiment, the interaction items and the sense of interaction with the user can be increased. At the same time, it can have the function of a memo. For example, through the pre-stored memo information, the user is prompted with the upcoming travel itinerary and matters to be done on the same day, etc., facilitating the user to make timely travel preparations or adjust travel arrangements.

[0018] In some embodiments, the user gestures include one or more of "OK", "shh", "open", and "lift". Among them, the vehicle action corresponding to the "OK" gesture is to start the vehicle and automatically unlock the door; the vehicle action corresponding to the "shh" gesture is to keep the vehicle in a silent state; the vehicle action corresponding to the "open" gesture is to start the air conditioning system according to the preset temperature; the vehicle action corresponding to the "lift" gesture is to open the trunk.

[0019] In some embodiments, the user gestures may further include "1-9" to define interaction instructions with different meanings to achieve a more convenient and fast human-machine interaction selection.

[0020] In some embodiments, the mapping relationship is defined as an interaction operation relationship between user gestures and / or user voice and vehicle actions.

[0021] Through this embodiment, it is possible to pre-define and customize interaction commands and control commands through the mapping relationship, and then further define the transfer relationship between the two, so that the user can control the vehicle to perform related actions through gestures or voice, achieving the effect of human-computer interaction and realizing intelligent control of the vehicle.

[0022] In some embodiments, the method further includes: identifying the distance between a pedestrian vehicle behind the vehicle and the vehicle, and when the distance is less than a preset safe distance, broadcasting an open door warning message to the user through the voice module of the rearview mirror.

[0023] Through this embodiment, it is possible to effectively reduce the risk of the user opening the door and hitting passing pedestrian vehicles. By prompting the user with the distance information of the pedestrian vehicle behind, it plays a warning effect of "having eyes in the back of the head", further improving the safety of the vehicle.

[0024] In some embodiments, obtaining the interaction instruction of the user further includes: if no interaction instruction of the user is obtained within a preset time period, obtaining the current time information based on the vehicle network. If it is recognized that the current time information is night, controlling the rearview mirror to execute an operation instruction to keep the turn signal on, and at the same time broadcasting a prompt of "Please use voice interaction" to the user through the voice module.

[0025] Through this embodiment, it is possible to solve the application scenario problem of difficult gesture recognition in the dim light environment at night. By keeping the turn signal on to warn passing pedestrian vehicles, ensuring the two-way safety of the user and pedestrian vehicles, and at the same time prompting the user that relevant functions of human-computer interaction can be completed through voice in this special environment.

[0026] In some embodiments, the preset operation instruction further includes: obtaining the temperature inside the vehicle. If the temperature inside the vehicle is greater than a preset value, controlling the voice module of the rearview mirror to broadcast a high temperature warning prompt to the user.

[0027] Through this embodiment, it is possible to effectively solve the scenario problem that the temperature inside the vehicle is too high due to the vehicle being exposed in the sun for a long time in summer. If the user directly enters the vehicle, especially when the passengers include the elderly, pregnant women or children, it is extremely easy to cause heat stroke, affecting life safety. When the temperature inside the vehicle is too high, by setting a threshold, a high temperature alarm is prompted to the user, and entering the cockpit is postponed. The air conditioning system can be started first through the human-computer interaction function, so that the cockpit has a suitable temperature before entering, improving the safety of the vehicle and the comfort of the user.

[0028] In some embodiments, the preset operation instructions further include: calculating the remaining driving range based on the remaining fuel or remaining power, and controlling the voice module of the rearview mirror to broadcast the remaining driving range information to the user.

[0029] Through this embodiment, it is possible to avoid problems such as breakdowns caused by the user not paying attention to the remaining fuel or remaining power of the vehicle, or being unable to refuel or charge during the journey, ensuring the safety of the user when using the vehicle.

[0030] Furthermore, if it is recognized that the memo information involves travel information, calculate the driving range required for the travel information. If the remaining driving range is less than the required driving range, control the voice module of the rearview mirror to broadcast a warning message indicating insufficient driving range to the user.

[0031] Through this embodiment, it is possible to prompt the user whether the current driving range meets the requirements according to the travel information, avoiding the problem of range anxiety caused by insufficient driving range during driving and the difficulty of refueling or charging.

[0032] In a second aspect, a system for an intelligent interaction and control method of a vehicle rearview mirror is provided. The system includes:

[0033] A position acquisition module, configured to acquire the distance information between the user and the vehicle, and when the user enters within a preset distance from the vehicle, control the rearview mirror to execute the preset operation instructions;

[0034] An identification module, where the identification module includes: an identity identification module, configured to identify the pre-stored user identity; a gesture recognition module, configured to identify the user's gesture interaction instructions; a voice recognition module, configured to identify the user's voice interaction instructions;

[0035] An anti-theft warning module, configured to determine whether the target approaching the vehicle identified by the identity identification module belongs to the pre-stored user identity;

[0036] An instruction acquisition module, configured to acquire the user's interaction instructions through the identification module of the rearview mirror;

[0037] An intelligent interaction module, configured to define the conversion mapping relationship between the interaction instructions and the operation instructions. The intelligent interaction module analyzes the interaction instructions and outputs a control instruction that has a mapping relationship with the interaction instructions;

[0038] An instruction execution module, configured to execute corresponding control operations according to the control instruction.

[0039] In some embodiments, the system includes: an anti-theft warning module, configured to determine whether the target approaching the vehicle identified by the identity identification module belongs to the pre-stored user identity.

[0040] Through this embodiment, the risk of theft can be effectively reduced. For example, if the user loses the wireless communication device used to associate with the vehicle, in order to prevent non-user personnel from entering or starting the vehicle, an identity recognition judgment is set before the human-machine interaction to identify whether the target approaching the vehicle belongs to the pre-stored user identity. Only the target that meets the user identity is allowed to perform the human-machine interaction, improving the security of the human-machine interaction.

[0041] In some embodiments, the system further includes: an image recognition module, configured to recognize the distance between the pedestrian vehicle behind the vehicle and the vehicle. When the distance is less than a preset safety distance, a door opening warning message is broadcast to the user through the voice module of the rearview mirror.

[0042] In some embodiments, the system further includes: an instruction definition module. The interaction instruction definition module includes a user gesture instruction definition module and a user voice instruction definition module, and is used to define specific gesture or voice instructions.

[0043] Through this embodiment, personalized customization of the human-machine interaction can be carried out, enhancing the feeling of the human-machine interaction, giving users a brand-new interaction experience, and through the human-machine interaction, obtaining intelligent control of the vehicle, while meeting various usage needs of users and improving convenience.

[0044] Among them, the user can customize the gesture interaction instruction through the user gesture instruction definition module, and define the user's habits or common gestures through the mapping relationship, so as to take into account the convenience and generality in the process of human-machine interaction.

[0045] Among them, the user can customize the voice interaction instruction through the user voice instruction definition module. Preferably, the voice interaction instruction preferentially uses the voice interaction instruction defined by the system to reduce environmental noise interference as much as possible.

[0046] Furthermore, to improve the accuracy of voice recognition, the trigger words of the voice interaction instruction can be defined through the user voice instruction definition module. For example, the user can define the trigger words in the form of a nickname, which is used to evoke the interaction system to enter the voice recognition mode and keep waiting for subsequent voice interaction instructions.

[0047] Furthermore, the trigger words and the voice interaction instructions defined by the system can be combined to maximize the accuracy of voice recognition.

[0048] The beneficial effects brought by the technical solution provided by the present invention include:

[0049] An embodiment of the present invention provides a method and system for intelligent interaction and control of a vehicle rearview mirror. When a user enters within a preset distance from the vehicle, the rearview mirror is controlled to swing and / or emit a double-flash light signal. The swing of the rearview mirror is similar to the interaction between a master and a pet, so as to achieve the human-machine interaction effect of the rearview mirror. When the rearview mirror receives an interaction instruction in the form of a gesture and / or voice issued by the user, the intelligent interaction module is used to realize the conversion between the interaction instruction and the control instruction of the vehicle's actions, so as to achieve intelligent control such as automatic start, door opening, air conditioner turning on, etc., further enhancing the human-machine interaction effect of the rearview mirror and giving the user a brand-new out-of-vehicle human-machine interaction experience. Brief Description of the Drawings

[0050] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0051] Figure 1 It is a flowchart of the method for intelligent interaction and control of a vehicle rearview mirror provided by an embodiment of the present invention;

[0052] Figure 2 It is a system diagram of the method for intelligent interaction and control of a vehicle rearview mirror provided by an embodiment of the present invention;

[0053] Figure 3 It is a schematic structural diagram of a vehicle rearview mirror provided by an embodiment of the present invention.

[0054] Description of the Reference Numerals:

[0055] 1. Rearview mirror; 2. Camera assembly; 3. Sensor assembly; 4. Turn signal; 5. Vehicle body. Detailed Embodiments

[0056] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts fall within the protection scope of the present invention.

[0057] As Figure 1 shown, an embodiment of the present invention provides a method for intelligent interaction and control of a vehicle rearview mirror, and the method includes:

[0058] S1. Obtain the distance information between the user and the vehicle;

[0059] S2. When the user enters within a preset distance from the vehicle, identify whether the target approaching the vehicle belongs to a pre-stored user identity; if so, control the rearview mirror to execute a preset operation instruction; if not, control the vehicle to enter the locked state and send an alarm prompt to the user terminal through the vehicle network;

[0060] The preset operation instruction includes one or more of the following: controlling the rearview mirror to execute at least one swinging action; controlling the rearview mirror to execute at least one turn signal lighting; based on the real-time information obtained through the vehicle network, controlling the voice module of the rearview mirror to broadcast the current time, weather information, and dressing tips to the user; based on the memo information pre-stored by the user through the in-vehicle control terminal or the user terminal, controlling the voice module of the rearview mirror to broadcast this information to the user;

[0061] S3. Obtain the interaction instruction of the user;

[0062] S4. Analyze the interaction instruction and output a control instruction that has a mapping relationship with the interaction instruction; the mapping relationship is used to define the interaction operation relationship between user gestures and / or user voices and vehicle actions;

[0063] S5. Execute corresponding control operations according to the control instruction.

[0064] In some embodiments, the preset operation instruction includes: an operation instruction for controlling the rearview mirror to execute at least one swinging action, and an operation instruction for controlling the rearview mirror to execute at least one turn signal lighting.

[0065] Through this embodiment, when a device with a wireless communication function enters within a preset distance from the vehicle, it is possible to achieve the rearview mirror swaying and lighting for welcome. Among them, the rearview mirror swaying is similar to the interaction between the owner and the pet, enhancing the sense of interaction, realizing the welcome outside the vehicle, and giving the user a brand-new pet welcome experience.

[0066] In some embodiments, the preset operation instruction further includes: based on the real-time information obtained through the vehicle network, controlling the voice module of the rearview mirror to broadcast the current time, weather information, and dressing tips to the user.

[0067] Through this embodiment, it is possible to increase the interaction items and the sense of interaction with the user, and at the same time prompt the weather and dressing information to the user, providing better travel preparation and travel experience for the user.

[0068] In some embodiments, the preset operation instruction further includes: based on the memo information pre-stored by the user through the in-vehicle control terminal or the user terminal, controlling the voice module of the rearview mirror to broadcast this information to the user.

[0069] Through this embodiment, the interactive items and the sense of interaction with the user can be increased, and at the same time, the function of a memo can be provided. For example, through the pre-stored memo information, the user can be reminded of the upcoming travel itinerary, pending matters, etc. on the current day, facilitating the user to make timely travel preparations or adjust travel arrangements.

[0070] In some embodiments, the user gestures include one or more of "OK", "shh", "open", and "lift". Among them, the vehicle action corresponding to the "OK" gesture is to start the vehicle and automatically unlock the door; the vehicle action corresponding to the "shh" gesture is to keep the vehicle in a silent state; the vehicle action corresponding to the "open" gesture is to start the air conditioning system according to a preset temperature; the vehicle action corresponding to the "lift" gesture is to open the trunk.

[0071] In some embodiments, the user gestures may further include "1-9" to define interactive commands with different meanings, so as to achieve a more convenient and faster human-machine interaction selection.

[0072] In some embodiments, the mapping relationship is defined as an interaction operation relationship between user gestures and / or user voices and vehicle actions.

[0073] Through this embodiment, the interaction commands and control commands can be predefined and customized through the mapping relationship, and then the switching relationship between the two can be further defined, enabling the user to control the vehicle to perform related actions through gestures or voices, achieving the effect of human-machine interaction and realizing the intelligent control of the vehicle.

[0074] In some embodiments, the method further includes:

[0075] S6. Identify the distance between the pedestrian vehicle behind the vehicle and the vehicle. When the distance is less than a preset safety distance, a door opening warning message is broadcast to the user through the voice module of the rearview mirror.

[0076] Through this embodiment, the risk of the user opening the door and hitting the passing pedestrian vehicle can be effectively reduced. By prompting the user with the distance information of the pedestrian vehicle behind, a warning effect of "having eyes in the back of the head" is achieved, further improving the vehicle safety.

[0077] In some embodiments, the obtaining of the user's interaction command further includes:

[0078] S31. If the user's interaction command is not obtained within a preset time period, obtain the current time information based on the vehicle network.

[0079] S32. If it is recognized that the current time information is night, control the rearview mirror to execute the operation instruction of keeping the turn signal on.

[0080] S33. Use the voice module to broadcast a prompt of "Please use voice interaction" to the user.

[0081] Through this embodiment, it is possible to solve the problem of difficult gesture recognition in the application scenario of dim lighting at night. By keeping the turn signal on to warn passing pedestrians and vehicles, the two-way safety of the user and pedestrians / vehicles is ensured. At the same time, the user is prompted that in this special environment, relevant functions of human-machine interaction can be completed through voice.

[0082] In some embodiments, the preset operation instructions further include: obtaining the vehicle interior temperature. If the vehicle interior temperature is greater than a preset value, controlling the voice module of the rearview mirror to broadcast a high-temperature warning prompt to the user.

[0083] Through this embodiment, it is possible to effectively solve the problem of the vehicle interior temperature being too high in summer due to long-term exposure to the sun. If the user directly enters the vehicle, especially when the passengers include the elderly, pregnant women or children, it is extremely easy to cause heat stroke, affecting life safety. When the vehicle interior temperature is too high, by setting a threshold, a high-temperature alarm is prompted to the user, and entering the cockpit is postponed. The air-conditioning system can be started first through the human-machine interaction function, and then enter after the cockpit has a suitable temperature, improving vehicle safety and user comfort.

[0084] In some embodiments, the preset operation instructions further include: calculating the remaining driving range based on the remaining fuel or remaining power, and controlling the voice module of the rearview mirror to broadcast the remaining driving range information to the user.

[0085] Through this embodiment, it is possible to avoid problems such as breakdowns or inability to refuel or charge during the journey caused by the user not paying attention to the remaining fuel or remaining power of the vehicle, ensuring the safety of the user using the vehicle.

[0086] Furthermore, if it is recognized that the memo information involves travel information, calculate the driving range required for the travel information. If the remaining driving range is less than the required driving range, control the voice module of the rearview mirror to broadcast a warning message of insufficient driving range to the user.

[0087] Through this embodiment, it is possible to prompt the user whether the current driving range meets the requirements according to the travel information, avoiding the problem of range anxiety caused by insufficient driving range during driving and the difficulty of refueling or charging.

[0088] In some embodiments, as Figure 2 shown, the present invention can also provide a system for a vehicle rearview mirror intelligent interaction and control method, and the system includes:

[0089] A position acquisition module 101 is configured to acquire distance information between a user and the vehicle, and when the user enters within a preset distance from the vehicle, control the rearview mirror to execute a preset operation instruction;

[0090] An identification module 102, the identification module includes: an identity identification module for identifying a pre-stored user identity; a gesture recognition module for recognizing a user's gesture interaction instruction; a voice recognition module for recognizing a user's voice interaction instruction;

[0091] An anti-theft warning module 103 is configured to determine whether a target approaching the vehicle belongs to a pre-stored user identity according to the identity identified by the identity identification module;

[0092] An instruction acquisition module 104 is configured to acquire the user's interaction instruction through the identification module of the rearview mirror;

[0093] An intelligent interaction module 105 is configured to define a conversion mapping relationship between an interaction instruction and an operation instruction, and the intelligent interaction module parses the interaction instruction and outputs a control instruction that has a mapping relationship with the interaction instruction;

[0094] An instruction execution module 106 is configured to execute corresponding control operations according to the control instruction.

[0095] In some embodiments, the system includes: an anti-theft warning module 107, configured to determine whether a target approaching the vehicle belongs to a pre-stored user identity according to the identity identified by the identity identification module.

[0096] Through this embodiment, the risk of theft can be effectively reduced. For example, if the user loses the wireless communication device associated with the vehicle, to prevent non-user personnel from entering or starting the vehicle, an identity identification judgment is set before human-machine interaction to determine whether a target approaching the vehicle belongs to a pre-stored user identity. Only targets that meet the user identity are allowed to perform human-machine interaction, improving the security of human-machine interaction.

[0097] In some embodiments, the identification module further includes: an image recognition module for recognizing the distance between a pedestrian vehicle behind the vehicle and the vehicle, and when the distance is less than a preset safety distance, a voice module of the rearview mirror is used to broadcast an opening warning message to the user.

[0098] In some embodiments, the system further includes: an interaction instruction definition module 108, the interaction instruction definition module includes a user gesture instruction definition module and a user voice instruction definition module for defining specific gesture or voice instructions.

[0099] Through this embodiment, personalized customization of human-machine interaction can be carried out, enhancing the feeling of human-machine interaction, giving users a brand-new interaction experience, and through human-machine interaction, intelligent control of the vehicle can be obtained, while meeting various usage needs of users and improving convenience.

[0100] Among them, the user can customize gesture interaction instructions through the user gesture instruction definition module, and define gestures that the user is used to or commonly used through the mapping relationship, so as to take into account convenience and generality in the process of human-machine interaction.

[0101] Among them, the user can customize voice interaction instructions through the user voice instruction definition module. Preferably, the voice interaction instructions preferentially use the voice interaction instructions defined by the system to reduce environmental noise interference as much as possible.

[0102] Furthermore, to improve the accuracy of speech recognition, the trigger words of the voice interaction instructions can be defined through the user voice instruction definition module. For example, the user can define the trigger words in the form of a nickname to evoke the interaction system to enter the speech recognition mode and keep waiting for subsequent voice interaction instructions.

[0103] Furthermore, trigger words and the voice interaction instructions defined by the system can be combined to maximize the accuracy of speech recognition.

[0104] As Figure 3 shown, the embodiment of the present invention provides a structural schematic diagram of a vehicle rearview mirror, which includes: a rearview mirror 1, a camera assembly 2, a sensor assembly 3, a turn signal 4, and an intelligent interaction controller (not shown). The rearview mirror 1 is installed on the vehicle body 5. The camera assembly 2, the sensor assembly 3, and the turn signal 4 are installed on the rearview mirror 1.

[0105] Among them, the camera assembly 2 includes a camera, a microphone, and a speaker, and is used to collect image information and voice information of users, pedestrians, and vehicles; the sensor assembly 3 is used to collect the distance information between the user and the vehicle.

[0106] Working process: When the sensor assembly 3 recognizes that the user enters within a preset distance from the vehicle, it controls the rearview mirror 1 to swing and / or controls the turn signal 4 to emit a double-flash light signal. The swing of the rearview mirror is similar to the interaction between the owner and the pet, so as to achieve the human-machine interaction effect of the rearview mirror. When the camera assembly 2 receives the interaction instructions of gestures and / or voices issued by the user, it realizes the conversion between the control instructions of the vehicle actions through the intelligent interaction controller, so as to achieve intelligent control such as automatic start, door opening, and air conditioner opening, further enhancing the human-machine interaction effect of the rearview mirror and giving users a brand-new out-of-vehicle human-machine interaction experience.

[0107] In the description of the present invention, it should be noted that the orientation or positional relationship indicated by terms such as "upper" and "lower" is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it should not be construed as a limitation to the present invention. Unless otherwise clearly specified and defined, the terms "installed", "connected" and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, or an electrical connection; it can be directly connected, or indirectly connected through an intermediate medium, and it can be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0108] It should be noted that in the present invention, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprising", "including" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising one..." does not exclude the presence of another identical element in the process, method, article or device comprising the said element.

[0109] The above are only specific embodiments of the present invention, enabling those skilled in the art to understand or implement the present invention. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to these embodiments shown herein, but rather to the broadest scope consistent with the principles and novel features claimed herein.

Claims

1. A vehicle rearview mirror intelligent interaction and control method, characterized in that: The method comprises: Obtaining distance information between the user and the vehicle; When the user enters the preset distance from the vehicle, it identifies whether the target approaching the vehicle belongs to the pre-stored user identity; if so, the rearview mirror is controlled to execute the preset operation instruction; if not, the vehicle is controlled to enter the locked state, and an alarm prompt is sent to the user terminal through the vehicle network; The preset operation instructions include one or more of the following: controlling the rearview mirror to perform at least one swinging action; controlling the rearview mirror to light up the turn signal at least once; controlling the voice module of the rearview mirror to broadcast the current time, weather information and wearing tips to the user based on the real-time information obtained by the Internet of Vehicles; controlling the voice module of the rearview mirror to broadcast the memo information pre-stored by the user through the vehicle control terminal or the user terminal to the user; Obtaining an interaction instruction from the user; Parsing the interaction instruction, and outputting a control instruction in a mapping relationship with the interaction instruction; the mapping relationship is used to define an interactive operation relationship between a user gesture and / or a user voice and a vehicle action; Execute corresponding control operations according to the control instructions.

2. The interaction and control method according to claim 1, characterized in that: The user gesture includes one or more of "OK", "Shh", "Open", and "Lift Up"; Among them, the vehicle action corresponding to the "OK" gesture is to start the vehicle and automatically open the door lock, the vehicle action corresponding to the "hush" gesture is to keep the vehicle silent, the vehicle action corresponding to the "open" gesture is to start the air-conditioning system according to the preset temperature, and the vehicle action corresponding to the "lift up" gesture is to open the trunk.

3. The interaction and control method according to claim 1 or 2, characterized in that: Identify the distance between the pedestrian vehicle behind the vehicle and the vehicle, and when the distance is less than a preset safety distance, broadcast the door opening warning information to the user through the voice module of the rearview mirror.

4. The interaction and control method according to claim 1, characterized in that: The obtaining of the user's interaction instruction further includes: If no interaction instruction from the user is obtained within a preset time period, obtaining current time information based on the Internet of Vehicles; If it is recognized that the current time information is night, the rearview mirror is controlled to execute an operation instruction of keeping the turn signal light on; The prompt "Please use voice interaction" is broadcast to the user through the voice module.

5. The interaction and control method according to claim 1, characterized in that: The preset operation instructions also include: The temperature inside the vehicle is obtained. If the temperature inside the vehicle is greater than a preset value, the voice module of the rearview mirror is controlled to broadcast a high temperature warning prompt to the user.

6. The interaction and control method according to claim 1, characterized in that: The preset operation instructions also include: The remaining cruising range is calculated based on the remaining oil or the remaining power, and the voice module of the rearview mirror is controlled to broadcast the remaining cruising range information to the user.

7. The interaction and control method according to claim 6, characterized in that: If it is recognized that the memo information involves travel information, the cruising range required for the travel information is calculated, and if the remaining cruising range is less than the required cruising range, the voice module of the rearview mirror is controlled to broadcast a warning message of insufficient cruising range to the user.

8. A system for intelligent interaction and control of a vehicle rearview mirror according to any one of claims 1 to 7, characterized in that: The system comprises: A position acquisition module, used to acquire the distance information between the user and the vehicle, and when the user enters within a preset distance from the vehicle, control the rearview mirror to execute a preset operation instruction; The recognition module includes: an identity recognition module for recognizing a pre-stored user identity; a gesture recognition module for recognizing a user's gesture interaction instructions; and a voice recognition module for recognizing a user's voice interaction instructions; The anti-theft warning module is used to identify whether the target approaching the vehicle belongs to a pre-stored user identity according to the identity recognition module; An instruction acquisition module, used for acquiring the user's interactive instruction through the recognition module of the rearview mirror; An intelligent interaction module, used to define a conversion mapping relationship between an interaction instruction and an operation instruction, wherein the intelligent interaction module parses the interaction instruction and outputs a control instruction in a mapping relationship with the interaction instruction; The instruction execution module is used to execute corresponding control operations according to the control instruction.

9. The system according to claim 8, characterized in that: The system further comprises: The image recognition module is used to identify the distance between the pedestrian vehicle behind the vehicle and the vehicle. When the distance is less than a preset safety distance, the voice module of the rearview mirror broadcasts a door opening warning message to the user.

10. The system according to claim 8, characterized in that: The system further comprises: The instruction definition module includes a user gesture instruction definition module and a user voice instruction definition module, which are used to define specific gesture or voice instructions.

Images