Method and device for controlling vehicle based on object in vehicle, medium and electronic equipment

Abstract

The present application relates to the field of automatic driving, and in particular to a method and device for controlling a vehicle based on an object in the vehicle, a medium and an electronic device. A vehicle system is provided with vehicle control rules associated with a plurality of objects in advance. The method comprises: acquiring a biological feature signal outside the vehicle, which can trigger the vehicle system to call the vehicle control rules; if it is determined that the object in the vehicle is a first object, the vehicle system controls the vehicle in a first control mode according to the vehicle control rules; and if it is determined that the object in the vehicle is a second object, the vehicle system controls the vehicle in a second control mode according to the vehicle control rules. The method implements a specific vehicle control function for a specific person in the vehicle under a specific vehicle external feature signal, so as to improve the intelligent degree of the vehicle.

Description

Technical Field

[0001] This invention relates to the field of autonomous driving, and more specifically to a method, apparatus, medium, and electronic device for controlling a vehicle based on in-vehicle objects. Background Technology

[0002] Autonomous driving technology and vehicle intelligence are the main directions of vehicle technology development. Current research and commercial applications mainly focus on scenarios where vehicles automatically respond to collected road condition information and implement certain self-control measures. However, many solutions in the field of autonomous driving and vehicle intelligence have not yet been realized, and most technologies put into practical application are at the level of assisted driving or auxiliary prompts, only able to collect or respond to some fixed road condition information, such as slowing down or stopping when the vehicle detects an obstacle ahead, or turning on the headlights when it gets dark. For dynamic information or personalized information related to people or things, vehicle systems struggle to accurately identify, acquire, and automatically respond. Therefore, vehicle systems cannot achieve a fully intelligent level. Thus, it is necessary to provide technical solutions that can address these problems to promote the intelligent development of vehicles. Summary of the Invention

[0003] The purpose of this invention is to provide a method, apparatus, medium, and electronic device for controlling a vehicle based on in-vehicle objects, thereby overcoming, at least to some extent, the aforementioned problems caused by limitations and defects in related technologies.

[0004] According to one aspect of the present invention, a method for controlling a vehicle based on in-vehicle objects is provided. The vehicle system has pre-set vehicle control rules associated with multiple objects, the vehicle control rules responding only when the objects are located inside the vehicle, and the responses differ for different objects; the method includes:

[0005] Acquire biometric signals from outside the vehicle, which can trigger the vehicle system to invoke the vehicle control rules;

[0006] If the object inside the vehicle is determined to be a first object, the vehicle system controls the vehicle in a first control mode according to the vehicle control rules; and if the object inside the vehicle is determined to be a second object, the vehicle system controls the vehicle in a second control mode according to the vehicle control rules; wherein the first control mode and the second control mode are different.

[0007] In one exemplary embodiment, the vehicle control system pre-sets multiple response conditions for each object, and activates the multiple response conditions for that object when any object is detected inside the vehicle; the method further includes:

[0008] When the biometric signal is detected to meet the response condition of any activation state, the vehicle system is triggered to invoke the vehicle control rules.

[0009] In one exemplary embodiment, the biometric signal outside the vehicle includes at least one of the following signals:

[0010] Voiceprint feature signals, semantic feature signals, and action feature signals of objects outside the vehicle.

[0011] In one exemplary embodiment, the method further includes:

[0012] When the biometric signal is detected to meet the response conditions of multiple activation states, the response conditions for triggering the vehicle system to invoke vehicle control rules are determined according to the priority among the multiple pre-set response conditions.

[0013] In an exemplary embodiment, the first control method and the second control method are different control methods set based on the response conditions of the first object and the response conditions of the second object, respectively.

[0014] In an exemplary embodiment, the first control method or the second control method includes at least one of the following control methods:

[0015] Control the vehicle to decelerate or stop, control the vehicle to unlock specific doors, control the vehicle to open specific windows, control the in-vehicle multimedia playback, and control the display of biometric signals from outside the vehicle inside the vehicle.

[0016] In an exemplary embodiment, the first control method or the second control method includes:

[0017] The specific window to be opened is determined based on the location of biometric signals outside the vehicle and the location of objects inside the vehicle.

[0018] In an exemplary embodiment, the first control method or the second control method includes:

[0019] Control the in-vehicle multimedia to stop playing or reduce the playback volume, and play the biometric signals from outside the vehicle inside the vehicle.

[0020] According to another aspect of the present invention, an apparatus for controlling a vehicle based on in-vehicle objects is provided. The vehicle system has pre-set vehicle control rules associated with multiple objects, the vehicle control rules responding only when the objects are located inside the vehicle, and responding differently for different objects; the apparatus includes:

[0021] The signal acquisition module is used to acquire biometric signals from outside the vehicle, which can trigger the vehicle system to invoke the vehicle control rules.

[0022] A control module is configured to, when the in-vehicle object is determined to be a first object, control the vehicle in a first control mode according to the vehicle control rules; and when the in-vehicle object is determined to be a second object, control the vehicle in a second control mode according to the vehicle control rules; wherein the first control mode and the second control mode are different.

[0023] According to another aspect of the present invention, an electronic device is provided, comprising:

[0024] At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the above-described method.

[0025] According to another aspect of the present invention, a computer-readable storage medium is provided, which stores a computer program, characterized in that the computer program implements the above-described method when executed by a processor.

[0026] This invention provides a method and apparatus for controlling a vehicle based on in-vehicle objects. The method can perform personalized identification of both in-vehicle occupants and acquired external feature signals. For the same external feature signal, different in-vehicle occupants will adopt different control functions, and for the same in-vehicle occupant, different external signals will also result in different vehicle control functions. This enables the implementation of specific vehicle control functions for specific in-vehicle occupants under specific external feature signals, thereby improving the intelligence level of the vehicle. Attached Figure Description

[0027] Figure 1 This is a flowchart illustrating a method for controlling a vehicle based on in-vehicle objects in an exemplary embodiment of the present invention.

[0028] Figure 2 This is a schematic diagram of the structure of a device for controlling a vehicle based on in-vehicle objects in an exemplary embodiment of the present invention. Detailed Implementation

[0029] To make the objectives, features, and advantages of the present invention more apparent and understandable, the technical solutions of the embodiments and examples of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. However, the exemplary embodiments and examples can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments and examples are provided to make the present invention more comprehensive and complete, and to fully convey the concept of the exemplary embodiments and examples to those skilled in the art. The features, structures, or characteristics described in the present invention can be combined in any suitable manner in one or more embodiments and examples. In the following description, numerous specific details are provided to give a full understanding of the embodiments and examples of the present invention. However, those skilled in the art will recognize that the technical solutions of the present invention can be practiced by omitting one or more of the specific details, or other methods, components, apparatus, steps, etc. In other cases, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present invention.

[0030] Furthermore, the accompanying drawings are merely illustrative of the invention and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Although the steps of the method in this invention are described in a specific order in the drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. The flowcharts shown in the drawings are merely illustrative and do not necessarily include all steps. For example, some steps may be decomposed, while others may be combined or partially combined; therefore, the actual order of execution may change depending on the circumstances. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0031] Autonomous driving technology and vehicle intelligence are the main directions of vehicle technology development. Current research and commercial applications mainly focus on scenarios where vehicles automatically respond to collected road condition information and implement certain self-control measures. However, many solutions in the field of autonomous driving and vehicle intelligence have not yet been realized, and most technologies put into practical application are at the level of assisted driving or auxiliary prompts. They can only collect or respond to some fixed road condition information, such as slowing down or stopping when the vehicle detects an obstacle ahead, or turning on the headlights when it gets dark. For dynamic information or personalized information related to people or things, vehicle systems struggle to accurately identify, acquire, and automatically respond. Therefore, vehicle systems cannot achieve a fully intelligent level.

[0032] To address the aforementioned deficiencies in related technologies, this invention provides a method and apparatus for controlling a vehicle based on in-vehicle objects. The vehicle system pre-configures vehicle control rules associated with multiple objects. These vehicle control rules respond only when the object is inside the vehicle, and the responses differ for different objects. The method includes: acquiring biometric signals from outside the vehicle, which trigger the vehicle system to invoke the vehicle control rules; if the in-vehicle object is determined to be a first object, the vehicle system controls the vehicle using a first control method according to the vehicle control rules; and if the in-vehicle object is determined to be a second object, the vehicle system controls the vehicle using a second control method according to the vehicle control rules; wherein the first control method and the second control method are different. On the one hand, the method can identify the occupants of the vehicle and respond differently to external signals based on this information, and implement different control methods for the vehicle. On the other hand, the method can also perform personalized identification of the acquired external feature signals. For the same external feature signal, different occupants will take different control functions, and for the same occupant, different external signals will lead to different vehicle control functions. This enables the implementation of specific vehicle control functions for specific occupants under specific external feature signals, thereby improving the intelligence level of the vehicle.

[0033] An exemplary embodiment of the present invention provides a method for controlling a vehicle based on in-vehicle objects. Figure 1 This is a flowchart illustrating a method for controlling a vehicle based on in-vehicle objects in an exemplary embodiment of the present invention. In the application scenario of this method, the vehicle system has pre-set vehicle control rules associated with multiple objects. The vehicle control rules respond only when the objects are located inside the vehicle, and the responses differ for different objects. Figure 1 As shown, the method for controlling a vehicle based on in-vehicle objects includes the following steps:

[0034] Step S11: Obtain biometric signals from outside the vehicle, which can trigger the vehicle system to invoke the vehicle control rules;

[0035] The development of vehicle technology has progressed through mechanization, digitalization, and the current stage of intelligentization. The logic of vehicle control has also evolved from early purely manual operation to digital operation and more advanced automated control. For example, vehicle systems can be pre-configured digitally to automatically respond in specific scenarios. The following section uses autonomous driving and vehicle intelligence as examples to elaborate on the method of controlling a vehicle based on in-vehicle objects according to this invention.

[0036] Autonomous driving and vehicle intelligence systems involve equipping vehicles with sensors (such as radar and cameras), controllers, and actuators. These systems acquire information through onboard environmental perception systems, process and respond to information via information terminals, and exchange information with people, vehicles, and roads. This gives vehicles intelligent environmental perception capabilities, enabling them to automatically analyze the safety and danger states of the vehicle and guide it to its destination according to the driver's wishes, ultimately replacing human operation. Intelligent vehicles are equipped with sensing, decision-making, and execution systems to acquire external information, utilizing new technologies such as information communication, the Internet, big data, cloud computing, and artificial intelligence to achieve partial or fully autonomous driving functions.

[0037] To achieve intelligent vehicle control, vehicle systems typically have pre-configured programs for executing intelligent control functions. The purpose of this invention is to enable the vehicle system to automatically respond differently to different occupants and different information captured from outside the vehicle, thus achieving specific vehicle control. Therefore, specific vehicle control methods are correspondingly set for specific occupants and external sound signals, motion signals, image signals, etc. When a specific feature is identified using the control method of this solution, the corresponding control method is applied to control the vehicle. In an exemplary embodiment, the vehicle system has pre-configured vehicle control rules associated with multiple objects. These vehicle control rules only respond when the object is inside the vehicle, and the response differs for different objects. Specifically, the objects inside the vehicle include the driver, passengers, etc. The control rules are used to apply different control methods to control the vehicle for different occupants. That is, by combining the characteristic information of each occupant, different vehicle control methods are configured. In response to characteristic signals from outside the vehicle, control rule A is applied to occupant a, control rule B is applied to occupant b, and control rule C is applied to occupant c.

[0038] In one exemplary embodiment, the vehicle system sets multiple response conditions for each object. These response conditions are used to respond to external feature signals; that is, when an external feature is detected and meets any response condition, the vehicle system is triggered to invoke the vehicle control rules. Furthermore, the vehicle system may pre-configure a considerable amount of driver and passenger information. Since each driver and passenger is not always inside the vehicle, the vehicle system pre-configures a detection and recognition function for each object inside the vehicle. Only when a driver or passenger is detected inside the vehicle is the response condition for that person activated, meaning the response condition can detect and respond to external feature signals. This feature allows the system to first determine whether the person is inside the vehicle when executing this solution. Only when the person is inside the vehicle can their corresponding response condition respond to external signals, thereby achieving personalized vehicle control. In another exemplary embodiment, the response condition for the person inside the vehicle can always be activated, but only when the person is inside the vehicle can they respond to external biometric signals. It is understood that in other embodiments, the response of the person inside the vehicle to external biometric signals can be achieved in other ways, and this invention does not impose any limiting descriptions on this.

[0039] For example, biometric signals from outside the vehicle can be acquired through electronic devices such as cameras, radar sensors, infrared sensors, and audio sensors installed around the vehicle. These signals can be voiceprint, semantic, or motion signature signals. For instance, the response condition can be set as a name detection condition for someone inside the vehicle. When the external biometric signal is a voice signal calling the name of someone inside the vehicle, the vehicle system can invoke vehicle control rules to respond once it has detected that person inside the vehicle. Another example is that the response condition can be set as a voiceprint detection condition for each person. For instance, for someone who is a parent, when the vehicle system receives a voice signal from outside the vehicle where a child calls "Dad" or "Mom," it can combine semantic and voiceprint information to determine if the person being called corresponds to someone inside the vehicle. If so, it invokes vehicle control rules to respond. Yet another example is that the response condition for a taxi can be set as a voice signal detection condition for someone outside the vehicle calling "taxi," "stop," or "TAXI," or a motion signal detection condition for waving to indicate a stop. When the vehicle system recognizes that the external signal meets these response conditions, it can invoke vehicle control rules to respond. Furthermore, the response conditions can be set to be activated only when no one other than the driver is detected inside the vehicle, thereby preventing taxis carrying passengers from being stopped. It is understood that the response conditions can be pre-set based on the application scenario, actual needs, and external signals that require a response. For example, personalized response rules can be set by the vehicle owner or authorized personnel. This is only a partial illustrative description and does not constitute any limitation on the present invention.

[0040] Step S13: If the object inside the vehicle is determined to be a first object, the vehicle system controls the vehicle in a first control mode according to the vehicle control rules; and if the object inside the vehicle is determined to be a second object, the vehicle system controls the vehicle in a second control mode according to the vehicle control rules; wherein the first control mode and the second control mode are different.

[0041] In an exemplary embodiment, before step S13, the system may further include: triggering the vehicle system to invoke the vehicle control rules when the biometric signal is detected to satisfy any response condition set to an active state.

[0042] As mentioned earlier, the vehicle system has multiple response conditions set for each person. When a biometric signal is acquired from outside the vehicle, the signal is compared with all the response conditions that are in an active state. That is, it is determined whether there is a corresponding person inside the vehicle for the signal from outside the vehicle. If there is a corresponding person, the vehicle control system calls the vehicle control rules. In step S13, the vehicle control method corresponding to the external biometric signal can be determined by the control rules. When the object inside the vehicle is determined to be the first object, the vehicle is controlled according to the first control method; when the object inside the vehicle is determined to be the second object, the vehicle is controlled according to the second control method. It can be understood that the roles of the first object, the second object, the first control method, and the second control method are to distinguish between the two objects and the two control methods. It does not limit the vehicle system to only have the first object or the second object, nor does it limit the vehicle control rules to only have the first control method or the second control method. For example, when a third object is set in the vehicle system, when the object inside the vehicle is determined to be the third object, the vehicle is controlled according to the third control method. It can also be regarded as the second object that is different from the first object. Therefore, the situation where there are third and other objects is also included in the first object and second object scheme shown in step S13.

[0043] In one exemplary embodiment, the response condition is a detection condition pre-set based on the biometric signal, wherein each biometric signal corresponds to the response condition of one or more in-vehicle objects. For example, if each biometric signal corresponds to the response condition of one object, the biometric signal can only satisfy one response condition and can only correspond to one in-vehicle object; in this case, only one corresponding control rule can be used to control the vehicle. As another example, each biometric signal can also correspond to the response conditions of multiple in-vehicle objects, meaning the biometric signal can correspond to multiple objects, thereby enabling the invocation of multiple control methods to control the vehicle. It should be noted that when multiple control methods are used to control the vehicle simultaneously, the personalized controls related to the occupants in each control method (such as unlocking specific doors, opening specific windows, etc.) can be implemented independently. However, the control functions that affect the vehicle as a whole in each control method (such as controlling vehicle deceleration, turning lights on or off, controlling in-vehicle multimedia playback, etc.) should be consistent. Otherwise, if different control methods implement different controls for the same function at the same time, it may lead to malfunctions in the vehicle system. For example, in the case of multiple responses, the priority order of each response can be preset. For features related to vehicle driving, the response level of the driver can be set higher than that of other personnel to ensure that the vehicle responds under the premise of safe driving.

[0044] In an exemplary embodiment, the first control method and the second control method are different control methods set based on the response conditions of the first object and the response conditions of the second object, respectively. The first control method or the second control method may be controlling the vehicle to decelerate or stop; the control method may also be unlocking a specific door, for example, unlocking the nearest door based on the position of an outside person relative to the vehicle to allow them to enter; the control method may also be controlling a window to rise or fall to a specific height, for example, determining the specific window to be opened based on the position of a biometric signal outside the vehicle and the position of an object inside the vehicle. First, the side closest to the vehicle is determined based on the position of the biometric signal outside the vehicle; second, the closest window is determined on that side of the vehicle based on the determined position of the object inside the vehicle, thereby determining the window most suitable for communication between the person inside and the person outside the vehicle; furthermore, the window can be opened to a specific height based on the height of the person outside and / or the person inside the vehicle, for example, when the person outside... When the passenger is tall, lowering the window halfway down is sufficient for communication between the passenger and the person outside. Conversely, when the person outside is short, the window should be fully opened for communication. Furthermore, the system can control window opening based on detected external environmental information. For instance, in rainy weather, even with an external trigger signal, the system will not directly open the vehicle; instead, the external signal will be communicated to the passenger through other means. Moreover, the system can also control window opening based on vehicle speed. At high speeds, even with the window open, communication between passengers and the person outside may be difficult. Therefore, the system can be configured to only open the window in response to an external signal when the vehicle speed is below a preset threshold. Another example is that the control method can also be to control the in-vehicle multimedia playback and / or control the display / playback of biometric signals from outside the vehicle inside the vehicle; in detail, when there is loud multimedia playback inside the vehicle, the occupants may not be able to hear the call signals from outside vehicles in time. In this case, when the vehicle system detects the signal from outside the vehicle, it can control the in-vehicle multimedia to stop playing or reduce the playback volume, and can replay the signal from outside the vehicle inside the vehicle so that the occupants can accurately hear it.

[0045] In one exemplary embodiment, the method may further include: setting different response levels for external biometric signals based on different in-vehicle objects. For example, if the in-vehicle object is identified as a driver, when responding to external biometric signals, priority is given to characteristics related to vehicle driving and road safety. For instance, vehicle condition, road condition, and driving information (such as vehicle deceleration and stopping) are given higher priority than other information when responding to the driver. Conversely, for non-drivers, other information may be given a higher priority than road condition and vehicle condition information. In another exemplary embodiment, the method may further include: setting fuzzy labels for unknown people outside the vehicle, such as passengers, family members' friends, colleagues, etc., and selecting the type of person boarding the vehicle at a certain time and place based on pre-set label information. People boarding in their home garage, people boarding together at work, and people randomly boarding on the roadside can all be assigned different labels.

[0046] Another exemplary embodiment of the present invention provides a device for controlling a vehicle based on in-vehicle objects. Figure 2 This is a schematic diagram of the structure of a device for controlling a vehicle based on in-vehicle objects in an exemplary embodiment of the present invention; as shown. Figure 2 As shown, the vehicle system has pre-set vehicle control rules associated with multiple objects. These vehicle control rules respond only when the object is inside the vehicle, and the response differs for different objects. The device includes:

[0047] The signal acquisition module 20 is used to acquire biometric signals from outside the vehicle, which can trigger the vehicle system to call the vehicle control rules.

[0048] The control module 22 is configured to, when the in-vehicle object is determined to be a first object, control the vehicle in a first control mode according to the vehicle control rules; and when the in-vehicle object is determined to be a second object, control the vehicle in a second control mode according to the vehicle control rules; wherein the first control mode and the second control mode are different.

[0049] The specific details of each module / unit in the above-described device have been described in detail in the corresponding method section and will not be repeated here. It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of the present invention, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0050] In addition to the methods and apparatus described above, embodiments of the present invention may also be computer program products, which include computer program instructions that, when executed by a processor, cause the processor to perform the steps in the methods according to various embodiments of the present invention described in the "Exemplary Methods" section of this specification.

[0051] The computer program product can be written in any combination of one or more programming languages ​​to perform the operations of the embodiments of the present invention. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0052] Another embodiment of the present invention provides an electronic device that can be used to perform all or part of the steps of the method described in this exemplary embodiment. The device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the steps of the method according to various embodiments of the present invention described in the "Exemplary Methods" section above.

[0053] Another embodiment of the present invention provides a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, cause the processor to perform the steps of the methods according to various embodiments of the present invention described in the "Exemplary Methods" section of this specification.

[0054] The computer-readable storage medium may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may, for example, include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0055] The basic principles of the present invention have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in the present invention are merely examples and not limitations, and should not be considered as essential features of each embodiment of the present invention. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the present invention to the necessity of employing the aforementioned specific details.

[0056] The block diagrams of devices, apparatuses, devices, and systems involved in this invention are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0057] Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of the invention are indicated by the following claims.

[0058] It should be understood that the present invention is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.

Claims

1. A method for controlling a vehicle based on in-vehicle objects, characterized in that, The vehicle system has pre-set vehicle control rules associated with multiple objects. These rules respond only when the object is inside the vehicle, and the responses differ for different objects. The vehicle control system has pre-set multiple response conditions for each object, and when any object is detected inside the vehicle, these conditions are activated. The method includes: Acquire biometric signals from outside the vehicle, which can trigger the vehicle system to invoke the vehicle control rules; the biometric signals from outside the vehicle include at least one of the following signals: voiceprint feature signals, semantic feature signals, and motion feature signals of objects outside the vehicle; When the biometric signal is detected to meet the response condition of any activation state, the vehicle system is triggered to invoke the vehicle control rules; If the object inside the vehicle is determined to be a first object, the vehicle system controls the vehicle in a first control mode according to the vehicle control rules; and if the object inside the vehicle is determined to be a second object, the vehicle system controls the vehicle in a second control mode according to the vehicle control rules; wherein the first control mode and the second control mode are different; the first control mode or the second control mode includes at least one of the following control modes: if the biometric signal outside the vehicle includes the motion feature signal, control the in-vehicle multimedia playback and control the motion feature signal to be displayed inside the vehicle; if the biometric signal outside the vehicle includes the voiceprint feature signal and / or semantic feature signal of the object outside the vehicle, control the in-vehicle multimedia to stop playing or reduce the playback volume, and play the voiceprint feature signal and / or semantic feature signal of the object outside the vehicle inside the vehicle.

2. The method for controlling a vehicle based on in-vehicle objects according to claim 1, characterized in that, The method further includes: When the biometric signal is detected to meet the response conditions of multiple activation states, the response conditions for triggering the vehicle system to invoke vehicle control rules are determined according to the priority among the multiple pre-set response conditions.

3. The method for controlling a vehicle based on in-vehicle objects according to claim 1, characterized in that, The first control method and the second control method are different control methods set based on the response conditions of the first object and the response conditions of the second object, respectively.

4. The method for controlling a vehicle based on in-vehicle objects according to claim 1, characterized in that, The first control method or the second control method includes: The specific window to be opened is determined based on the location of biometric signals outside the vehicle and the location of objects inside the vehicle.

5. A device for controlling a vehicle based on in-vehicle objects, characterized in that, The vehicle system has pre-set vehicle control rules associated with multiple objects. These rules respond only when the object is inside the vehicle, and the responses differ for different objects. The vehicle control system has pre-set multiple response conditions for each object, and activates these conditions when any object is detected inside the vehicle. The device includes: The signal acquisition module is used to acquire biometric signals from outside the vehicle. These biometric signals can trigger the vehicle system to invoke the vehicle control rules. The biometric signals from outside the vehicle include at least one of the following signals: voiceprint feature signals, semantic feature signals, and motion feature signals of objects outside the vehicle. A control module is configured to trigger the vehicle system to invoke the vehicle control rules when the biometric signal is detected to meet the response conditions of any activation state; when the in-vehicle object is determined to be a first object, the vehicle system controls the vehicle in a first control mode according to the vehicle control rules; and when the in-vehicle object is determined to be a second object, the vehicle system controls the vehicle in a second control mode according to the vehicle control rules; wherein the first control mode and the second control mode are different; the first control mode or the second control mode includes at least one of the following control modes: if the biometric signal outside the vehicle includes the motion feature signal, control the in-vehicle multimedia playback and control the motion feature signal to be displayed inside the vehicle; if the biometric signal outside the vehicle includes the voiceprint feature signal and / or semantic feature signal of the external object, control the in-vehicle multimedia to stop playback or reduce the playback volume, and play the voiceprint feature signal and / or semantic feature signal of the external object inside the vehicle.

6. An electronic device, characterized in that, include: At least one processor; And a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method for controlling a vehicle based on in-vehicle objects as described in any one of claims 1-4.

7. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the method for controlling a vehicle based on in-vehicle objects as described in any one of claims 1-4.

Images