A vehicle control method, a vehicle, and a terminal device

Abstract

The application is suitable for the technical field of vehicle control, and provides a vehicle control method, a vehicle and a terminal device. The method comprises the following steps: when it is detected that a person in the vehicle has a smoking behavior, if the weather condition of the environment where the vehicle is located is non-severe weather, and the vehicle speed is less than or equal to a first preset value, the emotional characteristics of the person in the vehicle are acquired; according to the emotional characteristics, the opening strategy of the vehicle window in the vehicle is determined; and according to the opening strategy, the action of the vehicle window is controlled. According to the application, when it is detected that a person in the vehicle has a smoking behavior, the opening strategy of the vehicle window is determined according to the emotional characteristics, and the action of the vehicle window does not need to be artificially controlled, so that the intelligent degree of the vehicle is improved.

Description

Technical Field

[0001] This application belongs to the field of vehicle control technology, and in particular relates to a vehicle control method, a vehicle, and a terminal device. Background Technology

[0002] When people are traveling in a car, they sometimes smoke to relieve fatigue. However, due to the small space inside the car, if the air cannot circulate, the air quality inside the car will become extremely poor. As time goes on, the oxygen concentration inside the car will decrease, which will not only affect the health of the people, but also slow down the driver's reaction and worsen their vision.

[0003] Currently, due to the low level of intelligence in vehicles, if someone smokes in the vehicle, they need to manually open the window to ensure air circulation and reduce the concentration of smoke inside. Summary of the Invention

[0004] This application provides a vehicle control method, a vehicle, and a terminal device, which can solve the problem of low vehicle intelligence.

[0005] In a first aspect, embodiments of this application provide a vehicle control method, including:

[0006] When smoking is detected in a vehicle, the emotional characteristics of the person in the vehicle are obtained.

[0007] Based on the emotional characteristics, a window opening strategy for the vehicle is determined, wherein the opening strategy includes the position of the window to be opened and a first opening value.

[0008] If the opening strategy includes a first window, the first window is controlled to move according to the opening strategy, wherein the first window is the window whose current opening value and the corresponding first opening value are different among the windows to be opened.

[0009] Secondly, embodiments of this application provide a vehicle, including:

[0010] The emotion feature acquisition module is used to acquire the emotion features of the people in the vehicle when smoking behavior is detected in the vehicle.

[0011] A window strategy determination module is used to determine the window opening strategy of the vehicle based on the emotional characteristics, wherein the opening strategy includes the position of the window to be opened and a first opening value.

[0012] A window adjustment module is used to control the action of a first window according to the opening strategy if a first window exists in the opening strategy, wherein the first window is a window whose current opening value and the corresponding first opening value are different among the windows to be opened.

[0013] Thirdly, embodiments of this application provide a terminal device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the vehicle control method described in any one of the first aspects above.

[0014] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the vehicle control method described in any one of the first aspects above.

[0015] Fifthly, embodiments of this application provide a computer program product that, when run on a terminal device, causes the terminal device to execute the vehicle control method described in any one of the first aspects.

[0016] The beneficial effects of the first aspect of this application compared to the prior art are as follows: when smoking behavior is detected in a vehicle, the emotional characteristics of the occupants are acquired; based on the emotional characteristics, a window opening strategy is determined; if a first window exists in the opening strategy, the action of the first window is controlled according to the opening strategy, wherein the first window is a window whose current opening value and corresponding first opening value are different among the windows to be opened. This application determines the window opening strategy based on emotional characteristics and automatically controls the window action when smoking behavior is detected in a vehicle, eliminating the need for manual window control and improving the vehicle's intelligence level.

[0017] It is understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a schematic diagram illustrating an application scenario of the vehicle control method provided in one embodiment of this application;

[0020] Figure 2 This is a schematic flowchart of a vehicle control method provided in an embodiment of this application;

[0021] Figure 3 This is a schematic flowchart of an air conditioning control method provided in another embodiment of this application;

[0022] Figure 4 This is a flowchart illustrating a method for determining emotional characteristics provided in an embodiment of this application;

[0023] Figure 5 This is a schematic diagram of the structure of a vehicle provided in one embodiment of this application;

[0024] Figure 6 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Detailed Implementation

[0025] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0026] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0027] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0028] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized.

[0029] Currently, most vehicle window adjustments are based on weather conditions: windows are closed in bad weather and opened in good weather. There's a lack of strategies for adjusting windows based on user needs, preventing vehicles from better serving passengers.

[0030] Furthermore, the inventors discovered that when people smoke in enclosed environments, the smell of smoke can easily cause emotional instability. Opening car windows to allow air circulation and reduce the concentration of smoke inside the vehicle when people are emotionally unstable can have a positive effect on mood regulation. Therefore, this application can determine the window opening strategy based on the emotional characteristics of the occupants, which not only improves the vehicle's intelligence but also allows the vehicle to better serve its occupants.

[0031] Figure 1 This is a schematic diagram illustrating an application scenario of the vehicle control method provided in this application embodiment. The vehicle control method can be used to control a vehicle. Specifically, an information acquisition device 10 in the vehicle acquires images inside the vehicle, and the in-vehicle host unit 20 determines whether any occupants are smoking based on these images. If the in-vehicle host unit 20 determines that occupants are smoking, it activates the negative ion function of the air conditioner and adjusts the air conditioner's circulation mode to external circulation mode. If the in-vehicle host unit 20 also determines that occupants are smoking, it can also acquire the vehicle speed detected by the speed sensor 30 and environmental information acquired by the environmental sensor 40. If the in-vehicle host unit 20 determines that the weather conditions in the vehicle's environment are not severe and that the vehicle speed is less than or equal to a first preset value, it determines the emotional characteristics of the occupants based on the image and / or video information acquired by the information acquisition device 10, and controls the window operation accordingly.

[0032] Information collection devices may include a driver monitoring system (DMS) and an occupant monitoring system (OMS). The DMS is used to collect information about the person in the driver's seat. The OMS is used to collect information about other occupants in the vehicle besides the person in the driver's seat.

[0033] The following combination Figure 1 The vehicle control method of this application embodiment will be described in detail. The method of this application can be implemented in the in-vehicle host 20.

[0034] Figure 2 A schematic flowchart of the vehicle control method provided in this application is shown, with reference to... Figure 2 The method is described in detail below:

[0035] S101, when smoking behavior is detected in a person in the vehicle, the emotional characteristics of the person in the vehicle are obtained.

[0036] In this embodiment, the presence of smoking is determined by detecting the concentration of carbon dioxide inside the vehicle. The carbon dioxide concentration can be detected by a sensor. If the concentration of carbon dioxide inside the vehicle is greater than a preset value, it is determined that someone in the vehicle is smoking. If the concentration of carbon dioxide inside the vehicle is less than or equal to the preset value, it is determined that no one in the vehicle is smoking. Alternatively, the presence of smoking can also be determined by image and / or video information collected by an in-vehicle information acquisition device. The image and / or video information collected by the information acquisition device is input into an image recognition network to determine whether someone in the vehicle is smoking.

[0037] In this embodiment, the act of smoking can be performed by the person in the driver's seat, the person in the passenger seat, or the person in the back seat.

[0038] In this embodiment, the emotional characteristics of the occupants in the vehicle can refer to the emotional characteristics of the occupant in the driver's seat. If there are multiple occupants in the vehicle, the emotional characteristics of the occupants can also be determined based on the emotions of all multiple occupants.

[0039] Emotional characteristics can include irritability, calmness, and happiness.

[0040] S102, based on the emotional characteristics, determine the opening strategy of the vehicle windows, wherein the opening strategy includes the position of the window to be opened and a first opening value.

[0041] In this embodiment, when the emotional characteristic is irritability, the window opening value can be set to a value within a first interval (e.g., 30%, 40%, etc.) to reduce irritability through air circulation. When the emotional characteristic is happiness, the window opening value is set to a value within a second interval (e.g., 10%, 5%, etc.). When the emotional characteristic is calm, the window opening value can be set to a value within a third interval (e.g., 20%, 25%, etc.). Vehicle windows can include door windows, body windows, and sunroofs. The maximum value in the third interval is less than the minimum value in the first interval. The maximum value in the second interval is less than the minimum value in the third interval.

[0042] For example, if the sunroof needs to be opened, the opening strategy includes the sunroof and the first opening value of the sunroof.

[0043] S103, if the opening strategy includes a first window, control the first window to move according to the opening strategy, wherein the first window is the window whose current opening value and the corresponding first opening value do not match among the windows to be opened.

[0044] In this embodiment, the current opening value of the window to be opened, which is included in the opening strategy, is obtained. If the current opening value of the window to be opened does not match the first opening value of the window set in the opening strategy, the window is recorded as the first window.

[0045] As a distance indicator, if the window to be opened included in the opening strategy is the sunroof, the initial opening value of the sunroof is 30%. If the current opening value of the sunroof is 20%, then the sunroof is determined to be the first sunroof, and it needs to be opened to 30%.

[0046] In this embodiment, when smoking is detected in a vehicle, the emotional characteristics of the occupants are acquired. Based on these emotional characteristics, a window opening strategy is determined. If a first window exists within the opening strategy, its operation is controlled according to the strategy. The first window is the window whose current opening value differs from the corresponding first opening value among the windows to be opened. This application determines the window opening strategy based on emotional characteristics when smoking is detected in a vehicle, eliminating the need for manual window control and improving vehicle automation. Simultaneously, opening the window alleviates the emotional distress of the occupants. Furthermore, determining the opening strategy based on emotional characteristics makes vehicle control more aligned with the needs of the occupants, enhancing the correlation between the occupants and the vehicle.

[0047] In one possible implementation, before obtaining the emotional characteristics of the people in the vehicle in step S101, the method may further include:

[0048] If it is determined that the weather conditions at the location of the vehicle are not severe, and / or if it is determined that the vehicle speed is less than or equal to a first preset value.

[0049] In this embodiment, when smoking is detected in a person in a vehicle, if the weather conditions at the location of the vehicle are not severe and / or the vehicle speed is less than or equal to a first preset value, the emotional characteristics of the person in the vehicle are obtained.

[0050] Optionally, when smoking is detected in a person in the vehicle, if the weather conditions at the vehicle's location are determined to be non-severe, the emotional characteristics of the person in the vehicle can be obtained.

[0051] When smoking is detected in a vehicle, if the vehicle speed is determined to be less than or equal to a first preset value, the emotional characteristics of the person in the vehicle are obtained.

[0052] When smoking is detected in a vehicle, if the weather conditions at the vehicle's location are determined to be non-severe and the vehicle's speed is less than or equal to a first preset value, then the emotional characteristics of the occupants in the vehicle are acquired. Specifically, the weather conditions can be acquired first, followed by the vehicle speed; the vehicle speed can be acquired first, followed by the weather conditions; or both weather conditions and vehicle speed can be acquired simultaneously.

[0053] In this embodiment, severe weather may include rain, snow, low temperatures, high temperatures, sandstorms, and smog. Weather conditions at the vehicle's location can be obtained from a cloud server, which stores weather forecasts. The vehicle sends its location to the cloud server, which then determines the weather conditions based on that location. Alternatively, weather conditions can be determined by combining information from the vehicle's external environment collected by its onboard data acquisition devices, as well as sensor data from temperature and humidity sensors.

[0054] In this embodiment, the vehicle speed can be detected by a speed sensor. The first preset value can be set as needed, for example, the first preset value can be set to 60 km / h, 80 km / h, etc.

[0055] like Figure 3 As shown, in one possible implementation, when smoking is detected in a person inside the vehicle, the method may further include:

[0056] S201, Obtain the first state of the air conditioner in the vehicle, the first state including the on / off state of the negative ion function and the circulation mode.

[0057] In this embodiment, the first state of the air conditioner refers to the state of the air conditioner at the current time. If the air conditioner is not turned on, the negative ion function of the air conditioner is turned off, and the circulation mode is "empty".

[0058] Loop modes can include outer loop mode, inner loop mode, automatic mode, and "empty" mode.

[0059] Negative ions are negatively charged oxygen ions, colorless and odorless. They are produced when air molecules are ionized under high pressure or strong radiation, and most of the free electrons are captured by oxygen. Therefore, negative air ions are often collectively referred to as "negative oxygen ions." Adding a negative ion generator to an air conditioner is primarily used to purify the air.

[0060] S202, if the negative ion function is off, turn on the negative ion function of the air conditioner.

[0061] In this embodiment, whether the negative ion function is turned on can be determined by the negative ion function activation button on the vehicle. If the negative ion function activation button is pressed, the negative ion function is turned on; if the negative ion function activation button is in the initial state, the negative ion function is turned off.

[0062] Specifically, if the negative ion function is in the off state, a first command is sent to the air conditioner, which is used to instruct the air conditioner to turn on the negative ion function.

[0063] S203, if the air conditioner's circulation mode is not external circulation mode, control the air conditioner to switch to external circulation mode.

[0064] In this embodiment of the application, when smoking is detected in the vehicle, the air conditioner is switched to external circulation mode and the negative ion function is activated to accelerate the purification of the air inside the vehicle and eliminate the smoke as quickly as possible.

[0065] In one possible implementation, when smoking is detected in a person in a vehicle, steps S201 to S203 can be executed first, and then the weather conditions and / or speed can be determined, and steps S101 to S103 can be executed.

[0066] In one possible implementation, when smoking is detected in a person in the vehicle, the weather conditions at the vehicle's location are obtained; if the weather conditions are severe, steps S201 to S203 are executed.

[0067] If the weather conditions are not severe, obtain the vehicle's speed.

[0068] If the vehicle speed is greater than the first preset value, proceed with steps S201 to S203.

[0069] If the vehicle speed is less than or equal to the first preset value, the processes of steps S201 to S203 and steps S101 to S103 are executed.

[0070] In one possible implementation, when smoking is detected in a person in the vehicle, the vehicle speed is obtained; if the vehicle speed is greater than a first preset value, steps S201 to S203 are executed.

[0071] If the vehicle speed is less than or equal to the first preset value, obtain the weather conditions.

[0072] If the weather conditions are severe, proceed with steps S201 to S203.

[0073] If the weather conditions are not severe, proceed with steps S201 to S203, and steps S101 to S103.

[0074] In one possible implementation, prior to step 102, the method may further include:

[0075] Obtain the location of the person who committed the smoking behavior.

[0076] Correspondingly, the implementation process of step S102 may include:

[0077] Based on the emotional characteristics and the location of the person performing the smoking behavior, the window opening strategy of the vehicle is determined.

[0078] In this embodiment, the location of the person smoking can be determined by image and / or video information collected by the information acquisition device. The car windows to be opened in the opening strategy include the windows closest to the person smoking.

[0079] By consulting a reference table, you can determine the window number or location closest to the person who smoked. The reference table is a pre-set table that stores the window number or location corresponding to each seat in the vehicle.

[0080] In one possible implementation, if the emotional characteristic is irritability and the smoking behavior is performed by the person in the driver's seat of the vehicle, the opening strategy includes: the first opening value of the window corresponding to the driver's seat is a second preset value, the first opening value of the second window is a second preset value, and the first opening value of the sunroof is a third preset value. The second window is at least one window on the passenger side, excluding the window corresponding to the passenger seat. The window corresponding to the driver's seat is the foremost window on the driver's side. The window corresponding to the passenger seat is the foremost window on the passenger side.

[0081] In this embodiment, when a person in the driver's seat smokes, opening the window corresponding to the driver's seat and the second window can improve air circulation inside the vehicle and allow the smoke to be expelled from the vehicle as quickly as possible.

[0082] Correspondingly, before step S102, the above method may further include:

[0083] If the current opening value of the window corresponding to the driver's position is less than the second preset value, it is determined that the current opening value of the window corresponding to the driver's position does not match the first opening value of the window corresponding to the driver's position included in the opening strategy, and then the first window includes the window corresponding to the driver's position.

[0084] In this embodiment, if the current opening value of the window corresponding to the driver's position is greater than the second preset value, it can be considered that the current opening value of the window corresponding to the driver's position matches or does not match the first opening value of the window corresponding to the driver's position included in the opening strategy, and can be set as needed.

[0085] If the current opening value of the second window is less than the second preset value, it is determined that the current opening value of the second window does not match the first opening value of the second window included in the opening strategy, and then the first window includes the second window.

[0086] In this embodiment, the current opening value of the second window is greater than the second preset value. The current opening value of the second window may or may not match the first opening value of the second window included in the opening strategy, and can be set as needed.

[0087] If the current opening value of the sunroof is less than the third preset value, it is determined that the current opening value of the sunroof does not match the first opening value of the sunroof included in the opening strategy, and then the first vehicle window includes the sunroof.

[0088] In this embodiment, the current opening value of the sunroof is greater than the third preset value. The current opening value of the sunroof may or may not match the first opening value of the sunroof included in the opening strategy, and can be set as needed.

[0089] In one possible implementation, if the emotional characteristic is calm and the smoking behavior is performed by the person in the driver's seat of the vehicle, the opening strategy includes: the first opening value of the window corresponding to the driver's seat is a fourth preset value, the first opening value of the second window is the fourth preset value, and the first opening value of the sunroof is a fifth preset value, wherein the fourth preset value is less than the second preset value, and the fifth preset value is less than the third preset value.

[0090] In this embodiment, when the emotional characteristic is calm, the degree to which the car window is opened can be less than when the emotional characteristic is agitated.

[0091] Correspondingly, before step S102, the above method may further include:

[0092] If the current opening value of the window corresponding to the driver's position is less than the fourth preset value, it is determined that the current opening value of the window corresponding to the driver's position does not match the first opening value of the window corresponding to the driver's position included in the opening strategy, and then the first window includes the window corresponding to the driver's position.

[0093] In this embodiment, if the current opening value of the window corresponding to the driver's position is greater than the fourth preset value, the current opening value of the window corresponding to the driver's position may or may not match the first opening value of the window corresponding to the driver's position included in the opening strategy, and can be set as needed.

[0094] If the current opening value of the second window is less than the fourth preset value, it is determined that the current opening value of the second window does not match the first opening value of the second window included in the opening strategy, then the first window includes the second window.

[0095] In this embodiment, the current opening value of the second window is greater than the fourth preset value. The current opening value of the second window may or may not match the first opening value of the second window included in the opening strategy, and can be set as needed.

[0096] If the current opening value of the sunroof is less than the fifth preset value, it is determined that the current opening value of the sunroof does not match the first opening value of the sunroof included in the opening strategy, and then the first vehicle window includes the sunroof.

[0097] In this embodiment, the current opening value of the sunroof is greater than the fifth preset value. The current opening value of the sunroof may or may not match the first opening value of the sunroof included in the opening strategy, and can be set as needed.

[0098] In one possible implementation, if the emotional characteristic is happiness and the smoking behavior is performed by the person in the driver's seat of the vehicle, the opening strategy includes: the first opening value of the window corresponding to the driver's seat is a sixth preset value, the first opening value of the second window is the sixth preset value, and the first opening value of the sunroof is a seventh preset value, wherein the sixth preset value is less than the fourth preset value, and the seventh preset value is less than the fifth preset value.

[0099] In this embodiment, when the emotional characteristic is happy, the degree to which the car window is opened can be less than when the emotional characteristic is calm.

[0100] Correspondingly, before step S102, the above method may further include:

[0101] If the current opening value of the window corresponding to the driver's position is less than the sixth preset value, it is determined that the current opening value of the window corresponding to the driver's position does not match the first opening value of the window corresponding to the driver's position included in the opening strategy, and then the first window includes the window corresponding to the driver's position.

[0102] In this embodiment, if the current opening value of the window corresponding to the driver's position is greater than the sixth preset value, the current opening value of the window corresponding to the driver's position may or may not match the first opening value of the window corresponding to the driver's position included in the opening strategy, and can be set as needed.

[0103] If the current opening value of the second window is less than the sixth preset value, it is determined that the current opening value of the second window does not match the first opening value of the second window included in the opening strategy, then the first window includes the second window.

[0104] In this embodiment, the current opening value of the second window is greater than the sixth preset value. The current opening value of the second window may or may not match the first opening value of the second window included in the opening strategy, and can be set as needed.

[0105] If the current opening value of the sunroof is less than the seventh preset value, it is determined that the current opening value of the sunroof does not match the first opening value of the sunroof included in the opening strategy, and then the first vehicle window includes the sunroof.

[0106] In this embodiment, the current opening value of the sunroof is greater than the seventh preset value. The current opening value of the sunroof may or may not match the first opening value of the sunroof included in the opening strategy, and can be set as needed.

[0107] In one possible implementation, if the emotional characteristic is irritability and the smoking behavior is performed by a person in the passenger seat of the vehicle, the opening strategy includes: a first opening value of a window corresponding to the passenger seat being a second preset value, a first opening value of a third window being a second preset value, and a first opening value of a sunroof being a third preset value. The third window is at least one window on the driver's side, excluding the window corresponding to the driver's seat.

[0108] In one possible implementation, if the emotional characteristic is calm and the smoking behavior is performed by a person in the passenger seat of the vehicle, the opening strategy includes: the first opening value of the window corresponding to the passenger seat is a fourth preset value, the first opening value of the third window is the fourth preset value, and the first opening value of the sunroof is a fifth preset value.

[0109] In one possible implementation, if the emotional characteristic is happiness and the smoking behavior is performed by a person in the passenger seat of the vehicle, the opening strategy includes: the first opening value of the window corresponding to the passenger seat is a sixth preset value, the first opening value of the third window is the sixth preset value, and the first opening value of the sunroof is a seventh preset value.

[0110] The methods for determining whether the current opening value of the window corresponding to the passenger seat matches the opening strategy, as well as the method for determining the third window, can refer to the method for determining the window corresponding to the driver's seat, and will not be repeated here.

[0111] In one possible implementation, if the emotional characteristic is irritability and the smoking behavior is performed by a person in a first position in the rear seat of the vehicle, the opening strategy includes: the first opening value of the window corresponding to the first position is a second preset value and the first opening value of the skylight is a third preset value.

[0112] Additionally, if the emotional characteristic is irritability and the smoking behavior is performed by a person in the first position in the rear seat of the vehicle, the opening strategy may further include: the first opening value of the fourth window is a second preset value. If the first position is on the driver's side of the vehicle, the fourth window is at least one window on the passenger side, excluding the window corresponding to the passenger seat. If the first position is on the passenger side of the vehicle, the fourth window is at least one window on the driver's side, excluding the window corresponding to the passenger seat.

[0113] In one possible implementation, if the emotional characteristic is calm or happy, and the smoking behavior is performed by the person in the first position in the back seat of the vehicle, the activation strategy can be set with reference to the activation strategy when the emotional characteristic is irritable, which will not be elaborated here.

[0114] like Figure 4 As shown, in one possible implementation, the process of step S101 may include:

[0115] S1011, determine the emotional value of the person in the vehicle based on the image information and / or video information collected by the information collection device installed in the vehicle.

[0116] Specifically, image and / or video information is input into a first neural network. By analyzing facial expressions, a first emotion value is determined for each person in the vehicle. The average of these first emotion values ​​is calculated to obtain the overall emotion value of each person in the vehicle.

[0117] Specifically, image and / or video information is input into a second neural network to determine the emotional value of the person in the driver's seat. The emotional value of the person in the driver's seat represents the emotional value of all occupants in the vehicle. Specifically, image information of the person in the driver's seat is determined using a digital signal processing system (DMS) to determine their emotional value.

[0118] Specifically, image and / or video information is input into a third neural network to determine the emotional values ​​of passengers (excluding the person in the driver's seat) in the vehicle. The emotional values ​​of all occupants in the vehicle are then determined based on the passengers' emotional values. Specifically, image information of passengers is obtained through Optical Motion Analysis (OMS) to determine their emotional values.

[0119] S1012, Determine the emotional characteristics of the person based on the emotional range in which the emotional value is located, wherein different emotional ranges correspond to different emotional characteristics.

[0120] In this embodiment, by analyzing the image information collected by the information acquisition device, the emotional characteristics of the person can be clearly and quickly determined, thereby preparing for the subsequent determination of the activation strategy based on the emotional characteristics.

[0121] For example, there are three emotion ranges: [0, 0.3], (0.3, 0.6], and (0.6, 1]. [0, 0.3] corresponds to happiness, (0.3, 0.6] to calmness, and (0.6, 1] to irritability. If the current emotion value is 0.5, the person's emotion is calm. If the current emotion value is 0.7, the person's emotion is irritability. In one possible implementation, when smoking is detected in the vehicle, before adjusting the windows and air conditioning, the current state of the air conditioning (first state) and the state of the windows (current opening value) need to be memorized so that when the smoking stops, the windows and air conditioning can be restored to their previous states.

[0122] Specifically, after step S103, the above method may further include:

[0123] S301, after determining that no one in the vehicle is smoking, turn off the negative ion function of the air conditioner and switch the air conditioner to the circulation mode of the first state.

[0124] In this embodiment, the presence of smoking behavior by occupants in a vehicle can be determined based on the image information collected by the information collection device.

[0125] In this embodiment, since the negative ion function of the air conditioner is turned off before the smoking behavior begins, the negative ion function of the air conditioner can be turned off after the smoking behavior stops.

[0126] If the air conditioner's recirculation mode was "empty" before the smoking started, you can turn it off after the smoking stopped. If the air conditioner's recirculation mode was "internal circulation" before the smoking started, switch the air conditioner's recirculation mode from "external circulation" to "internal circulation" after the smoking stopped.

[0127] For example, if the DMS returns no smoking behavior but the OMS does not return smoking behavior, it is determined that the person in the vehicle is not engaging in the smoking behavior. Alternatively, if the DMS returns no smoking behavior but the OMS returns smoking behavior, continue monitoring the OMS until it returns "stop smoking," then it is determined that the person in the vehicle is not engaging in the smoking behavior.

[0128] S302, control the first window to adjust to a second opening value, wherein the second opening value is the opening value of the first window before it is adjusted according to the opening strategy.

[0129] In this embodiment, after determining that no one in the vehicle is smoking, a prompt message can be displayed on the screen to indicate that the smoking mode has been exited; or, a text-to-speech (TTS) announcement can be made to indicate that the smoking mode has been exited.

[0130] Additionally, after the prompt indicates that the smoking mode has been exited, if a "hold" command is received, the windows and air conditioning can remain in their current state without reverting to their previous settings; if a "reset" command is received, the windows and air conditioning can be restored to their previous settings.

[0131] In this embodiment, when there is no smoking behavior in the vehicle, the air conditioning and windows in the vehicle can be restored to their previous unadjusted state so that the vehicle settings can continue to be set according to the previous settings, without the need for the personnel to adjust the windows and air conditioning themselves, thereby improving the automation level of the vehicle.

[0132] In one possible implementation, prior to step S101, the method may further include:

[0133] Upon receiving the first signal from the information collection device, which indicates that a person in the vehicle has taken a cigarette, the display screen will show the signal or the TTS (Traffic Response System) will broadcast a "first reminder message" to remind the person to pay attention to driving safety. For example, the first reminder message could be "Please do not smoke while driving, pay attention to driving safety." Specifically, the action of taking a cigarette can be detected by either the DMS (Distributed Motion System) or the OMS (Operational Motion System).

[0134] After receiving the second signal sent by the information collection device, the second signal is used to characterize the presence of a person in the vehicle lighting a cigarette, thus confirming that the person in the vehicle is smoking.

[0135] The display screen shows or the TTS (Text-to-Speech) system reads out a "second prompt message," which asks the user whether to activate the smoking mode. For example, the second prompt message could be, "We have detected that you are smoking. Would you like to activate the smoking mode for you?"

[0136] Upon receiving the third signal, the smoking mode is activated, and steps S101 to S103 and steps S201 to S203 are executed as described above.

[0137] The third signal can be generated by manually clicking the first button (OK), or by recognizing a gesture (OK), or by responding to a person's voice.

[0138] Upon receiving the fourth signal, the smoking mode is not activated, and steps S101 to S103 and steps S201 to S203 are not executed.

[0139] The fourth signal can be generated by manually clicking the second button (cancel), or by gesture recognition, or by a person's voice response.

[0140] Optionally, the method for determining smoking behavior in this application can also be performed on a cloud platform (server). The in-vehicle host transmits the image and / or video information collected by the information collection device to the cloud platform via the in-vehicle wireless terminal (Telematics Box, T-BOX). The cloud platform analyzes the image and / or video information to determine that the current scenario of the vehicle is smoking behavior, and sends the corresponding vehicle control policy to the in-vehicle host.

[0141] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0142] Corresponding to the vehicle control method described in the above embodiments, Figure 5 A structural block diagram of a vehicle provided in an embodiment of this application is shown. For ease of explanation, only the parts related to the embodiment of this application are shown.

[0143] Reference Figure 5 The vehicle 400 may include: an emotion feature acquisition module 410, a window strategy determination module 420, and a window adjustment module 430.

[0144] The emotion feature acquisition module 410 is used to acquire the emotion features of the people in the vehicle when smoking behavior is detected in the vehicle.

[0145] The window strategy determination module 420 is used to determine the window opening strategy of the vehicle based on the emotional characteristics, wherein the opening strategy includes the position of the window to be opened and a first opening value.

[0146] The window adjustment module 430 is used to control the action of the first window according to the opening strategy if there is a first window in the opening strategy, wherein the first window is the window whose current opening value and the corresponding first opening value are different among the windows to be opened.

[0147] In one possible implementation, the emotion feature acquisition module 410 may further be used before acquiring the emotion features of the people in the vehicle:

[0148] The weather conditions at the location of the vehicle are determined to be non-severe weather, and / or the vehicle speed is determined to be less than or equal to a first preset value.

[0149] In one possible implementation, the device 400 further includes:

[0150] The status acquisition module is used to acquire the first status of the air conditioner in the vehicle, the first status including the on / off status of the negative ion function and the circulation mode.

[0151] The first control module is used to turn on the negative ion function of the air conditioner if the negative ion function is in a closed state.

[0152] The second control module is used to control the air conditioner to switch to the external circulation mode if the air conditioner's circulation mode is not the external circulation mode.

[0153] In one possible implementation, the following components are also connected to the window strategy determination module 420:

[0154] A location determination module is used to obtain the location of the person who committed the smoking behavior;

[0155] Accordingly, the window strategy determination module 420 can be specifically used for:

[0156] Based on the emotional characteristics and the location of the person performing the smoking behavior, the window opening strategy of the vehicle is determined.

[0157] In one possible implementation, if the emotional characteristic is irritability and the smoking behavior is performed by the person in the driver's seat of the vehicle, the opening strategy includes: the first opening value of the window corresponding to the driver's seat is a second preset value, the first opening value of the second window is the second preset value, and the first opening value of the sunroof is a third preset value, wherein the second window is at least one window on the passenger side other than the window corresponding to the passenger seat, and the first opening value includes the second preset value and the third preset value;

[0158] Correspondingly, the window strategy determination module 420 is also connected to a judgment module, which can be specifically used for:

[0159] If the current opening value of the window corresponding to the driver's position is less than the second preset value, it is determined that the current opening value of the window corresponding to the driver's position does not match the first opening value of the window corresponding to the driver's position included in the opening strategy, and then the first window includes the window corresponding to the driver's position.

[0160] If the current opening value of the second window is less than the second preset value, it is determined that the current opening value of the second window does not match the first opening value of the second window included in the opening strategy, then the first window includes the second window;

[0161] If the current opening value of the sunroof is less than the third preset value, it is determined that the current opening value of the sunroof does not match the first opening value of the sunroof included in the opening strategy, and then the first vehicle window includes the sunroof.

[0162] In one possible implementation, if the emotional characteristic is calm and the smoking behavior is performed by the person in the driver's seat of the vehicle, the opening strategy includes: the first opening value of the window corresponding to the driver's seat is a fourth preset value, the first opening value of the second window is the fourth preset value, and the first opening value of the sunroof is a fifth preset value, wherein the fourth preset value is less than the second preset value, the fifth preset value is less than the third preset value, and the first opening value includes the fourth preset value and the fifth preset value;

[0163] Accordingly, the judgment module can be specifically used for:

[0164] If the current opening value of the window corresponding to the driver's position is less than the fourth preset value, it is determined that the current opening value of the window corresponding to the driver's position does not match the first opening value of the window corresponding to the driver's position included in the opening strategy, and then the first window includes the window corresponding to the driver's position.

[0165] If the current opening value of the second window is less than the fourth preset value, it is determined that the current opening value of the second window does not match the first opening value of the second window included in the opening strategy, then the first window includes the second window;

[0166] If the current opening value of the sunroof is less than the fifth preset value, it is determined that the current opening value of the sunroof does not match the first opening value of the sunroof included in the opening strategy, and then the first vehicle window includes the sunroof.

[0167] In one possible implementation, the emotion feature acquisition module 410 can specifically be used for:

[0168] The emotional state of the people in the vehicle is determined based on the image and / or video information collected by the information collection device installed in the vehicle.

[0169] The emotional characteristics of the person are determined based on the emotional range in which the emotional value is located, wherein different emotional ranges correspond to different emotional characteristics.

[0170] In one possible implementation, the following also includes components connected to the window adjustment module 430:

[0171] The third control module is used to turn off the negative ion function of the air conditioner and switch the air conditioner to the circulation mode of the first state after determining that no one in the vehicle is smoking.

[0172] The fourth control module is used to control the first window to adjust to a second opening value, wherein the second opening value is the opening value of the first window before it is adjusted according to the opening strategy.

[0173] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0174] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0175] This application also provides a terminal device, see [link to relevant documentation] Figure 6 The terminal device 500 may include: at least one processor 510, a memory 520, and a computer program stored in the memory 520 and executable on the at least one processor 510. When the processor 510 executes the computer program, it implements the steps in any of the above method embodiments, for example... Figure 2 Steps S101 to S103 in the illustrated embodiment. Alternatively, when the processor 510 executes the computer program, it implements the functions of each module / unit in the above vehicle embodiments, for example... Figure 5 The functions of modules 410 to 430 are shown.

[0176] For example, a computer program may be divided into one or more modules / units, one or more of which are stored in memory 520 and executed by processor 510 to complete this application. The one or more modules / units may be a series of computer program segments capable of performing specific functions, which describe the execution process of the computer program in terminal device 500.

[0177] Those skilled in the art will understand that Figure 6 This is merely an example of a terminal device and does not constitute a limitation on the terminal device. It may include more or fewer components than shown, or combine certain components, or different components, such as input / output devices, network access devices, buses, etc.

[0178] The processor 510 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0179] The memory 520 can be an internal storage unit of the terminal device or an external storage device, such as a plug-in hard drive, a smart media card (SMC), a secure digital card (SD), or a flash card. The memory 520 is used to store the computer program and other programs and data required by the terminal device. The memory 520 can also be used to temporarily store data that has been output or will be output.

[0180] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0181] The vehicle control method provided in this application can be applied to terminal devices such as computers, tablets, laptops, netbooks, and personal digital assistants (PDAs). This application does not impose any restrictions on the specific type of terminal device.

[0182] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0183] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0184] In the embodiments provided in this application, it should be understood that the disclosed terminal devices, apparatuses, and methods can be implemented in other ways. For example, the terminal device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, apparatuses, or units, and may be electrical, mechanical, or other forms.

[0185] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0186] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0187] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by one or more processors, it can implement the steps of the various method embodiments described above.

[0188] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by one or more processors, it can implement the steps of the various method embodiments described above.

[0189] Similarly, as a computer program product, when the computer program product is run on a terminal device, it enables the terminal device to implement the steps in the above-described method embodiments.

[0190] The computer program includes computer program code, which can be in the form of source code, object code, executable file, or some intermediate form. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media may not include electrical carrier signals and telecommunication signals.

[0191] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A vehicle control method, characterized in that, include: When smoking is detected in a vehicle, the emotional characteristics of the person in the vehicle are obtained, including irritability, calmness, and happiness. Obtain the location of the person who committed the smoking act; Based on the emotional characteristics and the location of the person performing the smoking behavior, a window opening strategy for the vehicle is determined. The opening strategy includes the location of the window to be opened and a first opening value. When the emotional characteristic is agitation, the first opening value of the window is set to an opening value within a first interval. When the emotional characteristic is happiness, the first opening value of the window is set to an opening value within a second interval. When the emotional characteristic is calm, the first opening value of the window is set to an opening value within a third interval. The maximum value of the third interval is less than the minimum value of the first interval, and the maximum value of the second interval is less than the minimum value of the third interval. If the opening strategy includes a first window, the first window is controlled to move according to the opening strategy, wherein the first window is the window whose current opening value does not match the corresponding first opening value among the windows to be opened.

2. The vehicle control method as described in claim 1, characterized in that, Before acquiring the emotional characteristics of the occupants in the vehicle, the method further includes: The weather conditions at the location of the vehicle are determined to be non-severe weather, and / or the vehicle speed is determined to be less than or equal to a first preset value.

3. The vehicle control method as described in claim 1, characterized in that, When smoking is detected in a person in a vehicle, the method further includes: The first state of the air conditioning in the vehicle is obtained, and the first state includes the on / off state of the negative ion function and the circulation mode. If the negative ion function is off, turn on the negative ion function of the air conditioner; If the air conditioner's circulation mode is not external circulation mode, control the air conditioner to switch to external circulation mode.

4. The vehicle control method as described in claim 1, characterized in that, If the emotional characteristic is irritability and the smoking behavior is performed by the person in the driver's seat of the vehicle, the opening strategy includes: the first opening value of the window corresponding to the driver's seat is a second preset value, the first opening value of the second window is a second preset value and the first opening value of the sunroof is a third preset value, wherein the second window is at least one window on the passenger side of the vehicle other than the window corresponding to the passenger seat. Accordingly, after determining the vehicle window opening strategy based on the emotional characteristics and the location of the person performing the smoking behavior, the method further includes: If the current opening value of the window corresponding to the driver's position is less than the second preset value, it is determined that the current opening value of the window corresponding to the driver's position does not match the first opening value of the window corresponding to the driver's position included in the opening strategy, and then the first window includes the window corresponding to the driver's position. If the current opening value of the second window is less than the second preset value, it is determined that the current opening value of the second window does not match the first opening value of the second window included in the opening strategy, then the first window includes the second window; If the current opening value of the sunroof is less than the third preset value, it is determined that the current opening value of the sunroof does not match the first opening value of the sunroof included in the opening strategy, and then the first vehicle window includes the sunroof.

5. The vehicle control method as described in claim 4, characterized in that, If the emotional characteristic is calm and the smoking behavior is performed by the person in the driver's seat of the vehicle, the opening strategy includes: the first opening value of the window corresponding to the driver's seat is a fourth preset value, the first opening value of the second window is the fourth preset value, and the first opening value of the sunroof is a fifth preset value, wherein the fourth preset value is less than the second preset value, and the fifth preset value is less than the third preset value; Accordingly, after determining the vehicle window opening strategy based on the emotional characteristics and the location of the person performing the smoking behavior, the method further includes: If the current opening value of the window corresponding to the driver's position is less than the fourth preset value, it is determined that the current opening value of the window corresponding to the driver's position does not match the first opening value of the window corresponding to the driver's position included in the opening strategy, and then the first window includes the window corresponding to the driver's position. If the current opening value of the second window is less than the fourth preset value, it is determined that the current opening value of the second window does not match the first opening value of the second window included in the opening strategy, then the first window includes the second window; If the current opening value of the sunroof is less than the fifth preset value, it is determined that the current opening value of the sunroof does not match the first opening value of the sunroof included in the opening strategy, and then the first vehicle window includes the sunroof.

6. The vehicle control method according to any one of claims 1 to 3, characterized in that, The acquisition of the emotional characteristics of the people in the vehicle includes: The emotional state of the people in the vehicle is determined based on the image and / or video information collected by the information collection device installed in the vehicle. The emotional characteristics of the person are determined based on the emotional range in which the emotional value is located, wherein different emotional ranges correspond to different emotional characteristics.

7. The vehicle control method as described in claim 3, characterized in that, After controlling the action of the first window according to the opening strategy, the method further includes: After confirming that no one in the vehicle is smoking, the negative ion function of the air conditioner is turned off, and the air conditioner is switched to the circulation mode of the first state. Control the first window to adjust to a second opening value, wherein the second opening value is the opening value of the first window before it is adjusted according to the opening strategy.

8. A vehicle, characterized in that, include: An emotion feature acquisition module is used to acquire the emotion features of the people in the vehicle when smoking behavior is detected in the vehicle. The emotion features include irritability, calmness, and happiness. A location determination module is used to obtain the location of the person who committed the smoking behavior; A window strategy determination module is used to determine the window opening strategy of the vehicle based on the emotional characteristics and the location of the person performing the smoking behavior. The opening strategy includes the location of the window to be opened and a first opening value. When the emotional characteristic is agitation, the first opening value of the window is set to an opening value within a first interval; when the emotional characteristic is happiness, the first opening value of the window is set to an opening value within a second interval; when the emotional characteristic is calm, the first opening value of the window is set to an opening value within a third interval. The maximum value of the third interval is less than the minimum value of the first interval, and the maximum value of the second interval is less than the minimum value of the third interval. A window adjustment module is used to control the action of a first window according to the opening strategy if a first window exists in the opening strategy, wherein the first window is a window whose current opening value and the corresponding first opening value are different among the windows to be opened.

9. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the vehicle control method as described in any one of claims 1 to 7.

Images