Method and device for vehicle to execute preset operation and electronic equipment

Abstract

The invention relates to the technical field of automobiles, in particular to a method and device for a vehicle to execute preset operation and electronic equipment, and aims to solve the problem of how to prevent the vehicle from continuing to execute the preset operation when a human body is left in the vehicle. The method comprises the following steps: acquiring target information; wherein the target information comprises an actual in-cabin image acquired by a member monitoring system in the cabin and pressure information acquired by at least one safety belt reminding device in the cabin; detecting the target information according to a preset condition to obtain a detection result; under the condition that the detection result is that the target information meets the first condition of the preset condition, executing preset operation; wherein the first condition includes that a human body is not recognized in the actual in-cabin image, pressure numerical values in the pressure information are all smaller than a pressure threshold value, and the preset operation includes at least one of control over locking of a vehicle lock and control over power failure of the vehicle.

Description

Technical Field

[0001] The present disclosure relates to the field of automobile technology, and in particular to a method, device, and electronic device for executing a preset operation on a vehicle. Background Art

[0002] Currently, more and more vehicles support preset operations, such as automatic locking and automatic power off. Automatic locking means the vehicle automatically locks after the driver leaves the vehicle. If the driver fails to promptly detect that someone has been left inside the vehicle, the vehicle locks and locks after the driver leaves the vehicle. This could cause the person to suffer from hypoxia. Furthermore, automatic power off means the vehicle automatically cuts off the power supply to the cabin after locking the vehicle. If someone remains inside, this could also cause hypoxia.

[0003] Therefore, how to prevent the vehicle from continuing to perform preset operations when there is a human body left in the vehicle has become an urgent problem to be solved. Summary of the Invention

[0004] In order to solve the above technical problems, the present disclosure provides a method, device and electronic device for a vehicle to perform a preset operation.

[0005] To achieve the above objectives, the present disclosure adopts the following technical solutions:

[0006] In a first aspect, the present disclosure provides a method for a vehicle to perform a preset operation, comprising: obtaining target information; wherein the target information includes an actual in-cabin image collected by an in-cabin occupant monitoring system and pressure information collected by at least one seat belt reminder device in the cabin; detecting the target information according to preset conditions to obtain a detection result; when the detection result is that the target information meets a first condition of the preset conditions, performing a preset operation; wherein the first condition includes that no human body is recognized in the actual in-cabin image, and the pressure values ​​in the pressure information are all less than a pressure threshold, and the preset operation includes at least one of controlling the vehicle lock to lock and controlling the vehicle to power off.

[0007] In some feasible examples, the target information also includes: linkage setting information of the child seat; the preset condition also includes a second condition, the second condition including that when the linkage setting information is used to indicate that a child seat has been placed in the cabin, no human body is recognized in the actual cabin image, and there is a pressure value greater than or equal to the pressure threshold; the target information is detected according to the preset condition to obtain a detection result, including: when the linkage setting information is used to indicate that a child seat has been placed in the cabin, human body detection is performed on the actual cabin image to obtain a first result; when the linkage setting information is used to indicate that a child seat has been placed in the cabin, the pressure value in the pressure information is compared with the pressure threshold to obtain a second result; based on the first result and the second result, the first result and the second result are used as detection results; the method for a vehicle to perform a preset operation provided by an embodiment of the present disclosure also includes: when the first result in the detection result is that no human body is recognized in the actual cabin image, and the second result in the detection result is that there is a pressure value greater than or equal to the pressure threshold, determining that the target information meets the second condition and performing the preset operation.

[0008] In some feasible examples, the target information is detected according to preset conditions to obtain detection results, including: performing human body detection on the actual in-cabin image to obtain a third result; comparing the pressure value in the pressure information with the pressure threshold to obtain a fourth result; based on the third result and the fourth result, taking the third result and the fourth result as the detection results; the method for the vehicle to perform preset operations provided by the embodiment of the present disclosure also includes: when the third result in the detection result is that a human body is recognized in the actual in-cabin image, and the fourth result in the detection result is that there is a pressure value greater than or equal to the pressure threshold, generating a prompt message; wherein the prompt message is used to indicate that there is a human body in the cabin.

[0009] In some feasible examples, the method for a vehicle to perform a preset operation provided by an embodiment of the present disclosure also includes: generating a prompt message when the third result in the detection result is that a human body is recognized in the actual cabin image, and the fourth result in the detection result is that the pressure values ​​in the pressure information are all less than the pressure threshold.

[0010] In some feasible examples, the target information is detected according to preset conditions to obtain detection results, including: when the linkage setting information is used to indicate that no child seat is placed in the cabin, human body detection is performed on the actual cabin image to obtain a fifth result; when the linkage setting information is used to indicate that no child seat is placed in the cabin, the pressure value in the pressure information is compared with the pressure threshold to obtain a sixth result; based on the fifth result and the sixth result, the fifth result and the sixth result are used as detection results; the method for the vehicle to perform preset operations provided by the embodiment of the present disclosure also includes: when the fifth result in the detection result is that no human body is recognized in the actual cabin image, and the sixth result in the detection result is that the pressure value in the pressure information is greater than or equal to the pressure threshold, it is determined that the target information does not meet the second condition, and a prompt message is generated.

[0011] In some feasible examples, the method for a vehicle to perform a preset operation provided by an embodiment of the present disclosure further includes: continuing to obtain target information after generating the prompt information.

[0012] In a second aspect, the present disclosure provides a device for a vehicle to perform preset operations, comprising: an acquisition unit for acquiring target information; wherein the target information includes an actual cabin image collected by a cabin occupant monitoring system and pressure information collected by at least one seat belt reminder device in the cabin; a processing unit for detecting the target information acquired by the acquisition unit according to preset conditions to obtain a detection result; the processing unit is also used to perform a preset operation when the detection result is that the target information meets a first condition of the preset conditions; wherein the first condition includes that no human body is recognized in the actual cabin image, and the pressure values ​​in the pressure information are all less than a pressure threshold, and the preset operation includes at least one of controlling the vehicle lock to lock and controlling the vehicle to power off.

[0013] In some feasible examples, the target information also includes: linkage setting information of the child seat; the preset condition also includes a second condition, the second condition including that when the linkage setting information is used to indicate that a child seat has been placed in the cabin, no human body is recognized in the actual cabin image, and there is a pressure value greater than or equal to the pressure threshold; the processing unit is specifically used to perform human body detection on the actual cabin image obtained by the acquisition unit when the linkage setting information obtained by the acquisition unit is used to indicate that a child seat has been placed in the cabin, and obtain a first result; the processing unit is specifically used to compare the pressure value in the pressure information obtained by the acquisition unit with the pressure threshold when the linkage setting information obtained by the acquisition unit is used to indicate that a child seat has been placed in the cabin, and obtain a second result; the processing unit is specifically used to use the first result and the second result as detection results based on the first result and the second result; the processing unit is also used to determine that the target information meets the second condition and execute the preset operation when the first result in the detection result is that no human body is recognized in the actual cabin image obtained by the acquisition unit, and the second result in the detection result obtained by the acquisition unit is that there is a pressure value greater than or equal to the pressure threshold.

[0014] In some feasible examples, the processing unit is specifically used to perform human body detection on the actual in-cabin image acquired by the acquisition unit to obtain a third result; the processing unit is specifically used to compare the pressure value in the pressure information acquired by the acquisition unit with the pressure threshold to obtain a fourth result; the processing unit is specifically used to use the third result and the fourth result as the detection result based on the third result and the fourth result; the processing unit is also used to generate a prompt message when the third result in the detection result is that a human body is recognized in the actual in-cabin image, and the fourth result in the detection result is that there is a pressure value greater than or equal to the pressure threshold; wherein the prompt message is used to indicate that there is a human body in the cabin.

[0015] In some feasible examples, the processing unit is further used to generate a prompt message when the third result in the detection result is that a human body is recognized in the actual cabin image obtained by the acquisition unit, and the fourth result in the detection result is that the pressure values ​​in the pressure information obtained by the acquisition unit are all less than the pressure threshold.

[0016] In some feasible examples, the processing unit is specifically used to perform human body detection on the actual in-cabin image obtained by the acquisition unit to obtain a fifth result when the linkage setting information obtained by the acquisition unit indicates that no child seat is placed in the cabin; the processing unit is specifically used to compare the pressure value in the pressure information obtained by the acquisition unit with the pressure threshold to obtain a sixth result when the linkage setting information obtained by the acquisition unit indicates that no child seat is placed in the cabin; the processing unit is specifically used to use the fifth result and the sixth result as detection results based on the fifth result and the sixth result; the processing unit is also used to determine that the target information does not meet the second condition and generate a prompt message when the fifth result in the detection result is that no human body is recognized in the actual in-cabin image obtained by the acquisition unit, and the sixth result in the detection result is that the pressure value in the pressure information obtained by the acquisition unit is greater than or equal to the pressure threshold.

[0017] In some feasible examples, the processing unit is further configured to control the acquisition unit to continue acquiring the target information after generating the prompt information.

[0018] In a third aspect, the present disclosure provides an electronic device comprising: a memory and a processor, wherein the memory is used to store a computer program; and the processor is used to enable the electronic device to implement the method for a vehicle to perform preset operations as provided in the first aspect above when executing the computer program.

[0019] In a fourth aspect, the present disclosure provides a computer-readable storage medium, comprising: a computer program stored on the computer-readable storage medium, which, when executed by a computing device, enables the computing device to implement a method for a vehicle to perform preset operations as provided in the first aspect above.

[0020] In a fifth aspect, the present disclosure provides a vehicle, comprising a device for performing preset operations of any vehicle provided in the second aspect.

[0021] In this disclosure, the names of the devices for performing preset vehicle operations do not limit the devices or functional modules themselves. In actual implementation, these devices or functional modules may appear with other names. As long as the functions of each device or functional module are similar to those disclosed herein, they are within the scope of the claims of this disclosure and their equivalents.

[0022] These and other aspects of the present disclosure will become more apparent from the following description.

[0023] The technical solution provided by the present disclosure has the following advantages compared with the existing technology:

[0024] The present disclosure provides a method for executing a preset operation in a vehicle, which obtains an actual cabin image captured by an in-cabin occupant monitoring system and pressure information collected by at least one seatbelt reminder device in the cabin. If no human body is identified in the actual cabin image and the pressure values ​​in the pressure information are all less than a pressure threshold, it indicates that no human body is in the cabin, and thus the preset operation can be executed. The preset operation includes at least one of controlling the locking of the vehicle locks and controlling the power off of the vehicle. It can be seen that by combining the actual cabin image and the pressure information, the presence of a human body in the cabin can be better determined. For example, the preset operation can only be executed if no human body is identified in the actual cabin image and the pressure values ​​in the pressure information are all less than the pressure threshold. This solves the problem of how to prevent the vehicle from continuing to execute the preset operation even when a human body is left in the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0026] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0027] Figure 1 One of the flowcharts of a method for a vehicle to perform a preset operation provided by an embodiment of the present disclosure;

[0028] Figure 2 A schematic diagram of the architecture of a method for a vehicle to perform a preset operation provided by an embodiment of the present disclosure;

[0029] Figure 3 A second flow chart of a method for executing a preset operation on a vehicle provided in an embodiment of the present disclosure;

[0030] Figure 4 A third flowchart of a method for executing a preset operation on a vehicle provided in an embodiment of the present disclosure;

[0031] Figure 5 A fourth flowchart of a method for executing a preset operation on a vehicle provided in an embodiment of the present disclosure;

[0032] Figure 6 A fifth flowchart of a method for performing a preset operation on a vehicle provided in an embodiment of the present disclosure;

[0033] Figure 7 A schematic structural diagram of a device for performing a preset operation on a vehicle provided by an embodiment of the present disclosure;

[0034] Figure 8 A schematic structural diagram of a vehicle-mounted terminal provided in an embodiment of the present disclosure;

[0035] Figure 9 A schematic structural diagram of a computer program product for a method for a vehicle to perform a preset operation provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0036] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features therein can be combined with each other in the absence of conflict.

[0037] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0038] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0039] The method for executing a preset operation on a vehicle in the embodiments of the present application is performed by a device for executing a preset operation on the vehicle. The device for executing a preset operation on the vehicle may be located in a server or other device, and this embodiment does not limit this. For example, when the device for executing a preset operation on the vehicle is located in an automobile, a new energy vehicle, or an intelligent connected vehicle, the method for executing a preset operation on the vehicle provided in the embodiments of the present disclosure is performed by the vehicle's processor.

[0040] In some examples, the car can be a fuel car, a new energy car, etc.

[0041] For example, the method for a vehicle to perform a preset operation provided by an embodiment of the present disclosure is introduced by taking an automobile as an example in which the executing entity of the method for a vehicle to perform a preset operation provided by an embodiment of the present disclosure is an automobile.

[0042] like Figure 1 As shown, the method for executing a preset operation on a vehicle provided by the embodiment of the present disclosure includes the following steps S11-S13:

[0043] S11. Obtain target information, wherein the target information includes an actual cabin image captured by an occupant monitoring system (OMS) in the cabin and pressure information captured by at least one safety belt reminder (SBR) in the cabin.

[0044] In some examples, the OMS obtains actual in-cabin images of the cabin through an image acquisition device, such as a camera, disposed in the cabin of the vehicle.

[0045] In some examples, the SBR obtains pressure information through a pressure collection device, such as a pressure sensor, disposed on a seat within a cabin of the vehicle.

[0046] In some examples, the architecture of the vehicle terminal is as follows: Figure 2 As shown, it includes an SBR signal feedback module, an OMS signal feedback module and a child seat signal linkage setting module, a vehicle occupant judgment module and a CAN bus. Among them, the vehicle occupant judgment module is used to determine whether there is a human body in the cabin based on the pressure information fed back by the SBR signal feedback module and the actual cabin image fed back by the OMS signal feedback module. Alternatively, the vehicle occupant judgment module is used to determine whether there is a human body in the cabin based on the pressure information fed back by the SBR signal feedback module, the actual cabin image fed back by the OMS signal feedback module and the linkage setting information fed back by the child seat signal linkage setting module.

[0047] For example, when the occupant judgment module determines whether there is a human body in the cabin based on the pressure information fed back by the SBR signal feedback module and the actual cabin image fed back by the OMS signal feedback module, if the occupant judgment module determines that no human body is identified in the actual cabin image, and the pressure values ​​in the pressure information are all less than the pressure threshold, it means that there is no human body in the cabin, so the occupant judgment module can send an indication information to the vehicle lock and / or power management model of the vehicle via the CAN bus. The indication information is used to instruct the vehicle lock to lock or control the vehicle to cut off power. Alternatively, when the occupant judgment module determines that a human body is identified in the actual cabin image, and / or there is a pressure value greater than or equal to the pressure threshold, it means that there is a human body in the cabin, so the occupant judgment module needs to continue to obtain the actual cabin image and pressure information to avoid erroneous execution of preset operations.

[0048] Alternatively, when the vehicle occupant determination module determines whether there is a human body in the cabin based on the pressure information fed back by the SBR signal feedback module, the actual cabin image fed back by the OMS signal feedback module, and the linkage setting information fed back by the child seat signal linkage setting module, if the vehicle occupant determination module determines that, when the linkage setting information indicates that a child seat has been placed in the cabin, if no human body is recognized in the actual cabin image, and there is a pressure value greater than or equal to the pressure threshold, it indicates that there is no human body in the cabin, and the vehicle occupant determination module can send an indication information to the vehicle lock and / or power management model via the CAN bus. Alternatively, if the vehicle occupant determination module determines that, when the linkage setting information indicates that a child seat has not been placed in the cabin, if no human body is recognized in the actual cabin image, and there is a pressure value greater than or equal to the pressure threshold, it indicates that there is a human body in the cabin, and the vehicle occupant determination module needs to continue to obtain the actual cabin image and pressure information to avoid erroneously executing the preset operation.

[0049] In some examples, such as Figure 2 As shown in Table 1, the meanings of the signals between the SBR signal feedback module, the OMS signal feedback module, the child seat signal linkage setting module, the vehicle occupant judgment module and the CAN bus are shown.

[0050] Table 1

[0051]

[0052]

[0053]

[0054] For example, taking the target information including the actual cabin image collected by the OMS and the pressure information of the SBR as an example, the process of the vehicle determining whether there is a human body in the cabin is as follows:

[0055] Perform human body recognition on the actual cabin image to determine the occupancy status of DrOMSSts, PsngOMSSts, RLOMSSts, RMOMSSts, RROMSSts, ThirdLOMSSts, ThirdMOMSSts, and ThirdROMSSts.

[0056] When the DrOMSSts position is 0x1, the PsngOMSSts position is 0x0, the RLOMSSts position is 0x0, the RMOMSSts position is 0x0, the RROMSSts position is 0x0, the ThirdLOMSSts position is 0x0, the ThirdMOMSSts position is 0x0, the ThirdROMSSts position is 0x0, and the pressure information includes DrS When BRSts==0x1, PsngSBRSts==0x0, RLSBRts==0x0, RMSBRSts==0x0, RRSBRSts==0x0, ThirdLSBRSts==0x0, ThirdMSBRSts==0x0, and ThirdRSBRSts==0x0, since the occupancy status of DrOMSSts is 0x1 and DrSBRSts==0x1, it is determined that there is a human body in the cabin.

[0057] or,

[0058] When the DrOMSSts position is 0x1, the PsngOMSSts position is 0x0, the RLOMSSts position is 0x0, the RMOMSSts position is 0x0, the RROMSSts position is 0x0, the ThirdLOMSSts position is 0x0, the ThirdMOMSSts position is 0x0, the ThirdROMSSts position is 0x0, and the pressure information includes DrS When BRSts==0x0, PsngSBRSts==0x0, RLSBRts==0x0, RMSBRSts==0x0, RRSBRSts==0x0, ThirdLSBRSts==0x0, ThirdMSBRSts==0x0, and ThirdRSBRSts==0x0, since the occupancy status of DrOMSSts is 0x1 and DrSBRSts==0x0, it is determined that there is a human body in the cabin.

[0059] or,

[0060] When the DrOMSSts position is 0x0, the PsngOMSSts position is 0x0, the RLOMSSts position is 0x0, the RMOMSSts position is 0x0, the RROMSSts position is 0x0, the ThirdLOMSSts position is 0x0, the ThirdMOMSSts position is 0x0, the ThirdROMSSts position is 0x0, and the pressure information includes DrSB When RSts==0x0, PsngSBRSts==0x0, RLSBRts==0x0, RMSBRSts==0x0, RRSBRSts==0x0, ThirdLSBRSts==0x0, ThirdMSBRSts==0x0, and ThirdRSBRSts==0x0, since the occupancy status of DrOMSSts is 0x0 and DrSBRSts==0x0, it is determined that there is no human body in the cabin.

[0061] For example, taking the target information including the actual cabin image collected by the OMS, the pressure information of the SBR, and the linkage setting information as an example, the process of the vehicle determining whether there is a human body in the cabin is as follows:

[0062] Perform human body recognition on the actual cabin image to determine the occupancy status of DrOMSSts, PsngOMSSts, RLOMSSts, RMOMSSts, RROMSSts, ThirdLOMSSts, ThirdMOMSSts, and ThirdROMSSts.

[0063] The occupancy status of DrOMSSts is 0x0, the occupancy status of PsngOMSSts is 0x0, the occupancy status of RLOMSSts is 0x0, the occupancy status of RMOMSts is 0x0, the occupancy status of RROMSSts is 0x0, the occupancy status of ThirdLOMSSts is 0x0, the occupancy status of ThirdMOMSSts is 0x0, the occupancy status of ThirdROMSSts is 0x0, and the pressure information includes DrSBRSts==0x1, PsngSBRSts==0x0, RLSBRts==0 x0, RMSBRSts==0x0, RRSBRSts==0x0, ThirdLSBRSts==0x0, ThirdMSBRSts==0x0, ThirdRSBRSts==0x0, and the linkage setting information includes RLChdSeatSts==0x1, RMChdSeatSts==0x0, RRChdSeatSts==0x0, ThirdLChdSeatSts==0x0, ThirdMChdSeatSts==0x0, ThirdRChdSeatSts s==0x0, since the occupancy status of DrOMSSts is 0x0, DrSBRSts==0x1 and RLChdSeatSts==0x1, it is determined that there is no human body in the cabin.

[0064] or,

[0065] The occupancy status of DrOMSSts is 0x0, the occupancy status of PsngOMSSts is 0x0, the occupancy status of RLOMSSts is 0x0, the occupancy status of RMOMSts is 0x0, the occupancy status of RROMSSts is 0x0, the occupancy status of ThirdLOMSSts is 0x0, the occupancy status of ThirdMOMSSts is 0x0, the occupancy status of ThirdROMSSts is 0x0, and the pressure information includes DrSBRSts==0x1, PsngSBRSts==0x0, RLSBRts==0 x0, RMSBRSts==0x0, RRSBRSts==0x0, ThirdLSBRSts==0x0, ThirdMSBRSts==0x0, ThirdRSBRSts==0x0, and the linkage setting information includes RLChdSeatSts==0x0, RMChdSeatSts==0x0, RRChdSeatSts==0x0, ThirdLChdSeatSts==0x0, ThirdMChdSeatSts==0x0, ThirdRChdSeatSts s==0x0, since the occupancy status of DrOMSSts is 0x0, DrSBRSts==0x1 and RLChdSeatSts==0x0, it is determined that there is a human body in the cabin.

[0066] S12. Detect the target information according to preset conditions to obtain a detection result.

[0067] S13. If the detection result shows that the target information meets the first condition of the preset conditions, perform a preset operation; wherein the first condition includes that no human body is recognized in the actual cabin image and the pressure values ​​in the pressure information are all less than the pressure threshold, and the preset operation includes at least one of controlling the vehicle lock to lock and controlling the vehicle to power off.

[0068] In some embodiments, after obtaining an actual in-cabin image, human body recognition can be performed on the actual in-cabin image to determine whether a human body is present in the actual in-cabin image. For example, the actual in-cabin image is compared with a theoretical in-cabin image (an image that does not contain a human body) to determine image regions where the actual in-cabin image differs from the theoretical in-cabin image. The image region is separated into foreground and background to obtain a foreground image. The foreground image is compared with at least one preset human body image to determine a similarity between the foreground image and the human body image. If a foreground image exists with a similarity greater than a similarity threshold, it is determined that a human body is present in the actual in-cabin image. If no foreground image exists with a similarity greater than the similarity threshold, it is determined that no human body is present in the actual in-cabin image.

[0069] Alternatively, the actual cabin image is input into the human body recognition model for human body recognition to determine whether there is a human body in the actual cabin image. The training process of the human body recognition model is as follows:

[0070] A training sample image and a labeling result of the training sample image are obtained; wherein the training sample image includes at least one human body, and the labeling result includes the number of human bodies included in the training sample image.

[0071] The training sample images are input into the neural network model for learning, and the prediction results of the neural network model for the training sample images are obtained.

[0072] Based on the prediction results and labeling results, the network parameters of the neural network model are adjusted until the neural network model converges to obtain a human body recognition model.

[0073] The method for executing a preset operation on a vehicle provided by an embodiment of the present disclosure obtains an actual cabin image captured by an in-cabin occupant monitoring system and pressure information collected by at least one seatbelt reminder device in the cabin. If no human body is identified in the actual cabin image and the pressure values ​​in the pressure information are all less than a pressure threshold, it indicates that there is no human body in the cabin, and therefore the preset operation can be executed. The preset operation includes at least one of controlling the locking of the vehicle locks and controlling the power off of the vehicle. It can be seen that by combining the actual cabin image and the pressure information, it is possible to better determine whether there is a human body in the cabin. For example, the preset operation can only be executed when no human body is identified in the actual cabin image and the pressure values ​​in the pressure information are all less than the pressure threshold. This solves the problem of how to prevent the vehicle from continuing to execute the preset operation when there is a human body left in the vehicle.

[0074] In some feasible examples, the target information further includes: linkage setting information of a child seat; the preset condition further includes a second condition, the second condition including that when the linkage setting information is used to indicate that a child seat has been placed in the cabin, no human body is recognized in the actual cabin image, and there is a pressure value greater than or equal to the pressure threshold; combined with Figure 1 ,like Figure 3 As shown, the above S12 can be specifically implemented through the following S120-S122. The method for executing preset operations on a vehicle provided in the embodiment of the present disclosure also includes S14.

[0075] S120: If the linkage setting information indicates that a child seat has been placed in the cabin, perform human body detection on the actual cabin image to obtain a first result;

[0076] S121. When the linkage setting information indicates that a child seat has been placed in the cabin, compare the pressure value in the pressure information with the pressure threshold to obtain a second result.

[0077] S122. Based on the first result and the second result, use both the first result and the second result as the detection result;

[0078] S14. When the first result in the detection result is that no human body is recognized in the actual cabin image, and the second result in the detection result is that there is a pressure value greater than or equal to the pressure threshold, determine that the target information meets the second condition and perform a preset operation.

[0079] In some examples, a user can configure child seat usage options on the vehicle-mounted terminal. For example, if a user configures a linkage setting for a child seat, the vehicle-mounted terminal generates linkage setting information in response to the linkage setting operation for the child seat. For example, if the linkage setting operation indicates that a child seat is already in the cabin, the linkage setting information indicates that the child seat is already in the cabin. Alternatively, if the linkage setting operation indicates that a child seat is not already in the cabin, the linkage setting information indicates that the child seat is not already in the cabin.

[0080] In some examples, when a child seat is placed in the cabin, the child seat will press the seat, causing the SBR pressure value to be greater than the pressure threshold. At this time, if no human body is recognized in the actual cabin image, it means that there is no human body in the cabin, so the preset operation can be performed.

[0081] In some possible implementations, combining Figure 1 ,like Figure 4 As shown, the above S12 can be specifically implemented through the following S123-S125. The method for a vehicle to perform a preset operation provided by an embodiment of the present disclosure also includes: S15.

[0082] S123, performing human body detection on the actual cabin image to obtain a third result;

[0083] S124. Compare the pressure value in the pressure information with the pressure threshold to obtain a fourth result;

[0084] S125. Based on the third result and the fourth result, use both the third result and the fourth result as the detection result;

[0085] S15. When the third result in the detection result is that a human body is recognized in the actual image inside the cabin, and the fourth result in the detection result is that there is a pressure value greater than or equal to the pressure threshold, generate a prompt message; wherein the prompt message is used to indicate that there is a human body in the cabin.

[0086] In some possible implementations, combining Figure 4 ,like Figure 5 As shown, the method for a vehicle to perform a preset operation provided by an embodiment of the present disclosure also includes: S16.

[0087] S16. When the third result in the detection result is that a human body is recognized in the actual cabin image, and the fourth result in the detection result is that the pressure values ​​in the pressure information are all less than the pressure threshold, generate a prompt message.

[0088] In some possible implementations, combining Figure 1 ,like Figure 6 As shown, the above S12 can be specifically implemented through the following S126-S28. The method for a vehicle to perform a preset operation provided by an embodiment of the present disclosure also includes: S17.

[0089] S126. If the linkage setting information indicates that no child seat is placed in the cabin, perform human body detection on the actual cabin image to obtain a fifth result.

[0090] S127. If the linkage setting information indicates that no child seat is placed in the cabin, compare the pressure value in the pressure information with the pressure threshold to obtain a sixth result.

[0091] S128. Based on the fifth result and the sixth result, use both the fifth result and the sixth result as the detection result;

[0092] S17. When the fifth result in the detection result is that no human body is recognized in the actual cabin image, and the sixth result in the detection result is that the pressure value in the pressure information is greater than or equal to the pressure threshold, it is determined that the target information does not meet the second condition and a prompt message is generated.

[0093] In some examples, to better alert the driver to the presence of a human body in the cabin, a prompt message may be generated when a human body is recognized in the actual cabin image and / or when a pressure value is greater than or equal to a pressure threshold. This prompt allows the driver to understand that a human body is left in the cabin, facilitating the driver's decision to make the correct decision.

[0094] In some examples, when there is no child seat placed in the cabin, if no human body is recognized in the actual cabin image and there is a pressure value greater than or equal to the pressure threshold, it means that there is a human body in the cabin. Therefore, the vehicle occupant judgment module needs to continue to obtain the actual cabin image and pressure information to avoid erroneous execution of preset operations.

[0095] In some feasible examples, the method for a vehicle to perform a preset operation provided by an embodiment of the present disclosure further includes: continuing to obtain target information after generating the prompt information.

[0096] In some examples, to better alert the driver to the presence of a person in the cabin, a prompt message is generated when a person is detected in the actual cabin image. This allows the driver to understand the presence of a person, enabling them to make the right decision. To prevent the driver from missing the prompt message, the system continues to acquire actual cabin images and pressure information. This prevents the vehicle from continuing to generate prompt messages even after the person has left the cabin.

[0097] The above mainly introduces the solution provided by the embodiment of the present disclosure from the perspective of method. In order to realize the above functions, it includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in a hardware or computer software driven hardware manner depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present disclosure.

[0098] In the embodiments of the present disclosure, the device for performing preset operations on the vehicle can be divided into functional modules based on the above-mentioned method examples. For example, each functional module can be divided according to each function, or two or more functions can be integrated into a single processing module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules. It should be noted that the module division in the embodiments of the present disclosure is illustrative and is only a logical functional division. In actual implementation, other division methods may be used.

[0099] like Figure 7 FIG. 1 is a schematic diagram of a structure of a device 10 for executing a preset operation on a vehicle provided by an embodiment of the present disclosure, comprising an acquisition unit 101 and a processing unit 102 .

[0100] The acquisition unit 101 is used to acquire target information; wherein the target information includes the actual cabin image collected by the cabin occupant monitoring system and the pressure information collected by at least one seat belt reminder device in the cabin; the processing unit 102 is used to detect the target information obtained by the acquisition unit 101 according to preset conditions to obtain a detection result; the processing unit 102 is also used to perform a preset operation when the detection result is that the target information meets the first condition of the preset conditions; wherein the first condition includes that no human body is recognized in the actual cabin image, and the pressure values ​​in the pressure information are all less than the pressure threshold, and the preset operation includes at least one of controlling the vehicle lock to lock and controlling the vehicle to power off.

[0101] In some feasible examples, the target information also includes: linkage setting information of the child seat; the preset condition also includes a second condition, the second condition including that when the linkage setting information is used to indicate that a child seat has been placed in the cabin, no human body is recognized in the actual cabin image, and there is a pressure value greater than or equal to the pressure threshold; the processing unit 102 is specifically configured to perform human body detection on the actual cabin image obtained by the acquisition unit 101 to obtain a first result when the linkage setting information obtained by the acquisition unit 101 is used to indicate that a child seat has been placed in the cabin; the processing unit 102 is specifically configured to perform human body detection on the actual cabin image obtained by the acquisition unit 101 to obtain a first result when the linkage setting information obtained by the acquisition unit 101 is used to indicate that a child seat has been placed in the cabin; the processing unit 102 is specifically configured to perform human body detection on the actual cabin image obtained by the acquisition unit 101 to obtain a first result The placement information is used to indicate that a child seat has been placed in the cabin, and the pressure value in the pressure information obtained by the acquisition unit 101 is compared with the pressure threshold to obtain a second result; the processing unit 102 is specifically used to use the first result and the second result as the detection result based on the first result and the second result; the processing unit 102 is also used to determine that the target information meets the second condition and perform a preset operation when the first result in the detection result is that no human body is recognized in the actual cabin image obtained by the acquisition unit 101, and the second result in the detection result obtained by the acquisition unit 101 is that there is a pressure value greater than or equal to the pressure threshold.

[0102] In some feasible examples, the processing unit 102 is specifically used to perform human body detection on the actual in-cabin image acquired by the acquisition unit 101 to obtain a third result; the processing unit 102 is specifically used to compare the pressure value in the pressure information acquired by the acquisition unit 101 with the pressure threshold to obtain a fourth result; the processing unit 102 is specifically used to use the third result and the fourth result as the detection result based on the third result and the fourth result; the processing unit 102 is also used to generate a prompt message when the third result in the detection result is that a human body is recognized in the actual in-cabin image, and the fourth result in the detection result is that there is a pressure value greater than or equal to the pressure threshold; wherein the prompt message is used to indicate that there is a human body in the cabin.

[0103] In some feasible examples, the processing unit 102 is further used to generate a prompt message when the third result in the detection result is that a human body is recognized in the actual cabin image obtained by the acquisition unit 101, and the fourth result in the detection result is that the pressure values ​​in the pressure information obtained by the acquisition unit 101 are all less than the pressure threshold.

[0104] In some feasible examples, the processing unit 102 is specifically used to perform human body detection on the actual in-cabin image obtained by the acquisition unit 101 to obtain a fifth result when the linkage setting information obtained by the acquisition unit 101 indicates that no child seat is placed in the cabin; the processing unit 102 is specifically used to compare the pressure value in the pressure information obtained by the acquisition unit 101 with the pressure threshold to obtain a sixth result when the linkage setting information obtained by the acquisition unit 101 indicates that no child seat is placed in the cabin; the processing unit 102 is specifically used to use the fifth result and the sixth result as detection results based on the fifth result and the sixth result; the processing unit 102 is also used to determine that the target information does not meet the second condition and generate a prompt message when the fifth result in the detection result is that no human body is recognized in the actual in-cabin image obtained by the acquisition unit 101, and the sixth result in the detection result is that the pressure value in the pressure information obtained by the acquisition unit 101 is greater than or equal to the pressure threshold.

[0105] In some feasible examples, the processing unit 102 is further configured to control the acquiring unit 101 to continue acquiring the target information after generating the prompt information.

[0106] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and its role will not be repeated here.

[0107] Of course, the apparatus 10 for executing a preset operation on a vehicle provided in the embodiment of the present disclosure includes but is not limited to the above-mentioned modules. For example, the apparatus 10 for executing a preset operation on a vehicle may further include a storage unit 103. The storage unit 103 may be used to store program code of the apparatus 10 for executing a preset operation on a vehicle, and may also be used to store data generated during the operation of the apparatus 10 for executing a preset operation on a vehicle, such as data in a write request.

[0108] Figure 8 A schematic diagram of the structure of a vehicle-mounted terminal provided by an embodiment of the present disclosure is shown in FIG. Figure 8 As shown, the vehicle-mounted terminal may include: at least one processor 51 , a memory 52 , a communication interface 53 and a communication bus 54 .

[0109] The following combination Figure 8 A detailed introduction to the various components of the vehicle terminal:

[0110] The processor 51 is the control center of the electronic device 10 and can be a single processor or a collective term for multiple processing elements. For example, the processor 51 is a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present disclosure, such as one or more DSPs or one or more field programmable gate arrays (FPGAs).

[0111] In a specific implementation, as an embodiment, the processor 51 may include one or more CPUs, such as Figure 8 Also, as an embodiment, the electronic device may include multiple processors, such as Figure 8 5. Each of these processors can be a single-core processor (Single-CPU) or a multi-core processor (Multi-CPU). A processor here can refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0112] The memory 52 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 52 may be independent and connected to the processor 51 via a communication bus 54. The memory 52 may also be integrated with the processor 51.

[0113] In a specific implementation, the memory 52 is used to store the data disclosed herein and execute the software programs disclosed herein. The processor 51 can execute various functions of the air conditioner by running or executing the software programs stored in the memory 52 and calling the data stored in the memory 52.

[0114] The communication interface 53 uses any transceiver or other device for communicating with other devices or communication networks, such as a Radio Access Network (RAN), a Wireless Local Area Network (WLAN), a terminal, or the cloud. The communication interface 53 may include an acquisition unit to implement the acquisition function.

[0115] The communication bus 54 can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. This bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0116] As an example, combine Figure 7 The function implemented by the acquisition unit 101 in the device 10 for executing a preset operation of the vehicle is the same as Figure 8 The function of the communication interface 53 is the same as that of the vehicle, and the function implemented by the processing unit 102 in the device 10 for performing a preset operation is the same as that of the vehicle. Figure 8 The function of the processor 51 in the vehicle is the same as that of the storage unit 103 in the device 10 for performing preset operations. Figure 8 The function of the memory 52 is the same as that of the memory 52 in FIG.

[0117] Another embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a computing device, the computing device executes the mode switching method shown in the above method embodiment.

[0118] In some embodiments, the disclosed methods may be implemented as computer program instructions encoded in a machine-readable format on a computer-readable storage medium or on other non-transitory media or articles of manufacture.

[0119] Figure 9The figure schematically shows a conceptual partial view of a computer program product provided by an embodiment of the present disclosure, wherein the computer program product includes a computer program for executing a computer process on a computing device.

[0120] In one embodiment, the computer program product is provided using a signal bearing medium 410. The signal bearing medium 410 may include one or more program instructions that, when executed by one or more processors, may provide the above-described Figure 1 Thus, for example, reference to Figure 1 In the embodiment shown in , one or more features of S11 and S12 may be undertaken by one or more instructions associated with the signal bearing medium 410. In addition, Figure 9 The program instructions in also describe example instructions.

[0121] In some examples, signal-bearing medium 410 may include computer-readable medium 411, such as, but not limited to, a hard drive, a compact disk (CD), a digital video disk (DVD), a digital tape, a memory, a read-only memory (ROM), a random access memory (RAM), and the like.

[0122] In some implementations, signal bearing medium 410 may include computer recordable medium 412 such as, but not limited to, memory, read / write (R / W) CD, R / W DVD, or the like.

[0123] In some embodiments, signal bearing medium 410 may include communication medium 413 such as, but not limited to, digital and / or analog communication media (eg, fiber optic cables, waveguides, wired communication links, wireless communication links, etc.).

[0124] Signal bearing medium 410 may be communicated by a wireless form of communication medium 413 (eg, a wireless communication medium conforming to the IEEE 802.41 standard or other transmission protocols). The one or more program instructions may be, for example, computing device executable instructions or logic implementing instructions.

[0125] In some examples, such as for Figure 7 The described apparatus 10 for performing preset operations on a vehicle may be configured to provide various operations, functions, or actions in response to one or more program instructions via a computer-readable medium 411 , a computer-recordable medium 412 , and / or a communication medium 413 .

[0126] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0127] In the several embodiments provided in the present disclosure, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0128] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0129] In addition, the functional units in the various embodiments of the present disclosure may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0130] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present disclosure is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk or an optical disk.

[0131] The foregoing description is intended only to provide specific embodiments of the present disclosure, intended to enable those skilled in the art to understand and implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the embodiments described herein, but rather to be construed in the broadest manner consistent with the principles and novel features disclosed herein.

Claims

1. A method for a vehicle to perform a preset operation, characterized in that: include: Acquiring target information; wherein the target information includes an actual cabin image collected by a crew monitoring system in the cabin and pressure information collected by at least one seat belt reminder device in the cabin; Detecting the target information according to preset conditions to obtain a detection result; When the detection result shows that the target information meets the first condition of the preset conditions, a preset operation is performed; wherein, the first condition includes that no human body is recognized in the actual cabin image, and the pressure values ​​in the pressure information are all less than the pressure threshold, and the preset operation includes at least one of controlling the vehicle lock to lock and controlling the vehicle power to be cut off.

2. The method for performing a preset operation on a vehicle according to claim 1, characterized in that: The target information also includes: linkage setting information of the child seat; The preset condition further includes a second condition, wherein, when the linkage setting information indicates that a child seat has been placed in the cabin, no human body is recognized in the actual cabin image, and a pressure value greater than or equal to the pressure threshold exists; The detecting the target information according to the preset conditions to obtain the detection result includes: When the linkage setting information indicates that a child seat has been placed in the cabin, performing human body detection on the actual cabin image to obtain a first result; When the linkage setting information indicates that a child seat has been placed in the cabin, comparing the pressure value in the pressure information with the pressure threshold to obtain a second result; Based on the first result and the second result, taking both the first result and the second result as detection results; The method further comprises: When the first result in the detection result is that no human body is recognized in the actual cabin image, and the second result in the detection result is that there is a pressure value greater than or equal to the pressure threshold, it is determined that the target information meets the second condition and the preset operation is performed.

3. The method for performing a preset operation on a vehicle according to claim 1, characterized in that: The detecting the target information according to the preset conditions to obtain the detection result includes: Performing human body detection on the actual cabin image to obtain a third result; Comparing the pressure value in the pressure information with the pressure threshold to obtain a fourth result; Based on the third result and the fourth result, taking both the third result and the fourth result as the detection result; The method further comprises: When the third result in the detection result is that a human body is recognized in the actual cabin image, and the fourth result in the detection result is that there is a pressure value greater than or equal to the pressure threshold, a prompt information is generated; wherein the prompt information is used to indicate that there is a human body in the cabin.

4. The method for performing a preset operation on a vehicle according to claim 3, characterized in that: The method further comprises: When the third result in the detection result is that a human body is recognized in the actual cabin image, and the fourth result in the detection result is that the pressure values ​​in the pressure information are all less than the pressure threshold, a prompt message is generated.

5. The method for performing a preset operation on a vehicle according to claim 1, characterized in that: The detecting the target information according to the preset conditions to obtain the detection result includes: When the linkage setting information indicates that no child seat is placed in the cabin, performing human body detection on the actual cabin image to obtain a fifth result; When the linkage setting information indicates that no child seat is placed in the cabin, comparing the pressure value in the pressure information with the pressure threshold to obtain a sixth result; Based on the fifth result and the sixth result, taking both the fifth result and the sixth result as the detection result; The method further comprises: When the fifth result in the detection result is that no human body is recognized in the actual cabin image, and the sixth result in the detection result is that the pressure value in the pressure information is greater than or equal to the pressure threshold, it is determined that the target information does not meet the second condition, and a prompt message is generated.

6. A device for performing a preset operation on a vehicle, characterized in that: include: an acquisition unit, configured to acquire target information; wherein the target information includes an actual cabin image acquired by a cabin crew monitoring system and pressure information acquired by at least one seat belt reminder device in the cabin; a processing unit, configured to detect the target information acquired by the acquisition unit according to preset conditions to obtain a detection result; The processing unit is further configured to execute a preset operation when the detection result shows that the target information satisfies a first preset condition; wherein the first condition includes that no human body is recognized in the actual cabin image, and the pressure values ​​in the pressure information are all less than a pressure threshold, and the preset operation includes at least one of controlling the vehicle lock to lock and controlling the vehicle power to be cut off.

7. The device for performing a preset operation on a vehicle according to claim 6, characterized in that: The target information further includes: linkage setting information of a child seat; the preset condition further includes a second condition, wherein, when the linkage setting information indicates that a child seat has been placed in the cabin, no human body is recognized in the actual cabin image, and a pressure value greater than or equal to the pressure threshold exists; the processing unit is specifically configured to, when the linkage setting information acquired by the acquiring unit indicates that a child seat has been placed in the cabin, perform human body detection on the actual cabin image acquired by the acquiring unit to obtain a first result; the processing unit is specifically configured to compare the pressure value in the pressure information obtained by the obtaining unit with the pressure threshold to obtain a second result when the linkage setting information obtained by the obtaining unit indicates that a child seat has been placed in the cabin; The processing unit is specifically configured to use the first result and the second result as the detection result based on the first result and the second result; The processing unit is further configured to, when a first result in the detection result is that no human body is recognized in the actual in-cabin image acquired by the acquisition unit, and a second result in the detection result acquired by the acquisition unit is that there is a pressure value greater than or equal to the pressure threshold, determine that the target information satisfies the second condition and execute the preset operation.

8. An electronic device, characterized in that: include: A memory and a processor, the memory being used to store a computer program; the processor being used to, when executing the computer program, enable the electronic device to implement the method for a vehicle to perform a preset operation as described in any one of claims 1-5.

9. A computer-readable storage medium, characterized in that include: The computer-readable storage medium stores a computer program, and when the computer program is executed by a computing device, the computing device implements the method for a vehicle to perform a preset operation as described in any one of claims 1 to 5.

10. A vehicle comprising the device for performing a preset operation of the vehicle according to claim 6.

Images