Article omission reminding method and device, controller, vehicle, medium and product

Abstract

The embodiment of the invention discloses an article omission reminding method and device, a controller, a vehicle, a medium and a product. The method comprises the steps of obtaining detection data collected for passengers in a vehicle; identifying an article omission risk level of the passenger based on the detection data; and executing an article omission reminding operation corresponding to the article omission risk level on the passenger. Therefore, the article omission risk level of the passenger is identified based on the detection data collected for the passenger in the vehicle, so that targeted article omission reminding is carried out on the passenger according to the article omission risk level of the passenger, accurate and effective article omission reminding can be carried out on the passenger, and the article omission reminding efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, device, controller, vehicle, medium and product for reminding a person of missing an item. Background Art

[0002] Passengers are prone to leaving items behind when riding, which greatly affects the passenger's riding experience. To this end, passengers can be reminded of the items they left behind when riding. In existing methods for reminding passengers of left behind items, a voice announcement is often made when the passenger is about to arrive at the station to remind the passenger of the left behind items.

[0003] However, this method of reminding passengers of missing items cannot accurately and effectively remind passengers of missing items, resulting in low efficiency of missing item reminders. Summary of the invention

[0004] The embodiments of the present application provide a method, device, controller, vehicle, medium and product for reminding passengers of missing items, which can provide passengers with targeted graded reminders of missing items according to the risk level of the passengers leaving their items behind, thereby providing passengers with accurate and effective reminders of missing items, thereby improving the efficiency of missing item reminders.

[0005] In order to achieve the above object, according to a first aspect of the present application, a method for reminding a person of missing an item is provided, the method comprising:

[0006] Acquire detection data collected from passengers in the vehicle;

[0007] identifying the risk level of the passenger's item missing based on the detection data;

[0008] An item missing reminder operation corresponding to the item missing risk level is performed on the passenger.

[0009] According to a second aspect of the present application, there is provided a device for reminding a person of missing an item, the device comprising:

[0010] An acquisition module, used to acquire detection data collected from passengers in the vehicle;

[0011] an identification module, configured to identify the risk level of the passenger's item missing based on the detection data;

[0012] The reminder module is used to perform an item missing reminder operation corresponding to the item missing risk level on the passenger.

[0013] According to a third aspect of the present application, a controller is provided, including a processor and a memory, wherein the memory stores an application program, and the processor is used to run the application program in the memory to implement the method for reminding a missing item provided in an embodiment of the present application.

[0014] According to a fourth aspect of the present application, a vehicle is provided, comprising the controller provided in the third aspect of the present application.

[0015] According to a fifth aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor to execute the steps in any one of the methods for reminding a missing item provided in the embodiments of the present application.

[0016] According to the sixth aspect of the present application, a computer program product is provided, which includes a computer program, and the computer program is stored in a computer-readable storage medium; when the processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, so that the electronic device performs the steps in the method for missing item reminder provided in an embodiment of the present application.

[0017] In the method, device, controller, vehicle, medium and product of the embodiment of the present application, the detection data collected from the passengers in the vehicle are obtained; the risk level of the passengers' items left behind is identified based on the detection data; and the item missing reminder operation corresponding to the item missing risk level is performed on the passengers. In this way, the item missing risk level of the passengers is identified based on the detection data collected from the passengers in the vehicle, and the item missing reminder operation corresponding to the item missing risk level is performed on the passengers, so that the passengers are given targeted item missing graded reminders according to the item missing risk level of the passengers, so that the passengers can be accurately and effectively reminded of the item missing, and the efficiency of the item missing reminder is effectively improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0019] Figure 1 This is a schematic diagram of an implementation scenario of a method for reminding a person of missing items provided in an embodiment of the present application;

[0020] Figure 2 It is a flowchart of a method for reminding a missing item provided in an embodiment of the present application;

[0021] Figure 3 This is a schematic diagram of the system architecture of a method for reminding a method of missing items provided in an embodiment of the present application;

[0022] Figure 4This is a schematic diagram of the overall process of a method for reminding a missing item provided in an embodiment of the present application;

[0023] Figure 5 is a schematic diagram of the structure of a device for reminding a missing item provided in an embodiment of the present application;

[0024] Figure 6 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0026] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0027] The embodiments of the present application provide a method, device, controller, vehicle, medium and product for reminding a missing item. The controller may be an electronic device, the missing item reminder device may be integrated in the electronic device, and the electronic device may be a server or a terminal.

[0028] Among them, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, network acceleration services (Content Delivery Network, CDN), and basic cloud computing services such as big data and artificial intelligence platforms. Terminals may include but are not limited to mobile phones, computers, intelligent voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, etc. Terminals and servers can be directly or indirectly connected via wired or wireless communications, and this application does not limit this.

[0029] The electronic device may be integrated into a vehicle, which may be a fuel vehicle, a plug-in hybrid vehicle, a new energy vehicle, etc. This application does not make any specific limitation on this.

[0030] See also Figure 1, taking the example of integrating the missing item reminder device into the electronic device, Figure 1 A schematic diagram of an implementation scenario of the method for reminding passengers of a missing item provided in an embodiment of the present application, wherein the electronic device can be integrated in a vehicle, and the electronic device can obtain detection data collected from passengers in the vehicle; identify the passenger's risk level of missing items based on the detection data; and perform a missing item reminder operation corresponding to the passenger's risk level of missing items.

[0031] It should be noted that Figure 1 The schematic diagram of the implementation environment scenario of the missing item reminder method is only an example. The implementation environment scenario of the missing item reminder method described in the embodiment of the present application is to more clearly illustrate the technical solution of the embodiment of the present application, and does not constitute a limitation on the technical solution provided by the embodiment of the present application. It is known to those skilled in the art that with the evolution of missing item reminders and the emergence of new business scenarios, the technical solution provided by the present application is also applicable to similar technical problems.

[0032] The solutions provided by the embodiments of the present application are specifically described by the following embodiments. It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.

[0033] This embodiment will be described from the perspective of a device for reminding a person of a missing item. Specifically, the device for reminding a person of a missing item may be integrated into an electronic device.

[0034] See also Figure 2 , Figure 2 : is a flow chart of a method for reminding a person of missing items provided in an embodiment of the present application. The method for reminding a person of missing items includes:

[0035] Step S101, acquiring detection data collected from passengers in the vehicle.

[0036] The detection data may be data collected from passengers in the vehicle. For example, the detection data may include at least one of visual detection data corresponding to the passenger and pressure detection data of an area of ​​interest corresponding to the passenger.

[0037] The visual detection data may be data of a visual modality, and may be data detected by a visual detection device, and the visual detection device may be a standard camera, an event camera, an infrared detection device, etc. The region of interest (ROI) may be an area in the vehicle that the passenger needs to pay attention to. The pressure detection data may be data detected by a pressure sensor, and may include the pressure value borne by the region of interest corresponding to the passenger.

[0038] Optionally, the visual detection data may include at least one of a first image taken by a camera and a second image taken by an event camera.

[0039] The camera may be a vehicle-mounted camera, specifically a standard camera, the first image may be an image of passengers captured by the standard camera, and the event camera may be a bionic visual sensor, also known as a dynamic visual sensor (DVS) or a dynamic and active-pixel visual sensor (DAVIS). The event camera outputs changes in pixel brightness. The second image may be an image captured by the event camera. Compared with the first image and the second image, the first image may be a static image, and the second image may be a dynamic image.

[0040] Optionally, the vehicle-mounted camera can capture images of passengers in the vehicle and operate at a low speed of less than 60 frames per second (fps), with a low dynamic range of less than 100 decibels (dB). Based on the image output by the vehicle-mounted camera, the passenger's seat position can be identified, the passenger and the surrounding area of ​​interest can be determined, and the first image of the passenger's area of ​​interest can be obtained. Among them, for the image captured in the passenger's area of ​​interest, the captured image can be subjected to high-quality lossless encoding to enhance the image quality, and for the image captured in the non-interest area, the bit rate and image quality can be reduced to save storage space.

[0041] Optionally, the event camera can capture a second image of passengers in the area of ​​interest, which operates at a high speed of less than 1 millisecond, and has a high dynamic range of more than 140dB. According to the output of the camera of the event camera, the event of interest, that is, the second image of the passenger, can be generated. Among them, the movement of the passenger can be photographed at high speed, and high-quality lossless encoding can be performed to enhance the image quality. For the non-movement behavior of the passenger, the bit rate and image quality can be reduced to save storage space and improve the calculation speed.

[0042] Optionally, the pressure detection data can be obtained by detecting a fiber optic pressure sensor. For example, the fiber optic pressure sensor can be set in the vehicle, so that the pressure detection data corresponding to the passenger can be obtained based on the fiber optic pressure sensor set in the passenger's area of ​​interest.

[0043] In one embodiment, the optical fiber pressure sensor can be installed on the front and rear seats of the vehicle, at the bottom of the door panel storage compartment, on the vehicle floor, or at the bottom of the auxiliary instrument panel storage box or cup holder. The number and location of the pressure sensors can be adjusted according to actual needs, and the present application embodiment does not limit this.

[0044] Optionally, before acquiring detection data collected for passengers in the vehicle, the region of interest corresponding to the passenger can be determined. For example, an image of the passenger can be captured by a camera in the vehicle; based on the image, the seating position of the passenger can be identified; and based on the seating position, the region of interest corresponding to the passenger in the vehicle can be determined.

[0045] The image may be an image including a passenger, and the seating position may be a position where the passenger sits in the vehicle.

[0046] In one embodiment, when a passenger sits in the left rear seat of the vehicle, the area of ​​interest corresponding to the passenger may include the left rear seat of the vehicle, the door panel storage compartment around the passenger, the vehicle floor, and the auxiliary instrument panel storage box or the bottom of the cup holder.

[0047] Step S102: Identify the risk level of the passenger's item missing based on the detection data.

[0048] The item missing risk level may be the level at which the passenger has the risk of missing items, and the item missing risk may indicate the possibility of the passenger missing items in the vehicle. The higher the level, the more likely the passenger is to miss items.

[0049] There are many ways to identify the risk level of passengers' item missing based on the detection data. For example, the risk of passengers' item missing can be identified based on visual detection data to obtain an identification result; and the risk level of passengers' item missing can be determined based on the identification result and pressure detection data.

[0050] Among them, the recognition result can be the result of identifying the risk of missing items for the passenger based on visual detection data, and the recognition result can include an item recognition result and / or a behavior recognition result. The item recognition result can be the result of identifying the risk of missing items for the passenger based on the first image, and the behavior recognition result can be the result of identifying the risk of missing items for the passenger based on the second image.

[0051] There are many ways to identify the risk of missing items from passengers based on visual detection data and obtain identification results. For example, the identification results may include item identification results and / or behavior identification results. Specifically, based on the first image, it can be identified whether the passenger has items that may be missed, and an item identification result can be obtained; and / or, based on the second image, it can be identified whether the passenger has behaviors that may lead to missing items, and a behavior identification result can be obtained.

[0052] Among them, the items that may be left behind may be the items that the passengers are more likely to leave behind in the vehicle, for example, they may include mobile phones, headphones, bags, cards, keys, lipsticks, powder cakes and the like; the behaviors that may lead to the missing items may be the behaviors that the passengers are more likely to lead to the missing items in the vehicle, for example, they may include answering the phone, rummaging through bags, touching up makeup, sleeping and the like.

[0053] Among them, based on the first image, it is identified whether the passenger has any items that may be missed, and there are multiple ways to obtain the item recognition result. For example, multiple preset item images of items that may be missed can be obtained; based on the item image and the first image, it is identified whether the passenger has any items that may be missed, and the item recognition result is obtained.

[0054] The object image may be an image of an object that is more likely to be missed, and the object image may be stored in a first database, and the first database may be an image library of objects that may be missed stored in a driving computer of the vehicle.

[0055] Among them, based on the object image and the first image, it is possible to identify whether the passenger has any objects that may be missed. There are many ways to obtain the object identification result. For example, the first image can be compared with the object images stored in the first database, so that through the deep learning algorithm, it can be autonomously identified whether there are objects with a high possibility of being missed in the picture of the first image, thereby obtaining the object identification result.

[0056] Among them, based on the second image, it is identified whether the passenger has engaged in behavior that may lead to the missing of items. There are multiple ways to obtain the behavior recognition result. For example, event images corresponding to multiple preset behaviors that may lead to the missing of items can be obtained; based on the event image and the second image, it is identified whether the passenger has engaged in behavior that may lead to the missing of items, and the behavior recognition result is obtained.

[0057] The event image may be an image corresponding to a behavior that may lead to missing items, and the event image may be stored in a second database, which may be an image library of event images of behaviors that may lead to missing items stored in the vehicle's on-board computer.

[0058] Among them, based on the event image and the second image, it is possible to identify whether the passenger has engaged in behavior that may lead to the missing of items. There are many ways to obtain the behavior recognition result. For example, the second image of the passenger may be compared with the event image stored in the second database, so that a deep learning algorithm can be used to autonomously identify whether the passenger has engaged in behavior that is more likely to lead to the missing of items, thereby obtaining the behavior recognition result.

[0059] After the recognition result is obtained, the risk level of the passenger's item missing can be determined based on the recognition result and the pressure detection data. There are many ways to determine the risk level of the passenger's item missing based on the recognition result and the pressure detection data. For example, the initial pressure detection data of the area of ​​interest before the passenger takes his seat can be obtained; based on the size comparison result of the pressure detection data and the initial pressure detection data, and the recognition result, the risk level of the passenger's item missing can be determined.

[0060] The initial pressure detection data may be the pressure value borne by the area of ​​interest corresponding to the passenger before the passenger takes his seat.

[0061] Optionally, the item missing risk level may include a first risk level and a second risk level, the first risk level may indicate that the passenger has no item missing risk, that is, the passenger is unlikely to leave items on the vehicle, and the second risk level may indicate that the passenger has an item missing risk, that is, the passenger is likely to leave items on the vehicle.

[0062] Among them, based on the size comparison result of the pressure detection data and the initial pressure detection data, as well as the recognition result, there can be multiple ways to determine the passenger's item missing risk level. For example, if the pressure detection data is less than or equal to the initial pressure detection data, the passenger's item missing risk level is determined to be the first risk level; if the pressure detection data is greater than the initial pressure detection data, whether the item missing risk level is the second risk level is determined based on the recognition result.

[0063] Among them, if the pressure detection data is less than or equal to the initial pressure detection data, it can be shown that the passenger has not placed items around the area of ​​interest, so the passenger does not have the risk of leaving items behind, and the passenger's item leaving risk level can be determined to be the first risk level. If the pressure detection data is greater than the initial pressure detection data, it can be shown that the passenger has placed items around the area of ​​interest, so the passenger has the risk of leaving items behind, and the passenger's item leaving risk level can be determined to be the second risk level. The passenger's item leaving risk level can be further determined based on the recognition result.

[0064] Optionally, the identification result may include an item identification result and a behavior identification result, and the second risk level may include a first sub-risk level, a second sub-risk level and a third sub-risk level, wherein the first sub-risk level may be a low risk level, i.e., the possibility of passengers leaving items behind is low, the second sub-risk level may be a medium risk level, i.e., the possibility of passengers leaving items behind is medium, and the third sub-risk level may be a high risk level, i.e., the possibility of passengers leaving items behind is high.

[0065] Among them, if the pressure detection data is greater than the initial pressure detection data, the step of determining whether the item omission risk level is the second risk level according to the identification result may include: if the pressure detection data is greater than the initial pressure detection data, the item identification result is no, and the behavior identification result is no, then determining the item omission risk level to be the first sub-risk level; if the pressure detection data is greater than the initial pressure detection data, the item identification result is yes, and the behavior identification result is no, then determining the item omission risk level to be the second sub-risk level; if the pressure detection data is greater than the initial pressure detection data, the item identification result is yes, and the behavior identification result is yes, then determining the item omission risk level to be the second sub-risk level.

[0066] For example, please refer to the following Table 1, in which d1 represents pressure detection data, and d0 represents initial pressure detection data. Among them, when the pressure detection data is less than or equal to the initial pressure detection data, and it is determined according to the item recognition result that the passenger does not have any items that may be missed, and according to the behavior recognition result that the passenger does not have any behavior that may lead to missed items, it can be determined that the passenger has no risk of missing items, that is, the passenger's item missing risk level is the first risk level; when the pressure detection data is less than or equal to the initial pressure detection data, and it is determined according to the item recognition result that the passenger has any items that may be missed, and according to the behavior recognition result that the passenger does not have any behavior that may lead to missed items, it can be determined that the passenger has no risk of missing items, that is, the passenger's item missing risk level is the first risk level; when the pressure detection data is less than or equal to the initial pressure detection data, and it is determined according to the item recognition result that the passenger has any items that may be missed, and according to the behavior recognition result that the passenger has any behavior that may lead to missed items, it can be determined that the passenger has no risk of missing items, that is, the passenger's item missing risk level is the first risk level; When the pressure detection data is greater than the initial pressure detection data, and it is determined according to the item recognition result that the passenger has no items that may be missed, and according to the behavior recognition result that the passenger has no behavior that may lead to missed items, it can be determined that the passenger has a low risk of missing items, that is, the passenger's risk level of missing items is the first sub-risk level; when the pressure detection data is greater than the initial pressure detection data, and it is determined according to the item recognition result that the passenger has items that may be missed, and according to the behavior recognition result that the passenger has no behavior that may lead to missed items, it can be determined that the passenger has a medium risk of missing items, that is, the passenger's risk level of missing items is the second sub-risk level; when the pressure detection data is greater than the initial pressure detection data, and it is determined according to the item recognition result that the passenger has items that may be missed, and according to the behavior recognition result that the passenger has behavior that may lead to missed items, it can be determined that the passenger has a high risk of missing items, that is, the passenger's risk level of missing items is the third sub-risk level, etc. In this way, the passenger's risk level of missing items can be accurately identified based on the recognition result and the size relationship between the pressure detection data and the initial pressure detection data.

[0067] Optionally, when the pressure detection data is less than or equal to the initial pressure detection data, and it is determined based on the item recognition result that the passenger has no items that may be missed, and it is determined based on the behavior recognition result that the passenger has behaviors that may lead to missed items, it can be determined that the passenger has no risk of missing items, that is, the passenger's item missing risk level is the first risk level.

[0068]

[0069]

[0070] Table 1

[0071] Step S103: performing an item missing reminder operation corresponding to the item missing risk level on the passenger.

[0072] The item missing reminder operation may be an operation to remind passengers whether they have left any items behind.

[0073] There are many ways to perform the missing item reminder operation corresponding to the item missing risk level on the passenger. For example, the passenger's riding status can be detected; when the passenger's riding status meets the missing item reminder conditions corresponding to the item missing risk level, the missing item reminder operation corresponding to the item missing risk level is performed on the passenger.

[0074] The riding status may be the status of the passenger riding in the vehicle, for example, it may include the status of not arriving at the station, the status of about to arrive at the station, the status of about to leave the seat, the status of leaving the seat, the status of the door opening, the status of getting off the vehicle, the status of the vehicle about to stop, etc. The missing item reminder condition may be the condition that triggers the missing item reminder to the passenger, for example, the riding status of the passenger may be the status of about to arrive at the station, the status of about to leave the seat, or the status of leaving the seat, etc. The specific conditions may be set according to the actual situation, and the embodiments of the present application are not limited here.

[0075] Optionally, different missing item reminder conditions may be set corresponding to different item missing risk levels. For example, for the first risk level, the missing item reminder condition may be triggered when the passenger is about to leave the seat; for the first sub-risk level, the missing item reminder condition may be triggered when the vehicle door is open; for the second sub-risk level, the missing item reminder condition may be triggered when the vehicle is about to stop; for the third sub-risk level, the missing item reminder condition may be triggered when the passenger is about to arrive at the station, etc.

[0076] Optionally, when the passenger's item missing risk level is the first risk level with no risk, there is no need to remind the passenger of the item missing; when the passenger's item missing risk level is the first sub-risk level with low risk, the first-level item missing warning can be turned on; when the passenger's item missing risk level is the second sub-risk level with medium risk, the second-level item missing warning can be turned on; when the passenger's item missing risk level is the third sub-risk level with high risk, the third-level item missing warning can be turned on.

[0077] Optionally, if the item missing risk level is the first sub-risk level, the item missing reminder operation may include: broadcasting an item missing reminder voice corresponding to the first sub-risk level.

[0078] The item left behind reminder voice may be a voice to remind passengers not to leave items behind, for example, it may be a voice announcement of "Please check your belongings". For example, the opening state of the doors around the passenger's area of ​​interest may be detected, and when the doors are open, a voice announcement of "Please check your belongings" may be made.

[0079] Optionally, if the item missing risk level is the second sub-risk level or the third sub-risk level, the step of performing a missing item reminder operation corresponding to the item missing risk level on the passenger may include one of the following: when the item missing risk level is the second sub-risk level, performing a first reminder operation, or, when the item missing risk level is the third sub-risk level, performing a second reminder operation, and detecting a vehicle locking signal generated by the vehicle; if a vehicle locking signal is detected, pushing a missing item reminder message to the terminal device corresponding to the passenger and / or driver.

[0080] The first reminder operation may be a reminder operation performed on the passenger when the risk level of the passenger's item missing is the second sub-risk level, and the second reminder operation may be a reminder operation performed on the passenger when the risk level of the passenger's item missing is the third sub-risk level. The terminal device corresponding to the passenger and / or the driver may be a terminal device used by the passenger, or a terminal device bound to the driver of the vehicle, such as a mobile phone, a watch, a tablet or other electronic device. The missing item reminder information may be information that reminds the passenger that there is a missing item.

[0081] The durations of the first reminder operation and the second reminder operation may be different, and both the first reminder operation and the second reminder operation include a target reminder behavior.

[0082] The target reminder behavior may be a reminder behavior common to the first reminder operation and the second reminder operation.

[0083] Among them, the method of executing the target reminder behavior may include: controlling the seat where the passenger is located to vibrate and outputting a first reminder signal; if it is detected that the passenger has left the seat, detecting first pressure detection data of the area of ​​interest; if the first pressure detection data is greater than the initial pressure detection data, controlling the vehicle to output a second reminder signal.

[0084] The first reminder signal may be a signal to remind passengers that there is a suspected missing item, for example, it may be a beeping reminder sound, and the first pressure detection data may be the pressure value detected in the area of ​​interest corresponding to the passenger after the passenger leaves the seat. The second reminder signal may be a signal to remind passengers that there is a suspected missing item when the first pressure detection data is greater than the initial pressure detection data. For example, the second reminder signal may be a flashing of the missing item icon configured on the display screen of the vehicle, and a whistle sound may be emitted by the vehicle.

[0085] For example, if the risk level of a passenger's item being left behind is the second sub-risk level, a secondary warning may be triggered when the passenger is about to arrive at the station, and the seat in the area of ​​interest corresponding to the passenger may be controlled to vibrate, accompanied by a beeping reminder sound, i.e., a first reminder signal, to remind the passenger that there is suspected item being left behind. The prompt of the first reminder signal may end when d1≤d0 is detected, or when it is manually closed, or automatically after 1 minute (the time can be set by yourself). After the prompt ends, the door opening status may be continuously detected. When the door is opened and the passenger leaves the seat, the first pressure detection data d2 detected by the pressure sensor in the area of ​​interest corresponding to the passenger may be detected. If d2>d0, a missing item warning may be triggered again, and the missing item icon on the vehicle's display screen may be controlled to flash, and the vehicle may be controlled to emit a whistle sound, and the warning may end after the door is closed.

[0086] For example, if the risk level of a passenger's item missing is the third sub-risk level, when the passenger is about to arrive at the station, the third-level warning can be triggered, and the seat in the area of ​​interest corresponding to the passenger can be controlled to vibrate, accompanied by a beeping reminder sound, that is, the second reminder signal, to remind the passenger that there is a suspected missing item. The prompt of the second reminder signal can end when d1≤d0 is detected, or when it is manually closed, or automatically end after 2 minutes (the time can be set by yourself). After the prompt ends, the door opening state can be continuously detected. When the door is opened and the passenger leaves the seat, the first pressure detection data d2 detected by the pressure sensor in the area of ​​interest corresponding to the passenger can be detected. If d2>d0, the missing item warning can be triggered again, and the missing item icon on the display screen of the vehicle can be controlled to flash, and the vehicle can be controlled to emit a whistle sound. After the door is closed, the warning ends. Then, it can be monitored whether the vehicle generates a locking signal. When the vehicle is locked and a locking signal is generated, a suspected missing item message (i.e., missing item prompt information) can be immediately pushed to the owner's mobile phone.

[0087] Accordingly, the present application embodiment provides an item missing detection system corresponding to the item missing reminder method, for example, please refer to Figure 3 , Figure 3This is a schematic diagram of the system architecture of a method for reminding a missing item provided by an embodiment of the present application. The missing item detection system can be composed of an information acquisition module, an evaluation and determination module, a central control module, and an early warning execution module. The information acquisition module can obtain a static image of the vehicle's area of ​​interest (i.e., the first image) and a dynamic image of an event of interest (i.e., the second image). Through a deep learning algorithm, it can be determined whether there are items with a high probability of being forgotten and behaviors that are likely to cause the items to be forgotten. Combined with the pressure value changes of the pressure sensor buried in the area inside the vehicle, the corresponding risk level of missing items for the passenger is determined and the location of the missing items is determined. A graded early warning is performed according to the risk level of missing items, so that the result of the risk determination of missing items is more accurate and convenient, and the key reminder areas and reminder cycles can be customized to avoid false alarms and frequent reminders, effectively improving the passenger's riding experience.

[0088] Among them, the information acquisition module can be composed of a vehicle-mounted standard camera, a vehicle-mounted event camera, and an optical fiber pressure sensor. The evaluation and determination module can be used to receive a first image of the vehicle's area of ​​interest and a second image of the event of interest, and through a deep learning algorithm, autonomously identify whether there are items that may be missed in the area of ​​interest in the vehicle, and the behavior that may cause the item to be missed, and combine the pressure value change of the optical fiber pressure sensor to determine the passenger's item missing risk level. The central control module can be used to receive the item missing risk level input by the evaluation and determination module, and control the early warning execution module to perform graded reminders. The central control module can be used to implement custom settings for key reminder areas and reminder cycles. Before or after passengers get on the bus, the working state of each pressure sensor can be set through the remote control terminal or the control panel in the car. When it is necessary to temporarily store items in a certain reminder area in the car, the pressure sensor in the area can be manually turned off, and the closing time can be set to avoid poor riding experience caused by false alarms and improve the riding experience.

[0089] In a specific embodiment, please refer to Figure 4 , Figure 4It is a schematic diagram of the overall process of a method for reminding a missing item provided in an embodiment of the present application. A passenger or a driver can set or confirm the activation status of each pressure sensor located in the vehicle through a remote control terminal. When it is necessary to activate the missing item detection function, the information acquisition module can be started. When it is not necessary to perform missing item detection, the information acquisition module can be turned off. When the item missing detection function is turned on, when it is detected that the door is opened, the pressure sensors arranged at key positions in the vehicle are controlled to record the initial pressure detection data d0. When the passenger takes a seat, the standard camera arranged in the vehicle can capture the image of the passenger. According to the captured image, the seat position of the passenger is identified and determined, and the passenger and its surroundings are determined as the region of interest ROI. Then, the static image of the region of interest ROI of the passenger in the vehicle, the pressure detection data obtained by pressure monitoring of the region of interest ROI, and the dynamic image of the passenger in the region of interest ROI can be obtained through the on-board standard camera, so that the evaluation and determination module can determine the item missing risk level based on the collected detection data to determine whether the passenger's item missing risk level is no risk, low risk, medium risk, or high risk, so that the corresponding item missing warning can be issued. For example, a first-level warning can be turned on for a low-risk item missing risk level, a second-level warning can be turned on for a medium-risk item missing risk level, and a third-level warning can be turned on for a high-risk item missing risk level.

[0090] In this way, the item missing reminder method provided in the embodiment of the present application can make a comprehensive judgment from three aspects, namely, possible item missing, behavior leading to item missing, and pressure value change, so as to accurately determine the passenger's item missing risk level. Compared with the existing item missing reminder method, it can have higher convenience, feasibility and accuracy, and can provide graded warnings for item missing risks while avoiding false alarms, taking into account both warning effect and driving experience, thereby improving the efficiency of item missing reminders.

[0091] As can be seen from the above, the embodiment of the present application obtains the detection data collected from the passengers in the vehicle; identifies the risk level of the passengers' items left behind based on the detection data; and performs the item missing reminder operation corresponding to the item missing risk level on the passengers. In this way, by identifying the risk level of the passengers' items left behind based on the detection data collected from the passengers in the vehicle, and thus performing the item missing reminder operation corresponding to the item missing risk level on the passengers, targeted item missing graded reminders are provided to the passengers according to the item missing risk level of the passengers, so that the passengers can be accurately and effectively reminded of the items left behind, and the efficiency of the item missing reminder is effectively improved.

[0092] In order to better implement the missing item reminder method provided in the embodiment of the present application, the embodiment of the present application also provides a device based on the missing item reminder method. The meanings of the terms are the same as those in the missing item reminder method, and the specific implementation details can refer to the description in the method embodiment.

[0093] For example, Figure 5 As shown, it is a schematic diagram of the structure of the missing item reminder device provided in an embodiment of the present application. The missing item reminder device may include an acquisition module 201, an identification module 202 and a reminder module 203, which are specifically as follows:

[0094] An acquisition module 201 is used to acquire detection data collected from passengers in the vehicle;

[0095] An identification module 202, for identifying a passenger's item missing risk level based on the detection data;

[0096] The reminder module 203 is used to perform an item missing reminder operation corresponding to the item missing risk level on the passenger.

[0097] In one embodiment, the detection data includes at least one of visual detection data corresponding to the passenger and pressure detection data of an area of ​​interest corresponding to the passenger.

[0098] In one embodiment, the identification module 202 includes:

[0099] The identification submodule is used to identify the risk of missing items of passengers based on visual detection data and obtain identification results;

[0100] The determination submodule is used to determine the risk level of the passenger's item missing according to the recognition result and the pressure detection data.

[0101] In one embodiment, the visual detection data includes at least one of a first image captured by a camera and a second image captured by an event camera.

[0102] In one embodiment, the recognition result includes an object recognition result and / or a behavior recognition result, and the recognition submodule includes:

[0103] A first recognition unit is used to recognize whether the passenger has any items that may be left behind based on the first image, and obtain an item recognition result;

[0104] and / or,

[0105] The second recognition unit is used to recognize, based on the second image, whether the passenger has a behavior that causes the item to be left behind, and obtain a behavior recognition result.

[0106] In one embodiment, the first identification unit is used to:

[0107] Acquire multiple preset object images of potentially missed objects;

[0108] Based on the object image and the first image, it is identified whether the passenger has any object that may be missed, and an object identification result is obtained.

[0109] In one embodiment, the second identification unit is used to:

[0110] Acquire event images corresponding to multiple preset behaviors that may cause missing items;

[0111] Based on the event image and the second image, it is identified whether the passenger has a behavior that causes the item to be left behind, and a behavior recognition result is obtained.

[0112] In one embodiment, determining a submodule includes:

[0113] A pressure detection unit, used to obtain initial pressure detection data of the area of ​​interest before the passenger takes his seat;

[0114] The level determination unit is used to determine the risk level of the passenger's item missing based on the size comparison result of the pressure detection data and the initial pressure detection data, and the recognition result.

[0115] In one embodiment, the item missing risk level includes a first risk level and a second risk level, the first risk level indicates that the passenger has no item missing risk, and the second risk level indicates that the passenger has an item missing risk;

[0116] Level determination units, including:

[0117] a first level determination subunit, configured to determine that the risk level of the passenger's item missing is a first risk level if the pressure detection data is less than or equal to the initial pressure detection data;

[0118] The second level determination subunit is used to determine whether the item missing risk level is the second risk level according to the recognition result if the pressure detection data is greater than the initial pressure detection data.

[0119] In one embodiment, the recognition result includes an object recognition result and a behavior recognition result, the second risk level includes a first sub-risk level, a second sub-risk level, and a third sub-risk level, and the second level determination subunit is used to:

[0120] If the pressure detection data is greater than the initial pressure detection data, the item recognition result is negative, and the behavior recognition result is negative, then the item missing risk level is determined to be the first sub-risk level;

[0121] If the pressure detection data is greater than the initial pressure detection data, the item recognition result is yes, and the behavior recognition result is no, then the item missing risk level is determined to be the second sub-risk level;

[0122] If the pressure detection data is greater than the initial pressure detection data, the object recognition result is yes, and the behavior recognition result is yes, then the object missing risk level is determined to be the second sub-risk level.

[0123] In one embodiment, the reminder module 203 includes:

[0124] A status detection submodule is used to detect the riding status of passengers;

[0125] The missing item reminder submodule is used to perform a missing item reminder operation corresponding to the missing item risk level on the passenger when the passenger's riding status meets the missing item reminder condition corresponding to the missing item risk level.

[0126] In one embodiment, if the item missing risk level is the first sub-risk level, the item missing reminder operation includes: broadcasting an item missing reminder voice corresponding to the first sub-risk level.

[0127] In one embodiment, if the item missing risk level is the second sub-risk level or the third sub-risk level, the reminder sub-module includes one of the following:

[0128] a first reminding unit, configured to execute a first reminding operation when the item missing risk level is a second sub-risk level, or

[0129] A second reminder unit, configured to execute a second reminder operation when the risk level of item missing is a third sub-risk level, and detect a vehicle locking signal generated by the vehicle;

[0130] The third reminder unit is used to push a missing item reminder message to the terminal device corresponding to the passenger and / or the driver if a vehicle locking signal is detected.

[0131] In one embodiment, the duration of the first reminder operation and the second reminder operation are different, and both the first reminder operation and the second reminder operation include a target reminder behavior.

[0132] In one embodiment, the first reminder unit and the second reminder unit are used to:

[0133] Controlling the seat where the passenger is seated to vibrate and outputting a first reminder signal;

[0134] If it is detected that the passenger leaves the seat, detecting first pressure detection data of the area of ​​interest;

[0135] If the first pressure detection data is greater than the initial pressure detection data, the vehicle is controlled to output a second reminder signal.

[0136] In one embodiment, the device for reminding a missing item further includes an area of ​​interest detection module, which is used to:

[0137] Capturing images of passengers through cameras in the vehicle;

[0138] Based on the image, identify the passenger's seat position;

[0139] Based on the seating positions, regions of interest corresponding to the passengers in the vehicle are determined.

[0140] As can be seen from the above, the embodiment of the present application is configured with a message distribution component in the kernel, and the kernel is implemented based on the first core of the target chip. The acquisition module 201 acquires the detection data collected from the passengers in the vehicle; the identification module 202 identifies the risk level of the passenger's item missing based on the detection data; and the reminder module 203 performs the item missing reminder operation corresponding to the item missing risk level on the passenger. In this way, by identifying the risk level of the passenger's item missing based on the detection data collected from the passenger in the vehicle, the item missing reminder operation corresponding to the item missing risk level is performed on the passenger, and the targeted item missing graded reminder is implemented for the passenger according to the risk level of the passenger's item missing, so that the passenger can be accurately and effectively reminded of the item missing, and the efficiency of the item missing reminder is effectively improved.

[0141] Accordingly, the embodiment of the present application further provides a controller, including a processor and a memory, wherein the memory stores an application program, and the processor is used to run the application program in the memory to implement the method for reminding a missing item provided in the embodiment of the present application. The controller may be an electronic device.

[0142] Correspondingly, an embodiment of the present application also provides a vehicle, which may include the controller provided by an embodiment of the present application.

[0143] Accordingly, the present application also provides an electronic device, such as Figure 6 As shown, Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 300 includes a processor 301 having one or more processing cores, a memory 302 having one or more computer-readable storage media, and a computer program stored in the memory 302 and executable on the processor. The processor 301 is electrically connected to the memory 302. Those skilled in the art will appreciate that the electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown, or combine certain components, or arrange components differently.

[0144] The processor 301 is the control center of the electronic device 300, and uses various interfaces and lines to connect various parts of the entire electronic device 300. By running or loading software programs and / or units stored in the memory 302, and calling data stored in the memory 302, the processor 301 executes various functions of the electronic device 300 and processes data. The processor 301 can be a processor CPU, a graphics processor GPU, a network processor (Network Processor, NP), etc., and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application.

[0145] In the embodiment of the present application, the processor 301 in the electronic device 300 will load instructions corresponding to the processes of one or more application programs into the memory 302 according to the following steps, and the processor 301 will run the application programs stored in the memory 302 to implement various functions, such as:

[0146] Acquire detection data collected from passengers in the vehicle; identify the passenger's item missing risk level based on the detection data; and perform an item missing reminder operation corresponding to the item missing risk level on the passenger.

[0147] Furthermore, various functions implemented by running the application program stored in the memory 302 can also be found in the description of the aforementioned embodiment, which will not be repeated here.

[0148] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0149] Optional, such as Figure 6 As shown, the electronic device 300 further includes: a touch screen 303, a radio frequency circuit 304, an audio circuit 305, an input unit 306, and a power supply 307. The processor 301 is electrically connected to the touch screen 303, the radio frequency circuit 304, the audio circuit 305, the input unit 306, and the power supply 307, respectively. Those skilled in the art can understand that Figure 6 The electronic device structure shown in the figure does not constitute a limitation of the electronic device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0150] The touch display screen 303 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display screen 303 may include a display panel and a touch panel. Among them, the display panel can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device, and these graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light-emitting diode (OLED, Organic Light-Emitting Diode) and the like. The touch panel can be used to collect the user's touch operation on or near it (such as the user uses any suitable object or attachment such as a finger, a stylus, etc. on the touch panel or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 301, and can receive the command sent by the processor 301 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 301 to determine the type of touch event, and then the processor 301 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 303 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 303 can also be used as a part of the input unit 306 to realize the input function.

[0151] The radio frequency circuit 304 may be used to send and receive radio frequency signals, so as to establish wireless communication with a network device or other electronic devices through wireless communication, and to send and receive signals with the network device or other electronic devices.

[0152] The audio circuit 305 can be used to provide an audio interface between the user and the electronic device through a speaker and a microphone. The audio circuit 305 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 305 and converted into audio data, and then the audio data is output to the processor 301 for processing, and then sent to another electronic device through the radio frequency circuit 304, or the audio data is output to the memory 302 for further processing. The audio circuit 305 may also include an earplug jack to provide communication between an external headset and the electronic device.

[0153] The input unit 306 may be used to receive input target video and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0154] The power supply 307 is used to supply power to various components of the electronic device 300. Optionally, the power supply 307 can be logically connected to the processor 301 through a power management system, so that the power management system can manage charging, discharging, and power consumption. The power supply 307 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0155] although Figure 6 Not shown, the electronic device 300 may also include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0156] In the above embodiments, the description of each embodiment has its own emphasis. For the parts not described in detail in a certain embodiment, please refer to the relevant description of other embodiments. It should be noted that the electronic device provided in the embodiment of the present application and the method for reminding the missing item in the above embodiment belong to the same concept. The specific implementation process is detailed in the above method embodiment and will not be repeated here.

[0157] As can be seen from the above, the electronic device provided in the embodiment of the present application can obtain the detection data collected from the passengers in the vehicle; identify the risk level of the passengers' items left behind based on the detection data; and perform the item missing reminder operation corresponding to the item missing risk level on the passengers. In this way, by identifying the risk level of the passengers' items left behind based on the detection data collected from the passengers in the vehicle, and thus performing the item missing reminder operation corresponding to the item missing risk level on the passengers, it is possible to provide the passengers with targeted item missing graded reminders according to the risk level of the passengers' items left behind, thereby providing the passengers with accurate and effective item missing reminders, and effectively improving the efficiency of item missing reminders.

[0158] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0159] To this end, an embodiment of the present application provides a computer-readable storage medium, which includes a computer program. When the computer program is run on an electronic device, the computer program is used to enable the electronic device to perform any of the missing item reminder methods provided in the embodiments of the present application. For example, the computer program can perform the following steps of the missing item reminder method:

[0160] Acquire detection data collected from passengers in the vehicle; identify the passenger's item missing risk level based on the detection data; and perform an item missing reminder operation corresponding to the item missing risk level on the passenger.

[0161] Furthermore, for the detailed steps of the above method steps, reference can be made to the description in the above embodiments, which will not be repeated here.

[0162] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0163] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0164] Since the computer program stored in the computer-readable storage medium can execute any of the methods for reminding a person of a missing item provided in the embodiments of the present application, the beneficial effects that can be achieved by any of the methods for reminding a person of a missing item provided in the embodiments of the present application can be achieved. For details, please refer to the previous embodiments and will not be repeated here.

[0165] According to one aspect of the present application, a computer program product is also provided, including a computer program, which is stored in a computer-readable storage medium; when a processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, so that the electronic device executes the methods provided in various optional implementations of the above embodiments.

[0166] In the above-mentioned embodiments of the missing item reminder device, computer-readable storage medium, controller, electronic device, vehicle, and computer program product, the description of each embodiment has its own emphasis. For parts not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process and beneficial effects of the above-mentioned missing item reminder device, computer-readable storage medium, controller, vehicle, computer program product, electronic device and its corresponding units can refer to the description of the missing item reminder method in the above embodiment, and will not be repeated here.

[0167] The above is a detailed introduction to a method, device, controller, vehicle, computer-readable storage medium and computer program product for reminding a missing item provided in an embodiment of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A method for reminding when an item is left behind, characterized in that: include: Acquire detection data collected from passengers in the vehicle; identifying the risk level of the passenger's item missing based on the detection data; An item missing reminder operation corresponding to the item missing risk level is performed on the passenger.

2. The method for reminding a person of missing an item according to claim 1, characterized in that: The detection data includes at least one of visual detection data corresponding to the passenger and pressure detection data of an area of ​​interest corresponding to the passenger.

3. The method for reminding a person of missing an item according to claim 2, characterized in that: The identifying the risk level of the passenger's item missing based on the detection data includes: Based on the visual detection data, the passenger is identified for the risk of missing items, and an identification result is obtained; The risk level of the passenger's item missing is determined according to the recognition result and the pressure detection data.

4. The method for reminding a person of missing an item according to claim 3, characterized in that: The visual detection data includes at least one of a first image captured by a camera and a second image captured by an event camera.

5. The method for reminding a person of missing an item according to claim 4, characterized in that: The identification result includes an item identification result and / or a behavior identification result. The identification of the risk of missing items on the passenger based on the visual detection data to obtain the identification result includes: Based on the first image, identifying whether the passenger has any items that may be left behind, and obtaining an item identification result; and / or, Based on the second image, it is identified whether the passenger has a behavior that causes the item to be left behind, and a behavior recognition result is obtained.

6. The method for reminding a person of missing an item according to claim 5, characterized in that: The step of identifying, based on the first image, whether the passenger has any items that may be left behind, and obtaining an item identification result includes: Acquire multiple preset object images of potentially missed objects; Based on the object image and the first image, it is identified whether the passenger has any object that may be left behind, and an object identification result is obtained.

7. The method for reminding a person of missing an item according to claim 5, characterized in that: The identifying, based on the second image, whether the passenger has a behavior that causes the item to be left behind, and obtaining a behavior identification result, comprises: Acquire event images corresponding to multiple preset behaviors that may cause missing items; Based on the event image and the second image, it is identified whether the passenger has a behavior that causes the item to be left behind, and a behavior recognition result is obtained.

8. The method for reminding a person of missing an item according to claim 5, characterized in that: The step of determining the risk level of the passenger's item missing according to the recognition result and the pressure detection data includes: Acquire initial pressure detection data of the region of interest before the passenger takes his seat; Based on the comparison result between the pressure detection data and the initial pressure detection data and the recognition result, the risk level of the passenger's item missing is determined.

9. The method for reminding a person of missing an item according to claim 8, characterized in that: The item missing risk level includes a first risk level and a second risk level, the first risk level indicating that the passenger has no item missing risk, and the second risk level indicating that the passenger has an item missing risk; The step of determining the risk level of the passenger's item missing based on the comparison result between the pressure detection data and the initial pressure detection data and the recognition result includes: If the pressure detection data is less than or equal to the initial pressure detection data, determining that the passenger's item missing risk level is a first risk level; If the pressure detection data is greater than the initial pressure detection data, it is determined whether the item missing risk level is a second risk level according to the recognition result.

10. The method for reminding a person of missing an item according to claim 9, characterized in that: The recognition result includes an item recognition result and a behavior recognition result, the second risk level includes a first sub-risk level, a second sub-risk level, and a third sub-risk level, and if the pressure detection data is greater than the initial pressure detection data, determining whether the item missing risk level is the second risk level according to the recognition result includes: If the pressure detection data is greater than the initial pressure detection data, the item recognition result is negative, and the behavior recognition result is negative, determining that the item missing risk level is the first sub-risk level; If the pressure detection data is greater than the initial pressure detection data, the item recognition result is yes, and the behavior recognition result is no, determining that the item missing risk level is the second sub-risk level; If the pressure detection data is greater than the initial pressure detection data, the item recognition result is yes, and the behavior recognition result is yes, then the item missing risk level is determined to be the second sub-risk level.

11. The method for reminding a person of missing an item according to claim 10, characterized in that: The performing the item missing reminder operation corresponding to the item missing risk level on the passenger includes: detecting the riding status of the passenger; When the riding status of the passenger meets the missing item reminder condition corresponding to the missing item risk level, the missing item reminder operation corresponding to the missing item risk level is performed on the passenger.

12. The method for reminding a person of missing an item according to claim 11, characterized in that: If the item missing risk level is the first sub-risk level, the item missing reminder operation includes: broadcasting an item missing reminder voice corresponding to the first sub-risk level.

13. The method for reminding a person of missing an item according to claim 11, characterized in that: If the item missing risk level is the second sub-risk level or the third sub-risk level, performing the item missing reminder operation corresponding to the item missing risk level on the passenger includes one of the following: When the item missing risk level is the second sub-risk level, a first reminder operation is performed, or, When the item missing risk level is the third sub-risk level, performing a second reminder operation and detecting a vehicle locking signal generated by the vehicle; If it is detected that the vehicle generates a locking signal, a missing item reminder message is pushed to the terminal device corresponding to the passenger and / or driver.

14. The method for reminding a person of missing an item according to claim 13, characterized in that: The first reminder operation and the second reminder operation have different durations, and both the first reminder operation and the second reminder operation include a target reminder behavior.

15. The method for reminding a person of missing an item according to claim 14, characterized in that: Perform goal-reminder behaviors, including: Controlling the seat where the passenger is located to vibrate and output a first reminder signal; If it is detected that the passenger leaves the seat, detecting first pressure detection data of the area of ​​interest; If the first pressure detection data is greater than the initial pressure detection data, the vehicle is controlled to output a second reminder signal.

16. The method for reminding a person of missing an item according to claim 2, characterized in that: Before acquiring the detection data collected from the passengers in the vehicle, the method further includes: Capturing images of passengers through cameras in the vehicle; Based on the image, identifying the seating position of the passenger; Based on the seating position, a region of interest corresponding to the passenger in the vehicle is determined.

17. A device for reminding a person of missing an item, characterized in that: include: An acquisition module, used to acquire detection data collected from passengers in the vehicle; an identification module, configured to identify the risk level of the passenger's item missing based on the detection data; The reminder module is used to perform an item missing reminder operation corresponding to the item missing risk level on the passenger.

18. A controller, characterized in that: It comprises a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of any one of the methods of claims 1 to 16.

19. A vehicle, characterized in that: The vehicle includes a controller as claimed in claim 18.

20. A computer-readable storage medium, characterized in that: It comprises a computer program. When the computer program is run on an electronic device, the computer program is used to enable the electronic device to execute the steps of any method described in claims 1 to 16.

21. A computer program product, characterized in that The invention comprises a computer program, which implements the steps of the method according to any one of claims 1 to 16 when being executed by a processor.

Images