Method, device, equipment and storage medium for identifying lost property behavior of people on board

Abstract

The disclosed embodiments relate to a method, device, equipment and storage medium for identifying the behavior of a person on board losing objects. The method comprises: obtaining vehicle interior status data of a vehicle at a first moment, determining a current set of objects corresponding to the person on board according to the vehicle interior status data, and identifying whether the person on board has the behavior of losing objects outside the vehicle according to the current set of objects and a pre-acquired original set of objects.

Description

Technical Field

[0001] The present disclosure relates to the field of artificial intelligence technology, and more specifically, to a method for identifying lost items by a person on board, a device for identifying lost items by a person on board, a device for identifying lost items by a person on board, and a computer-readable storage medium. Background Art

[0002] With the rapid development of society, the number of vehicles is increasing day by day, and traveling by vehicle has become an important mode of travel for people in their daily lives, such as traveling by public transportation, traveling by self-driving vehicles, etc.

[0003] At present, there is a common phenomenon in society that people on the vehicle throw objects out of the vehicle at will while traveling in the vehicle. This not only causes pollution to the surrounding environment, but also causes various traffic accidents, posing a great safety hazard to driving safety.

[0004] Therefore, in order to effectively reduce the phenomenon of people on board throwing objects out of the vehicle at will, it is necessary to provide a method for identifying the behavior of people on board throwing objects. Summary of the invention

[0005] One purpose of the embodiments of the present disclosure is to provide a new technical solution for identifying lost objects by people on board.

[0006] According to a first aspect of the present disclosure, a method for identifying lost items by a person on board a vehicle is provided, the method comprising:

[0007] Acquire the vehicle interior status data of the vehicle at the first moment;

[0008] Determine a current set of items corresponding to the person in the vehicle according to the vehicle status data;

[0009] According to the current set of items and the pre-acquired original set of items, it is identified whether the person on the vehicle has a behavior of throwing items outside the vehicle.

[0010] Optionally, identifying whether the person on the vehicle has a behavior of throwing objects outside the vehicle according to the current set of objects and the original set of objects includes:

[0011] Determining whether the current item set is consistent with the original item set;

[0012] In the case where the current set of items is consistent with the original set of items, identifying that the person on the vehicle has no behavior of throwing items outside the vehicle;

[0013] When the current item set is inconsistent with the original item set, it is identified that the person on the vehicle has a behavior of throwing objects out of the vehicle.

[0014] Optionally, identifying whether the person on the vehicle has a behavior of throwing objects outside the vehicle according to the current set of objects and the original set of objects further includes:

[0015] When the current item set is inconsistent with the original item set, acquiring vehicle exterior condition data at a second time, wherein the first time is earlier than the second time;

[0016] Determining whether there are any external objects outside the vehicle according to the external vehicle condition data;

[0017] In the case where there are objects outside the vehicle, identifying the behavior of the person on the vehicle throwing objects outside the vehicle;

[0018] In the case that there are no objects outside the vehicle, it is identified that the person in the vehicle has no behavior of throwing objects outside the vehicle.

[0019] Optionally, identifying whether the person on the vehicle has a behavior of throwing objects outside the vehicle according to the current set of objects and the original set of objects further includes:

[0020] In the case that there are external items outside the vehicle, determining the difference items between the current item set and the original item set;

[0021] Determining whether the difference item is consistent with the item outside the vehicle;

[0022] In the case where the discrepancy object is consistent with the object outside the vehicle, identifying that the person on the vehicle has thrown an object outside the vehicle;

[0023] When the difference object is inconsistent with the object outside the vehicle, it is identified that the person on the vehicle does not throw objects outside the vehicle.

[0024] Optionally, identifying whether the person on the vehicle has a behavior of throwing objects outside the vehicle according to the current set of objects and the original set of objects further includes:

[0025] In the case where there is an object outside the vehicle, determining whether the time difference between the second moment and the first moment is lower than a preset threshold;

[0026] When the time difference is lower than a preset threshold, identifying that the person on the vehicle has thrown something outside the vehicle;

[0027] When the time difference is not lower than a preset threshold, it is identified that the person on the vehicle does not throw objects outside the vehicle.

[0028] Optionally, identifying whether the person on the vehicle has a behavior of throwing objects outside the vehicle according to the current set of objects and the original set of objects further includes:

[0029] In the case where there are objects outside the vehicle, obtaining the window status of the vehicle within a specific time period, wherein the specific time period is a time period from the first moment to the second moment;

[0030] When the vehicle window state includes an open state, identifying that the person in the vehicle has thrown something outside the vehicle;

[0031] When the window state does not include an open state, it is identified that the person in the vehicle does not throw objects outside the vehicle.

[0032] Optionally, identifying whether the person on the vehicle has a behavior of throwing objects outside the vehicle according to the current set of objects and the original set of objects further includes:

[0033] In the case that the current item set is inconsistent with the original item set, obtaining a positional relationship between a hand of the person on the vehicle and a window of the vehicle at a third moment, wherein the third moment is earlier than the first moment;

[0034] In the case where the positional relationship is that the hand of the person on the vehicle is located outside the window of the vehicle, identifying that the person on the vehicle has a behavior of throwing objects outside the vehicle;

[0035] When the positional relationship is that the hand of the person on the vehicle is located within the window of the vehicle, it is identified that the person on the vehicle does not have the behavior of throwing objects outside the vehicle.

[0036] Optionally, the method further includes: in the case where it is identified that the person on the vehicle has a behavior of throwing objects outside the vehicle, performing at least one of the following:

[0037] The first item is to use the vehicle's on-board visual equipment to warn people on board of lost items; the second item is to use the vehicle's on-board speakers to warn people on board of lost items; the third item is to plan a parking route through the vehicle's automatic driving system and control the vehicle to park at a designated location based on the parking route.

[0038] Optionally, the step of obtaining the original item set includes:

[0039] Monitor whether there are people in the vehicle;

[0040] When it is detected that there is a person in the vehicle, the vehicle interior status data is obtained;

[0041] According to the in-vehicle status data, the original item set corresponding to the person in the vehicle is determined and obtained.

[0042] According to a second aspect of the present disclosure, a device for identifying lost items by a person on board is provided, comprising:

[0043] An acquisition module, used for acquiring the vehicle interior status data at a first moment;

[0044] A determination module, used to determine a current set of items corresponding to the person in the vehicle according to the vehicle status data;

[0045] The identification module is used to identify whether the person on the vehicle has thrown objects outside the vehicle based on the current set of objects and the pre-acquired original set of objects.

[0046] According to a third aspect of the present disclosure, an embodiment of a device for identifying lost items by a person on board is provided, comprising the device for identifying lost items by a person on board as described in the third aspect of the present specification, or comprising:

[0047] A memory for storing executable commands;

[0048] The processor is used to execute the method for identifying lost property behavior of people on board as described in the first aspect of this specification under the control of the executable command.

[0049] According to the fourth aspect of the present disclosure, an embodiment of a computer-readable storage medium is also provided, which stores executable instructions. When the executable instructions are executed by a processor, the method for identifying the lost object behavior of people on the vehicle as described in the first aspect of this specification is executed.

[0050] One beneficial effect of the disclosed embodiment is that, by comparing the current set of items corresponding to the current occupants with the original set of items corresponding to when the occupants just got on the vehicle, the embodiment can effectively identify whether the occupants have the behavior of throwing objects out of the vehicle, thereby greatly reducing the phenomenon of occupants throwing objects out of the vehicle at will when traveling in the vehicle.

[0051] Further features and advantages of the present invention will become apparent from the following detailed description of exemplary embodiments of the present invention with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0053] Figure 1 It is a block diagram of the hardware configuration of a device for identifying lost items by a person on board a vehicle provided by an embodiment of the present disclosure;

[0054] Figure 2 It is a flow chart of a method for identifying lost items by a person on board a vehicle provided by an embodiment of the present disclosure;

[0055] Figure 3 It is a structural schematic diagram of a device for identifying lost items by a person on board a vehicle provided by an embodiment of the present disclosure;

[0056] Figure 4 It is a structural schematic diagram of a device for identifying lost objects by people on board provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0057] Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present invention unless otherwise specifically stated.

[0058] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.

[0059] Technologies, methods and equipment known to persons of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods and equipment should be considered part of the specification.

[0060] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0061] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0062] <Hardware Configuration>

[0063] Figure 1 It is a block diagram of the hardware configuration of a device for identifying lost items by people on board provided in an embodiment of the present disclosure.

[0064] The vehicle personnel lost object behavior recognition device 1000 can be a virtual machine or a physical machine. The vehicle personnel lost object behavior recognition device 1000 can include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and the like. Among them, the processor 1100 can be a central processing unit CPU, a microprocessor MCU, etc. The memory 1200 includes, for example, a ROM (read-only memory), a RAM (random access memory), a non-volatile memory such as a hard disk, etc. The interface device 1300 includes, for example, a USB interface, a headphone interface, etc. The communication device 1400 can, for example, perform wired or wireless communication. The display device 1500 is, for example, a liquid crystal display, a touch display, etc. The input device 1600 can include, for example, a touch screen, a keyboard, etc. The user can input / output voice information through the speaker 1700 and the microphone 1800.

[0065] In this embodiment, the memory 1200 is used to store a computer program, which is used to control the processor 1100 to operate to perform the data processing method according to any embodiment of the present invention. A technician can design the computer program instructions according to the scheme disclosed in the present invention. How the computer program controls the processor 1100 to operate is well known in the art, so it will not be described in detail here.

[0066] Despite Figure 1 In the figure, multiple devices are shown for the device 1000 for identifying the lost object behavior of a person on a vehicle, but the present invention may only involve some of the devices, for example, the device 1000 for identifying the lost object behavior of a person on a vehicle only involves the memory 1200 and the processor 1100.

[0067] In addition, the device 1000 for identifying the lost object behavior of the person on the vehicle can be installed inside the vehicle or outside the vehicle independently. The device 1000 for identifying the lost object behavior of the person on the vehicle independent of the vehicle outside the vehicle can receive the in-vehicle status data collected by the vehicle through the network, and then determine the current item set corresponding to the person on the vehicle based on the in-vehicle status data, and finally identify whether the person on the vehicle has the behavior of throwing objects outside the vehicle based on the current item set and the original item set obtained in advance.

[0068] In the above description, a technician can design instructions according to the scheme disclosed in the present invention. How instructions control the processor to operate is well known in the art, so it will not be described in detail here.

[0069] <Method Example>

[0070] The present disclosure provides a method for identifying lost items by people on board. Figure 2 As shown, the method comprises the following steps:

[0071] S201: Acquire vehicle interior status data at a first moment.

[0072] In the disclosed embodiment, since the present invention aims to identify whether the occupants have the behavior of throwing objects out of the vehicle by comparing the set of items carried by the occupants when they just got on the vehicle with the set of items carried at the current moment, therefore, in the process of identifying whether the occupants have the behavior of throwing objects out of the vehicle, it is first necessary to determine the items carried by the occupants at the current moment.

[0073] Furthermore, in the embodiment of the present disclosure, in order to determine the items carried by the occupants of the vehicle at the current moment, it is necessary to obtain the vehicle interior status data at the first moment.

[0074] It should be noted here that the first moment refers to the current moment, that is, the acquired in-vehicle condition data is the in-vehicle condition data of the vehicle at the current moment.

[0075] In addition, the in-vehicle status data may be image data collected by an in-vehicle camera, which can reflect the status of items carried by people in the vehicle.

[0076] S202: Determine a current set of items corresponding to the person in the vehicle according to the vehicle status data.

[0077] Furthermore, since the interior condition data of the vehicle is image data collected by the in-vehicle camera, after acquiring the interior condition data of the vehicle, the embodiment of the present disclosure can perform image recognition on the interior condition data collected by the in-vehicle camera through a pre-created image recognition model, thereby identifying the current set of items corresponding to the people in the vehicle.

[0078] It should be noted here that in actual applications, the items thrown out of the car windows by people on the car are usually paper items, bottles, plastic items and cloth items. Therefore, in the process of making a sample image set for creating an image recognition model, the embodiment of the present disclosure can simulate actual riding conditions, obtain car interior images without paper items, bottles, plastic items and cloth items, and car interior images with at least one of paper items, bottles, plastic items and cloth items, make a sample image set based on the obtained car interior images, and subsequently train the image recognition model based on the sample image set.

[0079] Of course, the items thrown out of the car windows by people on board are not limited to paper items, bottles, plastic items and cloth items, but also include a wide variety of other items. The more types of items included in the sample image, the higher the accuracy of identifying whether the people on board have thrown objects out of the car. The specific items to be identified can be determined based on actual conditions.

[0080] It should also be noted here that in order to be able to distinguish the set of items carried by the occupants when they just get on the bus and the set of items carried at the current moment, in the present disclosed embodiment, the set of items carried by the occupants when they just get on the bus is defined as the original set of items, and the set of items carried at the current moment is defined as the current set of items.

[0081] The current item set includes items carried by the people in the car, such as backpacks, water bottles, etc.

[0082] S203: Identify whether the person on the vehicle has thrown objects outside the vehicle according to the current object set and the pre-acquired original object set.

[0083] Furthermore, after determining the current item set corresponding to the person on the vehicle, the embodiment of the present disclosure can identify whether the person on the vehicle has the behavior of throwing objects outside the vehicle based on the current item set and the original item set obtained in advance.

[0084] It should be noted that, since the present invention aims to identify whether the person on the vehicle has the behavior of throwing objects outside the vehicle by comparing the set of objects carried by the person on the vehicle when he / she just got on the vehicle with the set of objects carried by the person at the current moment, therefore, in the embodiment of the present disclosure, based on the current set of objects and the original set of objects obtained in advance, it is specifically identified as follows:

[0085] Determine whether the current item set is consistent with the original item set; if the current item set is consistent with the original item set, identify that the person on the vehicle does not have the behavior of throwing objects outside the vehicle; if the current item set is inconsistent with the original item set, identify that the person on the vehicle has the behavior of throwing objects outside the vehicle.

[0086] For example, assuming that the original item set obtained in advance includes: a backpack and a mineral water bottle, and the determined current item set includes: a backpack, and it is determined that the current item set is inconsistent with the original item set, it is recognized that the person on the vehicle has thrown objects out of the vehicle.

[0087] In addition, since the original item set is the items that the passengers carry when they first get on the bus, in the embodiment of the present disclosure, the original item set can be obtained as follows:

[0088] Monitor whether there is a person in the vehicle, and when it is detected that there is a person in the vehicle, obtain the vehicle interior status data, and determine and obtain the original item set corresponding to the person in the vehicle based on the vehicle interior status data.

[0089] It should be noted here that the detection of the presence of persons in the vehicle indicates that the persons have just boarded the vehicle.

[0090] Through the above method, by comparing the current set of items corresponding to the current occupants with the original set of items corresponding to when the occupants just got on the bus, it is possible to effectively identify whether the occupants have the behavior of throwing objects out of the bus, thereby greatly reducing the phenomenon of occupants throwing objects out of the bus at will when traveling in the vehicle.

[0091] In actual applications, it is possible that the person on the bus did not throw objects out of the bus window, but put some items in the original item set in their pockets or backpacks, resulting in the inconsistency between the current item set and the original item set. Therefore, in order to improve the accuracy of identifying the behavior of people on the bus throwing objects, the embodiments of the present disclosure provide the following two implementation methods for identifying whether the person on the bus has thrown objects out of the bus when the current item set is inconsistent with the original item set.

[0092] The first implementation method: Since the person on the vehicle will inevitably stick his hand out of the window when throwing objects out of the vehicle window, therefore, when the current item set is inconsistent with the original item set, the positional relationship between the hand of the person on the vehicle and the window of the vehicle at the third moment is obtained; when the positional relationship is that the hand of the person on the vehicle is located outside the window of the vehicle, it is identified that the person on the vehicle has thrown objects out of the vehicle; when the positional relationship is that the hand of the person on the vehicle is located inside the window of the vehicle, it is identified that the person on the vehicle has not thrown objects out of the vehicle.

[0093] It should be noted here that when it is determined that the current item set is inconsistent with the original item set, it means that an item in the original item set has disappeared at this moment. If the person on the bus has lost something, then before the first moment, the person on the bus will inevitably stretch his hand out of the window. Therefore, the third moment must be earlier than the first moment. The third moment can be the moment before the first moment, or it can be the N moments before the first moment. N is an integer greater than 1. The larger N is, the farther the third moment is from the first moment, and the lower the accuracy of identifying whether the person on the bus has lost something. Conversely, the smaller N is, the closer the third moment is to the first moment, and the higher the accuracy of identifying whether the person on the bus has lost something.

[0094] The second implementation method: after a person on the vehicle throws an object out of the vehicle window, the presence of corresponding objects will be identified outside the vehicle. Therefore, when the current object set is inconsistent with the original object set, the vehicle's external condition data is obtained at a second moment, wherein the first moment is earlier than the second moment; based on the external condition data, it is determined whether there are objects outside the vehicle; when there are objects outside the vehicle, it is identified that the person on the vehicle has thrown objects outside the vehicle; when there are no objects outside the vehicle, it is identified that the person on the vehicle has not thrown objects outside the vehicle.

[0095] It should be noted here that if a person on the vehicle loses objects, the discarded objects will inevitably appear outside the vehicle after the first moment. Therefore, the first moment must be earlier than the second moment. That is to say, only after it is identified at the first moment that the person on the vehicle has lost objects outside the vehicle, it is necessary to obtain the vehicle's external condition data at the second moment, and based on the external condition data, determine whether there are any objects outside the vehicle, so as to identify the person on the vehicle who has lost objects outside the vehicle based on the objects outside the vehicle.

[0096] It should also be noted here that the second moment can be the moment after the first moment, or it can be the N moments after the first moment, where N is an integer greater than 1. The larger N is, the farther the second moment is from the first moment, and the lower the accuracy of identifying whether the person on the vehicle has the behavior of throwing objects out of the vehicle. Conversely, the smaller N is, the closer the second moment is to the first moment, and the higher the accuracy of identifying whether the person on the vehicle has the behavior of throwing objects out of the vehicle.

[0097] Furthermore, even if it is determined that there are objects outside the vehicle, the objects may be thrown by pedestrians or other vehicles outside the vehicle, and not thrown out by the people on the vehicle. Therefore, in order to improve the accuracy of identifying the behavior of people on the vehicle throwing objects, the embodiments of the present disclosure provide the following three implementation methods for identifying whether the people on the vehicle have the behavior of throwing objects out of the vehicle on the basis of determining that there are objects outside the vehicle.

[0098] The first implementation method: when there are items outside the vehicle, determine the difference items between the current item set and the original item set; judge whether the difference items are consistent with the items outside the vehicle; when the difference items are consistent with the items outside the vehicle, identify that the person on the vehicle has thrown items outside the vehicle; when the difference items are inconsistent with the items outside the vehicle, identify that the person on the vehicle has not thrown items outside the vehicle.

[0099] The second implementation method: when there are objects outside the vehicle, determine whether the time difference between the second moment and the first moment is lower than a preset threshold; when the time difference is lower than the preset threshold, identify that the person on the vehicle has thrown objects outside the vehicle; when the time difference is not lower than the preset threshold, identify that the person on the vehicle has not thrown objects outside the vehicle.

[0100] It should be noted here that the time difference between the second moment and the first moment can reflect the possibility that the item outside the vehicle was discarded by the occupants of the vehicle. The smaller the time difference, the smaller the possibility that the item outside the vehicle was discarded by the occupants of the vehicle. Conversely, the larger the time difference, the greater the possibility that the item outside the vehicle was discarded by the occupants of the vehicle. A time difference below a certain probability can directly confirm that the item outside the vehicle was not discarded by the occupants of the vehicle. Therefore, a threshold value needs to be set to determine which interval of time difference can indicate that there is a direct correlation between the item outside the vehicle and the occupants of the vehicle.

[0101] The third implementation method: when there are objects outside the vehicle, obtaining the window status of the vehicle within a specific time period, wherein the specific time period is the time period from the first moment to the second moment; when the window status includes an open state, identifying that the person on the vehicle has thrown objects outside the vehicle; when the window status does not include an open state, identifying that the person on the vehicle has not thrown objects outside the vehicle.

[0102] It should be noted here that since the people on the vehicle want to throw objects out of the vehicle, the moment when the vehicle windows are in the open state must be between the first moment and the second moment. Therefore, in the embodiment of the present disclosure, the specific time period is the time period between the first moment and the second moment.

[0103] It should also be noted here that the above three implementation modes can be used alone or in combination, that is, at least two of the first implementation mode, the second implementation mode and the third implementation mode can be used in combination. The combined use can improve the accuracy of identifying whether the people on the vehicle have the behavior of throwing objects outside the vehicle.

[0104] In the embodiments of the present disclosure, in order to further reduce the phenomenon of occupants throwing objects out of the vehicle at will while traveling in the vehicle, after identifying that occupants have the behavior of throwing objects out of the vehicle through the above method, the occupants can be reminded that they are currently throwing objects out of the windows, so that they can develop the habit of not throwing objects out of the windows at will.

[0105] In the disclosed embodiment, at least one of the following three items may be executed to remind the occupants of the vehicle that they are currently throwing objects out of the vehicle window.

[0106] Item 1: Using the vehicle's onboard visual equipment to alert occupants of lost items.

[0107] Item 2: Using the vehicle's onboard loudspeaker to alert occupants of lost items.

[0108] Item 3: Planning a parking route through the automatic driving system of the vehicle, and controlling the vehicle to park at a designated location according to the parking route.

[0109] It should be noted here that, using the vehicle's on-board visual equipment to warn occupants of lost items is to prompt occupants of the behavior of losing items through the car window from a visual perspective, such as displaying text-type, image-type, icon-type or video-type warning signs on the vehicle's display screen to warn occupants of the behavior of losing items, or using an interior warning light or an exterior warning light to warn occupants of the behavior of losing items; using the vehicle's on-board speakers to warn occupants of lost items is to prompt occupants of the behavior of losing items through the car window from a sound perspective, such as issuing a warning voice, a warning buzzer or a horn outside the vehicle through the vehicle's on-board speakers; planning a parking route through the vehicle's automatic driving system and controlling the vehicle to park at a designated location according to the parking route is to prompt occupants of the behavior of losing items through the car window from the parking behavior.

[0110] In addition, controlling the vehicle to stop at a designated position specifically involves controlling the vehicle's power system, steering system, and brake system to stop the vehicle at the designated position.

[0111] <Device Example>

[0112] like Figure 3 As shown, the embodiment of the present disclosure also provides a device 30 for identifying lost items by a person on board, the device 30 comprising: an acquisition module 301, a determination module 302, an identification module 303 and an execution module 304;

[0113] An acquisition module 301 is used to acquire vehicle interior status data of a vehicle at a first moment;

[0114] A determination module 302, configured to determine a current set of items corresponding to the person in the vehicle according to the vehicle status data;

[0115] The identification module 303 is used to identify whether the person on the vehicle has thrown objects outside the vehicle according to the current object set and the pre-acquired original object set.

[0116] In one embodiment, the identification module 303 is specifically used to determine whether the current item set is consistent with the original item set; when the current item set is consistent with the original item set, identify that the person on the vehicle does not have the behavior of throwing objects outside the vehicle; when the current item set is inconsistent with the original item set, identify that the person on the vehicle has the behavior of throwing objects outside the vehicle.

[0117] In one embodiment, the identification module 303 is also used to, when the current item set is inconsistent with the original item set, obtain the vehicle's external condition data at a second moment, wherein the first moment is earlier than the second moment; determine whether there are external items outside the vehicle based on the external condition data; when there are external items outside the vehicle, identify whether the person on the vehicle has thrown items outside the vehicle; when there are no external items outside the vehicle, identify whether the person on the vehicle has not thrown items outside the vehicle.

[0118] In one embodiment, the identification module 303 is also used to, when there are items outside the vehicle, determine the difference items between the current item set and the original item set; determine whether the difference items are consistent with the items outside the vehicle; when the difference items are consistent with the items outside the vehicle, identify that the person on the vehicle has thrown items outside the vehicle; when the difference items are inconsistent with the items outside the vehicle, identify that the person on the vehicle has not thrown items outside the vehicle.

[0119] In one embodiment, the identification module 303 is also used to, when there are objects outside the vehicle, determine whether the time difference between the second moment and the first moment is lower than a preset threshold; when the time difference is lower than the preset threshold, identify that the person on the vehicle has thrown objects outside the vehicle; when the time difference is not lower than the preset threshold, identify that the person on the vehicle has not thrown objects outside the vehicle.

[0120] In one embodiment, the identification module 303 is also used to, when there are objects outside the vehicle, obtain the window status of the vehicle within a specific time period, wherein the specific time period is the time period from the first moment to the second moment; when the window status includes an open state, identify that the person on the vehicle has thrown objects outside the vehicle; when the window status does not include an open state, identify that the person on the vehicle has not thrown objects outside the vehicle.

[0121] In one embodiment, the recognition module 303 is also used to, when the current item set is inconsistent with the original item set, obtain the position relationship between the hand of the person on the vehicle and the window of the vehicle at a third moment, wherein the third moment is earlier than the first moment; when the position relationship is that the hand of the person on the vehicle is located outside the window of the vehicle, identify that the person on the vehicle has a behavior of throwing objects out of the vehicle; when the position relationship is that the hand of the person on the vehicle is located inside the window of the vehicle, identify that the person on the vehicle has not a behavior of throwing objects out of the vehicle.

[0122] In one embodiment, the execution module 304 is used to execute at least one of the following items when the identification module 303 identifies that the person on the vehicle has lost objects outside the vehicle: first, alerting the person on the vehicle of the lost objects through the vehicle-mounted visual equipment; second, alerting the person on the vehicle of the lost objects through the vehicle-mounted speakers; third, planning a parking route through the vehicle's automatic driving system, and controlling the vehicle to park at a designated location based on the parking route.

[0123] In one embodiment, the acquisition module 301 is specifically used to monitor whether there are people in the vehicle; when the presence of people in the vehicle is detected, obtain the vehicle's interior status data; and determine and acquire the original item set corresponding to the people in the vehicle based on the vehicle's interior status data.

[0124] <Equipment Embodiment>

[0125] In the embodiment of the present disclosure, there is also provided a Figure 4 The device 40 for identifying the lost object behavior of a person on board a vehicle shown in the figure includes the device 30 for identifying the lost object behavior of a person on board a vehicle described in the device embodiment of this specification.

[0126] In another embodiment, the vehicle person's lost object behavior recognition device 40 may also include a memory and a processor. The memory is used to store a computer program. The processor is used to execute the method described in any method embodiment of this specification under the control of the computer program stored in the memory.

[0127] The device for identifying the lost items of the person on the vehicle may be a terminal device. The device for identifying the lost items of the person on the vehicle may also be a server connected to the terminal device in communication. The device for identifying the lost items of the person on the vehicle may also include a terminal device and a server connected to the terminal device, which is not limited here.

[0128] <Computer Readable Storage Medium Embodiment>

[0129] This embodiment provides a computer-readable storage medium, in which executable commands are stored. When the executable commands are executed by a processor, the method described in any method embodiment of this specification is executed.

[0130] The present invention may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present invention.

[0131] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0132] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0133] The computer program instructions for performing the operation of the present invention may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be personalized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present invention.

[0134] Various aspects of the present invention are described herein with reference to the flow charts and / or block diagrams of the methods, devices (systems) and computer program products according to embodiments of the present invention. It should be understood that each box of the flow chart and / or block diagram and the combination of each box in the flow chart and / or block diagram can be implemented by computer-readable program instructions.

[0135] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0136] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0137] The flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of an instruction, and a part of the module, program segment or instruction contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or the flowchart, and the combination of the boxes in the block diagram and / or the flowchart can be implemented by a dedicated hardware-based system that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that it is equivalent to implement it by hardware, implement it by software, and implement it by combining software and hardware.

[0138] Embodiments of the present invention have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein are selected to best explain the principles of the embodiments, practical applications, or technical improvements in the marketplace, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the present invention is defined by the appended claims.

Claims

1. A method for identifying lost items by a person on a vehicle, comprising: Acquire vehicle interior status data of the vehicle at a first moment, wherein the vehicle interior status data is image data; Determine a current item set corresponding to the person on the vehicle according to the vehicle status data, wherein the current item set is a set of items carried by the person on the vehicle at the first moment; According to the current set of items and the pre-acquired original set of items, it is identified whether the person on the vehicle has the behavior of throwing items outside the vehicle, wherein the original set of items is the set of items that the person on the vehicle carries when he / she just gets on the vehicle, Wherein, according to the current item set and the original item set, identifying whether the person on the vehicle has a behavior of throwing objects outside the vehicle includes: Determining whether the current item set is consistent with the original item set; In the case where the current set of items is consistent with the original set of items, identifying that the person on the vehicle has no behavior of throwing items outside the vehicle; In the event that the current item set is inconsistent with the original item set: Acquiring vehicle exterior condition data of the vehicle at a second time, wherein the first time is earlier than the second time; Determining whether there are any external objects outside the vehicle according to the external vehicle condition data; In the case where there are objects outside the vehicle, identifying the behavior of the person on the vehicle throwing objects outside the vehicle; In the case that there are no objects outside the vehicle, it is identified that the person in the vehicle has no behavior of throwing objects outside the vehicle.

2. The method according to claim 1, characterized in that If there are objects outside the vehicle: determining the difference items between the current item set and the original item set; Determining whether the difference item is consistent with the item outside the vehicle; In the case where the discrepancy object is consistent with the object outside the vehicle, identifying that the person on the vehicle has thrown an object outside the vehicle; When the difference object is inconsistent with the object outside the vehicle, it is identified that the person on the vehicle does not throw objects outside the vehicle.

3. The method according to claim 1, characterized in that If there are objects outside the vehicle: Determining whether the time difference between the second moment and the first moment is lower than a preset threshold; When the time difference is lower than a preset threshold, identifying that the person on the vehicle has thrown something outside the vehicle; When the time difference is not lower than a preset threshold, it is identified that the person on the vehicle does not throw objects outside the vehicle.

4. The method according to claim 1, characterized in that: If there are objects outside the vehicle: Acquire the window status of the vehicle within a specific time period, wherein the specific time period is a time period from the first moment to the second moment; When the vehicle window state includes an open state, identifying that the person in the vehicle has thrown something outside the vehicle; When the window state does not include an open state, it is identified that the person in the vehicle does not throw objects outside the vehicle.

5. The method according to claim 1, characterized in that In the event that the current item set is inconsistent with the original item set: Obtaining a positional relationship between a hand of a person on the vehicle and a window of the vehicle at a third moment, wherein the third moment is earlier than the first moment; In the case where the positional relationship is that the hand of the person on the vehicle is located outside the window of the vehicle, identifying that the person on the vehicle has a behavior of throwing objects outside the vehicle; When the positional relationship is that the hand of the person on the vehicle is located within the window of the vehicle, it is identified that the person on the vehicle does not have the behavior of throwing objects outside the vehicle.

6. The method according to claim 1, characterized in that The in-vehicle condition data is image data collected by an in-vehicle camera.

7. The method according to claim 1, characterized in that The method further includes: when it is identified that the person on the vehicle has thrown something outside the vehicle, performing at least one of the following: The first item is to use the vehicle's on-board visual equipment to warn people on board of lost items; the second item is to use the vehicle's on-board speakers to warn people on board of lost items; the third item is to plan a parking route through the vehicle's automatic driving system and control the vehicle to park at a designated location based on the parking route.

8. The method according to claim 1, characterized in that: The step of obtaining the original item set includes: Monitor whether there are people in the vehicle; When it is detected that there is a person in the vehicle, the vehicle interior status data is obtained; According to the in-vehicle status data, the original item set corresponding to the person in the vehicle is determined and obtained.

9. A device for identifying lost items by people on a vehicle, comprising: An acquisition module, used for acquiring vehicle interior status data of the vehicle at a first moment, wherein the vehicle interior status data is image data; A determination module, configured to determine a current item set corresponding to the person on the vehicle according to the vehicle status data, wherein the current item set is a set of items carried by the person on the vehicle at the first moment; an identification module, for identifying whether the person on the vehicle has thrown objects outside the vehicle according to the current object set and a pre-acquired original object set, wherein the original object set is a set of objects that the person on the vehicle carries when he / she first gets on the vehicle, The identification module is also used for: Determining whether the current item set is consistent with the original item set; In the case where the current set of items is consistent with the original set of items, identifying that the person on the vehicle has no behavior of throwing items outside the vehicle; In the event that the current item set is inconsistent with the original item set: Acquiring vehicle exterior condition data of the vehicle at a second time, wherein the first time is earlier than the second time; Determining whether there are any external objects outside the vehicle according to the external vehicle condition data; In the case where there are objects outside the vehicle, identifying the behavior of the person on the vehicle throwing objects outside the vehicle; In the case that there are no objects outside the vehicle, it is identified that the person in the vehicle has no behavior of throwing objects outside the vehicle.

10. A device for identifying lost items by a person on board, comprising the device for identifying lost items by a person on board as claimed in claim 9, or the device comprises: A memory for storing executable commands; The processor is used to execute the method for identifying lost objects behavior of a person on board a vehicle as described in any one of claims 1 to 8 under the control of the executable command.

11. A computer-readable storage medium storing executable instructions, wherein when the executable instructions are executed by a processor, the method for identifying lost objects by a person on a vehicle as described in any one of claims 1 to 8 is executed.

Images