Lost property notification device and lost property notification method

Abstract

Provided are a lost property notification device and a lost property notification method that can accurately indicate lost property by establishing correspondence with a location. The lost property notification device of one embodiment detects lost property by comparing first clothing information with second clothing information only when a re-boarding location determination unit determines that the re-boarding location is a prescribed location. The lost property notification device of one embodiment notifies a passenger only when a relationship determination unit determines that the relationship between the content information of the lost property and the re-boarding location is not a prescribed relationship.

Description

Technical Field

[0001] The present invention relates to a lost property notification device and a lost property notification method. Background Art

[0002] With the development of economy, traveling by motor vehicle is becoming more and more popular. In addition, due to the need of riding or the pursuit of fashion sense, people often wear accessories such as sunglasses and hats when riding.

[0003] However, when wearing accessories or clothing on a vehicle, if you get off the vehicle to go to a convenience store, restaurant, etc., you often lose the items you are wearing at that place. In this case, if you fail to notice the lost item in time when the vehicle is started again, the vehicle will leave the place and you will miss the best time to retrieve the lost item. Returning to the place will waste time, and the user will not be able to accurately recall the place where the lost item was lost due to the increase in time. Therefore, there is an urgent need for a technology that can prompt whether there is a lost item when the user gets off the vehicle and returns to the vehicle.

[0004] In the prior art, there is a technology that uses an image recognition algorithm to perform image recognition to detect the differences between two pictures. In addition, there is a technology that extracts features based on image recognition processing to identify the content information of objects in the image. However, for the technology that prompts whether there is a lost item when the user returns to the motor vehicle, due to the complexity of the environment caused by factors such as the location, there are often technical problems such as missing prompts, false prompts, etc. that fail to accurately prompt the lost item. Summary of the invention

[0005] The present invention aims at the above-mentioned technical problems in the prior art, and its object is to provide a lost property notification device and a lost property notification method which can establish correspondence with a location and thus accurately prompt lost property.

[0006] According to one embodiment of the present invention, there is provided a lost property notification device, comprising: a first clothing information acquisition unit, which acquires clothing information for the passenger as first clothing information after the passenger gets on the vehicle; a boarding and alighting monitoring unit, which monitors the boarding and alighting of the passenger; a re-boarding determination unit, which determines whether the passenger gets on the vehicle again after getting off the vehicle through the monitoring of the boarding and alighting monitoring unit; a re-boarding location acquisition unit, which acquires the re-boarding location when the re-boarding determination unit determines that the passenger gets on the vehicle again; a second clothing information acquisition unit, which acquires clothing information for the passenger as second clothing information after the re-boarding determination unit determines that the passenger gets on the vehicle again; a re-boarding location determination unit, which determines whether the re-boarding location acquired by the re-boarding location acquisition unit is a prescribed location; a lost property detection unit, which detects lost property by comparing the first clothing information and the second clothing information only when the re-boarding location determination unit determines that the re-boarding location is a prescribed location, and a notification unit, which notifies the passenger when the lost property detection unit detects the lost property.

[0007] This makes it possible to accurately indicate lost property and avoid false indications by detecting lost property only when the place of re-boarding is a specified place.

[0008] The lost property notification device may include: a lost property identification unit that identifies content information of the lost property when the lost property detection unit detects the lost property; and a notification unit that notifies the occupant of the content information of the lost property identified by the lost property identification unit.

[0009] In this way, the content information of the lost item can be accurately presented.

[0010] The above-mentioned lost property notification device may also include: a vehicle position acquisition unit, which acquires the position of the vehicle in which the occupant is riding when the re-boarding determination unit determines that the occupant is re-boarding; and a notification unit, which notifies the occupant of the contact information of the specified location when the lost property detection unit detects the lost property and the distance between the position of the vehicle obtained by the vehicle position acquisition unit and the specified location exceeds a specified threshold.

[0011] This can provide contact information of possible lost locations, making it easier to find lost items.

[0012] The above-mentioned lost property notification device may also include: a relationship judgment unit, which judges whether the relationship between the content information of the lost property identified by the lost property identification unit and the location of re-boarding is a prescribed relationship; and the notification unit notifies the passenger only when the relationship judgment unit judges that the relationship between the content information of the lost property and the location of re-boarding is not a prescribed relationship.

[0013] This makes it possible to more accurately indicate lost property, and further avoid erroneous indications by notifying the passenger only when the relationship between the content information of the lost property and the place of re-boarding is not a prescribed relationship.

[0014] The above-mentioned lost property notification device may also be equipped with: a history information storage unit that stores the history of the correspondence between the content information of the lost property and the location of the re-boarding, and a relationship judgment unit that uses the correspondence stored in the history information storage unit as a basis for judging whether the relationship between the content information of the lost property and the location of the re-boarding is a prescribed relationship.

[0015] This makes it possible to intelligently determine the prescribed relationship, thereby further avoiding erroneous prompts.

[0016] The lost property notification device may be configured such that the specified location is a public place.

[0017] This makes it possible to more accurately indicate lost items and avoid false indications.

[0018] The lost property notification device may include a location property acquisition unit that acquires the property of the re-boarding location and determines whether the re-boarding location is a predetermined location based on the property of the re-boarding location.

[0019] This makes it possible to more accurately indicate lost items and avoid false indications.

[0020] In addition, one embodiment of the present invention provides a lost property notification device, comprising: a first clothing information acquisition unit, which acquires clothing information about the passenger as first clothing information after the passenger gets on the vehicle; a boarding and alighting monitoring unit, which monitors the boarding and alighting of the passenger; a re-boarding determination unit, which determines whether the passenger gets on the vehicle again after getting off the vehicle through the monitoring of the boarding and alighting monitoring unit; a re-boarding location acquisition unit, which acquires the re-boarding location when the re-boarding determination unit determines that the passenger gets on the vehicle again; and a second clothing information acquisition unit, which acquires the re-boarding location after the re-boarding determination unit determines that the passenger gets on the vehicle again. , obtaining the clothing information for the occupant as the second clothing information; a lost property detection unit, comparing the first clothing information and the second clothing information, thereby detecting the lost property; a lost property identification unit, when the lost property is detected by the lost property detection unit, identifying the content information of the lost property; a relationship judgment unit, judging the relationship between the content information of the lost property identified by the lost property identification unit and the place of re-boarding; and a notification unit, notifying the occupant only when the relationship judgment unit judges that the relationship between the content information of the lost property and the place of re-boarding is not a prescribed relationship.

[0021] This makes it possible to more accurately indicate lost property, and avoid erroneous indications by notifying the passenger only when the relationship between the content information of the lost property and the place of re-boarding is not a prescribed relationship.

[0022] In addition, one embodiment of the present invention provides a lost property notification method, comprising the following steps: a first clothing information acquisition step, in which clothing information for the passenger is acquired as first clothing information after the passenger gets on the vehicle; a boarding and alighting monitoring step, in which the passenger's boarding and alighting is monitored; a re-boarding judgment step, in which whether the passenger gets on the vehicle again after getting off the vehicle is judged in the boarding and alighting monitoring step; a re-boarding location acquisition step, in which, when the re-boarding judgment step determines that the passenger gets on the vehicle again, the re-boarding location is acquired; a second clothing information acquisition step, in which, after the re-boarding judgment step determines that the passenger gets on the vehicle again, the clothing information for the passenger is acquired as second clothing information; a re-boarding location judgment step, in which, when the re-boarding judgment step determines that the passenger gets on the vehicle again, the re-boarding location acquisition step is determined to be a prescribed location; a lost property detection step, in which the first clothing information and the second clothing information are compared to detect lost property only when the re-boarding location judgment step determines that the re-boarding location is a prescribed location, and a notification step, in which the passenger is notified when the lost property is detected in the lost property detection step.

[0023] This makes it possible to accurately indicate lost property and avoid false indications by detecting lost property only when the place of re-boarding is a specified place.

[0024] In addition, one embodiment of the present invention provides a lost property notification method, comprising: a first clothing information acquisition step, in which the clothing information of the passenger is acquired as the first clothing information after the passenger gets on the vehicle; a boarding and alighting monitoring step, in which the boarding and alighting of the passenger is monitored; a re-boarding determination step, in which, by monitoring in the boarding and alighting monitoring step, it is determined whether the passenger gets on the vehicle again after getting off the vehicle; a re-boarding location acquisition step, in which, if it is determined in the re-boarding determination step that the passenger gets on the vehicle again, the re-boarding location is acquired; a second clothing information acquisition step, in which, in the re-boarding determination step, it is determined whether the passenger gets on the vehicle again. Afterwards, obtaining the clothing information for the occupant as the second clothing information; a lost property detection step, comparing the first clothing information and the second clothing information, thereby detecting the lost property; a lost property identification step, identifying the content information of the lost property when the lost property is detected by the lost property detection step; a relationship judgment step, judging the relationship between the content information of the lost property identified in the lost property identification step and the place of re-boarding; and a notification step, notifying the occupant only when the relationship judgment step determines that the relationship between the content information of the lost property and the place of re-boarding is not a prescribed relationship.

[0025] This makes it possible to more accurately indicate lost property, and avoid erroneous indications by notifying the passenger only when the relationship between the content information of the lost property and the place of re-boarding is not a prescribed relationship. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 This is a block diagram showing the functional structure of the lost property notification device 100 according to the first embodiment.

[0027] Figure 2 This is a flowchart showing a lost property notification method performed by the lost property notification device 100 according to the first embodiment.

[0028] Figure 3 This is a block diagram showing the functional structure of the lost property notification device 100A involved in the specific example 1 of the first embodiment.

[0029] Figure 4 This is a block diagram showing the functional structure of the lost property notification device 100B involved in the specific example 2 of the first embodiment.

[0030] Figure 5 This is a block diagram showing the functional structure of the lost property notification device 100C involved in the specific example 3 of the first embodiment.

[0031] Figure 6 This is a block diagram showing the functional structure of the lost property notification device 200 involved in Embodiment 2.

[0032] Figure 7 A flowchart showing a lost property notification method performed by the lost property notification device 200 according to the second embodiment.

[0033] Figure 8 This is a block diagram showing the functional structure of the lost property notification device 200A involved in the specific example 4 of the second implementation mode.

[0034] Fig. 9 This is a table showing a specific example of the history stored in the history information storage unit 210 . DETAILED DESCRIPTION

[0035] The present invention is described in more detail below in conjunction with the accompanying drawings, embodiments and specific examples. Among them, the following description is only an example given to facilitate understanding of the present invention and is not intended to limit the scope of the present invention. In a specific embodiment, the components of the device can be changed, combined, deleted or added according to actual conditions, and the steps of the method can also be changed, combined, deleted, added or changed in order according to actual conditions. In the accompanying drawings, the size, direction, etc. are only for illustration and can be changed according to actual conditions.

[0036] (Implementation Method 1)

[0037] Below, refer to Figure 1 The lost property notification device 100 according to the first embodiment will be described. Figure 1 1 is a block diagram showing the functional structure of the lost property notification device 100 according to Embodiment 1. Figure 1As shown, the lost property notification device 100 involved in Embodiment 1 includes a boarding and alighting monitoring unit 101, a first clothing information acquisition unit 102, a re-boarding determination unit 103, a re-boarding location acquisition unit 104, a second clothing information acquisition unit 105, a re-boarding location determination unit 106, a lost property detection unit 107, and a notification unit 108. The arrows indicate the direction of data flow. The above-mentioned components in the lost property notification device 100 can be implemented in the form of software modules, or can also be implemented in the form of dedicated hardware integrated circuits. The lost property notification device 100 can be implemented by a single computer or server, or by multiple separate devices, such as a cloud computing server composed of multiple servers. In addition, the functions of the above-mentioned components of the lost property notification device 100 can be implemented by executing a program pre-stored in a recording medium by a computer processor, thereby implementing this embodiment. The following specifically describes the components of the lost property notification device 100.

[0038] The boarding and alighting monitoring unit 101 monitors the boarding and alighting of passengers. Specifically, the boarding and alighting monitoring unit 101 can obtain pulse signals and the like at the timing when passengers of a motor vehicle get on or off the vehicle, thereby marking the boarding and alighting of passengers. For example, the boarding and alighting monitoring unit 101 samples images from a camera installed in the cabin of a motor vehicle at a specified time interval such as 1 second, and uses image recognition methods such as face recognition algorithms to determine whether there are passengers boarding and alighting. For example, the boarding and alighting monitoring unit 101 determines whether there are passengers boarding and alighting by using thermal imaging sensors such as infrared sensors installed in the cabin of a motor vehicle. For example, the boarding and alighting monitoring unit 101 determines whether there are passengers boarding and alighting by using force information provided by a gravity sensor installed in a motor vehicle seat.

[0039] The boarding and alighting monitoring unit 101 may be composed of only a processor or a cloud processor to process information from a camera, a sensor, etc., or may be an independent monitoring device having a camera, a sensor, etc. The boarding and alighting monitoring unit 101 can send a signal indicating whether a passenger has boarded or alighted the vehicle to the first clothing information acquisition unit 102 and the re-boarding determination unit 103.

[0040] After the passenger gets on the vehicle, the first clothing information acquisition unit 102 acquires clothing information for the passenger as the first clothing information. For example, when the boarding and alighting monitoring unit 101 sends a signal indicating that the passenger has boarded the vehicle to the first clothing information acquisition unit 102, the first clothing information acquisition unit 102 uses a camera located in the cabin of the motor vehicle to capture a first image of the passenger, and acquires the clothing information of the passenger based on the first image. In this embodiment, the first image itself is stored as the first clothing information. However, the first clothing information is not limited to this, and the first image may be subjected to appropriate filtering processing or edge detection as required, and the processed image or some features extracted from the image may be stored as the first clothing information. The first image at least includes clothing or accessories worn by the passenger as the passenger's clothing information.

[0041] In addition, the first clothing information acquisition unit 102 may be composed of only a processor and a memory, etc., to send a shooting instruction to a camera and obtain the first image from the camera; or it may be an independent shooting device having a camera, etc. The time point when the camera shoots the first image is not limited to the timing when the passenger gets on the bus, and may be other time points after the passenger gets on the bus and the passenger is confirmed to be in the cabin by the boarding and alighting monitoring unit 101.

[0042] The re-ride judgment unit 103 judges whether the passenger gets on the bus again after getting off the bus through the monitoring of the boarding and alighting monitoring unit 101. Specifically, after receiving the signal that the passenger gets off the bus from the boarding and alighting monitoring unit 101, the re-ride judgment unit 103 judges that the passenger gets on the bus again when it receives the signal that the passenger gets on the bus again. In this embodiment, the re-ride judgment unit 103 can judge whether the passenger who is the object of re-ride is the same person as the passenger who got off the bus before at the timing of re-ride. For example, the re-ride judgment unit 103 judges whether the passenger who gets on the bus again is the same person based on the information obtained by the boarding and alighting monitoring unit 101 for monitoring the boarding and alighting of the passenger. For example, the judgment is made by comparing the images of the passenger before getting off the bus and after getting on the bus again taken by the camera located in the cabin. For example, the judgment is made by comparing the information obtained by the infrared sensor, gravity sensor, etc. Furthermore, the re-boarding determination unit 103 may determine whether the re-boarding passenger is the same person by comparing the image acquired by the first clothing information acquisition unit 102 each time the passenger boards the vehicle.

[0043] The re-boarding location acquisition unit 104 acquires the re-boarding location when the re-boarding determination unit 103 determines that the passenger re-boards. Here, the re-boarding location refers to information related to the location where the re-boarding occurs, and the exact location does not necessarily need to be acquired.

[0044] In this embodiment, when receiving a signal indicating that the passenger is re-boarding from the re-boarding determination unit 103, the re-boarding location acquisition unit 104 acquires the location of the vehicle through a positioning system such as a vehicle-mounted GPS, and acquires a POI information point corresponding to the location from a navigation map as the re-boarding location. The POI information point is, for example, location information provided by navigation map software, such as a shop, office building, or residential house. In addition, the POI information point may also be user-defined information, such as a home, office, or other common locations of the user. The re-boarding location acquisition unit 104 may be a vehicle-mounted navigation system with a GPS positioning function, or a processor that acquires corresponding information from a vehicle-mounted navigation system.

[0045] In addition, the method by which the re-boarding location acquisition unit 104 acquires the re-boarding location is not limited to this. For example, the re-boarding location acquisition unit 104 acquires image information from a camera installed outside the vehicle, and analyzes the image information to obtain the re-boarding location. For example, the camera is a panoramic camera, and the panoramic image captured by the camera is analyzed to determine whether the location is a store, an office building, a residential house, etc. as the re-boarding location.

[0046] The timing at which the re-boarding location acquisition unit 104 acquires the re-boarding location may be any time after the re-boarding occurs and before the vehicle leaves the re-boarding location. Therefore, the re-boarding location may be different from the location where the passenger gets off the vehicle, for example, when the passenger is not the driver or a parking service is provided by someone else.

[0047] After the re-boarding determination unit 103 determines that the passenger is re-boarding, the second clothing information acquisition unit 105 acquires the clothing information for the passenger as the second clothing information. For example, the second clothing information acquisition unit 105 shares the same components as the first clothing information acquisition unit 102, and takes pictures at the timing of each passenger boarding the vehicle, and when the re-boarding determination unit 103 determines that a certain boarding is the passenger's re-boarding, the captured image is stored as the second image. In addition, the second clothing information acquisition unit 105 may also be a component different from the first clothing information acquisition unit 102, and only when a signal indicating re-boarding is received from the re-boarding determination unit 103, the second image is obtained by taking pictures by a camera located in the cabin. The time point when the camera takes the second image is not limited to the timing of the passenger's re-boarding, and may also be other time points after the passenger re-boards and the passenger is confirmed to be in the cabin by the boarding and alighting monitoring unit 101.

[0048] In this embodiment, the second image itself is stored as the second clothing information. However, the second clothing information is not limited thereto, and the second image may be subjected to appropriate filtering or edge detection as required, and the processed image or partial features extracted from the image may be stored as the second clothing information. The second image at least includes clothing or accessories worn by the occupant as the occupant's clothing information.

[0049] The re-boarding location determination unit 106 determines whether the re-boarding location obtained by the re-boarding location acquisition unit 104 is a specified location. The so-called specified location is stored in a storage unit not shown in the figure, and can be added or deleted according to the instructions of the user or the lost property notification device 100. In addition, a location other than the specified location can also be stored in a storage unit not shown in the figure, and whether it is a specified location can be determined by elimination. For example, a public place is set as a specified location. That is, a location other than the home location set by the user is set as a specified location. In addition, the definition of the specified location can be various, and it is specifically explained with reference to the specific examples described later.

[0050] The lost object detection unit 107 detects lost objects by comparing the first clothing information and the second clothing information only when the re-boarding location determination unit 106 determines that the re-boarding location is a specified location. In this embodiment, the lost object is detected by comparing the first image as the first clothing information and the second image as the second clothing information. For example, the first image is first subjected to filtering processing such as binarization, grayscale, or normalization, and image edge detection is performed by algorithms such as CNN, i.e., convolutional neural network, to obtain edge features such as HOG features, i.e., directional gradient histogram features, and clothing or accessories are classified and identified by, for example, SVM classifier, i.e., support vector machine classifier. Thereafter, for example, clothing or accessories in the second image are identified by the same method, and the information of clothing or accessories contained in the first image and the second image is compared. If a certain clothing or accessory contained in the first image is not contained in the second image, the clothing or accessory is detected as a lost object. In addition, the method of detecting lost objects is not limited to this, and lost object detection can be performed by any image recognition technology.

[0051] Furthermore, the lost property detection unit 107 reduces the amount of processing required by performing lost property detection only when the re-boarding location is a predetermined location.

[0052] The notification unit 108 notifies the occupants when the lost property detection unit 107 detects the lost property. Here, the method of notifying the occupants is not limited. For example, the occupants may be notified by an alarm sound, or a prompt text showing the lost information may be displayed on a display unit not shown. Thus, the notification unit 108 is, for example, a component having a speaker, a display screen, etc. In addition, the notification unit 108 may also be connected to the vehicle audio, instrument panel, etc. of the motor vehicle in a wired or wireless manner, so that the occupants are notified of the lost information through the vehicle-mounted equipment.

[0053] Below, refer to Figure 2 The flow of the lost property notification method implemented by the lost property notification device 100 in Embodiment 1 will be described in detail. Figure 2 This is a flowchart showing a lost property notification method performed by the lost property notification device 100 according to the first embodiment.

[0054] First, in step S101, the boarding and alighting monitoring unit 101 monitors whether the passenger is boarding the vehicle. If the boarding and alighting monitoring unit 101 does not monitor the boarding of the passenger (S101: No), the determination in step S101 is performed again. For example, the determination in step S101 is performed again after a predetermined time interval. If the boarding and alighting monitoring unit 101 monitors the boarding of the passenger (S101: Yes), the flow proceeds to step S102.

[0055] In step S102, after the passenger's boarding is monitored by the boarding and alighting monitoring unit 101, the first clothing information acquisition unit 102 acquires clothing information about the passenger as first clothing information. For example, a first image is acquired in step S102. The flow proceeds to step S103.

[0056] In step S103, the re-boarding determination unit 103 determines whether the passenger re-boards the vehicle after getting off the vehicle. If the re-boarding determination unit 103 does not determine that the passenger re-boards the vehicle (S103: No), the determination in step S103 is performed again. For example, the determination in step S103 is performed again after a predetermined time interval. For example, the re-boarding determination unit 103 performs the determination in step S103 each time the boarding and alighting monitoring unit 101 monitors the boarding of the passenger. If the re-boarding determination unit 103 determines that the passenger re-boards the vehicle (S103: Yes), the process proceeds to step S104.

[0057] In step S104, the re-boarding point acquisition unit 104 acquires the re-boarding point. The flow proceeds to step S105.

[0058] In step S105, the re-boarding location determination unit 106 determines whether the re-boarding location is a prescribed location. If the re-boarding location determination unit 106 determines that the re-boarding location is not a prescribed location (S105: No), the process ends. That is, the process ends directly without performing lost property recognition and other processing, thereby reducing the processing volume. If the re-boarding location determination unit 106 determines that the re-boarding location is a prescribed location (S105: Yes), the process proceeds to step S106.

[0059] In step S106, the second clothing information acquisition unit 105 acquires the clothing information of the passenger after re-boarding as the second clothing information. For example, a second image is acquired in step S106. In addition, the timing of executing step S106 can be reversed with the timing of executing steps S104 and S105. For example, step S106 can be executed before step S104, or between step S104 and step S105. In addition, it is preferred to execute step S106 after step S105, thereby acquiring the second clothing information such as the second image only when the place of re-boarding is a specified place, thereby reducing the amount of processing and the amount of information stored. After executing steps S104 to S106, the process proceeds to step S107.

[0060] In step S107, the lost object detection unit 107 detects the lost object by comparing the first clothing information and the second clothing information. If the lost object detection unit 107 does not detect the lost object (S107: No), the process ends. If the lost object detection unit 107 detects the lost object (S107: Yes), the process proceeds to step S108.

[0061] In step S108, the occupant is informed of the detection of the lost item in any manner.

[0062] Through the above lost property notification method implemented by the lost property notification device 100, the lost property can be accurately detected and notified to the passenger in the case where the passenger gets off the bus and then gets on the bus again. In addition, by detecting the lost property and notifying the passenger only when the re-boarding location determination unit 106 determines that the re-boarding location is a specified location, it is possible to establish a correspondence with the re-boarding location and accurately notify the lost property. For example, when a user takes a motor vehicle to go home, the user usually changes clothes and / or accessories at home, and this change does not belong to the situation of "lost". Therefore, by setting the location of the home set by the user to not be a specified location, when the user takes the motor vehicle to go home and then gets on the bus again, the lost property is not detected. As a result, the user's confusion caused by the false prompt of the lost property is effectively avoided, the intelligence of the lost property notification is increased, and the user experience is improved. In addition, by detecting the lost property only when the re-boarding location is a specified location, the burden of the CPU or other processors caused by the lost property detection can be reduced, and the processing volume is effectively reduced. In addition, by setting the user's common location such as the company and school to not be a specified location, a similar effect can be achieved.

[0063] (Specific example 1)

[0064] Below, refer to Figure 3 , describing specific example 1 of implementation mode 1. Figure 3This is a block diagram showing the functional structure of the lost property notification device 100A involved in the specific example 1 of the first embodiment.

[0065] like Figure 3 As shown, the lost property notification device 100A of the specific example 1 of the first embodiment is different from the above-mentioned lost property notification device 100 in that it has a lost property identification unit 109. The same reference numerals are given to the same or corresponding components as those of the lost property notification device 100, and detailed descriptions thereof are omitted.

[0066] When the lost object detection unit 107 detects the lost object, the lost object recognition unit 109 recognizes the content information of the lost object. For example, the lost object recognition unit 109 performs image recognition on the partial image related to the lost object in the first image, and the lost object recognition unit 109 recognizes the name of the content contained in the partial image as the content information of the lost object. The partial image related to the lost object in the first image is obtained by comparing the first image and the second image, and the partial image that exists in the first image but does not exist in the second image is detected as the lost object by the lost object detection unit 107. The method of recognizing the name of the content in the partial image is not limited. For example, the lost object recognition unit 109 recognizes the name of the content through a neural network, and the neural network is a neural network trained by storing training samples of names and images of clothing and / or accessories.

[0067] The notification unit 108 notifies the occupant of the content information of the lost item identified by the lost item identification unit 109. For example, the notification unit 108 notifies the occupant of the name of the lost item as sound through a speaker or the like. For example, the notification unit 108 notifies the occupant of the name of the lost item as text through a display or the like. For example, the notification unit 108 notifies the occupant of a partial image related to the lost item as image information through a display or the like.

[0068] According to the lost property notification device 100A of the specific example 1 of the first embodiment, the content information such as the name of the lost property can be accurately notified to the occupant, thereby improving the user experience.

[0069] (Specific example 2)

[0070] Below, refer to Figure 4 , describing specific example 2 of implementation mode 1. Figure 4 This is a block diagram showing the functional structure of the lost property notification device 100B involved in the specific example 2 of the first embodiment.

[0071] like Figure 4As shown, the lost property notification device 100B of the specific example 2 of the first embodiment is different from the above-mentioned lost property notification device 100 in that it has a vehicle position acquisition unit 110. The same reference numerals are given to the same or corresponding components as those of the lost property notification device 100, and detailed descriptions thereof are omitted.

[0072] The vehicle position acquisition unit 110 acquires the position of the vehicle that the passenger is riding in when the re-riding determination unit 103 determines that the passenger is riding in the vehicle. For example, the vehicle position acquisition unit 110 can acquire the position of the vehicle that the passenger is riding in real time using a positioning system such as GPS.

[0073] When the lost property is detected by the lost property detection unit 107 and the distance between the position of the vehicle acquired by the vehicle position acquisition unit 110 and the place of re-boarding exceeds a predetermined threshold, the notification unit 108 notifies the passenger of the contact information of the place of re-boarding. For example, consider the following situation: after the passenger re-boards, the lost property notification device 100B notifies the passenger of the existence of the lost property, but the lost property is not retrieved in time due to various reasons and the vehicle leaves the place of re-boarding. In this case, in order for the passenger to notice the lost property in time and contact the place of re-boarding to confirm the status of the lost property, an effective measure is to notify the passenger of the contact information of the place of re-boarding. For example, when a motor vehicle drives more than 2 km away from a convenience store that is the re-boarding location, the message "You may have lost items at the convenience store, the convenience store's phone number is 123-45678" is displayed in the form of text or pictures in a place where the passengers can clearly see it, for example, on the vehicle's display screen, dashboard, etc. The above information can also be notified to the passengers in the form of voice through the vehicle's speakers, etc.

[0074] In addition, the specific example 1 and the specific example 2 can be combined to notify the passengers of the name of the lost item and the contact information of the place where they will board the vehicle again. For example, when the vehicle is more than 2 km away from the convenience store where they will board the vehicle again, a voice message "I may have lost my hat at the convenience store. The phone number of the convenience store is 123-45678" can be notified to the passengers through the vehicle's speakers.

[0075] According to the lost property notification device 100B of the specific example 2 of the implementation mode 1, even if the vehicle leaves the place where the property was lost, it is still possible to effectively contact the possible place where the property was lost, thereby improving the user experience.

[0076] (Concrete example 3)

[0077] Below, refer to Figure 5 , describing specific example 3 of implementation mode 1. Figure 5 This is a block diagram showing the functional structure of the lost property notification device 100C involved in the specific example 3 of the first embodiment.

[0078] like Figure 5 As shown, the lost property notification device 100C of the specific example 3 of the first embodiment is different from the above-mentioned lost property notification device 100 in that it has a location property acquisition unit 111. The same reference numerals are given to the same or corresponding components as those of the lost property notification device 100, and detailed descriptions thereof are omitted.

[0079] The location property acquisition unit 111 acquires the property of the re-boarding location. Specifically, after the re-boarding location acquisition unit 104 acquires the re-boarding location, the location property acquisition unit 111 analyzes the re-boarding location to acquire the property of the re-boarding location. The property of the re-boarding location is a property used to evaluate the attributes of the re-boarding location, and can be defined by the lost property notification device 100C or the user himself. For example, the location property acquisition unit 111 analyzes the POI information point that is the re-boarding location, and acquires the content information of the POI information point as the property of the re-boarding location. The content information of the POI information point can be acquired, for example, by the label of the POI information point recorded in the navigation map, or by semantically analyzing the name of the POI information point. For example, when the POI information point that is the re-boarding location is "XX Food Court", the property of the re-boarding location is acquired as "restaurant" through analysis.

[0080] In addition, the location property acquisition unit 111 analyzes the POI information point as the place of re-boarding, and obtains the loss index information as the property of the place of re-boarding. The loss index information is an index that can evaluate the correlation between the place of re-boarding and the possibility of loss. The larger the number of the loss index information, the greater the correlation between the place of re-boarding and the possibility of loss. For example, a correspondence table between the content information of the place and the loss index information is stored in the storage unit (not shown) of the lost property notification device 100C. The location property acquisition unit 111 obtains the loss index information as the property of the place of re-boarding by referring to the correspondence table. For example, the loss index information of "restaurant" is "8", and the loss index information of "office" is "2". In addition, the location property acquisition unit 111 can be connected to the Internet or local area network by wire or wirelessly, so as to send and receive data with the cloud database storing the loss index information of each POI information point. As a result, the loss index information of each POI information point can be updated in real time according to the user's loss history.

[0081] The re-boarding location determination unit 106 determines whether the re-boarding location is a specified location based on the nature of the re-boarding location. For example, when the content information of the POI information point is obtained as the nature of the re-boarding location, it is determined whether the re-boarding location is a specified location based on a correspondence table between the content information of the POI information point and the specified location stored in a storage unit (not shown). For example, a re-boarding location whose nature is a "restaurant" is a specified location. In addition, when the loss index information is obtained as the nature of the re-boarding location, if the loss index information exceeds a certain threshold, it is determined to be a specified location.

[0082] According to the lost property notification device 100C of the specific example 3 of the first embodiment, whether it is a specified location is determined based on the nature of the location, making the judgment accurate and reliable, and further reducing the possibility of false prompts and missed prompts.

[0083] (Implementation Method 2)

[0084] Below, refer to Figure 6 The lost property notification device 200 according to the second embodiment will be described. Figure 6 2 is a block diagram showing the functional structure of the lost property notification device 200 according to Embodiment 2. Figure 6 As shown, the lost property notification device 200 involved in embodiment 2 includes a boarding and alighting monitoring unit 201, a first clothing information acquisition unit 202, a re-boarding judgment unit 203, a re-boarding location acquisition unit 204, a second clothing information acquisition unit 205, a relationship judgment unit 206, a lost property detection unit 207, a notification unit 208 and a lost property identification unit 209. Among them, the boarding and alighting monitoring unit 201, the first clothing information acquisition unit 202, the re-boarding judgment unit 203, the re-boarding location acquisition unit 204, and the second clothing information acquisition unit 205 are respectively the components corresponding to the boarding and alighting monitoring unit 101, the first clothing information acquisition unit 102, the re-boarding judgment unit 103, the re-boarding location acquisition unit 104, and the second clothing information acquisition unit 105 in the lost property notification device 100 of the first embodiment; the lost property identification unit 209 is a component corresponding to the lost property identification unit 109 in the lost property notification device 100A of the specific example 1 of the first embodiment; the lost property detection unit 207 and the notification unit 208 are respectively the components corresponding to the lost property detection unit 107 and the notification unit 108 but the functions are not completely the same, and the specific description of the same or similar functional structures is omitted. The following specifically describes the differences between the second embodiment and the first embodiment.

[0085] The lost property detection unit 207 compares the first clothing information obtained by the first clothing information acquisition unit 202 and the second clothing information obtained by the second clothing information acquisition unit 205, thereby detecting the lost property. That is, the lost property detection unit 207 is different from the lost property detection unit 107 in the lost property notification device 100 in that the lost property detection unit 207 can detect the lost property without any judgment condition. For example, when the re-boarding judgment unit 203 judges the timing of the passenger's re-boarding, the lost property detection unit 207 compares the first image and the second image to detect the lost property. And, in embodiment 2, when the lost property is detected by the lost property detection unit 207, the lost property identification unit 209 identifies the content information of the lost property. For example, similar to specific example 1 of embodiment 1, the name of the lost property is identified as the content information of the lost property.

[0086] In addition, the lost property notification device 200 has a relationship determination unit 206. The relationship determination unit 206 determines the relationship between the content information of the lost property identified by the lost property identification unit 209 and the place of re-boarding. Specifically, the relationship determination unit 206 determines whether the relationship between the content information of the lost property and the place of re-boarding is a prescribed relationship. The so-called prescribed relationship can be confirmed based on a correspondence table of the content information of the lost property and the place of re-boarding stored in advance in a storage unit (not shown) as a prescribed relationship. For example, it is pre-set in the correspondence table that the lost property "work badge" and the place of re-boarding "office building" are set as a prescribed relationship, and the lost property "clothes" and the place of re-boarding "home" are set as a prescribed relationship. In addition, the prescribed relationship can be added or deleted according to an instruction from the user or the lost property notification device 200. For example, the relationship determination unit 206 can automatically add or delete the prescribed relationship based on certain information, and the basis can be various, which will be specifically explained with reference to the specific example described later.

[0087] The notification unit 208 notifies the passenger only when the relationship determination unit 206 determines that the relationship between the content information of the lost item and the re-boarding location is not a prescribed relationship. In other words, the passenger is not notified of the content information of the lost item and the re-boarding location being a prescribed relationship.

[0088] Below, refer to Figure 7 The flow of the lost property notification method implemented by the lost property notification device 200 in the second embodiment will be described in detail. Figure 7 This is a flowchart showing a lost property notification method implemented by the lost property notification device 200 according to the second embodiment.

[0089] First, in step S201, the boarding and alighting monitoring unit 201 monitors whether the passenger is boarding the vehicle. If the boarding and alighting monitoring unit 201 does not monitor the boarding of the passenger (S201: No), the determination in step S201 is performed again. For example, the determination in step S201 is performed again after a predetermined time interval. If the boarding and alighting monitoring unit 201 monitors the boarding of the passenger (S201: Yes), the flow proceeds to step S202.

[0090] In step S202, after the passenger's boarding is monitored by the boarding and alighting monitoring unit 201, the first clothing information acquisition unit 202 acquires clothing information about the passenger as first clothing information. For example, a first image is acquired in step S202. The flow proceeds to step S203.

[0091] In step S203, the re-boarding determination unit 203 determines whether the passenger re-boards the vehicle after getting off the vehicle. If the re-boarding determination unit 203 does not determine that the passenger re-boards the vehicle (S203: No), the determination in step S203 is performed again. If the re-boarding determination unit 203 determines that the passenger re-boards the vehicle (S203: Yes), the flow proceeds to step S204.

[0092] In step S204, the re-boarding point acquisition unit 204 acquires the re-boarding point. The flow proceeds to step S205.

[0093] In step S205, the second clothing information acquisition unit 205 acquires the clothing information of the passenger after re-boarding as the second clothing information. For example, a second image is acquired in step S205. The flow proceeds to step S206.

[0094] In step S206, the lost object detection unit 207 detects the lost object by comparing the first clothing information and the second clothing information. If the lost object detection unit 207 does not detect the lost object (S206: No), the process ends. If the lost object detection unit 207 detects the lost object (S206: Yes), the process proceeds to step S207.

[0095] In step S207, the lost object identification unit 209 identifies the content information of the lost object detected in step S206. For example, in step S207, the name of the lost object is identified as the content information.

[0096] In addition, the timing of executing step S204 may be in a different order from the timing of executing step S205, step S206, and step S207. For example, step S204 may be executed between step S205 and step S206, between step S206 and step S207, or between step S207 and step S208. In addition, it is preferred that step S204 is executed after step S206, so that the re-boarding location is acquired only when the lost item is detected, and the processing amount of the re-boarding location acquisition unit 204 can be at least reduced. After executing steps S204 to S207, the process proceeds to step S208.

[0097] In step S208, the relationship determination unit 206 determines the relationship between the content information of the lost object identified by the lost object identification unit and the place of re-boarding. Specifically, it is determined whether the relationship between the content information of the lost object and the place of re-boarding satisfies the prescribed relationship. In the case where the relationship determination unit 206 determines that the relationship between the content information of the lost object and the place of re-boarding satisfies the prescribed relationship (S208: Yes), the process ends. That is, in the case where the prescribed relationship is satisfied, the passenger is not notified. In the case where the relationship determination unit 206 determines that the relationship between the content information of the lost object and the place of re-boarding does not satisfy the prescribed relationship (S208: No), the process proceeds to step S209.

[0098] In step S209, the occupant is informed of the detection of the lost item in any manner.

[0099] According to the lost property notification device 200 of implementation mode 2, it is possible to accurately detect lost property and notify the occupants in the case where the occupants get off the bus and then get on the bus again. In addition, the content information of the lost property can be identified, so it is possible to notify the occupants of the content information such as the name of the lost property. In addition, by notifying the occupants only when the relationship between the content information of the lost property and the place of re-boarding does not meet the prescribed relationship, the possibility of false prompts is effectively reduced. For example, for routine actions of users that are not considered lost, such as changing clothes when staying at home or taking off work badges and work clothes when staying at the company, by setting the relationship between the content information of these lost properties and the place of re-boarding to the prescribed relationship without notifying the occupants, the confusion of users caused by false prompts of lost property is avoided, the intelligence of lost property notification is increased, and the user experience is improved.

[0100] (Concrete example 4)

[0101] Below, refer to Figure 8 , describing specific example 4 of implementation mode 2. Figure 8 This is a block diagram showing the functional structure of the lost property notification device 200A involved in the specific example 4 of the second implementation mode.

[0102] like Figure 8 As shown, the lost property notification device 200A of the specific example 4 of the second embodiment is different from the above-mentioned lost property notification device 200 in that it has a history information storage unit 210. The same reference numerals are given to the same or corresponding components as those of the lost property notification device 200, and detailed descriptions thereof are omitted.

[0103] The history information storage unit 210 stores a history of the correspondence between the content information of the lost item and the place of re-boarding. The history refers to a historical record of the correspondence between the content information of the lost item and the place of re-boarding obtained by the lost item notification device 200A.

[0104] The relationship judgment unit 206 uses the corresponding relationship stored in the history information storage unit 210 as a basis for judging whether the relationship between the content information of the lost item and the place of the next ride is a prescribed relationship. For example, the corresponding relationship in the history that meets certain conditions is added to the prescribed relationship. For example, the corresponding relationship whose number of appearances in the history exceeds a prescribed threshold is added to the prescribed relationship. In addition, the corresponding relationship in the history that meets certain conditions can also be deleted from the prescribed relationship.

[0105] Fig. 9 It is a table representing a specific example of the history stored in the history information storage unit 210. In the table of the history, the correspondence between the time of loss, the name of the lost object, and the place of re-boarding is stored. The relationship judgment unit 206 adds the correspondence that appears in the table no less than twice to the prescribed relationship based on the table of the history. Thus, the correspondence between "sunglasses" and "A community", and the correspondence between "work badge" and "B building" are added to the prescribed relationship. Thus, the notification unit 208 no longer notifies the passenger when the relationship between the content information of the lost object and the place of re-boarding is the above relationship. The way in which the relationship judgment unit 206 adds the correspondence to the prescribed relationship based on the table of the history is not limited to this. For example, it can also be added to the prescribed relationship when the number of occurrences of a certain correspondence within a certain time range exceeds a threshold value. For example, it can also be deleted from the prescribed relationship if a certain correspondence does not appear within a certain time range.

[0106] According to the lost property notification device 200A of the specific example 4 of the second embodiment, the user's history is used as the basis for judging the prescribed relationship, so that the prescribed relationship can be judged more accurately, and the prescribed relationship can be added or deleted intelligently, further improving the user experience.

[0107] In addition, the present invention can be implemented in combination with Embodiment 1 and Embodiment 2. That is, the lost property detection is performed only when the place of re-boarding is a prescribed place, and the passenger is notified only when the relationship between the content information of the lost property and the place of re-boarding is not a prescribed relationship. In this way, the lost property can be detected more accurately and false prompts can be avoided. In addition, for example, the notification methods described in Specific Examples 1 and 2 of Embodiment 1 can also be applied to Embodiment 2.

[0108] The embodiments of the present invention are described above with reference to the accompanying drawings. The embodiments described above are only specific examples of the present invention, which are used to understand the present invention and are not intended to limit the scope of the present invention. Those skilled in the art can make various modifications, combinations and reasonable omissions of elements to the embodiments based on the technical ideas of the present invention, and the resulting methods are also included in the scope of the present invention.

Claims

1. A lost property notification device, characterized in that: have: a first clothing information acquisition unit, which acquires clothing information of the passenger as first clothing information after the passenger gets on the vehicle; a boarding and alighting monitoring unit for monitoring the boarding and alighting of the passengers; a re-boarding determination unit, which determines whether the passenger re-boards the vehicle after getting off the vehicle through monitoring by the boarding and alighting monitoring unit; a re-boarding location acquisition unit, which acquires a re-boarding location when the re-boarding determination unit determines that the passenger re-boards; a second clothing information acquisition unit, which acquires clothing information of the occupant as second clothing information after the re-boarding determination unit determines that the occupant is re-boarding; a re-boarding location determination unit for determining whether the re-boarding location acquired by the re-boarding location acquisition unit is a predetermined location; a lost property detection unit that detects lost property by comparing the first clothing information with the second clothing information only when the re-boarding location determination unit determines that the re-boarding location is the predetermined location; as well as The notification unit notifies the occupant when the lost object detection unit detects the lost object.

2. The lost property notification device according to claim 1, characterized in that: have: a lost object recognition unit for recognizing content information of the lost object when the lost object is detected by the lost object detection unit; The notification unit notifies the occupant of content information of the lost item identified by the lost item identification unit.

3. The lost property notification device according to claim 2, characterized in that: have: a vehicle position acquisition unit, which acquires the position of the vehicle in which the passenger is riding, when the re-riding determination unit determines that the passenger is re-riding, The notification unit notifies the occupant of contact information of the predetermined location when the lost property detection unit detects the lost property and the distance between the position of the vehicle acquired by the vehicle position acquisition unit and the predetermined location exceeds a predetermined threshold.

4. The lost property notification device according to any one of claims 1 to 3, characterized in that: The specified location is a public place.

5. The lost property notification device according to any one of claims 1 to 3, characterized in that: have: a location property acquisition unit, which acquires the property of the location of the re-ride, Whether the re-boarding location is the predetermined location is determined based on the nature of the re-boarding location.

6. A lost property notification device, characterized in that: have: a first clothing information acquisition unit, which acquires clothing information of the passenger as first clothing information after the passenger gets on the vehicle; a boarding and alighting monitoring unit for monitoring the boarding and alighting of the passengers; a re-boarding determination unit, which determines whether the passenger re-boards the vehicle after getting off the vehicle through monitoring by the boarding and alighting monitoring unit; a re-boarding location acquisition unit, which acquires a re-boarding location when the re-boarding determination unit determines that the passenger re-boards; a second clothing information acquisition unit, which acquires clothing information of the occupant as second clothing information after the re-boarding determination unit determines that the occupant is re-boarding; a lost property detection unit, comparing the first clothing information with the second clothing information, thereby detecting a lost property; a lost object recognition unit for recognizing content information of the lost object when the lost object is detected by the lost object detection unit; a relationship determination unit for determining the relationship between the content information of the lost item identified by the lost item identification unit and the location of the re-boarding; as well as The notification unit notifies the passenger only when the relationship determination unit determines that the relationship between the content information of the lost item and the re-boarding location is not a predetermined relationship.

7. The lost property notification device according to claim 6, characterized in that: have: a history information storage unit storing a history of the correspondence between the content information of the lost item and the location of the re-boarding, The relationship determination unit uses the corresponding relationship stored in the history information storage unit as a basis for determining whether the relationship between the content information of the lost item and the place of the re-boarding is the prescribed relationship.

8. A lost property notification method, characterized in that: The following steps are required: a first clothing information obtaining step, after the passenger gets on the vehicle, obtaining clothing information for the passenger as the first clothing information; A boarding and alighting monitoring step, monitoring the boarding and alighting of the passengers; a re-boarding determination step, determining whether the passenger gets on the vehicle again after getting off the vehicle by monitoring in the boarding and alighting monitoring step; a re-boarding location acquisition step, in which, when the re-boarding determination step determines that the passenger is re-boarding, the re-boarding location is acquired; a second clothing information acquisition step, after the re-boarding determination step determines that the occupant is re-boarding, acquiring clothing information for the occupant as second clothing information; a re-boarding location determining step of determining whether the re-boarding location obtained in the re-boarding location obtaining step is a prescribed location; a lost property detection step, only when the re-boarding location determination step determines that the re-boarding location is the specified location, comparing the first clothing information with the second clothing information, thereby detecting the lost property; as well as A notification step of notifying the occupant when a lost item is detected by the lost item detection step.

9. A lost property notification method, characterized in that: have: a first clothing information obtaining step, after the passenger gets on the vehicle, obtaining clothing information for the passenger as the first clothing information; A boarding and alighting monitoring step, monitoring the boarding and alighting of the passengers; a re-boarding determination step, determining whether the passenger gets on the vehicle again after getting off the vehicle by monitoring in the boarding and alighting monitoring step; a re-boarding location acquisition step, in which, when the re-boarding determination step determines that the passenger is re-boarding, the re-boarding location is acquired; a second clothing information acquisition step, after the re-boarding determination step determines that the occupant is re-boarding, acquiring clothing information for the occupant as second clothing information; a lost property detection step, comparing the first clothing information with the second clothing information, thereby detecting the lost property; a lost object identification step, in the case where the lost object is detected by the lost object detection step, identifying content information of the lost object; a relationship determination step of determining the relationship between the content information of the lost object identified in the lost object identification step and the location of the re-boarding; as well as The notification step notifies the passenger only when the relationship determination step determines that the relationship between the content information of the lost item and the place of re-boarding is not a prescribed relationship.

Images