Lost item search support system and lost item search support method

Abstract

To facilitate identification of the location of a lost item (30).SOLUTION: An imaging unit (11) is attached to a mobility or a user and captures a video of surroundings. A control unit (24) performs short-range wireless communication with a wireless tag (31) added to an item (30) attached to the mobility or an item (30) worn by the user. When the short-range wireless communication with the wireless tag (31) is interrupted, the control unit (24) performs control so as to store the video captured by the imaging unit (11).SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a system and method for searching for lost items that support the search for lost items to which wireless tags are attached. [Background technology]

[0002] A technology has been disclosed in which a wireless tag is attached to belongings, and when the belongings are lost in the street, the location where the belongings were lost can be identified using a communication line (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-61123 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, if you are traveling on the road on a mobility device such as a bicycle, motorcycle, or electric kick scooter and you lose your belongings in a place where there is no communication line, it has been difficult to locate the lost item using a communication line.

[0005] Even if the location where radio waves from a wireless tag were last received could be identified by a GPS (Global Positioning System) sensor of a mobile terminal device, the location identified by the GPS sensor has a certain range, so it may be difficult to find a lost item from that range. Also, if the detection accuracy of the GPS sensor is low, it may be difficult to find a lost item. Also, if a personal item is lost in a location where the GPS sensor cannot detect radio waves, the location information of the GPS sensor cannot be utilized.

[0006] The present embodiment has been made in view of the above circumstances, and has an object to provide a technique that makes it easy to identify the location where an item was lost. [Means for solving the problem]

[0007] In order to solve the above problem, a lost item search support system according to one aspect of the present embodiment includes an imaging unit that is attached to a mobility or a user and captures an image of the surroundings, a wireless tag attached to an item attached to the mobility or an item worn by the user, and a control unit that executes short-range wireless communication. The control unit controls the image captured by the imaging unit to be stored when short-range wireless communication with the wireless tag is interrupted.

[0008] Another aspect of this embodiment is a method for assisting in searching for lost items, which includes the steps of capturing an image of the surroundings with an imaging unit attached to a mobility or a user, performing short-range wireless communication with a wireless tag attached to an item attached to the mobility or an item worn by the user, and controlling the imaging unit to store the image captured by the imaging unit when short-range wireless communication with the wireless tag is interrupted.

[0009] Any combination of the above components, and conversion of the expression of this embodiment between a method, an apparatus, a system, a recording medium, a computer program, etc. are also valid as aspects of this embodiment. Effect of the Invention

[0010] According to this embodiment, it is possible to easily identify the location where an item was lost. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing an example of a scene in which the lost item search support system according to an embodiment is used; [Diagram 2] 1 is a block diagram for explaining a configuration example of a lost item search support system according to an embodiment. [Diagram 3] 4 is a flowchart illustrating an example of the operation of the lost item search support system according to the embodiment. [Figure 4]FIG. 11 is a block diagram for explaining a configuration example of a lost item search support system according to a first modified example. [Diagram 5] FIG. 11 is a block diagram for explaining a configuration example of a lost item search support system according to a second modification. [Figure 6] FIG. 11 is a diagram showing an example of a scene in which the lost item search support system according to the third modification is used. [Figure 7] FIG. 11 is a block diagram for explaining a configuration example of a lost item search support system according to a third modification. [Figure 8] 13 is a flowchart showing an operation example of the lost item search support system according to the third modification. [Figure 9] FIG. 13 is a diagram showing an example of a scene in which the lost item search support system according to the fourth modification is used. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] 1 is a diagram showing an example of a usage scenario of a lost item search support system 1 according to an embodiment. The lost item search support system 1 according to an embodiment includes a drive recorder 10 and a mobile terminal device 20. Hereinafter, in this specification, the mobile terminal device 20 is assumed to be a smartphone. In recent years, an increasing number of users are attaching loss prevention tags to their belongings such as wallets, key cases, bags, cameras, and wireless earphones. The loss prevention tags are connected to the smartphone via short-range wireless communication.

[0013] 1 shows a situation in which a user U1 is riding a bicycle, which is an example of a mobility M1. The mobility M1 is not limited to a non-electric bicycle, but may be an electric bicycle, an electric motorcycle, a gasoline motorcycle, an electric kickboard, a non-electric kickboard, or an ultra-compact BEV.

[0014] In recent years, an increasing number of users are installing drive recorders on their bicycles or motorcycles to record footage of accidents or evidence of aggressive driving. In the example shown in FIG. 1, a drive recorder 10 is installed on the seat post of the bicycle saddle. The drive recorder 10 shown in FIG. 1 is installed at an angle of view that captures the rear of the bicycle. Note that a tail lamp may be added to the drive recorder 10 for capturing rearward images.

[0015] A user U1 shown in FIG. 1 carries a mobile terminal device 20 in his pocket, and the mobile terminal device 20 and the drive recorder 10 are connected via Wi-Fi (registered trademark) as a first short-range wireless communication.

[0016] A user U1 was carrying a wallet (an example of an article 30) to which a wireless tag 31 was attached as an anti-loss tag. The mobile terminal device 20 and the wireless tag 31 were connected by Bluetooth (registered trademark) Low Energy (hereinafter referred to as Bluetooth) or UWB (Ultra Wide Band) as a second short-range wireless communication. FIG. 1 shows a situation in which the user U1 lost the wallet he was carrying while riding a bicycle.

[0017] 2 is a block diagram for explaining a configuration example of a lost item search support system 1 according to an embodiment. The lost item search support system 1 includes a drive recorder 10 and a mobile terminal device 20. The drive recorder 10 includes an imaging unit 11, a GPS sensor 12, an acceleration sensor 13, a control unit 14, a recording medium 15, and an antenna 16.

[0018] The imaging unit 11 captures images of the surroundings. In the example shown in Fig. 1, the driving recorder 10 is installed to capture images of the rear of the mobility M1, but when the driving recorder 10 is installed on the handlebars, the imaging unit 11 captures images of the front of the mobility M1. Also, when the user U1 is wearing a helmet, the driving recorder 10 may be attached to the helmet.

[0019] The imaging unit 11 includes a lens and a solid-state imaging element. For example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor can be used as the solid-state imaging element. The solid-state imaging element converts light incident through the lens into an electrical video signal and outputs it to the control unit 14.

[0020] The GPS sensor 12 is an example of a GNSS (Global Navigation Satellite System) receiver, and detects the current position information of the mobility M1 by latitude, longitude, and altitude, and outputs the detected position information to the control unit 14. Specifically, the GPS sensor 12 receives radio waves including the respective transmission times from a plurality of GPS satellites, and calculates the latitude, longitude, and altitude of the reception point based on the plurality of transmission times included in the plurality of received radio waves.

[0021] For example, a three-axis acceleration sensor is used as the acceleration sensor 13, which detects acceleration values ​​in the XYZ directions applied to the acceleration sensor 13 and outputs the values ​​to the control unit .

[0022] The recording medium 15 is a large-capacity non-volatile recording medium, and can record video of the surroundings of the mobility M1 captured by the imaging unit 11. For example, a built-in flash memory (e.g., a NAND-type flash memory) or an external semiconductor memory card is used as the recording medium 15.

[0023] The control unit 14 includes a temporary storage unit 141, a detection unit 142, and a wireless communication unit 143. The control unit 14 is realized by a combination of hardware resources and software resources, or by hardware resources alone. As the hardware resources, a CPU, a ROM, a RAM, a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), and other LSIs can be used. As the software resources, a program such as firmware can be used.

[0024] The temporary storage unit 141 is a ring buffer that stores, for a certain period of time, video data captured by the imaging unit 11. When the capacity of the ring buffer becomes full, the oldest video data is deleted.

[0025] In the continuous recording mode, when the acceleration sensor 13 detects an acceleration value equal to or greater than a predetermined value, the detection unit 142 determines that a large impact has been applied to the drive recorder 10 due to an accident, collision, sudden braking, or the like, and stores the video data at the time of detection in the recording medium 15 with overwriting prohibited. In the event recording mode, when the acceleration sensor 13 detects an acceleration value equal to or greater than a predetermined value, the detection unit 142 starts recording the video data captured by the imaging unit 11 in the recording medium 15.

[0026] The wireless communication unit 143 uses the antenna 16 to execute wireless communication control using Wi-Fi as the first short-range wireless communication, and establishes a wireless connection with the first wireless communication unit 243a of the mobile terminal device 20. Note that the drive recorder 10 and the mobile terminal device 20 may be connected by wire (for example, a USB cable).

[0027] The mobile terminal device 20 includes an imaging unit 21, a GPS sensor 22, an operation display unit 23, a control unit 24, a recording medium 25, a first antenna 26a, and a second antenna 26b. The imaging units 21 are installed on the rear and front of the housing, and can capture images in the rear direction and the front direction of the housing, respectively. Each imaging unit 21 includes a lens and a solid-state imaging element. The solid-state imaging element converts light incident through the lens into an electrical video signal and outputs it to the control unit 24.

[0028] The GPS sensor 22 is an example of a GNSS receiver, which detects the current location information of the mobile terminal device 20 in terms of latitude, longitude, and altitude, and outputs the detected location information to the control unit 24.

[0029] The operation display unit 23 includes a touch panel display such as a liquid crystal display, an organic EL display, or a mini LED display, and displays an image input from the control unit 24. The operation display unit 23 also accepts an operation by the user U1, and outputs an operation signal to the control unit 24 according to the operation content of the user U1.

[0030] The control unit 24 includes a recording control unit 241, a first wireless communication unit 243a, and a second wireless communication unit 243b. The control unit 24 is realized by a combination of hardware resources and software resources, or by hardware resources alone. As hardware resources, a CPU, ROM, RAM, GPU, ASIC, FPGA, and other LSIs can be used. As software resources, programs such as an operating system, middleware, and applications can be used.

[0031] The recording medium 25 is a large-capacity non-volatile recording medium, and is configured with a built-in flash memory (for example, a NAND-type flash memory). Some models also allow an external semiconductor memory card to be added. Various programs and data are recorded in the recording medium 25. Video data captured by the imaging unit 21 can also be recorded.

[0032] The first wireless communication unit 243a uses the first antenna 26a to execute wireless communication control using Wi-Fi as the first short-range wireless communication, and establishes a wireless connection with the wireless communication unit 143 of the drive recorder 10.

[0033] The second wireless communication unit 243b uses the second antenna 26b to execute wireless communication control using Bluetooth or UWB as the second short-range wireless communication, and establishes a wireless connection with the control unit 32 of the wireless tag 31. The wireless tag 31 has a small battery (not shown) such as a button battery, and the control unit 32 continues to transmit radio waves related to the second short-range wireless communication from the antenna 33 as long as the power supply from the small battery continues.

[0034] The recording control unit 241 controls to store the video captured by the imaging unit 11 when the second short-range wireless communication with the wireless tag 31 is interrupted. When the user U1 drops the article 30 to which the wireless tag 31 is attached and the distance between the mobile terminal device 20 and the article 30 becomes a predetermined distance (for example, 10 m) or more, the second short-range wireless communication is interrupted.

[0035] Specifically, when the second short-range wireless communication with the wireless tag 31 is interrupted, the recording control unit 241 identifies the position information of the GPS sensor 22 detected at the timing of the interruption. The recording control unit 241 transmits a video storage instruction signal including the identified position information to the drive recorder 10.

[0036] When the control unit 14 of the drive recorder 10 receives the instruction signal from the mobile terminal device 20 in the continuous recording mode, the control unit 14 stores the video data of a predetermined period before and after the timing when the second short-range wireless communication is interrupted in the recording medium 15 without overwriting. For example, the video data of 5 seconds before and 15 seconds after the timing when the communication is interrupted is stored. The main purpose of storing this video data is to store as video the moment when the item 30 is dropped and where the item 30 rolls after being dropped, so it is desirable to set the ratio of recording time before and after the time after the item 30 is dropped longer than the time before the item 30 is dropped.

[0037] When the control unit 14 of the drive recorder 10 receives the instruction signal from the mobile terminal device 20 in the event recording mode, the control unit 14 starts recording the video data captured by the imaging unit 11 onto the recording medium 15 from the timing when the second short-range wireless communication is interrupted. In either mode, the control unit 14 stores the video data recorded onto the recording medium 15 together with the position information contained in the instruction signal. This makes it possible to record the location information about where the item 30 was dropped.

[0038] In addition, when the control unit 14 of the drive recorder 10 receives the above-mentioned instruction signal from the mobile terminal device 20, it may transmit the video data captured by the imaging unit 11 to the mobile terminal device 20 using a first short-range wireless communication, and store it in the recording medium 25 of the mobile terminal device 20.

[0039] The control unit 24 of the mobile terminal device 20 may display a message on the operation display unit 23 to notify the user U1 of the drop of the article 30 when the article 30 falls and the second short-range wireless communication is interrupted. The control unit 24 may also turn on a notification lamp (not shown) such as an LED when the second short-range wireless communication is interrupted. The control unit 24 may also output a voice message from a speaker (not shown) to notify the user U1 of the drop of the article 30 when the second short-range wireless communication is interrupted. The control unit 24 may also vibrate a vibrator (not shown) when the second short-range wireless communication is interrupted. However, if the user U1 is concentrating on driving, he or she often does not notice the above-mentioned notification.

[0040] User U1, who realizes that he has dropped item 30 in a location far away from where he dropped item 30, refers to the stored video or location information of the time when item 30 was dropped and returns to the vicinity of the location where he thinks he dropped item 30.

[0041] When the second antenna 26b of the mobile terminal device 20 picks up the radio waves transmitted by the wireless tag 31, the wireless tag 31 and the mobile terminal device 20 are reconnected by the second short-range wireless communication. This allows the user U1 to confirm that the article 30 to which the wireless tag 31 is attached is nearby. If the saved video shows the scene in which the article 30 falls and the position where the fallen article 30 finally reaches, the user U1 can easily find the dropped article 30.

[0042] Even if the article 30 is not shown in the stored video, if the scene shown is a familiar scene, it is useful for estimating the location where the article 30 was dropped. Even if the article 30 was dropped in a location where the GPS sensor 22 cannot detect radio waves or the detection accuracy of the GPS sensor 22 is low, it is possible to estimate the location where the article 30 was dropped based on the video.

[0043] If the wireless tag 31 has a built-in speaker, after the wireless tag 31 and the mobile terminal device 20 are reconnected by the second short-range wireless communication, the speaker of the wireless tag 31 can be made to ring from the mobile terminal device 20. The user U1 can search for the article 30 using the sound as a clue.

[0044] 3 is a flowchart showing an example of the operation of the lost item search support system 1 according to the embodiment. The second wireless communication unit 243b of the mobile terminal device 20 establishes second short-range wireless communication with the wireless tag 31 attached to the item 30 to be prevented from being lost (step S10). The second wireless communication unit 243b of the mobile terminal device 20 monitors whether the second short-range wireless communication with the wireless tag 31 is maintained (step S11). If the second short-range wireless communication with the wireless tag 31 is maintained (step S11: No), the second wireless communication unit 243b continues monitoring.

[0045] When the second short-range wireless communication with the wireless tag 31 is interrupted (step S11: Yes), the recording control unit 241 identifies the position information of the GPS sensor 22 detected at the timing when the second short-range wireless communication with the wireless tag 31 was interrupted (step S12). The recording control unit 241 transmits a video storage instruction signal including the identified position information to the drive recorder 10 (step S13).

[0046] When the control unit 14 of the drive recorder 10 receives a video saving instruction signal from the mobile terminal device 20 in the continuous recording mode, it saves the video data for a predetermined period before and after the timing when the second short-range wireless communication is interrupted, together with the received location information, on the recording medium 15 (step S14).

[0047] 4 is a block diagram for explaining a configuration example of a lost item search support system 1 according to Modification 1. In Modification 1, the lost item search support system 1 is configured by a single drive recorder 10, and does not use a mobile terminal device 20. The wireless communication unit 143 of the drive recorder 10 uses the antenna 16 to execute wireless communication control using Bluetooth or UWB as a second short-range wireless communication, and establishes a wireless connection with the control unit 32 of the wireless tag 31.

[0048] When the second short-range wireless communication with the wireless tag 31 is interrupted, the detection unit 142 specifies the position information of the GPS sensor 12 detected at the timing of the interruption, and controls so as to store the video captured by the imaging unit 11. In the case of the continuous recording mode, the detection unit 142 stores the video data of a predetermined period before and after the timing of the interruption of the second short-range wireless communication with the wireless tag 31 in the recording medium 15 without overwriting.

[0049] In the event recording mode, the detection unit 142 starts recording the video data captured by the imaging unit 11 onto the recording medium 15 from the timing when the second short-range wireless communication with the wireless tag 31 is interrupted. In either mode, the detection unit 142 stores the video data onto the recording medium 15, including the position information of the timing of the interruption.

[0050] 5 is a block diagram for explaining a configuration example of a lost item search support system 1 according to Modification 2. In Modification 2, the lost item search support system 1 is configured by a mobile terminal device 20 alone, and the drive recorder 10 is not used. In Modification 2, the mobile terminal device 20 is fixed to a folder installed on the handle of the mobility M1. The mobile terminal device 20 can capture an image in front of the mobility M1 with the imaging unit 21 on the back, and can capture an image on the rear side of the mobility M1 with the imaging unit 21 on the front.

[0051] In the second modification, the mobile terminal device 20 further includes an acceleration sensor 27. For example, a three-axis acceleration sensor is used for the acceleration sensor 27, which detects acceleration values ​​in the XYZ directions applied to the acceleration sensor 27 and outputs the acceleration values ​​to the control unit 24. In the second modification, the control unit 24 of the mobile terminal device 20 further includes a detection unit 242. When the acceleration sensor 27 detects an acceleration value equal to or greater than a predetermined value in the continuous recording mode, the detection unit 242 determines that a large impact has been applied to the mobile terminal device 20 due to an accident, collision, sudden braking, or the like, and stores the video data at the time of detection in the recording medium 25 with overwriting prohibited. When the acceleration sensor 27 detects an acceleration value equal to or greater than a predetermined value in the event recording mode, the detection unit 242 starts recording the video data captured by the imaging unit 21 in the recording medium 25.

[0052] The second wireless communication unit 243b uses the second antenna 26b to execute wireless communication control using Bluetooth or UWB as the second short-range wireless communication, and establishes a wireless connection with the control unit 32 of the wireless tag 31.

[0053] When the second short-range wireless communication with the wireless tag 31 is interrupted, the recording control unit 241 specifies the position information of the GPS sensor 22 detected at the timing of the interruption, and controls to store the video captured by the imaging unit 21. In the case of the continuous recording mode, the recording control unit 241 stores the video data of a predetermined period before and after the timing of the interruption of the second short-range wireless communication with the wireless tag 31 in the recording medium 25 without overwriting.

[0054] In the event recording mode, the recording control unit 241 starts storing the video data captured by the imaging unit 21 in the recording medium 25 from the timing when the second short-range wireless communication with the wireless tag 31 is interrupted. In either mode, the recording control unit 241 stores the video data in the recording medium 25 together with the position information of the timing when the communication was interrupted.

[0055] FIG. 6 is a diagram showing an example of a usage scene of the lost item search support system 1 according to the modified example 3. The lost item search support system 1 according to the modified example 3 includes a mobile terminal device 20 and a speed sensor 40. The speed sensor 40 is attached to a wheel of the mobility M1. The mobile terminal device 20 is fixed to a folder installed on the handle of the mobility M1. The speed sensor 40 and the mobile terminal device 20 are connected by a first short-range wireless communication. The speed sensor 40 and the mobile terminal device 20 may be connected by a wire (for example, a USB cable).

[0056] 7 is a block diagram for explaining a configuration example of the lost item search support system 1 according to the third modification. The sensor unit 41 of the speed sensor 40 magnetically or optically detects the rotation of the wheels of the mobility M1 and outputs the rotation to the control unit 42. The control unit 42 generates a pulse signal according to the detected number of rotations. The control unit 42 uses the antenna 43 to execute wireless communication control using Wi-Fi as the first short-range wireless communication, and transmits the generated pulse signal to the mobile terminal device 20.

[0057] A speed display application program is installed in advance in the control unit 24 of the mobile terminal device 20, and the circumference of the wheels of the mobility M1 is registered in advance. The control unit 24 measures the speed from the period of the pulse signal received from the speed sensor 40 and the registered circumference of the wheels. The control unit 24 can display the measured speed in real time on the operation display unit 23. The control unit 18 can also calculate the travel distance based on the measured speed and travel time, and display the calculated travel distance on the operation display unit 23 in real time.

[0058] The second wireless communication unit 243b uses the second antenna 26b to execute wireless communication control using Bluetooth or UWB as the second short-range wireless communication, and establishes a wireless connection with the control unit 32 of the wireless tag 31. Note that in the third modification, Bluetooth may be used for the first short-range wireless communication with the speed sensor 40, and UWB may be used for the second short-range wireless communication with the wireless tag 31.

[0059] In the third modification, the control unit 24 further includes an FPS (Frames Per Second) control unit 244. In the third modification, the image capturing of the surroundings of the mobility M1 by the mobile terminal device 20 is positioned as an image capturing support for lost item search, not as an image capturing as a drive recorder. Therefore, there is no need to capture images at a general frame rate of 30 Hz / 60 Hz, and capturing images at a low frame rate saves the battery capacity and memory capacity of the mobile terminal device 20.

[0060] The FPS control unit 244 controls the frame rate of the video captured by the imaging unit 21 according to the speed of the mobility M1. Specifically, the slower the speed of the mobility M1, the lower the frame rate of the imaging unit 21 is set by the FPS control unit 244. A table or function describing the relationship between the speed of the mobility M1 and the frame rate of the imaging unit 21 is registered in advance in the FPS control unit 244. The relationship between the speed of the mobility M1 and the frame rate of the imaging unit 21 is determined by a designer based on the results of experiments and simulations. For example, when the speed of the mobility M1 is 10 km / h or less, the frame rate of the imaging unit 21 may be set to about several Hz.

[0061] The FPS control unit 244 increases the frame rate of the imaging unit 21 when the second short-range wireless communication with the wireless tag 31 is interrupted. For example, the frame rate may be increased to a general frame rate of 30 Hz / 60 Hz.

[0062] When the second short-range wireless communication with the wireless tag 31 is interrupted, the recording control unit 241 specifies the position information of the GPS sensor 22 detected at the timing of the interruption, and controls so as to store the video captured by the imaging unit 21. In the case of the continuous recording mode, the recording control unit 241 stores the video data of a predetermined period before and after the timing of the interruption of the second short-range wireless communication with the wireless tag 31 in the recording medium 25 without overwriting. In the third modification, the recording control unit 241 may control the predetermined period before and after the interruption in accordance with the speed of the mobility M1. For example, the predetermined period before and after the interruption may be set shorter as the speed of the mobility M1 is slower.

[0063] In the event recording mode, the recording control unit 241 starts saving the video data captured by the imaging unit 21 to the recording medium 25 from the timing when the second short-range wireless communication with the wireless tag 31 is interrupted. In the event recording mode, the video to be saved is captured at a normal frame rate. In either mode, the recording control unit 241 saves the video data, including the position information of the timing of the interruption, to the recording medium 25.

[0064] 8 is a flowchart showing an example of the operation of the lost item search support system 1 according to the third modification. The second wireless communication unit 243b of the mobile terminal device 20 establishes a second short-range wireless communication with the wireless tag 31 attached to the item 30 to be prevented from being lost (step S20). The control unit 24 measures the speed of the mobility M1 based on the pulse signal received from the speed sensor 40 (step S21). The FPS control unit 244 adaptively changes the frame rate of the video captured by the imaging unit 21 according to the speed of the mobility M1 (step S22).

[0065] The second wireless communication unit 243b of the mobile terminal device 20 monitors whether the second short-range wireless communication with the wireless tag 31 is being maintained (step S23). If the second short-range wireless communication with the wireless tag 31 is being maintained (step S23: No), the process proceeds to step S21.

[0066] When the second short-range wireless communication with the wireless tag 31 is interrupted (step S23: Yes), the recording control unit 241 identifies the position information of the GPS sensor 22 detected at the timing when the second short-range wireless communication with the wireless tag 31 was interrupted (step S24). The FPS control unit 244 increases the frame rate of the imaging unit 21 (step S25). In the continuous recording mode, the recording control unit 241 stores video data for a predetermined period before and after the timing when the second short-range wireless communication was interrupted, together with the identified position information, in the recording medium 25 (step S26).

[0067] In the above description of the third modification, an example has been described in which the FPS control unit 244 controls the frame rate of the video captured by the imaging unit 21 in accordance with the speed of the mobility M1. In this regard, the FPS control unit 244 may control the frame rate of the video (video file) stored in the recording medium 25 in accordance with the speed of the mobility M1. The FPS control unit 244 may set a lower frame rate of the video stored in the recording medium 25 as the speed of the mobility M1 decreases. In this example, the imaging unit 21 may capture the video at a general frame rate of 30 Hz / 60 Hz. In this example as well, the processing load related to video recording on the mobile terminal device 20 can be reduced.

[0068] 9 is a diagram showing an example of a usage scene of the lost item search support system 1 according to the modified example 4. Up to this point, an example has been described in which the drive recorder 10 having the imaging unit 11 that captures surrounding images, or the portable terminal device 20 having the imaging unit 21 that captures surrounding images, is attached to the mobility M1. In the modified example 4, the drive recorder 10 having the imaging unit 11 that captures surrounding images, or the portable terminal device 20 having the imaging unit 21 that captures surrounding images, is attached to the user U1 himself.

[0069] 9, a drive recorder 10 (also called an action camera or a wearable camera) is attached to a shoulder harness of a backpack of a user U1 who is climbing a mountain. If the user U1 is wearing a helmet, the drive recorder 10 may be attached to the helmet.

[0070] The configuration and operation of the lost item search support system 1 according to the modification 4 are similar to those of the modification 3. The moving speed of the user U1 can be estimated based on the transition of the position information detected by the GPS sensor 22 of the mobile terminal device 20.

[0071] As described above, according to this embodiment, it is possible to easily identify the location where the item 30 was lost by storing video data before and after the timing when the second short-range wireless communication with the wireless tag 31 was interrupted. At that time, the location information at the timing when the second short-range wireless communication with the wireless tag 31 was interrupted is also stored, but if the detection accuracy of the GPS sensor is low, it may be difficult to identify the location where the item 30 was lost from the location information of the GPS sensor.

[0072] In this embodiment, since the image of the location where the item 30 was lost is stored, it becomes easy to identify the location where the item 30 was lost. If the stored image shows the scene where the item 30 was dropped and the location where the dropped item 30 finally reached, the user U1 can easily find the dropped item 30. Even if the item 30 is not shown in the stored image, if the scene shown is a familiar scene, it is helpful in estimating the location where the item 30 was dropped.

[0073] Furthermore, when the moving speed of the mobility M1 or the user U1 is slow, an increase in the processing load of the mobile terminal device 20 can be suppressed by capturing an image at a low frame rate, and the battery capacity and memory capacity can be saved. After the second short-range wireless communication with the wireless tag 31 is interrupted, a high-quality image can be stored by increasing the frame rate.

[0074] The present invention has been described above based on an embodiment. This embodiment is merely an example, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component and each treatment process, and that such modifications are also within the scope of the present invention.

[0075] In the above embodiment, a situation was assumed in which an item 30 with an attached wireless tag 31 that was being worn by a user U1 fell. However, the present disclosure can also be applied to a situation in which an item 30 with an attached wireless tag 31 that was mounted on the carrier or basket of a mobility M1 fell due to vibration or the like. [Explanation of symbols]

[0076] 1 Lost item search support system, U1 User, M1 Mobility, 10 Drive recorder, 11 Imaging unit, 12 GPS sensor, 13 Acceleration sensor, 14 Control unit, 141 Temporary storage unit, 142 Detection unit, 143 Wireless communication unit, 15 Recording medium, 16 Antenna, 20 Portable terminal device, 21 Imaging unit, 22 GPS sensor, 23 Operation display unit, 24 Control unit, 241 Recording control unit, 242 Detection unit, 243a First wireless communication unit, 243b Second wireless communication unit, 244 FPS control unit, 25 Recording medium, 26a First antenna, 26b Second antenna, 27 Acceleration sensor, 30 Item, 31 Wireless tag, 32 Control unit, 33 Antenna, 40 Speed ​​sensor, 41 Sensor unit, 42 Control unit, 43 Antenna.

Claims

1. An imaging unit that is attached to the mobility or a user and captures surrounding images; a wireless tag attached to an item attached to the mobility or an item worn by the user, and a control unit that performs short-range wireless communication; The control unit controls the image capturing unit to store the image when the short-distance wireless communication with the wireless tag is interrupted. Lost item search support system.

2. The imaging unit captures an image of a surrounding area while the mobility or the user is moving, The control unit controls the storage of the image for a predetermined period before and after the short-range wireless communication with the wireless tag is interrupted. The lost item search support system according to claim 1.

3. The control unit sets a frame rate of the imaging unit or a frame rate of a video image to be stored in a recording medium to be lower as the mobility or the moving speed of the user is slower. The lost item search support system according to claim 1.

4. the control unit increases a frame rate of the imaging unit or a frame rate of the video stored in the recording medium when short-range wireless communication with the wireless tag is interrupted. The lost item search support system according to claim 3.

5. A step of capturing an image of the surroundings with an imaging unit attached to the mobility or a user; performing short-range wireless communication with a wireless tag attached to an item attached to the mobility or an item worn by the user; and when short-distance wireless communication with the wireless tag is interrupted, controlling the image captured by the imaging unit to be stored. How to assist in finding lost property.

Images