Monitoring device, monitoring method, and monitoring program

Abstract

To determine whether or not a moving object has exited to the outside of a vehicle with high precision.SOLUTION: A monitoring device 100 has: an acquisition unit 121 for acquiring strength of a signal received by a moving object sensor provided inside a vehicle; and a determination unit 122 for determining whether or not the moving object has exited to the outside of the vehicle on the basis of the strength of the signal acquired by the acquisition unit 121.SELECTED DRAWING: Figure 8

Description

[Technical field]

[0001] The present invention relates to a monitoring device, a monitoring method, and a monitoring program. [Background technology]

[0002] Conventionally, there exists a technique for determining that an object (moving object) has not entered the vehicle interior when the object is detected near the vehicle (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2006-256372 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology, there is a problem that it may not be possible to accurately determine whether or not a moving object has exited the vehicle. For example, when detecting an exit from the vehicle based on the strength of a signal received by a moving object sensor, if there is little movement of the moving object inside the vehicle, the signal strength may decrease and the exit from the vehicle may not be detected. In addition, when there is extremely little movement, for example, when a person inside the vehicle is stationary or sleeping, the person may not be detected as a moving object and may be erroneously detected as having exited the vehicle. Thus, the above-mentioned problem is one example of the problem that the present invention is intended to solve. [Means for solving the problem]

[0005] In order to solve the above-mentioned problems and achieve the object, the invention described in claim 1 is characterized in having an acquisition unit that acquires the strength of a signal received by a motion sensor installed in the vehicle, and a judgment unit that judges whether a moving object has left the vehicle based on the strength of the signal acquired by the acquisition unit.

[0006] The invention described in claim 8 is a method executed by a monitoring device, characterized in that it includes an acquisition step of acquiring the strength of a signal received by a motion sensor installed in the vehicle from the motion sensor, and a determination step of determining whether or not a moving object has left the vehicle based on the strength of the signal acquired by the acquisition step.

[0007] The invention described in claim 9 is characterized in that it has a computer execute an acquisition step of acquiring the strength of a signal received by a motion sensor installed in the vehicle from the motion sensor, and a determination step of determining whether or not a moving object has left the vehicle based on the strength of the signal acquired by the acquisition step. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a monitoring device system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of a monitoring device according to an embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of an installation location of the moving body sensor according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a determination process performed by the monitoring device according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating a threshold value changing process performed by the monitoring device according to the embodiment. [Figure 6] FIG. 6 is a flowchart illustrating an example of processing by the monitoring device according to the embodiment. [Figure 7] FIG. 7 is a flowchart illustrating an example of processing by the monitoring device according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of the configuration of a monitoring device according to an embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of a determination process performed by the monitoring device according to the embodiment. [Figure 10] FIG. 10 is a flowchart illustrating an example of processing by the monitoring device according to the embodiment. [Figure 11]FIG. 11 is a hardware configuration diagram showing an example of a computer that realizes the functions of the monitoring device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, a mode for carrying out the present invention (hereinafter, referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0010] [First embodiment] [1. System Configuration] Next, the configuration of a monitoring system according to an embodiment will be described with reference to Fig. 1. Fig. 2 is a diagram showing the configuration of a monitoring system according to an embodiment. Fig. 1 shows a monitoring system 1 as an example of the monitoring system according to an embodiment.

[0011] 1, the monitoring system 1 may include an in-vehicle device 10 and a monitoring device 100. The in-vehicle device 10 and the monitoring device 100 are connected to each other via a network N so as to be able to communicate with each other via a wired or wireless connection. The monitoring system 1 shown in FIG. 1 may include any number of in-vehicle devices 10 and any number of monitoring devices 100.

[0012] The in-vehicle device 10 may be a dedicated sensor device built into or externally attached to the vehicle VEx, or may be a device such as a recording device (dashcam) installed in the vehicle VEx for crime prevention or anti-tailgating purposes.

[0013] The in-vehicle device 10 may also be configured with a sensor device and a notification device. As an example, the in-vehicle device 10 may be a composite device in which a sensor device and a notification device that are independent of each other are communicatively connected. As another example, the in-vehicle device 10 may be a single device having a sensor function and a notification function.

[0014] Furthermore, a user can connect a predetermined sensor to a portable terminal device (e.g., a smartphone, a tablet terminal, a notebook PC, a desktop PC, a PDA, etc.) that he or she uses on a daily basis and install a predetermined application to use it as a substitute for the in-vehicle device 10. For example, a portable terminal device that is equipped with a predetermined sensor or to which a predetermined sensor is connected can be understood as the in-vehicle device 10 referred to here. When the portable terminal device is used as the in-vehicle device 10, for example, it is installed on the dashboard of the vehicle VEx while driving.

[0015] The in-vehicle device 10 may also include various sensors, such as a distance sensor, a microwave sensor, a LiDAR (light detection and ranging) or other motion sensor, a temperature sensor, a microphone, a GPS sensor, an acceleration sensor, a gyro sensor, a camera, and an air pressure sensor.

[0016] The monitoring device 100 may acquire various types of data based on the sensor information detected by these sensors (for example, by analyzing the sensor information). For example, the monitoring device 100 acquires information on moving objects inside and outside the vehicle from a moving object sensor. Also, for example, the monitoring device 100 acquires the temperature inside the vehicle from a temperature sensor. Also, for example, the monitoring device 100 acquires audio from a microphone. Also, for example, the monitoring device 100 acquires angular velocity from a gyro sensor. Also, for example, the monitoring device 100 acquires video data of the outside captured from inside the vehicle VEx by a camera. Note that the monitoring device 100 may acquire sensor information detected not only by sensors provided in the in-vehicle device 10, but also by sensors provided in the vehicle VEx itself.

[0017] The monitoring device 100 is a device that determines whether a moving object has entered the vehicle interior. For example, the monitoring device 100 determines whether a moving object has entered the vehicle interior based on the strength of each signal received by a plurality of moving object sensors provided in the vehicle. The monitoring device 100 is also a device that determines whether a moving object has exited the vehicle exterior. For example, the monitoring device 100 determines whether a moving object has exited the vehicle exterior based on the strength of each signal received by a moving object sensor provided in the vehicle.

[0018] Here, if the in-vehicle device 10 is an edge computer that performs edge processing near the user, the monitoring device 100 may be, for example, a cloud computer that performs processing on the cloud side. In other words, the monitoring device 100 may be a server device.

[0019] In the following embodiment, an example is shown in which the monitoring according to the embodiment is realized in the monitoring system 1 by transmitting and receiving information between the in-vehicle device 10 and the monitoring device 100. However, the monitoring according to the embodiment may be realized only on the edge side, i.e., the in-vehicle device 10. In this case, the in-vehicle device 10 may be configured to behave like the monitoring device 100 by, for example, a monitoring program according to the embodiment.

[0020] 2. Configuration of the monitoring device Next, the monitoring device 100 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the monitoring device 100 according to the embodiment. As shown in Fig. 2, the monitoring device 100 has a communication unit 110, a storage unit 130, and a control unit 120. Each unit of the monitoring device 100 will be described below.

[0021] The communication unit 110 is realized by, for example, a network interface card (NIC), etc. The communication unit 110 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the in-vehicle device 10, for example.

[0022] The storage unit 130 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk, an optical disk, etc. The storage unit 130 stores the position where the moving object sensor is installed, the strength of the signal to be transmitted, the sensitivity of receiving the signal, the strength of the received signal, the angle calculated from the received signal, the distance, the coordinates of the moving object, information on the vehicle model (such as the vehicle model and size), information on notification (such as notification settings, notification destination terminal information, address information), images (including moving images and still images), and other information necessary for determining whether a moving object has entered the vehicle or whether a moving object has left the vehicle.

[0023] The control unit 120 is realized using a CPU (Central Processing Unit), an NP (Network Processor), an FPGA (Field Programmable Gate Array), etc., and executes a processing program stored in a memory. As shown in Fig. 2, the control unit 120 has an acquisition unit 121, a determination unit 122, a threshold change unit 123, and an output unit 124. Each unit of the control unit 120 will be described below.

[0024] The acquisition unit 121 acquires the strength of each signal received by a plurality of motion sensors provided in the vehicle. For example, the acquisition unit 121 acquires the strength of each signal received by a plurality of motion sensors provided in the vehicle so as to include the vehicle interior in its detection range. For example, the acquisition unit 121 acquires the strength of each signal received by a plurality of motion sensors provided in pillars on the left and right sides of the vehicle. Here, the pillar is given as an example of a location where the motion sensor is installed, but it may be installed near the rearview mirror as shown in FIG. 3(1) or on the center pillar as shown in FIG. 3(2). That is, the motion sensor is installed in a location in the vehicle according to the purpose, such as the front pillar, center pillar, rear pillar, rearview mirror, ceiling, seat, or rear window.

[0025] The acquisition unit 121 further acquires the location where each moving body sensor is installed. For example, the acquisition unit 121 acquires the location where each moving body sensor is installed by receiving an input of the location where each moving body sensor is installed from a user. Also, for example, the acquisition unit 121 acquires the location where each moving body sensor is installed by receiving information on the location where each moving body sensor is installed from another system.

[0026] The acquisition unit 121 further acquires vehicle model information. For example, the acquisition unit 121 acquires vehicle model information by accepting an input of the vehicle model information from a user. For example, the acquisition unit 121 acquires vehicle model information by receiving the vehicle model information from another system.

[0027] The determination unit 122 determines whether or not a moving object has entered the vehicle based on the intensity of each signal acquired by the acquisition unit 121. For example, the determination unit 122 determines that a moving object has entered the vehicle when the intensity of each signal acquired by the acquisition unit 121 is equal to or greater than a first threshold and the sum of the intensities of each signal acquired by the acquisition unit 121 is equal to or greater than a second threshold that is greater than the sum of the first thresholds.

[0028] More specifically, the judgment unit 122 judges that a moving object has entered the vehicle when the strength of each signal acquired by the acquisition unit 121 (strength of the signal received by moving object sensor A: 27, strength of the signal received by moving object sensor B: 30) is greater than or equal to a first threshold value (22) and the sum of the strengths of each signal acquired by the acquisition unit 121 (27 + 30 = 57) is greater than or equal to a second threshold value (56) that is greater than the sum of the first threshold values.

[0029] At this time, the determination unit 122 can perform the determination process by further using a time element. For example, the determination unit 122 determines that a moving object has entered the vehicle when the intensity of each signal acquired by the acquisition unit 121 is equal to or greater than a first threshold value for a period equal to or greater than a predetermined percentage of the predetermined period, and the sum of the intensity of each signal acquired by the acquisition unit is equal to or greater than a second threshold value that is greater than the sum of the first threshold values ​​for a period equal to or greater than a predetermined percentage of the predetermined period.

[0030] More specifically, the judgment unit 122 judges that a moving object has entered the vehicle when the intensity of each signal acquired by the acquisition unit 121 is greater than or equal to a first threshold for a period of 50% or more of 0.5 seconds, and the sum of the intensity of each signal acquired by the acquisition unit 121 is greater than or equal to a second threshold that is greater than the sum of the first thresholds for a period of 50% or more of 0.5 seconds.

[0031] Here, the second threshold value is a value larger than the sum of the first threshold values. For example, the second threshold value is a value larger than the sum of the first threshold values, larger than the sum of the intensities of the signals acquired by the acquisition unit 121 when a moving object is present on both sides of the vehicle, and smaller than the sum of the intensities of the signals acquired by the acquisition unit 121 when a moving object is present inside the vehicle.

[0032] More specifically, the second threshold is a value that is greater than the sum of the first thresholds (22+22=44), greater than the sum of the intensities of the signals acquired by the acquisition unit 121 when there is a moving object on both sides of the vehicle (intensity of the signal received by the moving object sensor A: 25+intensity of the signal received by the moving object sensor B: 25=50), and smaller than the sum of the intensities of the signals acquired by the acquisition unit 121 when there is a moving object inside the vehicle (intensity of the signal received by the moving object sensor A: 30+intensity of the signal received by the moving object sensor B: 30=60). Note that, although two first thresholds are shown in the above example, the number of first thresholds is not limited to this.

[0033] The second threshold may be equal to or greater than a predetermined value. For example, the second threshold is equal to or greater than 115% of the sum of the first thresholds. On the other hand, the second threshold may be equal to or less than a predetermined value. For example, the second threshold is equal to or less than 130% of the sum of the first thresholds.

[0034] That is, the above-mentioned second threshold value is a value that can accurately distinguish between a case where a moving object is present outside the vehicle and a case where a moving object is present inside the vehicle (regardless of location, such as the driver's seat, passenger seat, or back seat). Note that the above-mentioned first threshold value and second threshold value are examples of values ​​shown by experiments conducted on a minivan with a total length of approximately 4600 mm and a width of approximately 1700 mm as the target vehicle, and when using the technology described in this specification, it is desirable to change the first threshold value and the second threshold value as appropriate depending on the vehicle model and size.

[0035] The threshold changing unit 123 changes the first threshold according to the installation positions of the motion sensors acquired by the acquiring unit 121. For example, when the installation positions of the motion sensors acquired by the acquiring unit 121 are biased, the threshold changing unit 123 changes the first threshold for the detection range on the biased side.

[0036] Specifically, when the location where each motion sensor acquired by the acquisition unit 121 is installed is located to the left of the center of the vehicle, the threshold change unit 123 increases the first threshold for the detection range on the left side and decreases the first threshold for the detection range on the right side.

[0037] Furthermore, the threshold change unit 123 changes either one or both of the first threshold and the second threshold according to the information on the vehicle type acquired by the acquisition unit 121. For example, the threshold change unit 123 changes either one or both of the first threshold and the second threshold according to the size of the vehicle acquired by the acquisition unit 121. More specifically, when the vehicle type acquired by the acquisition unit 121 is a station wagon type and the vehicle size is large, the threshold change unit 123 reduces either one or both of the first threshold and the second threshold. On the other hand, when the vehicle acquired by the acquisition unit 121 is a light vehicle and the vehicle size is small, the threshold change unit 123 increases either one or both of the first threshold and the second threshold.

[0038] The output unit 124 outputs a predetermined notification when the determination unit 122 determines that a moving object has entered the vehicle. For example, the output unit 124 outputs to issue an alarm when the determination unit 122 determines that a moving object has entered the vehicle. Here, the output process performed by the output unit 124 includes various modes such as an alarm, a notification to a mobile terminal, and sending an email to a predetermined address. That is, when a moving object has entered the vehicle, the output unit 124 can output a predetermined notification to an appropriate target. For example, when sending a notification to a mobile terminal or an email to a predetermined address, the output unit 124 can output to notify / send an image of the interior of the vehicle captured by an imaging device provided in the vehicle together.

[0039] [3. Determining whether someone has entered a vehicle] Next, the process of determining whether or not a person has intruded into the vehicle performed by the monitoring device 100 will be described with reference to Fig. 4. Fig. 4 is a diagram for explaining an example of the process of determining whether or not a person has intruded into the vehicle performed by the monitoring device 100. First, Fig. 4(1) shows a case where a person is present on the right side of the vehicle. In this case, the strength of each signal received by the moving object sensor is higher on the right side of the vehicle than a first threshold value, and lower on the left side of the vehicle than the first threshold value. In addition, the sum of the strengths of the signals on the right and left sides of the vehicle is lower than a second threshold value.

[0040] Next, FIG. 4(2) shows a case where there is a person inside the vehicle. In this case, the strength of each signal received by the motion sensor is higher than the first threshold on both the right and left sides of the vehicle. The sum of the signal strengths from the right and left sides of the vehicle is also higher than the second threshold. Next, FIG. 4(3) shows a case where there is a person on the left side of the vehicle, and there is a reflector (a cause of multipath) on the right side of the vehicle that reflects the detection wave of the motion sensor. In this case, the strength of each signal received by the motion sensor is higher than the first threshold on both the right and left sides of the vehicle. On the other hand, the sum of the signal strengths from the right and left sides of the vehicle is lower than the second threshold.

[0041] Next, Fig. 4(4) shows a case where there are people on both sides of the vehicle. In this case, the strength of the signals received by the motion sensors on both the right and left sides of the vehicle is higher than the first threshold. On the other hand, the sum of the strength of the signals on the right and left sides of the vehicle is lower than the second threshold, as in Fig. 4(3).

[0042] That is, the strength of the signal received by each motion sensor is high even when a person is outside the vehicle (FIGS. 4(1)(3)(4)), but the sum of the strengths of the signals received by each motion sensor is higher than the second threshold only when a person is inside the vehicle (FIG. 4(2)). Therefore, in addition to threshold judgment on the strength of the signal received by each motion sensor, the judgment unit 122 also performs threshold judgment on the sum of the strengths of each signal, thereby preventing erroneous detection even when multipath factors exist or when people are present on both sides of the vehicle.

[0043] For example, when the strength of each signal acquired by the acquisition unit 121 is high (exceeding the first threshold) and the sum of the signal strengths is high (exceeding the second threshold), it is determined that a moving object has entered the vehicle, making it possible to accurately determine whether a moving object is outside the vehicle (Figures 4(1)(3)(4)) or inside the vehicle (Figure 4(2)).

[0044] [4. Changing the threshold] Next, the threshold value changing process performed by the monitoring device 100 will be described with reference to Fig. 5. Fig. 5 is a diagram for explaining an example of the threshold value changing process performed by the monitoring device 100. First, Fig. 5(1) shows a case where the moving object sensor is located to the left of the center of the vehicle.

[0045] In this case, since the motion sensor is located to the left of the center of the vehicle, the time (distance) until the signal reflected from the motion sensor on the left side of the vehicle is received is shortened, and a stronger signal is received from the left side of the vehicle. Therefore, when the motion sensor is located to the left of the center of the vehicle (FIG. 5(3)), the threshold value changing unit 123 increases the first threshold value for the detection range on the left side.

[0046] On the other hand, since the motion sensor is located to the left of the center of the vehicle, the time and distance required to receive the signal reflected from the motion sensor on the right side of the vehicle becomes longer, and a signal of lower strength is received from the right side of the vehicle. Therefore, when the motion sensor is located to the left of the center of the vehicle (FIG. 5(3)), the threshold value changing unit 123 reduces the first threshold value for the detection range on the right side.

[0047] Next, Fig. 5 (2) shows a case where the size of the vehicle in which the moving object sensor is installed is large. In this case, the large size of the vehicle shortens the time (distance) until the signal reflected from the moving object outside the vehicle is received, and the strength of the signal reflected from the moving object entering the rear of the vehicle or the moving object outside the vehicle becomes lower. Therefore, when the size of the vehicle is large, the threshold change unit 123 reduces either or both of the first threshold and the second threshold. Conversely, when the size of the vehicle is small, the threshold change unit 123 increases either or both of the first threshold and the second threshold.

[0048] In other words, the monitoring device 100 changes the threshold value for determining whether or not a moving object has entered the vehicle depending on the location where the moving object sensor is installed and information on the vehicle type (vehicle size), thereby reflecting changes in signal strength due to differences in the location where the moving object sensor is installed and the size of the vehicle in the threshold value, and can accurately determine whether or not a moving object has entered the vehicle.

[0049] [5. Flowchart] Next, the processing by the monitoring device 100 configured as described above will be described with reference to the flowcharts in Figures 6 and 7. The flowcharts in Figures 6 and 7 are mainly executed by the control unit 120. Moreover, this flowchart can be configured as a program executed by the CPU of the control unit 120 to become a monitoring program. Note that the steps below can be executed in a different order, and some processing may be omitted.

[0050] With reference to Fig. 6, the procedure of the process by which the monitoring device 100 determines the intrusion of a moving object will be described. First, the monitoring device 100 determines whether or not a moving object is present inside the vehicle (step S101). For example, when the monitoring device 100 determines that a moving object inside the vehicle has left the vehicle using the technology of the second embodiment described below, the monitoring device 100 determines that a moving object is not present inside the vehicle. Here, when the monitoring device 100 determines that a moving object is present inside the vehicle (step S101 "Yes"), the process returns to step S101 again.

[0051] On the other hand, if the monitoring device 100 determines that no moving object is present inside the vehicle (step S101 "No"), the acquisition unit 121 acquires the intensity of each signal received by a plurality of moving object sensors provided inside the vehicle (step S102). For example, the acquisition unit 121 acquires the intensity of each signal received by a plurality of moving object sensors provided inside the vehicle so that the detection range includes the interior of the vehicle.

[0052] Next, the determination unit 122 determines whether the intensity of each signal acquired by the acquisition unit 121 is equal to or greater than a first threshold during a period equal to or greater than a predetermined percentage of the predetermined period (step S103). Note that in step S103, the determination process may be performed without using the element of the period. For example, the determination unit 122 determines whether the intensity of each signal acquired by the acquisition unit 121 is equal to or greater than a first threshold. Here, if the determination unit 122 determines that the intensity is not equal to or greater than the first threshold (step S103 "No"), the process returns to step S102 again. On the other hand, if the determination unit 122 determines that the intensity is equal to or greater than the first threshold (step S103 "Yes"), the determination unit 122 subsequently determines whether the sum of the intensity of each signal acquired by the acquisition unit 121 is equal to or greater than a second threshold during a period equal to or greater than a predetermined percentage of the predetermined period (step S104). Note that in step S104, the determination process may be performed without using the element of the period. For example, the determining unit 122 determines whether or not the sum of the intensities of the signals acquired by the acquiring unit 121 is equal to or greater than a second threshold value.

[0053] Here, if the judgment unit 122 judges that the detected value is not equal to or greater than the second threshold value (step S104 "No"), the process returns to step S102. On the other hand, if the judgment unit 122 judges that the detected value is equal to or greater than the second threshold value (step S104 "Yes"), the judgment unit 122 judges that a moving object has entered the vehicle (step S105). For example, the judgment unit 122 judges that a person has entered the vehicle. Then, the output unit 124 outputs a predetermined notification (step S106). For example, the output unit 124 outputs to issue an alarm.

[0054] Next, a process procedure for the monitoring device 100 to change the threshold will be described with reference to Fig. 7. The acquisition unit 121 acquires vehicle type information (step S201). For example, the acquisition unit 121 acquires the vehicle type information by accepting an input of the vehicle type information from a user. Then, the threshold change unit 123 changes the threshold according to the vehicle type information acquired by the acquisition unit 121 (step S202). For example, the threshold change unit 123 changes either one or both of the first threshold and the second threshold according to the size of the vehicle acquired by the acquisition unit 121.

[0055] Next, the acquisition unit 121 acquires the position where each moving body sensor is installed (step S203). For example, the acquisition unit 121 acquires the position where each moving body sensor is installed by accepting an input of the position where each moving body sensor is installed from the user.

[0056] Then, the threshold changing unit 123 changes the threshold according to the installation positions of the motion sensors acquired by the acquiring unit 121 (step S204). For example, when the installation positions of the motion sensors acquired by the acquiring unit 121 are biased, the threshold changing unit 123 changes the first threshold for the detection range on the biased side.

[0057] In addition, the acquisition unit 121 and the threshold change unit 123 may only perform the threshold change process according to the vehicle model (steps S201 and S202), or may only perform the threshold change process according to the location where the motion sensor is installed (steps S203 and S204).

[0058] 6. Effects The monitoring device 100 of the embodiment has an acquisition unit 121 that acquires the strength of each signal received by multiple moving object sensors provided in the vehicle, and a judgment unit 122 that judges whether or not a moving object has entered the vehicle based on the strength of each signal acquired by the acquisition unit 121.

[0059] As a result, the monitoring device 100 can accurately determine whether or not a moving object has entered the vehicle by determining whether or not the signal strength satisfies the threshold condition. In other words, the monitoring device 100 can prevent erroneous detection that can occur due to multipath or when moving objects are present on both sides of the vehicle by using a threshold for the signal strength that is set so as to be able to determine when a moving object has entered the vehicle.

[0060] The judgment unit 122 of the monitoring device 100 of the embodiment judges that a moving object has entered the vehicle when the strength of each signal acquired by the acquisition unit 121 is greater than or equal to a first threshold and the sum of the strengths of each signal acquired by the acquisition unit 121 is greater than or equal to a second threshold that is greater than the sum of the first thresholds.

[0061] Thus, the monitoring device 100 can determine with high accuracy whether or not a moving object has entered the vehicle interior by determining whether or not the signal strength satisfies the conditions of the first threshold and the second threshold.

[0062] The determination unit 122 of the monitoring device 100 according to the embodiment determines that a moving object has entered the vehicle when the strength of each signal acquired by the acquisition unit 121 is greater than or equal to a first threshold for a period of at least a predetermined percentage of a specified period, and the sum of the strengths of each signal acquired by the acquisition unit 121 is greater than or equal to a second threshold that is greater than the sum of the first thresholds for a period of at least a predetermined percentage of a specified period.

[0063] As a result, the monitoring device 100 can accurately determine whether or not a moving object has entered the vehicle by determining whether or not the signal strength satisfies the conditions of the first threshold and the second threshold for a period during which the signal strength is equal to or greater than a specified percentage of a specified period.

[0064] In the monitoring device 100 of the embodiment, the second threshold value is greater than the sum of the first threshold values, greater than the sum of the intensities of each signal acquired by the acquisition unit 121 when a moving object is present on both sides of the vehicle, and smaller than the sum of the intensities of each signal acquired by the acquisition unit 121 when a moving object is present inside the vehicle.

[0065] As a result, the monitoring device 100 can accurately determine whether or not a moving object has entered the vehicle by determining whether the signal strength satisfies the condition of a second threshold value which is greater than the sum of the first threshold values, greater than the sum of the signal strengths when a moving object is present on both sides of the vehicle, and less than the sum of the signal strengths when a moving object is present inside the vehicle.

[0066] In the monitoring device 100 according to the embodiment, the second threshold value is equal to or greater than 115% of the sum of the first threshold values. This allows the monitoring device 100 to determine whether or not a moving object has entered the vehicle with high accuracy by determining whether or not the signal strength satisfies the condition of the second threshold value, which is equal to or greater than 115% of the sum of the first threshold values.

[0067] In the monitoring device 100 according to the embodiment, the second threshold value is equal to or less than 130% of the sum of the first threshold values. This allows the monitoring device 100 to determine whether or not a moving object has entered the vehicle with high accuracy by determining whether or not the signal strength satisfies the condition of the second threshold value, which is equal to or less than 130% of the sum of the first threshold values.

[0068] The acquisition unit 121 of the monitoring device 100 according to the embodiment further acquires the position at which each moving object sensor is installed, and further has a threshold change unit that changes the first threshold value according to the position at which each moving object sensor is installed acquired by the acquisition unit 121.

[0069] As a result, the monitoring device 100 can change the threshold value for determining whether or not a moving object has entered the vehicle depending on the location where the moving object sensor is installed, thereby reflecting the change in signal strength due to differences in the location where the moving object sensor is installed in the threshold value, and can accurately determine whether or not a moving object has entered the vehicle.

[0070] The acquisition unit 121 of the monitoring device 100 according to the embodiment further acquires information on the vehicle model, and further has a threshold change unit 123 that changes either or both of the first threshold value and the second threshold value depending on the information on the vehicle model acquired by the acquisition unit 121.

[0071] As a result, the monitoring device 100 can change the threshold value for determining whether or not a moving object has entered the vehicle interior in accordance with information about the vehicle model in which the moving object sensor is installed, thereby reflecting changes in signal strength due to differences in the size of the vehicle in which the moving object sensor is installed in the threshold value, and can accurately determine whether or not a moving object has entered the vehicle interior.

[0072] The output unit 124 of the monitoring device 100 according to the embodiment outputs a predetermined notification when the determination unit 122 determines that a moving object has entered the vehicle interior. This enables the monitoring device 100 to accurately determine whether or not a moving object has entered the vehicle interior, and to notify the outside of the information that a moving object has entered the vehicle interior.

[0073] [Second embodiment] [1. Configuration of monitoring device] In the first embodiment, an example of determining whether a moving object has entered the vehicle from the strength of a signal received by a moving object sensor is described, whereas in the second embodiment described below, an example of determining whether a moving object has left the vehicle from the strength of a signal received by a moving object sensor is described. Note that descriptions of contents common to the first embodiment will be omitted as appropriate.

[0074] First, the monitoring device 100 according to the embodiment will be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of the configuration of the monitoring device 100 according to the embodiment. As shown in Fig. 8, the control unit 120 of the monitoring device 100 has an acquisition unit 121, a determination unit 122, a threshold change unit 123, an output unit 124, and a change unit 125. Each unit of the control unit 120 will be described below.

[0075] The acquisition unit 121 acquires the strength of a signal received by a motion sensor provided in the vehicle. For example, the acquisition unit 121 acquires the strength of each signal received by a plurality of motion sensors provided in the vehicle. Also, for example, the acquisition unit 121 acquires the strength of each signal received by a plurality of motion sensors provided in the vehicle so as to include the vehicle interior in its detection range.

[0076] The acquisition unit 121 further acquires the location where each moving body sensor is installed. For example, the acquisition unit 121 acquires the location where each moving body sensor is installed by receiving an input of the location where each moving body sensor is installed from a user. Also, for example, the acquisition unit 121 acquires the location where each moving body sensor is installed by receiving information on the location where each moving body sensor is installed from another system.

[0077] The acquisition unit 121 further acquires vehicle model information. For example, the acquisition unit 121 acquires vehicle model information by accepting an input of the vehicle model information from a user. For example, the acquisition unit 121 acquires vehicle model information by receiving the vehicle model information from another system.

[0078] The determination unit 122 determines whether or not the moving object has exited the vehicle based on the intensity of the signal acquired by the acquisition unit 121. For example, the determination unit 122 determines that the moving object has exited the vehicle when the intensity of the signal acquired by the acquisition unit 121 is continuously less than a threshold value for a predetermined period of time.

[0079] More specifically, the determination unit 122 determines that the moving object has exited the vehicle because the strength (18) of the signal acquired by the acquisition unit 121 is less than the threshold (22) for 100% of a period of 0.5 seconds. Here, regarding the predetermined period, the period used to determine whether the moving object has exited the vehicle is longer than the period used to determine whether the moving object has entered the vehicle. For example, if the period used to determine whether the moving object has entered the vehicle is 50% of 0.5 seconds (0.25 seconds), the period used to determine whether the moving object has exited the vehicle may be 50% of 1.0 seconds (0.5 seconds).

[0080] In addition, the threshold value for determining whether a moving object has exited the vehicle corresponds to the first threshold value for determining whether a moving object has entered the vehicle. For example, if the first threshold value for determining whether a moving object has entered the vehicle is 22, and the signal strength is equal to or greater than the first threshold value (22), then the threshold value for determining whether a moving object has exited the vehicle is 22, and the signal strength is less than the threshold value (22), the moving object is determined to have exited the vehicle.

[0081] Furthermore, the determination unit 122 can determine whether or not a moving object has exited the vehicle using the strength of each signal received by the multiple moving object sensors. For example, the determination unit 122 determines whether or not a moving object has exited the vehicle when the strength of each signal acquired by the acquisition unit 121 is continuously below a threshold for a predetermined period of time. For example, the determination unit 122 determines that a moving object has exited the vehicle when the strength of each signal received by the moving object sensors provided on the left and right sides of the vehicle is continuously below a threshold for a predetermined period of time.

[0082] More specifically, the judgment unit 122 judges that a moving object has exited the vehicle when the strength (18) of the signal received by the moving object sensor provided on the right side of the vehicle is less than the threshold value (22) for 100% of a period of 0.5 seconds and the strength (19) of the signal received by the moving object sensor provided on the left side of the vehicle is less than the threshold value (22) for 100% of a period of 0.5 seconds.

[0083] The threshold changing unit 123 changes the threshold depending on the installation positions of the motion sensors acquired by the acquiring unit 121. For example, when the installation positions of the motion sensors acquired by the acquiring unit 121 are biased, the threshold changing unit 123 changes the first threshold for the detection range on the biased side.

[0084] Specifically, when the location where each motion sensor acquired by the acquisition unit 121 is installed is located to the left of the center of the vehicle, the threshold change unit 123 increases the threshold for the detection range on the left side and decreases the threshold for the detection range on the right side.

[0085] The threshold change unit 123 changes the threshold according to the vehicle type information acquired by the acquisition unit 121. For example, the threshold change unit 123 changes the threshold according to the size of the vehicle acquired by the acquisition unit 121. More specifically, the threshold change unit 123 decreases the threshold when the vehicle acquired by the acquisition unit 121 is a station wagon type and the vehicle size is large. On the other hand, the threshold change unit 123 increases the threshold when the vehicle acquired by the acquisition unit 121 is a light vehicle and the vehicle size is small.

[0086] When a moving object is present inside the vehicle, the change unit 125 changes either the strength of the signal emitted by the moving object sensor or the sensitivity with which the moving object sensor receives the signal, or both. For example, when a moving object is present inside the vehicle, the change unit 125 lowers the strength of the signal emitted by the moving object sensor and increases the sensitivity with which the moving object sensor receives the signal.

[0087] The output unit 124 stops outputting a predetermined notification when the determination unit 122 determines that the moving object has exited the vehicle. For example, the output unit 124 stops outputting an alarm when the determination unit 122 determines that the moving object has exited the vehicle. Here, the output process that the output unit 124 stops includes various modes such as an alarm, a notification to a mobile terminal, and sending an email to a predetermined address.

[0088] [2. Judgment on whether to leave the vehicle] Next, the process of determining whether the monitoring device 100 has exited the vehicle will be described with reference to Fig. 9. Fig. 9 is a diagram for explaining an example of the process of determining whether the monitoring device 100 has exited the vehicle. As shown in Fig. 9(1), when a moving object has entered the vehicle, the intensity of the signal received by the moving object sensor is high on both the right and left sides of the vehicle, as in Fig. 4(2). However, as shown in Fig. 9(2), when the moving object that has entered the vehicle does not move much (for example, when the moving object does not move for a certain period of time after entering the vehicle, or when the person in the vehicle is resting), the intensity of the signal received by the moving object sensor may decrease.

[0089] Here, the determination unit 122 determines whether the moving object has exited the vehicle using stricter determination criteria than when determining whether the moving object has entered the vehicle. For example, the determination unit 122 determines that the moving object has exited the vehicle when the intensities of the signals received by the moving object sensors provided on the left and right sides of the vehicle are both below a threshold for a predetermined period of time. Here, the threshold for determining whether the moving object has exited the vehicle corresponds to a first threshold for determining whether the moving object has entered the vehicle. In other words, the determination unit 122 determines that the moving object has exited the vehicle after the signal intensity becomes lower than when the moving object entered the vehicle.

[0090] In addition, the period used to determine whether a moving object has exited the vehicle is longer than the period used to determine whether a moving object has entered the vehicle. In other words, the monitoring device 100 determines whether a moving object has exited the vehicle using stricter criteria than the criteria for determining whether a moving object has entered the vehicle, thereby making it possible to accurately determine whether a moving object is present inside the vehicle or has exited the vehicle, and to prevent erroneous detection in which a moving object is determined to have exited the vehicle when the signal strength accidentally falls below the threshold.

[0091] [3. Change Processing] Next, the change process by the monitoring device 100 will be described. As described above in the vehicle exit judgment, even if a person is present in the vehicle, if the person is stationary or resting, the person moves less and the strength of the signal received by the motion sensor may decrease. Furthermore, if the person staying in the vehicle is sleeping and does not move other than breathing, the person may not be detected as a moving object with the normal motion sensor settings.

[0092] Here, when a moving object is present inside the vehicle, the change unit 125 changes either the strength of the signal emitted by the moving object sensor or the sensitivity with which the moving object sensor receives the signal, or both. For example, when a moving object is present inside the vehicle, the change unit 125 lowers the strength of the signal emitted by the moving object sensor and increases the sensitivity with which the moving object sensor receives the signal.

[0093] In other words, when it is determined that a moving object (person) is present inside the vehicle, the change unit 125 changes the settings of the moving object sensor so that it can detect chest movement caused by the person's breathing, thereby preventing erroneous detection that a person in the vehicle has left the vehicle even when there is little movement observed, and making it possible to accurately determine whether or not a moving object has left the vehicle.

[0094] [4. Flowchart] Next, the processing by the monitoring device 100 configured as described above will be described with reference to the flowchart in Fig. 10. The flowchart in Fig. 10 is executed mainly by the control unit 120. Moreover, this flowchart can be configured as a program executed by the CPU of the control unit 120 to become a monitoring program. Note that the steps below can be executed in a different order, and some processing may be omitted.

[0095] First, referring to Fig. 10, the procedure of the process by which the monitoring device 100 determines whether a moving object has exited the vehicle will be described. First, the monitoring device 100 determines whether a moving object is present inside the vehicle (step S301). For example, when the monitoring device 100 determines that a moving object has entered the vehicle using the technology of the first embodiment described above, the monitoring device 100 determines that a moving object is present inside the vehicle. Here, when the monitoring device 100 determines that a moving object is not present inside the vehicle (step S301 "No"), the process returns to step S301 again.

[0096] On the other hand, if the monitoring device 100 determines that a moving object is present inside the vehicle (step S301 "Yes"), the change unit 125 changes either or both of the strength of the signal emitted by the moving object sensor and the sensitivity with which the moving object sensor receives the signal (step S302). For example, when a moving object is present inside the vehicle, the change unit 125 lowers the strength of the signal emitted by the moving object sensor and increases the sensitivity with which the moving object sensor receives the signal.

[0097] Next, the acquisition unit 121 acquires the intensity of a signal received by a motion sensor provided in the vehicle (step S303). For example, the acquisition unit 121 acquires the intensity of a signal received by a motion sensor provided in the vehicle so as to include the vehicle interior in its detection range.

[0098] Next, the determination unit 122 determines whether the intensity of the signal acquired by the acquisition unit 121 continues to be less than the threshold for a predetermined period of time (step S304). If the determination unit 122 determines that the intensity is not less than the threshold (step S304 "No"), the process returns to step S303.

[0099] On the other hand, if the determination unit 122 determines that the difference is less than the threshold value (step S304 "Yes"), the determination unit 122 determines that the moving object has left the vehicle (step S305). Then, the output unit 124 stops outputting the predetermined notification (step S306). For example, the output unit 124 stops outputting the alarm.

[0100] 5. Effects The monitoring device 100 of the embodiment has an acquisition unit 121 that acquires the strength of a signal received by a moving object sensor installed in the vehicle, and a judgment unit 122 that judges whether or not a moving object has exited the vehicle based on the strength of the signal acquired by the acquisition unit 121.

[0101] As a result, the monitoring device 100 can accurately determine whether or not a moving object has exited the vehicle by determining whether or not the signal strength satisfies the threshold condition. In other words, the monitoring device 100 can prevent erroneous detection that may occur when the movement of a moving object inside the vehicle decreases by using a threshold value for the signal strength that is set so that the monitoring device 100 can determine that a moving object has exited the vehicle.

[0102] The determination unit 122 of the monitoring device 100 according to the embodiment determines that the moving object has exited the vehicle when the strength of the signal acquired by the acquisition unit 121 is less than the threshold for a predetermined period of time. As a result, the monitoring device 100 determines whether the signal strength satisfies the threshold condition for a predetermined period of time, thereby making a determination based on stricter criteria than when the moving object enters the vehicle, and can accurately determine whether the moving object has exited the vehicle.

[0103] The acquisition unit 121 of the monitoring device 100 according to the embodiment acquires the strength of each signal received by a plurality of moving object sensors provided in the vehicle, and the judgment unit 122 judges whether or not a moving object has left the vehicle when the strength of each signal acquired by the acquisition unit 121 remains below a threshold for a predetermined period of time.

[0104] As a result, the monitoring device 100 can determine whether the strength of each signal received by multiple moving object sensors over a specified continuous period of time satisfies the threshold condition, making a judgment based on stricter standards than when a moving object enters the vehicle, and can accurately determine whether a moving object has exited the vehicle.

[0105] The acquisition unit 121 of the monitoring device 100 according to the embodiment further acquires the position at which each moving body sensor is installed, and further has a threshold change unit 123 that changes the threshold value according to the position at which each moving body sensor acquired by the acquisition unit 121 is installed.

[0106] As a result, the monitoring device 100 can change the threshold value for determining whether or not a moving object has exited the vehicle depending on the location where the moving object sensor is installed, thereby reflecting the change in signal strength due to differences in the location where the moving object sensor is installed in the threshold value, and can accurately determine whether or not a moving object has exited the vehicle.

[0107] The acquisition unit 121 of the monitoring device 100 according to the embodiment further acquires information on the vehicle type, and further includes a threshold change unit that changes the threshold value according to the information on the vehicle type acquired by the acquisition unit 121. In this way, the monitoring device 100 changes the threshold value for determining whether or not a moving object has exited the vehicle according to information on the vehicle type in which the moving object sensor is installed, thereby allowing the threshold value to reflect changes in signal strength due to differences in the size of the vehicle in which the moving object sensor is installed, and thereby enabling the monitoring device 100 to accurately determine whether or not a moving object has exited the vehicle.

[0108] The monitoring device 100 according to the embodiment further includes a change unit 125 that changes either or both of the strength of the signal emitted by the moving object sensor and the sensitivity with which the moving object sensor receives the signal when a moving object is present inside the vehicle. This allows the monitoring device 100 to prevent erroneous detection that may occur when the movement of the moving object present inside the vehicle is extremely small, and to accurately determine whether or not the moving object has left the vehicle.

[0109] The output unit 124 of the monitoring device 100 according to the embodiment stops outputting a predetermined notification when the determination unit 122 determines that the moving object has exited the vehicle. This enables the monitoring device 100 to accurately determine whether the moving object has exited the vehicle, and to stop sending a notification to the outside when the moving object has exited the vehicle.

[0110] [others] [1. Hardware configuration] Moreover, the monitoring device 100 according to the embodiment described above is realized, for example, by a computer 1000 having a configuration as shown in Fig. 11. Fig. 11 is a hardware configuration diagram showing an example of a computer that realizes the functions of the monitoring device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, a HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0111] The CPU 1100 operates and controls each unit based on a program stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started up, programs that depend on the hardware of the computer 1000, and the like.

[0112] The HDD 1400 stores programs executed by the CPU 1100 and data used by the programs. The communication interface 1500 receives data from other devices via a predetermined communication network and sends the data to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0113] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0114] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0115] For example, when the computer 1000 functions as the monitoring device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control unit 120. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from other devices via a predetermined communication network.

[0116] [2. Other] Although an example of an embodiment of the present invention has been described above, the present invention is not limited to the above example. In other words, a person skilled in the art can implement the present invention by modifying it in various ways according to conventional knowledge without departing from the gist of the present invention. As long as the monitoring device of the present invention is still included in such modifications, it is of course included in the scope of the present invention. [Explanation of symbols]

[0117] 1. Surveillance System 10 Onboard equipment 100 Monitoring equipment 110 Communications Department 120 Control section 121 Acquisition Department 122 Judgment section 123 Threshold change unit 124 Output section 125 Changes 130 Storage section

Claims

1. an acquisition unit that acquires the intensity of a signal received by a motion sensor provided in the vehicle; a determination unit that determines whether or not a moving object has exited the vehicle based on the intensity of the signal acquired by the acquisition unit; A monitoring device comprising:

2. The monitoring device according to claim 1 , wherein the determination unit determines that the moving object has left the vehicle when the intensity of the signal acquired by the acquisition unit is continuously less than a threshold value for a predetermined period of time.

3. The acquisition unit acquires intensities of signals received by a plurality of motion sensors provided in the vehicle, The determination unit determines whether the moving object has exited the vehicle when the intensity of each of the signals acquired by the acquisition unit is continuously less than a threshold value for a predetermined period of time.

3. The monitoring device according to claim 2.

4. The acquisition unit further acquires a position where each motion sensor is installed, a threshold changing unit that changes the threshold in accordance with the positions at which the motion sensors are installed, the positions being acquired by the acquiring unit; 4. The monitoring device of claim 3, further comprising:

5. The acquisition unit further acquires vehicle model information, a threshold value changing unit that changes the threshold value in accordance with the vehicle type information acquired by the acquisition unit; 3. The monitoring device of claim 2, further comprising:

6. The monitoring device according to claim 2, further comprising a change unit that changes either or both of the strength of the signal emitted by the motion sensor and the sensitivity with which the motion sensor receives the signal when a moving object is present inside the vehicle.

7. 2. The monitoring device according to claim 1, further comprising an output unit that stops outputting a predetermined notification when the determination unit determines that the moving object has left the vehicle.

8. A method performed by a monitoring device, comprising: an acquiring step of acquiring a strength of a signal received by a motion sensor provided in a vehicle from the motion sensor; a determination step of determining whether or not a moving object has exited the vehicle based on the intensity of the signal acquired by the acquisition step; A monitoring method comprising:

9. an acquiring step of acquiring a strength of a signal received by a motion sensor provided in a vehicle from the motion sensor; a determination step of determining whether or not a moving object has exited the vehicle based on the intensity of the signal acquired in the acquisition step; A monitoring program that causes a computer to execute the above steps.

Images