Monitoring device, monitoring method, and monitoring program

Abstract

A monitoring device (100) is characterized by comprising: an acquisition unit (121) that acquires the intensity of each signal received by a plurality of moving body sensors provided in a vehicle; and a determination unit (122) that determines whether or not a moving body has intruded into the vehicle on the basis of the intensities of the respective signals acquired by the acquisition unit (121).

Description

Monitoring device, monitoring method, and monitoring program

[0001] The present invention relates to a monitoring device, a monitoring method, and a monitoring program.

[0002] 2. Description of the Related Art Conventionally, there exists a technique for determining that an object (moving object) has not entered the vehicle interior when the object is detected near the vehicle (for example, Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2006-256372

[0004] However, the conventional technology has a problem in that it may not be possible to accurately determine whether a moving object has entered the vehicle interior. For example, if a reflector (e.g., a truck, etc.) is present near a vehicle equipped with a moving object sensor, multipath may occur, resulting in a false detection that a moving object has entered the vehicle interior. Furthermore, even if no reflector is present near a vehicle equipped with a moving object sensor, if there are people on both sides of the vehicle, false detection is more likely to occur than with multipath, making it more difficult to determine whether a detected moving object has entered the vehicle interior. Thus, the above-mentioned problems are examples of the problems that the present invention aims to solve.

[0005] In order to solve the above-mentioned problems and achieve the object, the invention described in claim 1 is characterized by having an acquisition unit that acquires the strength of each signal received by multiple motion sensors installed in the vehicle, and a judgment unit that determines whether a moving object has entered the vehicle based on the strength of each signal acquired by the acquisition unit.

[0006] The invention described in claim 10 is a method executed by a monitoring device, characterized in that it includes an acquisition step of acquiring the strength of each signal received by a plurality of moving object sensors installed in the vehicle, and a determination step of determining whether or not a moving object has entered the vehicle based on the strength of each signal acquired by the acquisition step.

[0007] The invention described in claim 11 is characterized in that a computer is made to execute an acquisition step of acquiring the strength of each signal received by a plurality of motion sensors installed in the vehicle, and a determination step of determining whether or not a moving object has entered the vehicle based on the strength of each signal acquired from each motion sensor by the acquisition step.

[0008] FIG. 1 is a diagram showing an example of the configuration of a monitoring device system according to an embodiment. FIG. 2 is a diagram showing an example of the configuration of a monitoring device according to an embodiment. FIG. 3 is a diagram showing an example of an installation location of a motion sensor according to an embodiment. FIG. 4 is a diagram showing an example of a determination process performed by a monitoring device according to an embodiment. FIG. 5 is a diagram showing a threshold change process performed by a monitoring device according to an embodiment. FIG. 6 is a flowchart showing an example of a process performed by a monitoring device according to an embodiment. FIG. 7 is a flowchart showing an example of a process performed by a monitoring device according to an embodiment. FIG. 8 is a diagram showing an example of the configuration of a monitoring device according to an embodiment. FIG. 9 is a diagram showing an example of a determination process performed by a monitoring device according to an embodiment. FIG. 10 is a flowchart showing an example of a process performed by a monitoring device according to an embodiment. FIG. 11 is a hardware configuration diagram showing an example of a computer that realizes the functions of a monitoring device.

[0009] Hereinafter, a mode for carrying out the present invention (hereinafter referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0010] [First embodiment] [1. System configuration] Next, the configuration of a monitoring system according to an embodiment will be described with reference to Fig. 1. Fig. 2 is a diagram showing the configuration of a monitoring system according to an embodiment. Fig. 1 shows a monitoring system 1 as an example of a monitoring system according to an embodiment.

[0011] 1, the monitoring system 1 may include an in-vehicle device 10 and a monitoring device 100. The in-vehicle device 10 and the monitoring device 100 are connected to each other via a network N so as to be able to communicate with each other via a wired or wireless connection. The monitoring system 1 shown in FIG. 1 may include any number of in-vehicle devices 10 and any number of monitoring devices 100.

[0012] The in-vehicle device 10 may be a dedicated sensor device built into or externally attached to the vehicle VEx, or may be a recording device (drive recorder) or other device installed in the vehicle VEx for crime prevention or to prevent tailgating.

[0013] The in-vehicle device 10 may also be configured with a sensor device and a notification device. As an example, the in-vehicle device 10 may be a composite device in which a sensor device and a notification device that are independent of each other are connected to each other so as to be able to communicate with each other. As another example, the in-vehicle device 10 may be a single device having a sensor function and a notification function.

[0014] Furthermore, a user can connect a predetermined sensor to a portable terminal device (e.g., a smartphone, a tablet terminal, a notebook PC, a desktop PC, a PDA, or the like) that they use on a daily basis and install a predetermined application, thereby substituting the portable terminal device as the in-vehicle device 10. For example, a portable terminal device that is equipped with a predetermined sensor or to which a predetermined sensor is connected can be understood as the in-vehicle device 10 referred to here. When the portable terminal device is used as the in-vehicle device 10, it is installed, for example, on the dashboard of the vehicle VEx while driving.

[0015] The in-vehicle device 10 may also include various sensors, such as a distance sensor, a motion sensor such as a microwave sensor or a LiDAR (light detection and ranging) sensor, a temperature sensor, a microphone, a GPS sensor, an acceleration sensor, a gyro sensor, a camera, and an air pressure sensor.

[0016] The monitoring device 100 may acquire various types of data based on sensor information detected by these sensors (for example, by analyzing the sensor information). For example, the monitoring device 100 acquires information on moving objects inside and outside the vehicle from a moving object sensor. Also, for example, the monitoring device 100 acquires the temperature inside the vehicle from a temperature sensor. Also, for example, the monitoring device 100 acquires audio from a microphone. Also, for example, the monitoring device 100 acquires angular velocity from a gyro sensor. Also, for example, the monitoring device 100 acquires video data of the outside captured from inside the vehicle VEx by a camera. Note that the monitoring device 100 may acquire sensor information detected not only by sensors provided in the in-vehicle device 10, but also by sensors provided in the vehicle VEx itself.

[0017] The monitoring device 100 is a device that determines whether a moving object has entered the vehicle interior. For example, the monitoring device 100 determines whether a moving object has entered the vehicle interior based on the strength of each signal received by a plurality of moving object sensors provided in the vehicle. The monitoring device 100 is also a device that determines whether a moving object has exited the vehicle. For example, the monitoring device 100 determines whether a moving object has exited the vehicle based on the strength of each signal received by a moving object sensor provided in the vehicle.

[0018] Here, if the in-vehicle device 10 is an edge computer that performs edge processing near the user, the monitoring device 100 may be, for example, a cloud computer that performs processing on the cloud side. In other words, the monitoring device 100 may be a server device.

[0019] Furthermore, in the following embodiment, an example is shown in which the monitoring according to the embodiment is realized in the monitoring system 1 by transmitting and receiving information between the in-vehicle device 10 and the monitoring device 100. However, the monitoring according to the embodiment may be realized only on the edge side, i.e., by the in-vehicle device 10. In this case, the in-vehicle device 10 may be configured to behave like the monitoring device 100, for example, by a monitoring program according to the embodiment.

[0020] 2. Configuration of the Monitoring Device Next, the monitoring device 100 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example configuration of the monitoring device 100 according to the embodiment. As shown in Fig. 2, the monitoring device 100 has a communication unit 110, a storage unit 130, and a control unit 120. Each unit of the monitoring device 100 will be described below.

[0021] The communication unit 110 is realized by, for example, a network interface card (NIC), etc. The communication unit 110 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the in-vehicle device 10, for example.

[0022] The storage unit 130 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk, an optical disk, etc. The storage unit 130 stores the position where the motion sensor is installed, the strength of the signal to be transmitted, the sensitivity of receiving the signal, the strength of the received signal, the angle calculated from the received signal, the distance, the coordinates of the motion sensor, vehicle information (vehicle type, vehicle size, etc.), information related to notification (notification settings, notification destination terminal information, address information, etc.), images (including moving images and still images), and other information necessary for determining whether a motion sensor has entered the vehicle or whether a motion sensor has left the vehicle.

[0023] The control unit 120 is realized using a CPU (Central Processing Unit), an NP (Network Processor), an FPGA (Field Programmable Gate Array), or the like, and executes processing programs stored in memory. As shown in Fig. 2, the control unit 120 has an acquisition unit 121, a determination unit 122, a threshold value change unit 123, and an output unit 124. Each unit of the control unit 120 will be described below.

[0024] The acquisition unit 121 acquires the intensity of each signal received by multiple motion sensors provided in the vehicle. For example, the acquisition unit 121 acquires the intensity of each signal received by multiple motion sensors provided in the vehicle so that the vehicle interior is included in its detection range. For example, the acquisition unit 121 acquires the intensity of each signal received by multiple motion sensors provided on the left and right pillars of the vehicle. Here, pillars have been given as an example of a location where the motion sensors are installed, but they may also be installed near the rearview mirror as shown in FIG. 3(1) or on the center pillar as shown in FIG. 3(2). In other words, the motion sensors are installed in locations in the vehicle depending on the purpose, such as the front pillars, center pillars, rear pillars, rearview mirrors, ceiling, seats, and rear window.

[0025] The acquisition unit 121 also acquires the location where each motion sensor is installed. For example, the acquisition unit 121 acquires the location where each motion sensor is installed by receiving input of the location where each motion sensor is installed from a user. For example, the acquisition unit 121 acquires the location where each motion sensor is installed by receiving information on the location where each motion sensor is installed from another system.

[0026] The acquisition unit 121 also acquires vehicle model information. For example, the acquisition unit 121 acquires vehicle model information by accepting input of vehicle model information from a user. For example, the acquisition unit 121 also acquires vehicle model information by receiving vehicle model information from another system.

[0027] The determination unit 122 determines whether or not a moving object has entered the vehicle interior based on the intensity of each signal acquired by the acquisition unit 121. For example, the determination unit 122 determines that a moving object has entered the vehicle interior when the intensity of each signal acquired by the acquisition unit 121 is equal to or greater than a first threshold and the sum of the intensities of the signals acquired by the acquisition unit 121 is equal to or greater than a second threshold that is greater than the sum of the first thresholds.

[0028] More specifically, the judgment unit 122 judges that a moving object has entered the vehicle if the strength of each signal acquired by the acquisition unit 121 (strength of the signal received by motion sensor A: 27, strength of the signal received by motion sensor B: 30) is greater than or equal to a first threshold value (22) and the sum of the strengths of each signal acquired by the acquisition unit 121 (27 + 30 = 57) is greater than or equal to a second threshold value (56) that is greater than the sum of the first threshold values.

[0029] At this time, the determination unit 122 can perform the determination process by further using a time element. For example, the determination unit 122 determines that a moving object has entered the vehicle when the intensity of each signal acquired by the acquisition unit 121 is equal to or greater than a first threshold value for a period of at least a predetermined percentage of the predetermined period, and the sum of the intensity of each signal acquired by the acquisition unit is equal to or greater than a second threshold value that is greater than the sum of the first threshold values ​​for a period of at least a predetermined percentage of the predetermined period.

[0030] More specifically, the judgment unit 122 judges that a moving object has entered the vehicle if the strength of each signal acquired by the acquisition unit 121 is greater than or equal to a first threshold for a period of 50% or more of 0.5 seconds, and the sum of the strengths of each signal acquired by the acquisition unit 121 is greater than or equal to a second threshold that is greater than the sum of the first thresholds for a period of 50% or more of 0.5 seconds.

[0031] Here, the second threshold value is a value greater than the sum of the first threshold values. For example, the second threshold value is a value greater than the sum of the first threshold values, greater than the sum of the intensities of the signals acquired by the acquisition unit 121 when a moving object is present on both sides of the vehicle, and smaller than the sum of the intensities of the signals acquired by the acquisition unit 121 when a moving object is present inside the vehicle.

[0032] More specifically, the second threshold is a value that is greater than the sum of the first thresholds (22 + 22 = 44), greater than the sum of the intensities of the signals acquired by the acquisition unit 121 when a moving object is present on both sides of the vehicle (intensity of the signal received by moving object sensor A: 25 + intensity of the signal received by moving object sensor B: 25 = 50), and smaller than the sum of the intensities of the signals acquired by the acquisition unit 121 when a moving object is present inside the vehicle (intensity of the signal received by moving object sensor A: 30 + intensity of the signal received by moving object sensor B: 30 = 60). Note that although two first thresholds are shown in the above example, the number of first thresholds is not limited to this.

[0033] The second threshold may be equal to or greater than a predetermined value. For example, the second threshold may be equal to or greater than 115% of the sum of the first thresholds. On the other hand, the second threshold may be equal to or less than the predetermined value. For example, the second threshold may be equal to or less than 130% of the sum of the first thresholds.

[0034] That is, the second threshold value is a value that can accurately distinguish between a case where a moving object is present outside the vehicle and a case where a moving object is present inside the vehicle (regardless of location, such as in the driver's seat, passenger seat, or rear seat). Note that the first threshold value and the second threshold value are example values ​​indicated by an experiment conducted using a minivan with a total length of approximately 4,600 mm and a width of approximately 1,700 mm as the target vehicle, and when using the technology described in this specification, it is desirable to change the first threshold value and the second threshold value as appropriate depending on the vehicle model and size.

[0035] The threshold changing unit 123 changes the first threshold in accordance with the installation positions of the motion sensors acquired by the acquiring unit 121. For example, when the installation positions of the motion sensors acquired by the acquiring unit 121 are biased, the threshold changing unit 123 changes the first threshold for the detection range on the biased side.

[0036] Specifically, when the location where each motion sensor acquired by the acquisition unit 121 is installed is located to the left of the center of the vehicle, the threshold change unit 123 increases the first threshold for the detection range on the left side and decreases the first threshold for the detection range on the right side.

[0037] Furthermore, the threshold changing unit 123 changes either or both of the first threshold and the second threshold according to the vehicle type information acquired by the acquisition unit 121. For example, the threshold changing unit 123 changes either or both of the first threshold and the second threshold according to the vehicle size acquired by the acquisition unit 121. More specifically, when the vehicle type acquired by the acquisition unit 121 is a wagon type and the vehicle size is large, the threshold changing unit 123 decreases either or both of the first threshold and the second threshold. On the other hand, when the vehicle acquired by the acquisition unit 121 is a light vehicle and the vehicle size is small, the threshold changing unit 123 increases either or both of the first threshold and the second threshold.

[0038] The output unit 124 outputs a predetermined notification when the determination unit 122 determines that a moving object has entered the vehicle interior. For example, the output unit 124 outputs a notification to issue an alarm when the determination unit 122 determines that a moving object has entered the vehicle interior. Here, the output process performed by the output unit 124 includes various modes, such as issuing an alarm, sending a notification to a mobile device, or sending an email to a predetermined address. That is, when a moving object has entered the vehicle interior, the output unit 124 can output a predetermined notification to an appropriate target. For example, when sending a notification to a mobile device or an email to a predetermined address, the output unit 124 can output a notification or send an image of the vehicle interior captured by an imaging device installed in the vehicle together with the notification or email.

[0039] 3. Determining Vehicle Intrusion Next, the process of determining vehicle intrusion by the monitoring device 100 will be described with reference to FIG. 4. FIG. 4 is a diagram for explaining an example of the process of determining vehicle intrusion by the monitoring device 100. First, FIG. 4(1) shows a case where a person is present on the right side of the vehicle. In this case, the strength of each signal received by the motion sensor is higher on the right side of the vehicle than a first threshold, and lower on the left side of the vehicle than the first threshold. Furthermore, the sum of the strengths of the signals on the right and left sides of the vehicle is lower than a second threshold.

[0040] Next, Figure 4 (2) shows the case where there is a person inside the vehicle. In this case, the strength of each signal received by the motion sensor on both the right and left sides of the vehicle is higher than the first threshold. Furthermore, the sum of the signal strengths on the right and left sides of the vehicle is also higher than the second threshold. Next, Figure 4 (3) shows the case where there is a person on the left side of the vehicle and a reflector (a cause of multipath) on the right side of the vehicle that reflects the detection wave of the motion sensor. In this case, the strength of each signal received by the motion sensor on both the right and left sides of the vehicle is higher than the first threshold. On the other hand, the sum of the signal strengths on the right and left sides of the vehicle is lower than the second threshold.

[0041] Next, Figure 4 (4) shows the case where there are people on both sides of the vehicle. In this case, the strength of the signals received by the motion sensors on both the right and left sides of the vehicle is higher than the first threshold. On the other hand, the sum of the strength of the signals on the right and left sides of the vehicle is lower than the second threshold, as in Figure 4 (3).

[0042] That is, the strength of the signal received by each motion sensor is high even when a person is outside the vehicle (FIG. 4(1)(3)(4)), but the sum of the strengths of the signals received by each motion sensor is higher than the second threshold only when a person is inside the vehicle (FIG. 4(2)). Therefore, the determination unit 122 performs a threshold determination on the strength of the signal received by each motion sensor, as well as a threshold determination on the sum of the strengths of each signal, thereby preventing erroneous detection even when there are multipath factors or when people are present on both sides of the vehicle.

[0043] For example, if the strength of each signal acquired by the acquisition unit 121 is high (exceeding the first threshold) and the total signal strength is high (exceeding the second threshold), it is determined that a moving object has entered the vehicle, making it possible to accurately determine whether the moving object is outside the vehicle (Figures 4 (1) (3) (4)) or inside the vehicle (Figure 4 (2)).

[0044] 4. Changing the Threshold Value Next, the threshold value changing process performed by the monitoring device 100 will be described with reference to Fig. 5. Fig. 5 is a diagram for explaining an example of the threshold value changing process performed by the monitoring device 100. First, Fig. 5(1) shows the case where the moving object sensor is located to the left of the center of the vehicle.

[0045] In this case, since the motion sensor is located to the left of the center of the vehicle, the time (distance) until the signal reflected from the motion sensor on the left side of the vehicle is received is shortened, and a stronger signal is received from the left side of the vehicle. Therefore, when the position where each motion sensor is installed is to the left of the center of the vehicle (FIG. 5(3)), the threshold value changing unit 123 increases the first threshold value for the detection range on the left side.

[0046] On the other hand, since the motion sensor is located to the left of the center of the vehicle, the time and distance until the signal reflected from the moving object on the right side of the vehicle is received becomes longer, and a signal of lower strength is received from the right side of the vehicle. Therefore, when the position where each motion sensor is installed is located to the left of the center of the vehicle (FIG. 5(3)), the threshold value changing unit 123 reduces the first threshold value for the detection range on the right side.

[0047] Next, Figure 5 (2) shows the case where the vehicle in which the moving object sensor is installed is large. In this case, the large size of the vehicle shortens the time (distance) until a signal reflected from a moving object outside the vehicle is received, and the strength of a signal reflected from a moving object entering the rear of the vehicle or from a moving object outside the vehicle is lower. Therefore, when the vehicle is large, the threshold change unit 123 reduces either or both of the first threshold and the second threshold. Conversely, when the vehicle is small, the threshold change unit 123 increases either or both of the first threshold and the second threshold.

[0048] In other words, the monitoring device 100 changes the threshold value for determining whether a moving object has entered the vehicle according to information on the location where the moving object sensor is installed and the vehicle type (vehicle size), thereby reflecting changes in signal strength due to differences in the location where the moving object sensor is installed and the size of the vehicle in the threshold value, and can accurately determine whether a moving object has entered the vehicle.

[0049] 5. Flowchart Next, the processing performed by the monitoring device 100 configured as described above will be described with reference to the flowcharts in Figures 6 and 7. The flowcharts in Figures 6 and 7 are mainly executed by the control unit 120. Furthermore, this flowchart can be configured as a program executed by the CPU of the control unit 120 to form a monitoring program. Note that the steps below may be executed in a different order, and some processing may be omitted.

[0050] 6, the procedure of the process by which the monitoring device 100 determines whether a moving object has entered the vehicle will be described. First, the monitoring device 100 determines whether a moving object is present inside the vehicle (step S101). For example, if the monitoring device 100 determines that a moving object has exited the vehicle using the technology of a second embodiment described below, the monitoring device 100 determines that a moving object is not present inside the vehicle. Here, if the monitoring device 100 determines that a moving object is present inside the vehicle (step S101 "Yes"), the process returns to step S101.

[0051] On the other hand, if the monitoring device 100 determines that no moving object is present inside the vehicle (step S101 "No"), the acquisition unit 121 acquires the intensity of each signal received by the multiple moving object sensors provided inside the vehicle (step S102). For example, the acquisition unit 121 acquires the intensity of each signal received by the multiple moving object sensors provided inside the vehicle so that the detection range includes the interior of the vehicle.

[0052] Next, the determination unit 122 determines whether the intensity of each signal acquired by the acquisition unit 121 is equal to or greater than a first threshold for a period equal to or greater than a predetermined percentage of the predetermined period (step S103). Note that the determination process in step S103 may be performed without using the period element. For example, the determination unit 122 determines whether the intensity of each signal acquired by the acquisition unit 121 is equal to or greater than a first threshold. If the determination unit 122 determines that the intensity is not equal to or greater than the first threshold (step S103 "No"), the process returns to step S102. On the other hand, if the determination unit 122 determines that the intensity is equal to or greater than the first threshold (step S103 "Yes"), the determination unit 122 then determines whether the sum of the intensity of each signal acquired by the acquisition unit 121 is equal to or greater than a second threshold for a period equal to or greater than a predetermined percentage of the predetermined period (step S104). Note that the determination process in step S104 may be performed without using the period element. For example, the determining unit 122 determines whether the sum of the intensities of the signals acquired by the acquiring unit 121 is equal to or greater than a second threshold value.

[0053] Here, if the determination unit 122 determines that the detected value is not equal to or greater than the second threshold ("No" in step S104), the process returns to step S102. On the other hand, if the determination unit 122 determines that the detected value is equal to or greater than the second threshold ("Yes" in step S104), the determination unit 122 determines that a moving object has entered the vehicle (step S105). For example, the determination unit 122 determines that a person has entered the vehicle. Then, the output unit 124 outputs a predetermined notification (step S106). For example, the output unit 124 outputs a notification to issue an alarm.

[0054] Next, the procedure for the monitoring device 100 to change the threshold will be described with reference to FIG. 7 . The acquisition unit 121 acquires vehicle model information (step S201). For example, the acquisition unit 121 acquires vehicle model information by accepting input of the vehicle model information from a user. Next, the threshold change unit 123 changes the threshold in accordance with the vehicle model information acquired by the acquisition unit 121 (step S202). For example, the threshold change unit 123 changes either or both of the first threshold and the second threshold in accordance with the vehicle size acquired by the acquisition unit 121.

[0055] Next, the acquiring unit 121 acquires the location where each motion sensor is installed (step S203). For example, the acquiring unit 121 acquires the location where each motion sensor is installed by receiving an input of the location where each motion sensor is installed from the user.

[0056] Then, the threshold changing unit 123 changes the threshold in accordance with the installation positions of the motion sensors acquired by the acquiring unit 121 (step S204). For example, if the installation positions of the motion sensors acquired by the acquiring unit 121 are biased, the threshold changing unit 123 changes the first threshold for the detection range on the biased side.

[0057] In addition, the acquisition unit 121 and the threshold change unit 123 may only perform threshold change processing according to the vehicle model (steps S201 and S202), or may only perform threshold change processing according to the location where the motion sensor is installed (steps S203 and S204).

[0058] 6. Effects The monitoring device 100 according to the embodiment includes an acquisition unit 121 that acquires the strength of each signal received by a plurality of moving object sensors provided inside the vehicle, and a determination unit 122 that determines whether or not a moving object has entered the vehicle based on the strength of each signal acquired by the acquisition unit 121.

[0059] As a result, the monitoring device 100 can determine with high accuracy whether a moving object has entered the vehicle by determining whether the signal strength satisfies the threshold condition. In other words, by using a threshold value for the signal strength that is set so as to be able to determine whether a moving object has entered the vehicle, the monitoring device 100 can prevent erroneous detection that can occur when there are multiple paths or when moving objects are present on both sides of the vehicle.

[0060] The determination unit 122 of the monitoring device 100 according to the embodiment determines that a moving object has entered the vehicle when the strength of each signal acquired by the acquisition unit 121 is greater than or equal to a first threshold and the sum of the strengths of each signal acquired by the acquisition unit 121 is greater than or equal to a second threshold that is greater than the sum of the first thresholds.

[0061] As a result, the monitoring device 100 can accurately determine whether a moving object has entered the vehicle by determining whether the signal strength satisfies the conditions of the first threshold and the second threshold.

[0062] The determination unit 122 of the monitoring device 100 according to the embodiment determines that a moving object has entered the vehicle when the strength of each signal acquired by the acquisition unit 121 is greater than or equal to a first threshold value for a period of at least a predetermined percentage of the predetermined period, and the sum of the strengths of each signal acquired by the acquisition unit 121 is greater than or equal to a second threshold value that is greater than the sum of the first threshold values ​​for a period of at least a predetermined percentage of the predetermined period.

[0063] As a result, the monitoring device 100 can accurately determine whether a moving object has entered the vehicle by determining whether the signal strength satisfies the conditions of the first threshold and the second threshold during a period in which the signal strength is equal to or greater than a specified percentage of the specified period.

[0064] In the monitoring device 100 of the embodiment, the second threshold value is greater than the sum of the first threshold values, greater than the sum of the intensities of the respective signals acquired by the acquisition unit 121 when there is a moving object on both sides of the vehicle, and smaller than the sum of the intensities of the respective signals acquired by the acquisition unit 121 when there is a moving object inside the vehicle.

[0065] As a result, the monitoring device 100 can accurately determine whether a moving object has entered the vehicle by determining whether the signal strength satisfies the conditions of a second threshold value, which is greater than the sum of the first threshold values, greater than the sum of the signal strengths when a moving object is present on both sides of the vehicle, and less than the sum of the signal strengths when a moving object is present inside the vehicle.

[0066] In the monitoring device 100 according to the embodiment, the second threshold is a value that is 115% or more of the sum of the first thresholds. This allows the monitoring device 100 to determine with high accuracy whether a moving object has entered the vehicle by determining whether the signal strength satisfies the condition of the second threshold, which is a value that is 115% or more of the sum of the first thresholds.

[0067] In the monitoring device 100 according to the embodiment, the second threshold is a value equal to or less than 130% of the sum of the first thresholds. This allows the monitoring device 100 to determine with high accuracy whether a moving object has entered the vehicle by determining whether the signal strength satisfies the condition of the second threshold, which is a value equal to or less than 130% of the sum of the first thresholds.

[0068] The acquisition unit 121 of the monitoring device 100 according to the embodiment further acquires the location where each motion sensor is installed, and further has a threshold change unit that changes the first threshold value according to the location where each motion sensor acquired by the acquisition unit 121 is installed.

[0069] As a result, the monitoring device 100 can change the threshold value for determining whether or not a moving object has entered the vehicle depending on the location where the moving object sensor is installed, thereby reflecting the change in signal strength due to differences in the location where the moving object sensor is installed in the threshold value, and can accurately determine whether or not a moving object has entered the vehicle.

[0070] The acquisition unit 121 of the monitoring device 100 according to the embodiment further acquires information about the vehicle model, and further includes a threshold change unit 123 that changes either the first threshold value or the second threshold value or both depending on the information about the vehicle model acquired by the acquisition unit 121.

[0071] As a result, the monitoring device 100 can change the threshold value for determining whether a moving object has entered the vehicle according to information about the vehicle model in which the moving object sensor is installed, thereby reflecting changes in signal strength due to differences in the size of the vehicle in which the moving object sensor is installed in the threshold value, and can accurately determine whether a moving object has entered the vehicle.

[0072] The output unit 124 of the monitoring device 100 according to the embodiment outputs a predetermined notification when the determination unit 122 determines that a moving object has entered the vehicle interior. This enables the monitoring device 100 to accurately determine whether a moving object has entered the vehicle interior and to notify the outside of the information that a moving object has entered the vehicle interior.

[0073] [Second embodiment] [1. Configuration of monitoring device] In the first embodiment, an example was described in which it was determined that a moving object had entered the vehicle based on the strength of a signal received by a moving object sensor, but in the second embodiment described below, an example is described in which it was determined that a moving object had left the vehicle based on the strength of a signal received by a moving object sensor. Note that descriptions of content common to the first embodiment will be omitted as appropriate.

[0074] First, a monitoring device 100 according to an embodiment will be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of the configuration of the monitoring device 100 according to an embodiment. As shown in Fig. 8, the control unit 120 of the monitoring device 100 includes an acquisition unit 121, a determination unit 122, a threshold value change unit 123, an output unit 124, and a change unit 125. Each unit included in the control unit 120 will be described below.

[0075] The acquisition unit 121 acquires the strength of signals received by motion sensors provided in the vehicle. For example, the acquisition unit 121 acquires the strength of each signal received by multiple motion sensors provided in the vehicle. Also, for example, the acquisition unit 121 acquires the strength of each signal received by multiple motion sensors provided in the vehicle so that the vehicle interior is included in the detection range.

[0076] The acquisition unit 121 also acquires the location where each motion sensor is installed. For example, the acquisition unit 121 acquires the location where each motion sensor is installed by receiving input of the location where each motion sensor is installed from a user. For example, the acquisition unit 121 acquires the location where each motion sensor is installed by receiving information on the location where each motion sensor is installed from another system.

[0077] The acquisition unit 121 also acquires vehicle model information. For example, the acquisition unit 121 acquires vehicle model information by accepting input of vehicle model information from a user. For example, the acquisition unit 121 also acquires vehicle model information by receiving vehicle model information from another system.

[0078] The determination unit 122 determines whether or not the moving object has exited the vehicle based on the strength of the signal acquired by the acquisition unit 121. For example, the determination unit 122 determines that the moving object has exited the vehicle when the strength of the signal acquired by the acquisition unit 121 is continuously less than a threshold value for a predetermined period of time.

[0079] More specifically, the determination unit 122 determines that the moving object has exited the vehicle when the signal strength (18) acquired by the acquisition unit 121 is less than the threshold (22) for 100% of a period of 0.5 seconds. Here, with regard to the predetermined period, the period used to determine whether the moving object has exited the vehicle is longer than the period used to determine whether the moving object has entered the vehicle. For example, if the period used to determine whether the moving object has entered the vehicle is 50% of 0.5 seconds (0.25 seconds), the period used to determine whether the moving object has exited the vehicle may be 50% of 1.0 seconds (0.5 seconds).

[0080] The threshold value for determining whether a moving object has exited the vehicle corresponds to the first threshold value for determining whether a moving object has entered the vehicle. For example, if the first threshold value for determining whether a moving object has entered the vehicle is 22, and the signal strength is equal to or greater than the first threshold value (22), the threshold value for determining whether a moving object has exited the vehicle is 22, and the signal strength is less than the threshold value (22), and the moving object is determined to have exited the vehicle.

[0081] Furthermore, the determination unit 122 can determine whether or not a moving object has exited the vehicle using the intensities of the signals received by the multiple motion sensors. For example, the determination unit 122 determines whether or not a moving object has exited the vehicle when the intensities of the signals acquired by the acquisition unit 121 are continuously below a threshold for a predetermined period of time. For example, the determination unit 122 determines that a moving object has exited the vehicle when the intensities of the signals received by the motion sensors provided on the left and right sides of the vehicle are all continuously below a threshold for a predetermined period of time.

[0082] More specifically, the determination unit 122 determines that a moving object has left the vehicle if the strength (18) of the signal received by the moving object sensor provided on the right side of the vehicle is less than the threshold value (22) for 100% of the period of 0.5 seconds, and the strength (19) of the signal received by the moving object sensor provided on the left side of the vehicle is less than the threshold value (22) for 100% of the period of 0.5 seconds.

[0083] The threshold changing unit 123 changes the threshold depending on the installation positions of the motion sensors acquired by the acquiring unit 121. For example, if the installation positions of the motion sensors acquired by the acquiring unit 121 are biased, the threshold changing unit 123 changes the threshold for the detection range on the biased side.

[0084] Specifically, when the location where each motion sensor acquired by the acquisition unit 121 is installed is located to the left of the center of the vehicle, the threshold change unit 123 increases the threshold for the detection range on the left side and decreases the threshold for the detection range on the right side.

[0085] The threshold changing unit 123 changes the threshold in accordance with the vehicle type information acquired by the acquisition unit 121. For example, the threshold changing unit 123 changes the threshold in accordance with the vehicle size acquired by the acquisition unit 121. More specifically, the threshold changing unit 123 decreases the threshold when the vehicle acquired by the acquisition unit 121 is a wagon type and has a large vehicle size. On the other hand, the threshold changing unit 123 increases the threshold when the vehicle acquired by the acquisition unit 121 is a light vehicle and has a small vehicle size.

[0086] When a moving object is present inside the vehicle, the change unit 125 changes either the strength of the signal emitted by the moving object sensor or the sensitivity with which the moving object sensor receives the signal, or both. For example, when a moving object is present inside the vehicle, the change unit 125 lowers the strength of the signal emitted by the moving object sensor and increases the sensitivity with which the moving object sensor receives the signal.

[0087] The output unit 124 stops outputting a predetermined notification when the determination unit 122 determines that the moving object has exited the vehicle. For example, the output unit 124 stops outputting an alarm when the determination unit 122 determines that the moving object has exited the vehicle. Here, the output processing that the output unit 124 stops includes various modes such as issuing an alarm, sending a notification to a mobile terminal, sending an email to a predetermined address, etc.

[0088] 2. Vehicle Exit Determination Next, the vehicle exit determination process performed by the monitoring device 100 will be described with reference to FIG. 9. FIG. 9 is a diagram illustrating an example of the vehicle exit determination process performed by the monitoring device 100. As shown in FIG. 9(1), when a moving object has entered the vehicle, the intensity of the signal received by the moving object sensor is high on both the right and left sides of the vehicle, as in FIG. 4(2). However, as shown in FIG. 9(2), when the moving object that has entered the vehicle does not move much (for example, when the moving object remains motionless for a certain period of time after entering, or when someone in the vehicle is resting), the intensity of the signal received by the moving object sensor may decrease.

[0089] Here, the determination unit 122 determines whether a moving object has exited the vehicle using stricter determination criteria than when determining whether a moving object has entered the vehicle interior. For example, the determination unit 122 determines that a moving object has exited the vehicle when the strength of the signals received by the moving object sensors provided on the left and right sides of the vehicle are all below a threshold for a predetermined period of time. Here, the threshold for determining whether a moving object has exited the vehicle corresponds to the first threshold for determining whether a moving object has entered the vehicle interior. In other words, the determination unit 122 determines that a moving object has exited the vehicle after the signal strength becomes lower than when the moving object entered the vehicle.

[0090] Furthermore, the period used to determine whether a moving object has exited the vehicle is longer than the period used to determine whether a moving object has entered the vehicle. In other words, by determining whether a moving object has exited the vehicle using stricter criteria than those for determining whether a moving object has entered the vehicle, monitoring device 100 can accurately determine whether a moving object is inside the vehicle or has exited the vehicle, and can prevent erroneous detection in which a moving object is determined to have exited the vehicle when the signal strength accidentally falls below the threshold.

[0091] 3. Change Processing Next, the change processing by the monitoring device 100 will be described. As explained in the above description of vehicle exit determination, even if a person is present inside the vehicle, if the person is stationary or resting, there may be a decrease in movement, resulting in a decrease in the strength of the signal received by the motion sensor. Furthermore, if the person in the vehicle is sleeping and there is no movement other than breathing, there may be a case where the person cannot be detected as a moving object with the normal motion sensor settings.

[0092] When a moving object is present inside the vehicle, the change unit 125 changes either the strength of the signal emitted by the moving object sensor or the sensitivity with which the moving object sensor receives the signal, or both. For example, when a moving object is present inside the vehicle, the change unit 125 lowers the strength of the signal emitted by the moving object sensor and increases the sensitivity with which the moving object sensor receives the signal.

[0093] In other words, when it is determined that a moving object (person) is present inside the vehicle, the modification unit 125 changes the settings of the moving object sensor so that it can detect chest movement caused by the person's breathing, thereby preventing erroneous detection that determines that a person inside the vehicle has left the vehicle even when there is little movement observed, and making it possible to accurately determine whether or not a moving object has left the vehicle.

[0094] [4. Flowchart] Next, the processing performed by the monitoring device 100 configured as described above will be described with reference to the flowchart in Fig. 10. The flowchart in Fig. 10 is mainly executed by the control unit 120. This flowchart can also be configured as a program executed by the CPU of the control unit 120 to form a monitoring program. Note that the steps below can be executed in a different order, and some processing may be omitted.

[0095] First, referring to Fig. 10, the procedure of the process performed by the monitoring device 100 to determine whether a moving object has exited the vehicle will be described. First, the monitoring device 100 determines whether a moving object is present inside the vehicle (step S301). For example, if the monitoring device 100 determines that a moving object has entered the vehicle using the technology of the first embodiment described above, the monitoring device 100 determines that a moving object is present inside the vehicle. Here, if the monitoring device 100 determines that a moving object is not present inside the vehicle (step S301 "No"), the process returns to step S301 again.

[0096] On the other hand, if the monitoring device 100 determines that a moving object is present inside the vehicle (step S301 "Yes"), the change unit 125 changes either the strength of the signal emitted by the moving object sensor or the sensitivity with which the moving object sensor receives the signal, or both (step S302). For example, when a moving object is present inside the vehicle, the change unit 125 lowers the strength of the signal emitted by the moving object sensor and increases the sensitivity with which the moving object sensor receives the signal.

[0097] Next, the acquisition unit 121 acquires the intensity of the signal received by the motion sensor provided in the vehicle (step S303). For example, the acquisition unit 121 acquires the intensity of the signal received by the motion sensor provided in the vehicle so that the detection range includes the interior of the vehicle.

[0098] Next, the determination unit 122 determines whether the intensity of the signal acquired by the acquisition unit 121 has been less than the threshold value for a predetermined period of time (step S304). If the determination unit 122 determines that the intensity is not less than the threshold value (step S304 "No"), the process returns to step S303.

[0099] On the other hand, if the determination unit 122 determines that the moving object is less than the threshold value ("Yes" in step S304), the determination unit 122 determines that the moving object has exited the vehicle (step S305). Subsequently, the output unit 124 stops outputting the predetermined notification (step S306). For example, the output unit 124 stops outputting the alarm.

[0100] 5. Effects The monitoring device 100 according to the embodiment includes an acquisition unit 121 that acquires the intensity of a signal received by a moving object sensor provided inside the vehicle, and a determination unit 122 that determines whether a moving object has exited the vehicle based on the intensity of the signal acquired by the acquisition unit 121.

[0101] As a result, the monitoring device 100 can determine with high accuracy whether a moving object has exited the vehicle by determining whether the signal strength satisfies the threshold condition. In other words, by using a threshold value for the signal strength that is set so that the monitoring device 100 can determine that a moving object has exited the vehicle, it is possible to prevent false detection that may occur when the movement of a moving object inside the vehicle decreases.

[0102] The determination unit 122 of the monitoring device 100 according to the embodiment determines that a moving object has exited the vehicle when the strength of the signal acquired by the acquisition unit 121 is less than a threshold for a predetermined period of time. As a result, the monitoring device 100 determines whether the signal strength for a predetermined period of time satisfies the threshold condition, thereby making a determination based on stricter standards than when a moving object enters the vehicle, and can accurately determine whether a moving object has exited the vehicle.

[0103] The acquisition unit 121 of the monitoring device 100 according to the embodiment acquires the strength of each signal received by a plurality of moving object sensors installed in the vehicle, and the determination unit 122 determines whether or not a moving object has left the vehicle when the strength of each signal acquired by the acquisition unit 121 remains below a threshold value for a predetermined period of time.

[0104] As a result, the monitoring device 100 determines whether the strength of each signal received by multiple motion sensors over a predetermined continuous period of time satisfies the threshold conditions, thereby making a judgment using stricter standards than when a motion object enters the vehicle, and can accurately determine whether a motion object has exited the vehicle.

[0105] The acquisition unit 121 of the monitoring device 100 according to the embodiment further acquires the location where each motion sensor is installed, and further includes a threshold change unit 123 that changes the threshold value according to the location where each motion sensor acquired by the acquisition unit 121 is installed.

[0106] As a result, the monitoring device 100 can change the threshold value for determining whether a moving object has exited the vehicle depending on the location where the moving object sensor is installed, thereby reflecting changes in signal strength due to differences in the location where the moving object sensor is installed in the threshold value, and can accurately determine whether a moving object has exited the vehicle.

[0107] The acquisition unit 121 of the monitoring device 100 according to the embodiment further acquires information about the vehicle type, and further includes a threshold change unit that changes the threshold in accordance with the information about the vehicle type acquired by the acquisition unit 121. As a result, the monitoring device 100 changes the threshold for determining whether or not a moving object has exited the vehicle in accordance with information about the vehicle type in which the moving object sensor is installed, thereby reflecting changes in signal strength due to differences in the size of the vehicle in which the moving object sensor is installed in the threshold, and can accurately determine whether or not a moving object has exited the vehicle.

[0108] The monitoring device 100 according to the embodiment further includes a change unit 125 that changes either the strength of the signal emitted by the moving object sensor or the sensitivity with which the moving object sensor receives the signal when a moving object is present inside the vehicle. This allows the monitoring device 100 to prevent false detection that may occur when the movement of the moving object present inside the vehicle is extremely small, and to accurately determine whether the moving object has left the vehicle.

[0109] The output unit 124 of the monitoring device 100 according to the embodiment stops outputting a predetermined notification when the determination unit 122 determines that the moving object has exited the vehicle. This enables the monitoring device 100 to accurately determine whether the moving object has exited the vehicle, and to stop sending notifications to the outside when the moving object has exited the vehicle.

[0110] [Others] [1. Hardware Configuration] The monitoring device 100 according to the above-described embodiment is realized, for example, by a computer 1000 configured as shown in Fig. 11. Fig. 11 is a hardware configuration diagram showing an example of a computer that realizes the functions of the monitoring device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, a HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0111] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, programs that depend on the hardware of the computer 1000, and the like.

[0112] The HDD 1400 stores programs executed by the CPU 1100 and data used by the programs. The communication interface 1500 receives data from other devices via a predetermined communication network and sends the data to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0113] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0114] Media interface 1700 reads a program or data stored in recording medium 1800 and provides it to CPU 1100 via RAM 1200. CPU 1100 loads the program or data from recording medium 1800 onto RAM 1200 via media interface 1700 and executes the loaded program. Recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0115] For example, when the computer 1000 functions as the monitoring device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control unit 120. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via a predetermined communication network.

[0116] [2. Other] While one example of an embodiment of the present invention has been described above, the present invention is not limited to the above example. In other words, a person skilled in the art can implement various modifications in accordance with conventionally known knowledge without departing from the gist of the present invention. As long as such modifications still comprise the monitoring device of the present invention, they are of course included in the scope of the present invention.

[0117] REFERENCE SIGNS LIST 1 monitoring system 10 in-vehicle device 100 monitoring device 110 communication unit 120 control unit 121 acquisition unit 122 determination unit 123 threshold value change unit 124 output unit 125 change unit 130 storage unit

Claims

1. A monitoring device comprising: an acquisition unit that acquires the strength of each signal received by a plurality of motion sensors installed inside a vehicle; and a judgment unit that judges whether or not a moving object has entered the vehicle based on the strength of each of the signals acquired by the acquisition unit.

2. The monitoring device described in claim 1, characterized in that the judgment unit judges that the moving object has entered the vehicle when the strength of each of the signals acquired by the acquisition unit is equal to or greater than a first threshold and the sum of the strengths of the each of the signals acquired by the acquisition unit is equal to or greater than a second threshold that is greater than the sum of the first thresholds.

3. The monitoring device described in claim 2, characterized in that the judgment unit judges that the moving object has entered the vehicle when the intensity of each of the signals acquired by the acquisition unit is greater than or equal to a first threshold for a period of time that is equal to or greater than a specified percentage of the specified period, and the sum of the intensity of each of the signals acquired by the acquisition unit is greater than or equal to a second threshold that is greater than the sum of the first thresholds for a period of time that is equal to or greater than a specified percentage of the specified period.

4. The monitoring device described in claim 2, characterized in that the second threshold is greater than the sum of the first thresholds, greater than the sum of the intensities of each of the signals acquired by the acquisition unit when the moving object is present on both sides of the vehicle, and smaller than the sum of the intensities of each of the signals acquired by the acquisition unit when the moving object is present inside the vehicle.

5. The monitoring device according to claim 2, wherein the second threshold value is a value equal to or greater than 115% of the sum of the first threshold values.

6. The monitoring device according to claim 2, wherein the second threshold value is a value equal to or less than 130% of the sum of the first threshold values.

7. The monitoring device according to claim 2, further comprising a threshold change unit that changes the first threshold value according to the location of each of the motion sensors acquired by the acquisition unit, and further comprising: a threshold change unit that changes the first threshold value according to the location of each of the motion sensors acquired by the acquisition unit.

8. The monitoring device according to claim 2, further comprising a threshold change unit that further acquires vehicle type information and changes either or both of the first threshold value and the second threshold value depending on the vehicle type information acquired by the acquisition unit.

9. The monitoring device according to claim 1, further comprising an output section which outputs a predetermined notification when the determination section determines that the moving object has entered the vehicle interior.

10. A monitoring method executed by a monitoring device, comprising: an acquisition step of acquiring the strength of each signal received by a plurality of motion sensors provided in the vehicle; and a determination step of determining whether or not a moving object has entered the vehicle based on the strength of each of the signals acquired by the acquisition step.

11. A monitoring program that causes a computer to execute the following steps: an acquisition step of acquiring the strength of each signal received by a plurality of motion sensors installed inside the vehicle; and a determination step of determining whether or not a moving object has entered the vehicle based on the strength of each of the signals acquired by the acquisition step.

Images