Monitoring device, monitoring method and monitoring program

Abstract

In a poor environment in which a moving body that is not a subject of interest is present in a vicinity of a vehicle, there are cases in which appropriate monitoring is not performed, such as the moving body that is not a subject of interest causing an erroneous alarm. A monitoring device according to the present invention is characterized by including an acquisition unit that acquires sensor data generated by a sensor provided inside a vehicle, a detection unit that detects, on the basis of the acquired sensor data, a poor environment in which a moving body that is a subject of interest is present, and an adjustment unit that, in accordance with the detected information of the poor environment, adjusts at least one of detection range and sensitivity of the sensor with respect to the moving body that is a subject of interest, to start detection of behavior of the moving body that is a subject of interest.

Description

Monitoring device, monitoring method, and monitoring program

[0001] The present invention relates to a monitoring device, a monitoring method, and a monitoring program.

[0002] There are technologies that monitor suspicious moving objects relative to a vehicle by acquiring data on the vehicle's surrounding environment using sensors such as cameras, microphones, and illuminance sensors installed on the vehicle. Among these technologies, there is one that sets a security level based on the volume of traffic, brightness, and sound volume in the surrounding area (see, for example, Patent Document 1). This technology adjusts the security level, for example, by lowering it when the volume of traffic in the surrounding area is heavy or the sound is loud, or by raising it when it is dark.

[0003] Furthermore, among the devices for monitoring the environment surrounding a vehicle, there are some that, for example, enter a power-saving monitoring mode when monitoring parking, and when a moving object is detected within a specified area around the vehicle, activate the SOC (System On Chip) and enter a detailed monitoring mode to detect the behavior of the moving object.

[0004] JP 2008-009615 A ​​JP 2020-149088 A

[0005] However, in a moving object detection method using a microwave / millimeter wave sensor, in a bad environment where there is a moving object that is not a target of attention around the vehicle, the non-target moving object may cause a false alarm, or the monitoring mode may be switched, resulting in increased power consumption and thus in inappropriate monitoring. Note that a bad environment where there is a moving object that is not a target of attention refers to an environment where there is heavy rain around the vehicle, or where there is swaying grass, trees, flags, etc., when a person peering into the vehicle is considered to be a target of attention, but is not limited to these.

[0006] In order to solve such problems and achieve the object, the monitoring device of the invention described in claim 1 is characterized by having an acquisition unit that acquires sensor data generated by a sensor installed inside the vehicle, a detection unit that detects a hostile environment in which a moving object that is not a target of attention is present based on the acquired sensor data, and an adjustment unit that adjusts at least one of the detection range and sensitivity of the sensor for a moving object that is a target of attention in order to start detecting the behavior of the moving object that is a target of attention, depending on the content of the detected hostile environment.

[0007] FIG. 1 is a diagram illustrating a configuration of a monitoring system according to an embodiment. FIG. 2 is a diagram illustrating an example of a configuration of a monitoring device 100 according to an embodiment. FIG. 3 is a diagram illustrating an example of switching of a fail-safe level according to an embodiment. FIG. 4 is a diagram illustrating an example of switching of a fail-safe level when there is grass on the side according to an embodiment. FIG. 5 is a diagram illustrating another example of switching of a fail-safe level when there is grass on the side according to an embodiment. FIG. 6 is a diagram illustrating an example of switching of a fail-safe level when there is a passenger according to an embodiment. FIG. 7 is a diagram illustrating an example of switching of a fail-safe level when there is grass behind according to an embodiment. FIG. 8 is a diagram illustrating an example of switching of a fail-safe level when it is raining according to an embodiment. FIG. 9 is a diagram illustrating another example of switching of a fail-safe level when it is raining according to an embodiment. FIG. 10 is a diagram illustrating an example of switching of a fail-safe level when parking with a parking meter according to an embodiment. FIG. 11 is a flowchart illustrating an example of the flow of a sensor adjustment process according to an embodiment. FIG. 12 is a hardware configuration diagram illustrating an example of a computer 1000 that realizes the functions of the monitoring device 100.

[0008] Hereinafter, a mode for carrying out the present invention (hereinafter referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0009] 1. System Configuration First, the configuration of a monitoring system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing the configuration of a monitoring system according to an embodiment. As shown in Fig. 1, an example of a monitoring system according to an embodiment is a vehicle 10 equipped with a monitoring device 100. The monitoring device 100 may be, for example, a device that is built into the vehicle 10, brought into the vehicle 10, or externally attached and connected to the vehicle 10 so as to be capable of communicating with the vehicle 10.

[0010] The monitoring device 100 acquires information about the surroundings of the vehicle 10 using, for example, a motion sensor or other sensor built into the monitoring device 100 or communicably connected to the monitoring device 100, and monitors people who approach, look into, or invade the vehicle 10 as moving objects to be watched for. On the other hand, the monitoring device 100 controls so as not to detect, for example, heavy rain, swaying plants and flags, accumulated snow, blowing snow, and the like around the vehicle 10 as moving objects that are not to be watched for. Note that the detection of moving objects to be watched for, such as approaching people, and moving objects that are not to be watched for, such as swaying plants and trees, may be performed by determining the identity of the detected object using, for example, existing technology.

[0011] 2. Configuration of the monitoring device 100 Next, the monitoring device 100 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the monitoring device 100 according to the embodiment. The monitoring device 100 may be, for example, a device mounted on a vehicle, and as shown in Fig. 2, has a communication unit 110, a storage unit 130, and a control unit 120. Each unit of the monitoring device 100 will be described below.

[0012] The communication unit 110 is realized by, for example, a network interface card (NIC), etc. The communication unit 110 is connected to a network via a wired or wireless connection, and transmits and receives information to and from other devices, for example.

[0013] The storage unit 130 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in Fig. 2, the storage unit 130 has, for example, a sensor data storage unit 131, a position data storage unit 132, and a map data storage unit 133.

[0014] The sensor data storage unit 131 stores, for example, information relating to sensor data acquired by a sensor capable of detecting a moving object, such as a motion sensor included in the monitoring device 100 or communicably connected to the monitoring device 100. The sensor data stored in the sensor data storage unit 131 is, for example, transmitted from the sensor as needed and stored in the sensor data storage unit 131. Here, the sensor may be, for example, a light detection and ranging (LiDAR), a camera, a passive infrared (PIR) sensor, a thermograph, or the like.

[0015] The position data storage unit 132 stores, for example, information related to the position of the vehicle 10. The position information of the vehicle 10 stored in the position data storage unit 132 may be, for example, position information acquired from a GPS (Global Positioning System), and is acquired from the GPS at a predetermined timing and stored in the position data storage unit 132.

[0016] The information stored in the storage unit 130 is not limited to sensor data, and the storage unit 130 may store, for example, various other information. Furthermore, if the storage unit 130 does not use, for example, the location information or map information of the vehicle 10, the storage unit 130 does not need to store this information.

[0017] The control unit 120 is realized using a CPU (Central Processing Unit), an NP (Network Processor), an FPGA (Field Programmable Gate Array), or the like, and executes processing programs stored in memory. As shown in Fig. 2, the control unit 120 includes, for example, an acquisition unit 121, a detection unit 122, an adjustment unit 123, and a disconnection unit 124. Each unit included in the control unit 120 will be described below.

[0018] The acquisition unit 121 acquires, for example, sensor data generated by a sensor provided inside the vehicle 10. The sensor data may be acquired from the sensor data storage unit 131, for example.

[0019] The acquisition unit 121 also acquires, for example, location information and map information of the vehicle 10 .

[0020] The detection unit 122 detects an adverse environment in which a moving object that is not a target of attention exists, for example, based on the sensor data acquired by the acquisition unit 121. Here, examples of the moving object that is not a target of attention include heavy rain around the vehicle 10, swaying plants, trees, flags, etc., accumulated snow, and blowing snow. The detection unit 122 determines that an adverse environment has been detected when it detects at least one of heavy rain, swaying plants, trees, flags, etc., and accumulated snow and blowing snow around the vehicle 10. Furthermore, an adverse environment may include an environment such as a roadside with heavy pedestrian traffic. Note that, for example, in order to prevent false detection of an adverse environment and improve detection accuracy, the detection unit 122 may continuously detect an adverse environment for a predetermined period of time, such as three minutes.

[0021] Furthermore, the detection unit 122 starts detecting an adverse environment after a certain period of time has elapsed while the wireless connection with the terminal associated with the vehicle 10 is interrupted. Here, the terminal associated with the vehicle 10 is, for example, a mobile terminal such as a smartphone, a mobile phone, or a smart key, and the wireless connection may be a Bluetooth (registered trademark) Low Energy (BLE) connection.

[0022] Furthermore, the detection unit 122 detects, for example, an adverse environment, and executes detection of the adverse environment after a certain time has elapsed since the detection range and sensitivity of the sensor have been adjusted by the adjustment unit 123. This is a re-execution of detection of the adverse environment, and is intended to cope with the possibility that the surrounding environment of the vehicle 10 may have changed over time, for example.

[0023] Furthermore, the detection unit 122 may perform detection of an adverse environment after a certain time has elapsed since the detection of an adverse environment was performed. This is also a re-execution of detection of an adverse environment, but is a re-execution when an adverse environment is not detected.

[0024] Furthermore, the detection unit 122 detects an occupant inside the vehicle 10, for example, after a certain period of time has passed with the wireless connection to the terminal associated with the vehicle 10 being disconnected. Here, the reason why the certain period of time has passed with the wireless connection being disconnected is to exclude cases where, for example, a driver carrying a smart key or the like is wandering around the vicinity of the vehicle 10, where the wireless connection is likely to be repeatedly disconnected and reconnected.

[0025] Furthermore, when the detection unit 122 detects an occupant, for example, the detection unit 122 continues object detection without detecting the moving object to be watched for in order to start detecting the behavior of the moving object to be watched by the sensor. This will be described in more detail using a part of FIG.

[0026] Fig. 3 is a diagram showing an example of switching of fail-safe levels according to the embodiment. In the vehicle 10 viewed from above the "without fail-safe" section shown on the far left of Fig. 3, for example, the range shown as a moving object detection range 160 is the moving object detection range, and is the range for detecting a moving object to be watched for, i.e., a person approaching, peering into, or invading the vehicle 10. Note that Fig. 3 shows the moving object detection range 160 by one sensor, but the moving object detection range 160 may be a range by multiple sensors, such as the ranges on the right and left sides of the vehicle 10.

[0027] Further, an object detection range having a range equal to or wider than the moving object detection range 160 may be provided. For example, when an object is detected in at least one of the object detection ranges, the SOC is activated, and the behavior of the moving object in the moving object detection range 160 is detected. That is, the monitoring device 100 first operates in a power-saving monitoring mode in which the behavior of the moving object in the object detection range 160 is not detected, but only the detection of the object in the object detection range is performed (object detection does not activate the SOC and does not detect the behavior of the moving object, enabling power-saving operation). Then, for example, when an object is detected in the object detection range, the monitoring device 100 enters a detailed monitoring mode in which the behavior of the moving object in the moving object detection range 160 is detected. Because object detection has a relatively small impact on power consumption even in adverse environments, the object detection range may be configured to maintain a predetermined range even when the moving object detection range 160 is adjusted by the adjustment unit 123 due to adverse environments.

[0028] For example, if there is an occupant inside the vehicle 10, the detection unit 122 continues to perform object detection without detecting the moving object of interest in order to start detecting the behavior of the moving object of interest using the sensor.

[0029] Furthermore, the detection unit 122 stops executing object detection, for example, when the ACC (also called the ACC power supply; ACC is an abbreviation for Accessory) of the vehicle 10 is turned on or when the battery voltage of the vehicle 10 falls below a predetermined threshold. This is because, for example, when the ACC is turned on, it means that the driver with a smart key or the like has returned to the vehicle 10, making monitoring of the vehicle 10 unnecessary. Also, when the battery voltage of the vehicle 10 falls below a predetermined threshold, the battery is prevented from running down.

[0030] The adjustment unit 123 adjusts at least one of the detection range and sensitivity of the sensor for the moving object of interest, for starting detection of the behavior of the moving object of interest, in accordance with, for example, the content of the adverse environment detected by the detection unit 122. The detection range of the sensor for the moving object of interest here is, for example, the moving object detection range 160 in Fig. 3. In order to prevent problems such as excessive detection of a moving object that is not a target of attention in an adverse environment, which may increase the power consumption of the battery of the vehicle 10 or generate excessive alarms, the adjustment unit 123 adjusts the detection range and sensitivity of the sensor in accordance with the content of the adverse environment.

[0031] The adjustment of the detection range and sensitivity of the sensor will be described in more detail with reference to Fig. 3. In the example of Fig. 3, the detection range and sensitivity of the sensor are expressed as levels such as no fail-safe, Lv1, Lv2, etc. according to the degree of adjustment, but this is not limited to the example shown in Fig. 3.

[0032] Without fail-safe, for example, the moving object detection range 160 is wide as shown in Figure 3, and the sensor sensitivity is high, so there is a possibility that over-detection may occur due to moving objects that are not of interest in adverse environments.

[0033] The fail-safe level 1 is a state to which the system transitions from no fail-safe when, for example, heavy rain, swaying plants or flags are detected as moving objects that are not of interest in a bad environment. The fail-safe level 1 is a state in which, for example, the moving object detection range 160 is a medium range as shown in FIG. 3 and the sensor sensitivity is low.

[0034] The fail-safe level 2 is a state to which the system transitions when excessive detection occurs even in the fail-safe level 1. The fail-safe level 2 is a state in which the moving object detection range 160 is narrow as shown in FIG. 3 and the sensor sensitivity is low.

[0035] In this way, for example, when the adjustment unit 123 detects a bad environment around the vehicle 10, it performs at least one of reducing the detection range of the sensor for the moving object of interest and reducing the sensitivity in order to start detecting the behavior of the moving object of interest.

[0036] Furthermore, as a fail-safe, the adjustment unit 123 may selectively narrow only the detection range in the direction in which the adverse environment is detected. For example, when an adverse environment is detected on the right side of the vehicle 10, the adjustment unit 123 executes at least one of narrowing the detection range of the sensor for the moving object of interest and reducing the sensitivity in order to start detecting the behavior of the moving object of interest in the right side direction in which the adverse environment is detected.

[0037] Furthermore, for example, when the number of times an event for generating a warning is detected within a certain period of time is equal to or exceeds a predetermined threshold, the adjustment unit 123 performs at least one of further reducing the reduced detection range of the sensor and further reducing the reduced sensitivity, depending on the number of times the event is detected. The event here is, for example, the detection of the behavior of a moving object by the sensor, and when an excessive number of events are detected, the detection range and sensitivity of the sensor are adjusted.

[0038] The adjustment unit 123 also adjusts at least one of the detection range and sensitivity of the sensor for detecting the behavior of the target moving object, for example, in accordance with the number of events detected within a certain period of time that triggers a warning. More specifically, for example, in a state without a failsafe, if the number of events detected, i.e., the detection coefficient of the behavior of the target moving object by the sensor, is equal to or exceeds a predetermined threshold within a certain period of time, such as 12 or more times within 10 minutes, it is determined to be excessive detection. In this case, the adjustment unit 123 transitions to failsafe level 1, for example, and adjusts the detection range and sensitivity of the sensor.

[0039] Furthermore, the adjustment unit 123 determines whether the vehicle 10 is parked at a predetermined location, for example, based on the location information of the vehicle 10 and the map information acquired by the acquisition unit 121. Then, for example, when the adjustment unit 123 determines that the vehicle 10 is parked at a predetermined location, the adjustment unit 123 performs at least one of reducing the detection range and the sensitivity of the sensor for the moving object of interest in order to start detecting the behavior of the moving object of interest. The predetermined location is, for example, a parking meter, and if the vehicle is parked at the parking meter, there is a possibility that pedestrians, cars, etc. may be overdetected. Therefore, the adjustment unit 123 adjusts the detection range and the sensitivity of the sensor.

[0040] In this case, the adjustment of the detection range and sensitivity of the sensor may be, for example, the adjustment of the fail-safe level Lv1 shown in FIG.

[0041] Returning to the description of FIG. 2, the disconnection unit 124 performs hysteresis control to disconnect the wireless connection with a terminal associated with the vehicle 10, such as a smart key.

[0042] 3. Switching of Fail-Safe Levels Next, the switching of the fail-safe level shown in FIG. 3 will be described for each situation using FIGS. 4 to 10. FIG. 4 is a diagram showing an example of switching of the fail-safe level when there is grass on the side according to the embodiment. FIG. 4 shows an example of a case where the vehicle 10 is parked in a place where there is grass on the side of the vehicle 10, for example, on the right side of the vehicle 10, and the wind is blowing, causing the grass to sway. Note that there is no fail-safe immediately after parking.

[0043] In such a situation, for example, after the driver gets off the vehicle and the BLE connection is interrupted, the monitoring device 100 starts detecting an adverse environment for three minutes. Then, for example, when the monitoring device 100 detects rustling grass, as shown in FIG. 4 , the monitoring device 100 adjusts the moving object detection range 160, which is the detection range of the sensor, and the sensitivity of the sensor. Note that the monitoring device 100 may continue searching for the driver (strictly speaking, the BLE connection) even after detecting rustling grass, and may adjust the moving object detection range 160 and the sensitivity of the sensor if the driver is not found during the three-minute detection of an adverse environment.

[0044] Furthermore, after a certain period of time, such as 175 minutes, has elapsed since the fail-safe mode was switched on, the monitoring device 100 begins a new five-minute reassessment to detect adverse conditions. If, for example, the monitoring device 100 detects rustling grass again during the reassessment, it ends the reassessment and extends the fail-safe duration by 180 minutes. On the other hand, if, for example, the reassessment does not detect any adverse conditions, such as rustling grass, the monitoring device 100 transitions the sensor's fail-safe level to no fail-safe and returns the sensor's detection range and sensitivity to a state without fail-safe.

[0045] 5 is a diagram showing another example of switching of the fail-safe level when there is grass on the side according to the embodiment. Like FIG. 4, FIG. 5 shows an example of a case where the vehicle 10 is parked in a place where there is grass on the side of the vehicle 10, for example, on the right side of the vehicle 10, but there is no wind blowing for a while after parking, and the grass is not rustling.

[0046] In such a situation, for example, after the driver gets off the vehicle and the BLE connection is interrupted, the monitoring device 100 starts detecting a bad environment for three minutes, but since the swaying of the grass is not detected, the bad environment is not detected and the detection of the bad environment ends.

[0047] When the wind starts to blow without a fail-safe, the monitoring device 100 detects, for example, the swaying of grass in the moving object detection range 160, and adjusts the moving object detection range 160 and the sensitivity of the sensor.

[0048] 5, if excessive detection is determined, the monitoring device 100 adjusts the moving object detection range 160 and the sensitivity of the sensor, and if excessive detection is still determined, the monitoring device 100 further adjusts the moving object detection range 160 and the sensitivity of the sensor. Also, even in the example of FIG. 5, the adverse environment may be re-determined as in the example of FIG. 4.

[0049] Fig. 6 is a diagram showing an example of switching of the fail-safe level when a passenger is present according to the embodiment. Similar to Fig. 4, Fig. 6 shows an example in which the vehicle 10 is parked in a location where there is grass on the side of the vehicle 10, for example, on the right side of the vehicle 10, and the wind is blowing, causing the grass to sway. Furthermore, in the example of Fig. 6, a passenger 50 is waiting in the vehicle 10.

[0050] In such a situation, for example, after the driver gets off the vehicle and the BLE connection is interrupted, the monitoring device 100 starts detecting an adverse environment for three minutes, but stops detecting the behavior of a moving object by the sensor if it detects a passenger 50, as shown in Fig. 6. Note that, for example, even if swaying grass is not detected, if it detects a passenger 50, it may stop detecting the behavior of a moving object.

[0051] 7 is a diagram illustrating an example of switching of the fail-safe level when there is grass behind the vehicle 10 according to the embodiment. For example, FIG. 7 shows an example in which the vehicle 10 is parked in a location with grass behind it, and the wind is blowing, causing the grass to sway.

[0052] In such a situation, for example, after the driver gets off the vehicle and the BLE connection is interrupted, the monitoring device 100 starts detecting an adverse environment for three minutes. Then, for example, as shown in FIG. 7 , when the monitoring device 100 detects rustling grass, it adjusts the moving object detection range 160 and the sensitivity of the sensor. Note that in the example of FIG. 7 , as in the example of FIG. 4 , the monitoring device 100 may continue searching for the driver even after detecting rustling grass, and may adjust the moving object detection range 160 and the sensitivity of the sensor if the driver is not found during the three-minute detection of an adverse environment. Also in the example of FIG. 7 , the adverse environment may be re-determined as in the example of FIG. 4 .

[0053] 8 is a diagram illustrating an example of switching of the fail-safe level when it is raining according to the embodiment. Fig. 8 shows an example in which light rain occurs when the vehicle is parked, but changes to heavy rain while the vehicle is parked.

[0054] In such a situation, for example, after the driver gets off the vehicle and the BLE connection is interrupted, the monitoring device 100 starts detecting an adverse environment for three minutes, but since heavy rain is not detected, the adverse environment is not detected and the detection of the adverse environment ends.

[0055] When the rain turns into heavy rain, the monitoring device 100 detects, for example, heavy rain and adjusts the moving object detection range 160 and the sensitivity of the sensor as shown in FIG.

[0056] Also in the example of FIG. 8, the adverse environment may be re-evaluated as in the example of FIG.

[0057] 9 is a diagram illustrating another example of switching of the fail-safe level in the event of rain according to the embodiment. Fig. 9 is a continuation of the example of Fig. 4, and illustrates an example in which heavy rain begins to fall after the monitoring device 100 detects swaying grass.

[0058] The monitoring device 100 adjusts the moving object detection range 160 and the sensitivity of the sensor, for example, as shown in Fig. 9. Also, in the example of Fig. 9, the adverse environment may be re-evaluated as in the example of Fig. 4.

[0059] 10 is a diagram illustrating an example of switching of the fail-safe level when parking at a parking meter according to the embodiment. FIG. 10 shows an example of parking at a parking meter.

[0060] In such a situation, for example, after the driver gets off the vehicle and the BLE connection is interrupted, the monitoring device 100 starts detecting an adverse environment for three minutes, but the adverse environment is not detected and the detection of the adverse environment ends.

[0061] Under such circumstances, the monitoring device 100 detects, for example, a pedestrian or a vehicle, and if it determines that the detection is excessive, adjusts the moving object detection range 160 and the sensitivity of the sensor as shown in Fig. 10. Furthermore, the monitoring device 100 may determine whether the vehicle 10 is parked in a parking meter based on, for example, the location information of the vehicle 10 acquired from a GPS and map information, and adjusts the moving object detection range 160 and the sensitivity of the sensor if the vehicle 10 is parked in a parking meter. Even in the example of Fig. 10, the adverse environment may be re-determined as in the example of Fig. 4.

[0062] [4. Flowchart] Next, the sensor adjustment process executed by the monitoring device 100 will be described using the flowchart of FIG. 11 . FIG. 11 is a flowchart showing an example of the flow of the sensor adjustment process according to the embodiment. Each process in the flowchart of FIG. 11 is executed mainly by the control unit 120, for example. This flowchart can be configured as a program executed by the CPU of the control unit 120 to form a monitoring program. Note that the processing steps in the flowchart of FIG. 11 can be executed in a different order, and some processing steps may be omitted. The flowchart of FIG. 11 may be executed, for example, when a certain period of time has elapsed since the wireless connection with the terminal associated with the vehicle 10 was lost.

[0063] First, the monitoring device 100 acquires, for example, sensor data generated by a sensor provided inside the vehicle 10 from the sensor data storage unit 131 (step S101).

[0064] Next, the monitoring device 100 detects an adverse environment in which a moving object that is not a target of attention exists, for example, based on the sensor data acquired in step S101 (step S102). The detection of an adverse environment in step S102 may be performed continuously for, for example, three minutes.

[0065] If a bad environment is not detected (step S103: No), the process proceeds to step S105.

[0066] On the other hand, if a bad environment is detected (step S103: Yes), the monitoring device 100, for example, transitions the fail-safe level depending on the nature of the detected bad environment, and adjusts the detection range and sensitivity of the sensor (step S104).

[0067] Next, the monitoring device 100 performs, for example, event detection, i.e., detection of the behavior of a moving object by a sensor (step S105). If an event is not detected (step S106: No), the monitoring device 100 returns to step S105 and repeats the process until an event is detected.

[0068] On the other hand, if an event is detected (step S106: Yes), the monitoring device 100 determines, for example, whether the number of times the event is detected within a certain period of time is equal to or greater than a threshold (step S107). If the number of times the event is detected is equal to or greater than the threshold (step S107: Yes), the monitoring device 100 determines that the behavior of a moving object that is not a target of attention has been overdetected, and returns to step S104, for example, and adjusts the detection range or sensitivity of the sensor.

[0069] On the other hand, if the number of times the event is detected is less than the threshold (step S107: No), the monitoring device 100 generates a warning, for example, by detecting the behavior of a moving object that is a target of attention (step S108). After step S108 is executed, the sensor adjustment process shown in FIG. 11 ends.

[0070] 5. Effects The monitoring device 100 according to the embodiment includes an acquisition unit 121 that acquires sensor data generated by a sensor provided inside the vehicle 10, a detection unit 122 that detects an adverse environment in which a moving object that is not a target of attention is present based on the acquired sensor data, and an adjustment unit 123 that adjusts at least one of the detection range and sensitivity of the sensor for a moving object that is a target of attention in order to start detecting the behavior of the moving object that is a target of attention, depending on the content of the detected adverse environment.

[0071] In this way, the monitoring device 100 detects an adverse environment based on sensor data acquired by a sensor provided in the vehicle 10, and adjusts either the detection range or sensitivity of the sensor for a moving object of interest to start detecting the behavior of the moving object of interest according to the content of the detected adverse environment. As a result, even in an adverse environment where there are moving objects that are not of interest around the vehicle 10, the monitoring device 100 can prevent an increase in power consumption due to frequent activation of the SOC and the generation of false alarms due to the moving objects that are not of interest.

[0072] Furthermore, when the adjustment unit 123 of the monitoring device 100 detects a bad environment around the vehicle 10, it performs at least one of narrowing the detection range and reducing the sensitivity.

[0073] This allows the monitoring device 100 to prevent an increase in power consumption and the occurrence of false alarms, even in adverse environments such as when there is a moving object behind the vehicle 10 that is not a target of attention.

[0074] In addition, when the adjustment unit 123 of the monitoring device 100 detects a bad environment on a predetermined side of the vehicle 10, it performs at least one of reducing the detection range and reducing the sensitivity on the side where the bad environment is detected.

[0075] This allows the monitoring device 100 to prevent an increase in power consumption and the occurrence of false alarms, even in adverse environments such as when there is a moving object on the side of the vehicle 10 that is not a target of attention.

[0076] In addition, when the number of times an event is detected within a certain period of time to generate an alert is equal to or greater than a predetermined threshold, the adjustment unit 123 of the monitoring device 100 performs at least one of further reducing the reduced detection range and further reducing the reduced sensitivity, depending on the number of times the event is detected.

[0077] This allows the monitoring device 100 to prevent false alarms caused by excessive detection of moving objects that are not of interest.

[0078] Furthermore, the detection unit 122 of the monitoring device 100 starts detecting an adverse environment after a certain period of time has passed since the wireless connection with the terminal associated with the vehicle 10 was lost.

[0079] This allows the monitoring device 100 to prevent an increase in power consumption and the occurrence of false alarms when it is not necessary to detect an adverse environment, such as when the driver is wandering around the vehicle 10. Furthermore, after a certain period of time has passed with the wireless connection disconnected, it is considered that the driver who owns the terminal has sufficiently left the vehicle (the driver is no longer around the vehicle), and this is therefore an ideal time to detect an adverse environment.

[0080] Furthermore, the detection unit 122 of the monitoring device 100 performs detection of an adverse environment after a certain time has elapsed since the detection range or sensitivity was adjusted.

[0081] As a result, even if the surrounding environment of the vehicle 10 changes over time, the monitoring device 100 can prevent an increase in power consumption and the occurrence of false alarms due to adverse environments.

[0082] Furthermore, the detection unit 122 of the monitoring device 100 performs detection of an adverse environment after a certain time has elapsed since the detection of an adverse environment was performed.

[0083] As a result, even if the surrounding environment of the vehicle 10 changes over time, the monitoring device 100 can prevent an increase in power consumption and the occurrence of false alarms due to adverse environments.

[0084] In addition, the detection unit 122 of the monitoring device 100 detects an occupant inside the vehicle 10 after a certain period of time has passed since the wireless connection with the terminal associated with the vehicle 10 was lost, and if an occupant is detected, the detection unit 122 continues to perform object detection without performing detection of the moving object of interest to start detecting the behavior of the moving object of interest using the sensor.

[0085] This allows the monitoring device 100 to prevent an increase in power consumption and the occurrence of false alarms when it is not necessary to detect an adverse environment, such as when there is a passenger in the vehicle.

[0086] Furthermore, the detection unit 122 of the monitoring device 100 stops executing object detection when the ACC of the vehicle 10 is turned on or when the battery voltage of the vehicle 10 becomes equal to or lower than a predetermined threshold value.

[0087] This allows the monitoring device 100 to prevent an increase in power consumption of the vehicle 10 and the battery from running out.

[0088] 6. Hardware Configuration The monitoring device 100 according to the above-described embodiment is realized, for example, by a computer 1000 configured as shown in Fig. 12. Fig. 12 is a hardware configuration diagram showing an example of the computer 1000 that realizes the functions of the monitoring device 100. The computer 1000 has a CPU 1100, a ROM 1200, a RAM 1300, a HDD 1400, a communication I / F (interface) 1500, an input / output I / F (interface) 1600, and a media I / F (interface) 1700.

[0089] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1200 or the HDD 1400. The ROM 1200 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, programs that depend on the hardware of the computer 1000, and the like.

[0090] The HDD 1400 stores programs executed by the CPU 1100 and data used by the programs. The communication I / F 1500 receives data from other devices via a predetermined communication network N and sends the data to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0091] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output I / F 1600. The CPU 1100 acquires data from the input devices via the input / output I / F 1600. The CPU 1100 also outputs generated data to the output devices via the input / output I / F 1600.

[0092] Media I / F 1700 reads a program or data stored in recording medium 1800 and provides it to CPU 1100 via RAM 1300. CPU 1100 loads the program or data from recording medium 1800 onto RAM 1300 via media I / F 1700 and executes the loaded program. Recording medium 1800 is, for example, an optical recording medium such as a DVD (registered trademark) (Digital Versatile Disc) or a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0093] For example, when the computer 1000 functions as the monitoring device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1300 to realize the functions of the control unit 120. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via a predetermined communication network.

[0094] [7. Other] Up to this point, one example of an embodiment of the present invention has been described, but the present invention is not limited to the above example. In other words, a person skilled in the art can implement various modifications in accordance with conventionally known knowledge without departing from the gist of the present invention. As long as such modifications still comprise the monitoring device of the present invention, they are of course included in the scope of the present invention.

[0095] REFERENCE SIGNS LIST 10 Vehicle 50 Passenger 100 Monitoring device 110 Communication unit 120 Control unit 121 Acquisition unit 122 Detection unit 123 Adjustment unit 124 Disconnection unit 130 Storage unit 131 Sensor data storage unit 132 Position data storage unit 160 Moving object detection range 1000 Computer 1100 CPU 1200 ROM 1300 RAM 1400 HDD 1500 Communication I / F 1600 Input / output I / F 1700 Media I / F 1800 Recording medium

Claims

1. An acquisition unit that acquires sensor data generated by a sensor provided inside a vehicle, a detection unit that detects a bad environment in which a moving object that is not a target of attention exists based on the acquired sensor data, and a control unit that adjusts at least one of a detection range and sensitivity of the sensor with respect to the moving object that is the target of attention in order to start detecting the behavior of the moving object that is the target of attention according to the content of the detected bad environment. A monitoring device characterized by having.

2. The adjustment unit executes at least one of reducing the detection range and reducing the sensitivity when the bad environment is detected around the vehicle. The monitoring device according to claim 1, characterized in that.

3. The adjustment unit executes at least one of reducing the detection range and reducing the sensitivity on the side where the bad environment is detected when the bad environment is detected on a predetermined side of the vehicle. The monitoring device according to claim 1 or 2, characterized in that.

4. When the number of detections of an event for generating a warning within a certain period of time is equal to or greater than a predetermined threshold value, the adjustment unit executes at least one of further reducing the reduced detection range and further reducing the reduced sensitivity according to the number of detections. The monitoring device according to claim 1 or 2, characterized in that.

5. The detection unit starts detecting the bad environment after a certain period of time has elapsed while the wireless connection with the terminal associated with the vehicle is interrupted. The monitoring device according to claim 1, characterized in that.

6. The detection unit executes detection of the bad environment after a certain period of time has elapsed after adjusting the detection range or the sensitivity. The monitoring device according to claim 1, characterized in that.

7. The detection unit executes detection of the bad environment after a certain period of time has elapsed after executing detection of the bad environment. The monitoring device according to claim 1, characterized in that.

8. The detection unit detects an occupant inside the vehicle after a certain period of time has elapsed while the wireless connection with the terminal associated with the vehicle is interrupted, and when the occupant is detected, the detection of the moving object that is the target of attention by the sensor is not executed and the execution of object detection is continued. The monitoring device according to claim 1, characterized in that.

9. The monitoring device according to claim 8, wherein the detection unit stops executing the object detection when the ACC of the vehicle is turned on or when the battery voltage of the vehicle becomes equal to or lower than a predetermined threshold value.

10. A monitoring method executed by a monitoring device, the method including: an acquisition step of acquiring sensor data generated by a sensor provided inside a vehicle; a detection step of detecting, based on the acquired sensor data, a bad environment in which there are moving objects that are not objects of attention; and an adjustment step of adjusting at least one of a detection range and sensitivity of the sensor with respect to the moving object that is the object of attention in order to start detecting the behavior of the moving object that is the object of attention, according to the content of the detected bad environment.

11. A monitoring program that causes a computer to execute: an acquisition step of acquiring sensor data generated by a sensor provided inside a vehicle; a detection step of detecting, based on the acquired sensor data, a bad environment in which there are moving objects that are not objects of attention; and an adjustment step of adjusting at least one of a detection range and sensitivity of the sensor with respect to the moving object that is the object of attention in order to start detecting the behavior of the moving object that is the object of attention, according to the content of the detected bad environment.

Images