Monitoring method, monitoring device, and monitoring program

Abstract

Provided is a vehicle monitoring method that is executed using a first vehicle and a second vehicle positioned in the vicinity of the first vehicle and provided with an imaging device capable of imaging an external subject. This monitoring method includes: a detection process for detecting, by the first vehicle, a specific event that has a chance of posing a risk to the first vehicle; a reporting process for reporting detection information to the outside of the first vehicle by means of the first vehicle when the specific event is detected; and a control process for generating image data by means of the imaging device of the second vehicle when the second vehicle receives the detection information.

Description

Monitoring Method, Monitoring Device, and Monitoring Program

[0001] The present invention relates to a monitoring method, a monitoring device, and a monitoring program for monitoring a vehicle.

[0002] Conventionally, technologies for monitoring vehicles have been proposed. For example, in JP2009-280109A, there is proposed a technology in which when there is an obstacle within a set distance from a parked vehicle, an in-vehicle camera is instructed to start shooting, and the image data captured by the in-vehicle camera is recorded in a memory.

[0003] In the above-described conventional technology, when an impact occurs during parking or there is a sign for a certain period near the vehicle, an accident, a theft scene, etc. can be photographed by the activated in-vehicle camera, and the captured image data can be left in the memory. However, the imaging range of the in-vehicle camera installed in the vehicle to be monitored is often limited. Therefore, there is a possibility that it may be difficult to appropriately generate and record image data regarding an accident, a theft scene, etc.

[0004] An object of the present invention is to more appropriately generate image data regarding a specific event that may expose a vehicle to danger.

[0005] One aspect of the present invention is a vehicle monitoring method executed using a first vehicle and a second vehicle located around the first vehicle and equipped with imaging equipment capable of imaging an external subject. This monitoring method includes a detection process for detecting a specific event that may expose the first vehicle to danger, a notification process for notifying detection information outside the first vehicle when the specific event is detected, and a control process for generating image data by the imaging equipment of the second vehicle when the second vehicle receives the detection information.

[0006] Figure 1 is a block diagram illustrating an example of a monitoring system for monitoring the first vehicle. Figure 2 is a simplified diagram showing an example configuration of a location information database. Figure 3 is a simplified diagram showing an example configuration of a specific image data database. Figure 4 is a schematic diagram of specific image data. Figure 5 is a diagram illustrating notification example 1, in which the first vehicle notifies an external party of detection information. Figure 6 is a sequence chart showing an example of communication processing performed between each vehicle. Figure 7 is a diagram illustrating notification example 2, in which the first vehicle notifies an external party of detection information. Figure 8 is a diagram illustrating an example of tracking processing. Figure 9 is a sequence chart showing an example of communication processing performed between each device. Figure 10 is a diagram illustrating an example of specific image data recording processing for the second vehicle. Figure 11 is a diagram illustrating an example of specific image data recording processing for the monitoring server. Figure 12 is a diagram illustrating an example of having other devices perform generation processing, etc. Figure 13 is a diagram illustrating an example of recording specific image data related to electronic equipment.

[0007] Embodiments of the present invention will be described below with reference to the attached drawings.

[0008] [Example of Monitoring System Configuration] Figure 1 is a block diagram showing an example of a monitoring system 1 that monitors a first vehicle C1. Figure 1 shows an example in which a monitoring system 1 is realized by connecting an information processing system 100 installed on the first vehicle C1, a monitoring server 200, and an electronic device 300 owned by the owner of the first vehicle C1 (user U1) via a network 20. Note that this is just one example of a monitoring system 1, and the monitoring system 1 may be realized using other vehicles, other servers, other electronic devices, or even just a vehicle. In addition, this embodiment shows an example in which a parked vehicle is the target of monitoring, but it is not limited to this.

[0009] Furthermore, when describing the operation examples of other vehicles (second vehicle C2 to eighth vehicle C8) shown in Figures 5, 7, 8, etc., parts corresponding to each part of the first vehicle C1 will be denoted by the same reference numerals as those used for the first vehicle C1.

[0010] [Example of Information Processing System Configuration] The information processing system 100 comprises a sound acquisition unit 111, an in-vehicle image acquisition unit 112, an out-of-vehicle image acquisition unit 113, sensors 114, a monitoring device 110, a light-emitting unit 150, and a sound output unit 160. The monitoring device 110 is an example of a device that can detect specific events that may endanger the first vehicle C1, and when such specific events are detected, notify detection information to the outside of the first vehicle C1 and save specific image data related to those specific events. The light-emitting unit 150 and the sound output unit 160 are examples of devices that can notify detection information to the outside of the first vehicle C1. The detection information is information for notifying the outside that a specific event has been detected in the first vehicle C1. Detection information transmitted to other vehicles via other devices (for example, a monitoring server 200) will be described as notification information. That is, notification information is an example of detection information.

[0011] Here, a specific event refers to an event that could endanger the first vehicle C1. For example, if a suspicious person approaches the first vehicle C1, if a suspicious person is peering into the vehicle through the window of the first vehicle C1, or if a suspicious person is loitering around the first vehicle C1, theft, theft, or break-in may occur in the first vehicle C1. Therefore, if these events are detected, they can be detected as specific events. In this embodiment, an object that could endanger the first vehicle C1, i.e., an object that causes a specific event (for example, a person such as a suspicious person, a moving object, or a dangerous creature), will be referred to as a specific object. As a detection method for detecting specific objects, for example, known object recognition technologies (for example, face recognition technology, person recognition technology, personal identification technology, or image recognition technology) can be employed.

[0012] Furthermore, for example, if a moving object (e.g., another vehicle, motorcycle, bicycle) approaches the first vehicle C1, or if an impact occurs to the first vehicle C1, there is a possibility that a hit-and-run incident may occur involving the first vehicle C1. Therefore, if these events are detected, they can be detected as specific events. Also, for example, if a dangerous animal (e.g., a bear, wild boar) approaches the first vehicle C1, or if a dangerous animal is roaming around the first vehicle C1, there is a possibility that some kind of damage may occur to the first vehicle C1. Therefore, if these events are detected, they can be detected as specific events.

[0013] The monitoring device 110 is connected to the network 20 using a wireless communication method. The network 20 is a public telephone network, the Internet, or other similar network.

[0014] The sound acquisition unit 111 is installed inside or outside the first vehicle C1 and acquires sounds from inside and outside the first vehicle C1, and outputs sound information related to the acquired sounds to the monitoring device 110. For example, one or more microphones or sound acquisition sensors can be used as the sound acquisition unit 111.

[0015] The in-vehicle image acquisition unit 112 captures images (image data) of subjects inside the first vehicle C1 and outputs image information related to the generated images to the monitoring device 110. The in-vehicle image acquisition unit 112 is installed inside the first vehicle C1 (for example, on the ceiling) and captures images (image data) of subjects inside the first vehicle C1. The imaging range of the in-vehicle image acquisition unit 112 may be set to an imaging range that can capture subjects outside the first vehicle C1.

[0016] The external image acquisition unit 113 captures images of subjects outside the first vehicle C1 and generates images (image data), and outputs image information related to the generated images to the monitoring device 110. Note that two or more external image acquisition units 113 may be provided, and images from all or some of these external image acquisition units 113 may be used. For example, one external image acquisition unit 113 may be installed in front of the first vehicle C1 to capture images of subjects from the front of the first vehicle C1 and generate images (image data), or another external image acquisition unit 113 may be installed behind the first vehicle C1 to capture images of subjects behind the first vehicle C1 and generate images (image data). Alternatively, one or more devices capable of acquiring images of subjects present in all directions around the first vehicle C1 and subjects inside the first vehicle C1, such as a 360-degree camera, may be used. Note that the in-vehicle image acquisition unit 112 and the external image acquisition unit 113 may be the same device or configured as different devices. Furthermore, from this point forward, the in-vehicle image acquisition unit 112 and the out-of-vehicle image acquisition unit 113 will be referred to as the image acquisition unit 115, as needed.

[0017] The in-vehicle image acquisition unit 112 and the out-of-vehicle image acquisition unit 113 are each composed of, for example, an image sensor that receives light from a subject focused by a lens, and an image processing unit that performs predetermined image processing on the image data generated by the image sensor. For example, a CCD (Charge Coupled Device) type or a CMOS (Complementary Metal Oxide Semiconductor) type image sensor can be used as the image sensor.

[0018] The sensors 114 are various sensors installed on the first vehicle C1, and each sensor outputs detection information to the monitoring device 110. Examples of sensors include anti-theft sensors, collision sensors, LiDAR (Light Detection and Ranging), RADAR (Radio Detection and Ranging), Sonar, location information acquisition sensors (location information acquisition unit), and illuminance sensors. Known sensors can be used for each of these sensors. LiDAR, RADAR, and Sonar are examples of sensors that detect the surrounding conditions of the first vehicle C1 and detect specific events. The anti-theft sensor outputs a message when it detects a predetermined vibration in the first vehicle C1. The collision sensor outputs a message when it detects an impact in the first vehicle C1. For example, specific events can be detected using anti-theft sensors, collision sensors, etc. These are just examples, and other sensors may be used. Furthermore, only some of these sensors may be used.

[0019] The location information acquisition unit acquires location information related to the location of the first vehicle C1. For example, this can be implemented using a GNSS (Global Navigation Satellite System) receiver that acquires location information using GNSS. The location information includes various positional data such as latitude, longitude, and altitude at the time of receiving the GNSS signal. Alternatively, location information may be acquired using other methods. For example, location information may be derived using information from surrounding access points or base stations. Alternatively, location information may be acquired using beacons.

[0020] The monitoring device 110 comprises a control unit 120, a storage unit 130, and a communication unit 140. The communication unit 140 exchanges various types of information with other devices using wired or wireless communication based on the control of the control unit 120. For example, when a specific event is detected in the first vehicle C1, the communication unit 140 transmits detection information indicating that event to the monitoring server 200. Also, for example, when the communication unit 140 receives specific image data from the monitoring server 200, it outputs that specific image data to the control unit 120.

[0021] The control unit 120 controls each part based on various programs stored in the memory unit 130. The control unit 120 is implemented by a processing unit such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The vehicle ECU (Electronic Control Unit) of the first vehicle C1 may also be used as the control unit 120, or a processing unit different from the vehicle ECU may be provided as the control unit 120.

[0022] The control unit 120 performs various controls based on the information output from the sound acquisition unit 111, sensors 114, image acquisition unit 115, communication unit 140, etc., and the information acquired by the vehicle information acquisition unit 121. For example, the control unit 120 performs a detection process to detect a specific event that may endanger the first vehicle C1, a notification process to notify the outside of the first vehicle C1 of the detection information when the specific event is detected, and a recording process to record specific image data related to the specific event in the image data holding unit 131. Also, for example, the control unit 120 performs control processing to control the operating state of the light-emitting unit 150 and the sound output unit 160. Specifically, the control unit 120 comprises a vehicle information acquisition unit 121, a detection unit 122, and an operation control unit 123.

[0023] The vehicle information acquisition unit 121 acquires various information (vehicle status information) relating to the first vehicle C1, and outputs the acquired vehicle status information to the detection unit 122. The vehicle status information can be acquired, for example, from the CAN (Controller Area Network) signal. The vehicle status information includes, for example, the position of the shift lever (e.g., P range, D range), position information, etc. For example, it is possible to determine whether the first vehicle C1 is stopped based on the position of the shift lever, etc.

[0024] The detection unit 122 performs various detection processes based on the information output from the sound acquisition unit 111, sensors 114, image acquisition unit 115, vehicle information acquisition unit 121, communication unit 140, etc. For example, the detection unit 122 detects a specific event that may endanger the first vehicle C1 and outputs the detection result to the operation control unit 123.

[0025] For example, the detection unit 122 detects a specific object outside the first vehicle C1 that may endanger the first vehicle C1, based on the external image acquired by the image acquisition unit 115, and detects that a specific event has occurred. As described above, this method for detecting the specific object can employ, for example, known object recognition technology (e.g., face recognition technology, personal identification technology, image recognition technology). As also described above, various sensors (e.g., obstacle prevention sensors, collision sensors) may be used to detect the occurrence of the specific event. Furthermore, for example, the detection unit 122 performs tracking processing of the specific object. Known tracking processing can be performed as this tracking processing.

[0026] The motion control unit 123 performs control related to various operations. For example, when a specific event is detected by the detection unit 122, the motion control unit 123 performs a notification process to notify the outside of the first vehicle C1 of the detection information, and a recording process to record specific image data related to that specific event in the image data holding unit 131. Also, for example, the motion control unit 123 performs control processing to control the operating state of the light-emitting unit 150 and the sound output unit 160. Examples of these operation controls will be explained in detail with reference to Figures 5 to 11, etc.

[0027] The memory unit 130 is a storage medium for storing various types of information. For example, the memory unit 130 stores various types of information necessary for the control unit 120 to perform various processes (e.g., control programs, image data storage unit 131). The memory unit 130 also stores various types of information acquired via the communication unit 140. As the memory unit 130, for example, ROM (Read Only Memory), RAM (Random Access Memory), SRAM (Static Random Access Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), or a combination thereof can be used.

[0028] The light-emitting unit 150 is a light-emitting device installed in the first vehicle C1, and is, for example, a headlight, taillight, reverse light, fog lamp, turn signal, etc. The light-emitting unit 150 is also capable of changing its illumination state based on instructions from the monitoring device 110.

[0029] The sound output unit 160 is a sound output device installed in the first vehicle C1, and is, for example, a warning sound generator (horn, car horn). The sound output unit 160 is also capable of outputting various sounds based on instructions from the monitoring device 110.

[0030] [Example of monitoring server configuration] The monitoring server 200 includes a communication unit 210, a control unit 220, and a storage unit 230.

[0031] The communication unit 210, based on the control of the control unit 220, exchanges various types of information with other devices using wired or wireless communication.

[0032] The control unit 220 controls each part based on various programs stored in the storage unit 230. The control unit 220 is implemented by a processing unit such as a CPU or GPU. The control unit 220 includes a detection unit 221, an output control unit 222, and a recording control unit 223.

[0033] The detection unit 221 performs various detection processes. For example, the detection unit 221 acquires detection information transmitted from the first vehicle C1 via the communication unit 210, and based on this detection information, detects specific events that may endanger the first vehicle C1. The detection unit 221 then outputs the detection results to the output control unit 222 and the recording control unit 223. In addition, for example, the detection unit 221 performs tracking processing of a specific object related to the specific event. This tracking processing will be explained in detail with reference to Figure 8.

[0034] The output control unit 222 performs control related to various output operations. For example, when the detection unit 221 detects a specific event related to the first vehicle C1, the output control unit 222 transmits notification information to each vehicle surrounding the first vehicle C1 (for example, the second vehicle C2). This notification information is information that notifies each vehicle surrounding the first vehicle C1 (for example, the second vehicle C2) of an instruction to generate image data using the image acquisition unit 115 of that vehicle, and is an example of detection information. The method of transmitting this notification information will be explained in detail with reference to Figures 7 to 9, etc.

[0035] The recording control unit 223 performs control related to various recording operations. For example, when the detection unit 221 detects a specific event related to the first vehicle C1, the recording control unit 223 records the specific image data received from each vehicle (for example, the second vehicle C2) that has sent notification information via the output control unit 222 into the specific image data DB 250. This recording method will be explained in detail with reference to Figures 3, 9, 11, etc.

[0036] The storage unit 230 is a storage medium for storing various types of information. For example, the storage unit 230 stores various types of information necessary for the control unit 220 to perform various processes (e.g., control programs, location information DB 240 (see Figure 2), specific image data DB 250 (see Figure 3)). The storage unit 230 also stores various types of information acquired via the communication unit 210. As the storage unit 230, for example, ROM, RAM, SRAM, HDD, SSD, or a combination thereof can be used.

[0037] [Example of Electronic Device Configuration] The electronic device 300 is a device that can display various images on its display unit and output various audio information from its audio output unit in response to operations by user U1. For example, when user U1 receives a request operation for specific image data from the monitoring server 200, the electronic device 300 transmits request information corresponding to that request operation to the monitoring server 200 and obtains the specific image data corresponding to that request operation from the monitoring server 200. The electronic device 300 then displays the specific image data obtained from the monitoring server 200 on its display unit. The electronic device 300 can be implemented by, for example, an electronic device such as a smartphone, tablet terminal, or portable personal computer, or an information processing device.

[0038] [Example of Location Information DB Configuration] Figure 2 is a simplified diagram showing an example of the configuration of the location information DB 240 stored in the storage unit 230.

[0039] The location information DB 240 is a database that manages the location information of each vehicle monitored by the monitoring server 200. Specifically, the location information DB 240 stores the vehicle ID 241 and the location information 242 in association with each other.

[0040] Vehicle ID 241 is identification information used to identify each vehicle being monitored by the monitoring server 200. In Figure 2, for the sake of clarity, an example is shown in which simplified information such as "C001" is stored in Vehicle ID 241.

[0041] Location information 242 is location information that can identify the location of each vehicle being monitored by the monitoring server 200. In Figure 2, for the sake of clarity, an example is shown in which simplified information is stored in location information 242. Location information acquired by location information acquisition units installed in each vehicle is sequentially transmitted to the monitoring server 200 and stored in location information 242.

[0042] [Example of the configuration of the specific image data DB] Figure 3 is a simplified diagram showing an example of the configuration of the specific image data DB 250 stored in the storage unit 230.

[0043] The specific image data DB250 is a database that manages the specific image data transmitted from each vehicle to be monitored by the monitoring server 200. Specifically, in the specific image data DB250, the vehicle ID 251 of the target vehicle, the position information 252, and the specific image data 253 are stored in an associated manner.

[0044] The vehicle ID 251 of the target vehicle is identification information for identifying a vehicle in which a specific event that may pose a danger is detected around the host vehicle. Note that the vehicle ID 251 of the target vehicle corresponds to the vehicle ID 241 shown in FIG. 2. For example, when the monitoring server 200 receives detection information transmitted from a vehicle in which a specific event has been detected, the vehicle ID of the vehicle that transmitted the detection information is stored as the vehicle ID 251 of the target vehicle.

[0045] The position information 252 is position information that can identify the position of the vehicle in which the vehicle ID of the target vehicle's vehicle ID 251 is stored. For example, when the monitoring server 200 receives detection information transmitted from a vehicle in which a specific event has been detected, the position information 242 (see FIG. 2) of the vehicle that transmitted the detection information is stored as the position information 252. For example, when detection information is transmitted from a parked vehicle to the monitoring server 200, the parking position is stored as the position information 252. Therefore, it is possible to identify the position where a specific event has been detected in the parked vehicle.

[0046] The specific image data 253 stores image data (specific image data) transmitted from other vehicles existing around the vehicle in which the vehicle ID of the target vehicle's vehicle ID 251 is stored. In FIG. 3, the description of the specific image data is omitted for ease of explanation. For example, when the monitoring server 200 receives specific image data regarding the vehicle in which the vehicle ID of the target vehicle's vehicle ID 251 is stored from another vehicle, the specific image data is stored in the specific image data 253 in association with the vehicle ID. The specific image data stored in the specific image data 253 can be provided in response to requests from the owner, related parties (e.g., investigative agencies), etc. of the vehicle corresponding to the vehicle ID stored in the vehicle ID 251 of the target vehicle.

[0047] [Configuration Example of Specific Image Data] Figure 4 is a diagram schematically showing specific image data 270 stored in the specific image data DB 250. In Figure 4, image data 260 generated by a vehicle other than the vehicle in which a specific event that may put the host vehicle at risk is detected is schematically shown as a rectangle extending in the left - right direction. Also shown is an example where the image data from the start position S1 to the end position E1 among the image data 260 is taken as the specific image data 270.

[0048] For example, it is possible to make the specific image data 270 by associating and recording accompanying information (for example, tag information, time information) with the image data from the start position S1 to the end position E1. And based on that accompanying information, the specific image data 270 from the start position S1 to the end position E1 can be identified.

[0049] For example, when detection information is output from a vehicle (for example, the first vehicle C1) in which a specific event that may put the host vehicle at risk is detected, specific image data 270 regarding that specific event is generated by the image acquisition unit 115 of another vehicle (for example, the second vehicle C2) that has received the detection information (or notification information). Here, the timing when the other vehicle receives the detection information (or notification information) is the start position S1. Also, the end timing set based on some rule is the end position E1. For example, when receiving instruction information instructing the end of specific image data from the vehicle in which the specific event is detected, when receiving instruction information instructing the end of specific image data from the monitoring server 200, when a predetermined time has elapsed after receiving the detection information, etc., can be the end timing of the specific image data. For example, when the user U1 of the first vehicle C1 in which the specific event is detected returns to the first vehicle C1 from a distant place and performs an on - operation on the first vehicle C1, the above - mentioned instruction information is transmitted from the first vehicle C1 to the monitoring server 200 (or another vehicle). In this case, the instruction information is transmitted from the monitoring server 200 to each vehicle.

[0050] Figure 4 shows an example of generating image data 260 including specific image data 270, but the method is not limited to this. For example, if another vehicle that has received detection information (or notification information) is stopped, it is assumed that the image acquisition unit 115 of that vehicle is also in the off state. In such a case, it is possible to activate the image acquisition unit 115 of the other vehicle to the on state when the detection information is received, and to start the generation and recording process of the specific image data 270. Alternatively, if the image acquisition unit 115 of the other vehicle is activated when the detection information is received, the image acquisition unit 115 of the other vehicle may be turned off when the specific image data is finished. In these cases, only the specific image data 270 will be generated and recorded.

[0051] Furthermore, as mentioned above, the specific image data 270 can be provided upon request from the owner of the vehicle that output the detection information, related parties (e.g., law enforcement agencies), etc.

[0052] [Example of Notification When a Specific Event is Detected 1] Figure 5 schematically shows an example of when a specific event that may endanger the first vehicle C1 is detected in the first vehicle C1, and this detection information is notified to an external party. Figure 5 shows an example where each vehicle (first vehicle C1 to eighth vehicle C8) is stationary and each vehicle (first vehicle C1 to eighth vehicle C8) is not being monitored by the monitoring server 200 (or when the first vehicle C1 is parked outside the range of the mobile communication network). For example, if the first vehicle C1 is parked in an underground parking lot, inside a tunnel, in the mountains, etc., it is assumed that the first vehicle C1 is parked outside the range of the mobile communication network. Also, Figure 5 shows an example in which the detection process, control process, etc. according to this embodiment are performed only on stationary vehicles, but is not limited to this.

[0053] For example, consider a scenario where a specific object O1 that could endanger the first vehicle C1 is approaching the parked first vehicle C1. As mentioned above, the specific object O1 refers to, for example, a person unrelated to the user who owns the first vehicle C1, a moving object (e.g., another vehicle, motorcycle, bicycle), etc., that for some reason could endanger the first vehicle C1. For example, this could include a person rummaging through the luggage in the parked first vehicle C1, a moving object moving near the parked first vehicle C1 and nearly colliding with it, or a moving object that collides with the parked first vehicle C1 and then flees the scene. In this case, the detection unit 122 detects the specific object O1 based on information from sensors 114, image acquisition unit 115, etc.

[0054] If a specific event is detected in which a specific object O1 approaches (or comes into contact with) a stationary first vehicle C1 and potentially endangers the first vehicle C1, the operation control unit 123 executes control to notify the outside that a specific event has been detected in the first vehicle C1. For example, the operation control unit 123 may cause the light-emitting unit 150 to emit light according to a predetermined pattern, or the sound output unit 160 to output a specific sound according to a predetermined pattern, to notify people, vehicles, etc., present around the first vehicle C1 that a specific event has been detected in the first vehicle C1. For example, a notification method of known technology can be used for this notification. For example, a notification method using a horn or hazard lights from a vehicle anti-theft alarm system can be used. The information transmitted by these notification methods (e.g., light signals, sound signals) is an example of detection information.

[0055] Furthermore, a vehicle theft alarm system capable of detecting specific events that may endanger the parked vehicle C1 may be used. This vehicle theft alarm system, for example, notifies those nearby of the detection by sounding a horn, flashing lights, etc., when it detects a specific event that may endanger the parked vehicle C1. This vehicle theft alarm system is a device that detects intrusions, for example, when the parked vehicle C1 is locked and there is a possibility of unauthorized entry through the side door, back door, hood, etc. of vehicle C1. This vehicle theft alarm system can detect specific events, for example, when the side door, back door, hood, etc. of vehicle C1 are opened or unlocked, when movement is detected inside the vehicle (for example, when a specific person enters the vehicle by breaking a window), or when tilting of vehicle C1 is detected (for example, when a specific person leans against vehicle C1 to look inside through the window). Alternatively, specific events may be detected using an imaging device that is activated when shaken. In this way, it is also possible to detect specific events using various devices and output the detected information externally.

[0056] When detection information (e.g., light signal, sound signal) is output from the first vehicle C1, surrounding vehicles can receive this detection information. For example, for a vehicle parked in a position where it can receive the hazard lights emitted from the light-emitting unit 150, the exterior image generated by the vehicle's image acquisition unit 115 (see Figure 1) will include the light from the hazard lights. The detection unit 122 (see Figure 1) of that vehicle can then detect the detection information based on the light pattern of the hazard lights included in the exterior image. Known image recognition techniques can be used to determine this light pattern.

[0057] Furthermore, for example, in the case of a vehicle parked in a position where it is possible to acquire a specific sound output from the sound output unit 160, the specific sound will be included in the sound information acquired by the vehicle's sound acquisition unit 111 (see Figure 1). Therefore, the vehicle's detection unit 122 (see Figure 1) can detect the vehicle based on the specific sound and its pattern included in that sound information. Known sound recognition techniques can be employed for determining this specific sound and its pattern.

[0058] In this manner, the operation control unit 123 (see Figure 1) of each vehicle (vehicles surrounding the first vehicle C1) that has acquired detection information (e.g., optical signals, sound signals) output from the first vehicle C1 records the image data generated by the image acquisition unit 115 (see Figure 1) as specific image data in the image data holding unit 131 (see Figure 1).

[0059] Here, if the image acquisition unit 115 of the vehicle that acquired the detection information from the first vehicle C1 is stopped at the time of acquisition, the image acquisition unit 115 is started up, the image acquisition unit 115 is made to generate image data after startup, and that image data is recorded as specific image data. On the other hand, if the image acquisition unit 115 of the vehicle that acquired the detection information from the first vehicle C1 is running at the time of acquisition, the image data generated by the image acquisition unit 115 from that time onward is recorded as specific image data.

[0060] The detection range for the detection information can be adjusted by the amount of light emitted from the light-emitting unit 150, the volume of the specific sound output from the sound output unit 160, etc. The detection range for the detection information can be set to, for example, several tens of meters to several hundred meters. The vehicle receiving the detection information may estimate the distance to the vehicle that output the detection information based on the received light amount, volume, etc., and start the generation and recording process of specific image data on the condition that this estimated distance is within a threshold. For example, the generation and recording process of specific image data may be started in the vehicle itself when the distance to the first vehicle C1 is within a predetermined value. This makes it possible to prevent the generation and recording process of specific image data from being executed in vehicles that are far away.

[0061] [Example of communication processing between vehicles] Figure 6 is a sequence chart showing an example of communication processing between the first vehicle C1 and the second vehicle C2. Figure 6 shows an example where detection information is output from the first vehicle C1 while the first vehicle C1 and the second vehicle C2 are parked at the positions shown in Figure 5. In Figure 6, only the second vehicle C2 is shown as an example of a vehicle in the vicinity of the first vehicle C1 that can acquire the detection information output from the first vehicle C1, but the same can be applied to other vehicles. Furthermore, this communication processing example will be explained with reference to Figures 1 to 5 as appropriate.

[0062] In step S501, the detection unit 122 of the first vehicle C1 detects a specific event that may endanger the first vehicle C1 based on information from sensors 114, image acquisition unit 115, etc. For example, as shown in Figure 5, if a specific object O1 is approaching the stationary first vehicle C1, the specific event is detected when the specific object O1 related to the specific event is detected.

[0063] In step S502, the operation control unit 123 of the first vehicle C1 outputs detection information to notify the outside that a specific event has been detected in the first vehicle C1. For example, as shown in Figure 5, the detection information is output by illuminating the light-emitting unit 150 according to a predetermined pattern or by outputting a specific sound from the sound output unit 160. At the same time as outputting the detection information, warning information may be sent to the electronic device 300 to notify the user U1 that a specific event has been detected in the first vehicle C1.

[0064] In step S503, the operation control unit 123 of the first vehicle C1 executes a recording process to record the image data generated by the in-vehicle image acquisition unit 112 and the out-of-vehicle image acquisition unit 113 as specific image data in the image data holding unit 131. If at least one of the in-vehicle image acquisition unit 112 and the out-of-vehicle image acquisition unit 113 is stopped at the time the specific event is detected, the stopped image acquisition unit 115 is started, the image acquisition unit 115 is made to generate image data, and that image data is recorded as specific image data. On the other hand, for image data generated by the image acquisition unit 115 (in-vehicle image acquisition unit 112, out-of-vehicle image acquisition unit 113) that was started at the time the specific event was detected, the image data from that time onward is recorded as specific image data. In the above example, both the in-vehicle image acquisition unit 112 and the out-of-vehicle image acquisition unit 113 are used, but only the image acquisition unit 115 capable of capturing images of the outside of the first vehicle C1 may be used.

[0065] In step S511, the detection unit 122 (see Figure 1) of the second vehicle C2 receives detection information output from the first vehicle C1. For example, as shown in Figure 5, if a predetermined pattern of light emission is emitted, detection information can be received based on that light pattern. Also, for example, if a specific sound of a predetermined pattern is emitted, detection information can be received based on that specific sound pattern.

[0066] In step S512, the operation control unit 123 (see Figure 1) of the second vehicle C2 executes a recording process to record the image data generated by the image acquisition unit 115, which captures the area outside the second vehicle C2, as specific image data in the image data holding unit 131 (see Figure 1). As described above, if the image acquisition unit 115 of the second vehicle C2 that acquired the detection information from the first vehicle C1 is stopped at the time the detection information from the first vehicle C1 is acquired, the image acquisition unit 115 is started up, the image acquisition unit 115 generates image data after the start up, and that image data is recorded as specific image data. On the other hand, if the image acquisition unit 115 of the second vehicle C2 that acquired the detection information from the first vehicle C1 is started up at the time the detection information from the first vehicle C1 is acquired, the image data generated by the image acquisition unit 115 from that time onward is recorded as specific image data.

[0067] In this way, the recorded specific image data can be provided to other devices upon request from an external source. An example of this provision will be explained in detail with reference to Figure 10.

[0068] [Example of notification when a specific event is detected 2] Figure 7 is a schematic diagram illustrating an example in which a specific event that may endanger the first vehicle C1 is detected in the first vehicle C1, and this detection information is notified to an external party. Figure 7 shows an example where each vehicle (first vehicle C1 to eighth vehicle C8) is stationary and under the monitoring of the monitoring server 200. Figure 7 also shows an example where each vehicle (first vehicle C1 to eighth vehicle C8) is within the range of a mobile communication network.

[0069] The method for detecting a specific event in the first vehicle C1 is the same as in the example shown in Figure 5, so the explanation is omitted here. In the example shown in Figure 7, as in the example shown in Figure 5, it is also possible to output detection information by emitting light from the light-emitting unit 150, outputting a specific sound from the sound output unit 160, etc., to notify surrounding vehicles that a specific event has been detected. For example, if there is a vehicle among the first vehicle C1 to the eighth vehicle C8 that is not being monitored by the monitoring server 200, it is possible to output detection information for that vehicle by emitting light from the light-emitting unit 150, outputting a specific sound from the sound output unit 160, etc., as in the example shown in Figure 5, to notify surrounding vehicles that a specific event has been detected. Also, although Figure 7 shows an example of sending notification information from the first vehicle C1 to other vehicles via the monitoring server 200, output information (or notification information) may also be sent directly from the first vehicle C1 to other vehicles using wireless communication without going through the monitoring server 200.

[0070] If a specific event is detected in the first vehicle C1, the operation control unit 123 transmits detection information indicating that a specific event has been detected in the first vehicle C1 to the monitoring server 200 via the communication unit 140 and the network 20. This allows the operation control unit 123 to notify the monitoring server 200 that a specific event has been detected in the first vehicle C1. The detection information includes the vehicle ID of the first vehicle C1. In addition, if necessary, the location information of the first vehicle C1 and information related to the detected specific event (for example, image information related to a specific object) may be included in the detection information.

[0071] When the monitoring server 200 receives the detection information, the detection unit 221 (see Figure 1) detects that a specific event that could endanger the first vehicle C1 has been detected in the first vehicle C1 corresponding to the vehicle ID included in the detection information. The recording control unit 223 stores the vehicle ID included in the detection information in the vehicle ID 251 (see Figure 3) of the target vehicle in the specific image data DB 250, and stores the location information of the first vehicle C1 corresponding to the vehicle ID included in the detection information in the location information 252 (see Figure 3). If the detection information includes location information, that location information is stored in the location information 252. If the detection information does not include location information, the location information 242 associated with the vehicle ID 241 (Figure 2) included in the detection information is stored in the location information 252.

[0072] Next, the output control unit 222 identifies other vehicles to which specific image data generation and recording processes should be executed, based on the position information of the first vehicle C1 corresponding to the vehicle ID included in the detection information. For example, the output control unit 222 identifies other vehicles within the notification range based on the position of the first vehicle C1. For example, the output control unit 222 defines the notification range CE1 as a circle with radius R1 centered on the position of the first vehicle C1, and identifies the second vehicle C2 to the fifth vehicle C5 that are within the notification range CE1. The radius R1 can be set as appropriate based on experiments, simulations, etc. For example, a value of several meters to several hundred meters can be set as the radius R1. The radius R1 may also be changed as appropriate based on the number of vehicles within the notification range CE1. For example, if the number of vehicles within the notification range CE1 is greater than or equal to a threshold, the radius R1 may be changed to a smaller value, and if the number of vehicles within the notification range CE1 is less than a threshold, the radius R1 may be changed to a larger value. Although a circular example is shown for the notification range CE1, it is not limited to this and may be other shapes such as polygons. Alternatively, for example, the notification range may be defined as a range that includes a predetermined number of other vehicles present around the first vehicle C1.

[0073] Next, the output control unit 222 transmits notification information to the identified second vehicle C2 to fifth vehicle C5, instructing them to perform image data generation and recording processes using the image acquisition unit 115 installed in each vehicle. In this case, the output control unit 222 can transmit notification information to each vehicle based on the vehicle ID 241 (see Figure 2). The notification information also includes the vehicle ID of the first vehicle C1. This makes it possible to associate the specific image data generated by the second vehicle C2 to fifth vehicle C5 with the first vehicle C1.

[0074] In this manner, the operation control unit 123 (see Figure 1) of each vehicle (second vehicle C2 to fifth vehicle C5) that receives notification information output from the monitoring server 200 records the image data generated by the image acquisition unit 115 as specific image data in the image data storage unit 131. In this case, accompanying information that can identify the vehicle ID (vehicle ID of the first vehicle C1) included in the received notification information is associated with the specific image data. Note that the method of recording the specific image data, the operation method of the image acquisition unit 115 while it is stopped or running, etc., are the same as in the example shown in Figure 5, so the explanation is omitted here.

[0075] Here, if the surroundings of each vehicle (second vehicle C2 to fifth vehicle C5) that receives notification information output from the monitoring server 200 are dark, it is assumed that the subject included in the specific image data generated by the image acquisition unit 115 will be difficult to see. It is also important to inform specific objects detected by the first vehicle C1 (for example, a person, a vehicle carrying a person) that the specific object is being monitored.

[0076] Therefore, the operation control unit 123 of each vehicle that receives notification information output from the monitoring server 200 detects the brightness around its own vehicle based on the illuminance sensor (sensors 114 (see Figure 1)), and if the brightness around its own vehicle is below a reference value, it executes a control to turn on the light-emitting unit 150. For example, it is possible to illuminate at least one of the light-emitting units such as headlights, taillights, reverse lights, fog lamps, and turn signals. In this case, if the position of a specific object detected by the first vehicle C1 can be identified, only the light-emitting unit corresponding to the direction of that position may be illuminated. This makes it possible to make the specific object included in the specific image data clearer, and to issue a clearer warning regarding the specific object (for example, a person, a vehicle with a person in it).

[0077] Furthermore, if a specific object can be identified within the specific image data, a tracking process is performed to track that specific object. This tracking process will be explained in detail with reference to Figure 8.

[0078] Furthermore, specific image data recorded in each vehicle that receives notification information (vehicles 2C2 to 5C5) can be uploaded to the monitoring server 200 at predetermined timings and provided in response to various requests. For example, when the specific image data reaches its end, it is uploaded to the monitoring server 200 and managed by the monitoring server 200. In this case, the monitoring server 200 can provide the specific image data in response to requests from the owner of vehicle 1C1, related parties (e.g., law enforcement agencies), etc.

[0079] Furthermore, if a request is made by a specific person (for example, the owner of the first vehicle C1, or a related party (for example, an investigative agency)) within a predetermined time (for example, several minutes to several hours) based on the end timing of specific image data, the operation control unit 123 of each vehicle (second vehicle C2 to fifth vehicle C5) can provide that specific image data to the specific person. For example, using wireless communication (for example, short-range wireless communication (wireless LAN (Local Area Network), Bluetooth®, etc.)), the operation control unit 123 of each vehicle can transmit the specific image data to the communication device of the specific person (for example, a smartphone, tablet terminal). In this case, the specific image data may be transmitted to the communication device of the specific person on the condition that some kind of authentication (for example, a passcode) has been performed, or it may be transmitted to the communication device of the specific person without requiring authentication. As mentioned above, specific image data among the image data held in the image data holding unit 131 can be identified based on the accompanying information.

[0080] [Example of tracking a specific object] Figure 8 is a schematic diagram showing an example of tracking processing when tracking a specific object O1. In Figure 8, when the specific object O1 detected in the example shown in Figure 7 moves in the direction of arrow AW1, the monitoring server 200 executes tracking processing to track the specific object O1. Figure 8 also shows an example in which specific image data generated in each vehicle (second vehicle C2 to fifth vehicle C5) that receives notification information is sequentially transmitted to the monitoring server 200. In other words, the monitoring server 200 can use the specific image data transmitted from each vehicle (second vehicle C2 to fifth vehicle C5) to monitor the situation around each vehicle (second vehicle C2 to fifth vehicle C5) in real time.

[0081] The detection unit 221 of the monitoring server 200 detects a specific object O1 contained in specific image data transmitted from the first vehicle C1 and specific image data transmitted from each vehicle (second vehicle C2 to fifth vehicle C5) that received the notification information. The method for detecting the specific object O1 will now be explained.

[0082] For example, a specific object O1 that could endanger the first vehicle C1 could be a person approaching the first vehicle C1, a person moving around the first vehicle C1, or a moving object (e.g., a car, motorcycle, bicycle) moving around the first vehicle C1. Therefore, the detection unit 221 detects people, moving objects, etc. from specific image data transmitted from the first vehicle C1. A known detection method can be used for detecting these people and moving objects. For example, if multiple people, moving objects, etc. are detected in the specific image data transmitted from the first vehicle C1, it is possible to detect one or a predetermined number of people, moving objects, etc. that are close to the first vehicle C1 as the specific object O1. In this case, the detection unit 221 stores identification information (e.g., image information, feature quantities) that can identify the detected specific object O1 in the storage unit 230.

[0083] Next, the detection unit 221 continues to perform the detection process for the specific object O1 in the specific image data transmitted from the first vehicle C1 and the specific image data transmitted from each vehicle (second vehicle C2 to fifth vehicle C5) that received the notification information. For example, it is possible to employ known image recognition techniques such as tracking processes.

[0084] For example, as shown in Figure 8, it is conceivable that a specific object O1 detected at position P1 may move away from the first vehicle C1 (in the direction of arrow AW1). In this case, for example, the specific object O1 that was at position P1 is likely to be included in the specific image data transmitted from the first vehicle C1, but the specific object O1 that has moved to position P2 is less likely to be included in the specific image data transmitted from the first vehicle C1. However, the specific object O1 that has moved to position P2 is considered to be likely to be included in the specific image data transmitted from the third vehicle C3. Regarding the identity of the specific object O1, for example, known image recognition techniques can be employed.

[0085] Thus, it is assumed that the specific image data containing the specific object O1 changes in accordance with the movement of the specific object O1. Therefore, the detection unit 221 can estimate the direction of movement of the specific object O1 based on the detection result of the specific object O1 in each specific image data transmitted from each vehicle. For example, if the specific object O1 that was included in the specific image data transmitted from the first vehicle C1 has moved, become smaller, or disappeared and is now included in the specific image data transmitted from the third vehicle C3, it is possible to estimate that the specific object O1 is moving in the direction from the first vehicle C1 to the third vehicle C3. Furthermore, if the specific object O1 is included in multiple specific image data, known image recognition techniques (for example, techniques for estimating the distance to an object included in an image) can be used to estimate the distance from the position of each vehicle corresponding to each specific image data to the specific object O1, and the position of the vehicle with the closest distance can be estimated as the position of the specific object O1. The direction of movement of the specific object O1 can be estimated using these techniques.

[0086] For example, if a specific object O1 moves away from the first vehicle C1, it is possible that the specific object O1 will no longer be included in the imaging range of each vehicle that sent the notification information. For example, if the specific object O1 moves to position P3, it is possible that the specific object O1 will no longer be included in the imaging range of the third vehicle C3, which is closest to the specific object O1. In this case, it becomes impossible to track the specific object O1. Therefore, if the direction of movement of the specific object O1 can be estimated, the output control unit 222 can send new notification information to the vehicle in that direction of movement.

[0087] For example, the output control unit 222 transmits notification information to the eighth vehicle C8, which is located in the direction of movement of the specific object O1, when the specific object O1 passes near the third vehicle C3. For example, the output control unit 222 identifies other vehicles located within the notification range CE2 based on the position of the third vehicle C3. For example, the output control unit 222 defines the notification range CE2 as a circle with radius R2 centered on the position of the third vehicle C3, and identifies the eighth vehicle C8 located within the notification range CE2. The output control unit 222 then transmits notification information to the identified eighth vehicle C8, instructing it to perform image data generation and recording processing using the image acquisition unit 115 installed in the eighth vehicle C8. The method for setting the notification range is the same as the example shown in Figure 7. However, radius R2 may be the same value as radius R1 or a different value. An example of a circular notification range CE2 is shown, but it is not limited to this, and may be other shapes such as a rectangle extending in the direction of movement of the specific object O1, and other vehicles to which notification information is transmitted may be identified using methods other than shape.

[0088] Furthermore, the tracking process described above is performed until the end of the specific image data. That is, as the specific object O1 moves away from the first vehicle C1, notification information is sequentially sent to the vehicles in the direction of travel of the specific object O1 so that the specific object O1 is included in the specific image data of at least one of the vehicles. As a result, even if the specific object O1 detected in the first vehicle C1 moves away from the first vehicle C1, it is possible to properly secure specific image data that includes the specific object O1.

[0089] [Example of communication processing between vehicles] Figure 9 is a sequence chart showing an example of communication processing between the first vehicle C1, the second vehicle C2, and the monitoring server 200. Figure 9 shows an example where detection information is output from the first vehicle C1 while the first vehicle C1 and the second vehicle C2 are parked at the positions shown in Figure 7. In Figure 9, only the second vehicle C2 is shown as an example of a vehicle in the vicinity of the first vehicle C1 that can acquire notification information output from the monitoring server 200, but the same can be applied to other vehicles. Furthermore, this communication processing example will be explained with reference to Figures 1 to 8 as appropriate.

[0090] Note that steps S521, S523, and S542 correspond to steps S501, S503, and S512 shown in Figure 6. Therefore, their explanations are omitted.

[0091] In step S522, the operation control unit 123 of the first vehicle C1 transmits detection information to the monitoring server 200 to notify the monitoring server 200 that a specific event has been detected in the first vehicle C1.

[0092] In step S524, the operation control unit 123 of the first vehicle C1 transmits specific image data generated by the image acquisition unit 115 and recorded in the image data storage unit 131 to the monitoring server 200. This transmission process of specific image data may be performed in real time, periodically, or irregularly.

[0093] In step S531, the monitoring server 200 receives detection information transmitted from the first vehicle C1. Upon receiving this detection information, the detection unit 221 detects that a specific event potentially endangering the first vehicle C1 that transmitted the detection information has been detected. The recording control unit 223 also stores the vehicle ID included in the detection information in the vehicle ID 251 of the target vehicle in the specific image data DB 250, and stores the location information of the first vehicle C1 corresponding to the vehicle ID included in the notification information in the location information 252.

[0094] In step S532, the output control unit 222 of the monitoring server 200 identifies other vehicles from among the other vehicles surrounding the first vehicle C1 that will perform the generation and recording processes for specific image data. For example, as shown in Figure 7, it is possible to identify the second vehicle C2 to the fifth vehicle C5 that are located within the notification range CE1 based on the position of the first vehicle C1. However, in Figure 9, only the second vehicle C2 is shown as a representative of the identified vehicles.

[0095] In step S533, the output control unit 222 of the monitoring server 200 transmits notification information to the second vehicle C2 identified in step S532.

[0096] In step S534, the monitoring server 200 receives specific image data transmitted from the first vehicle C1. The recording control unit 223 of the monitoring server 200 then records the specific image data in the specific image data DB 250. Specifically, the recording control unit 223 associates the specific image data with the vehicle ID of the first vehicle C1 (vehicle ID 251 of the target vehicle) and records it in the specific image data 253.

[0097] In step S541, the second vehicle C2 receives notification information transmitted from the monitoring server 200.

[0098] In step S543, the operation control unit 123 of the second vehicle C2 transmits the specific image data generated by the image acquisition unit 115 and recorded in the image data storage unit 131 to the monitoring server 200.

[0099] In step S535, the monitoring server 200 receives specific image data transmitted from the second vehicle C2. The recording control unit 223 of the monitoring server 200 then records the specific image data in the specific image data DB 250. Specifically, the recording control unit 223 associates the specific image data with the vehicle ID of the first vehicle C1 (the vehicle ID 251 of the target vehicle) and records it in the specific image data 253.

[0100] [Example of surrounding vehicle operation] Figure 10 is a flowchart showing an example of specific image data recording processing in a second vehicle C2 surrounding a first vehicle C1. This specific image data recording processing is executed by the control unit 220 (see Figure 1) based on a program stored in the storage unit 230 (see Figure 1). In Figure 10, the second vehicle C2 is shown as an example of a vehicle surrounding the first vehicle C1, but it can be applied similarly to other vehicles. This specific image data recording processing will be explained with reference to Figures 1 to 9 as appropriate. Also, Figure 10 shows the specific image data recording processing when the second vehicle C2 is stopped, but it is not limited to this.

[0101] In step S601, the detection unit 122 of the second vehicle C2 determines whether it has received detection information from other surrounding vehicles or whether it has received notification information from the monitoring server 200. For example, if both the other vehicle outputting detection information and the second vehicle C2 are vehicles monitored by the monitoring server 200, and the location of the second vehicle C2 is within the range of the mobile communication network, the communication unit 140 of the second vehicle C2 receives notification information from the monitoring server 200. On the other hand, if at least one of the other vehicle outputting detection information and the second vehicle C2 is not a vehicle monitored by the monitoring server 200, or if the location of the second vehicle C2 is outside the range of the mobile communication network, the detection unit 122 of the second vehicle C2 detects detection information from other surrounding vehicles. For example, detection information may be output by the emission of light from the light-emitting unit 150 of the other surrounding vehicle, the output of a specific sound from the sound output unit 160, etc.

[0102] In step S602, the operation control unit 123 of the second vehicle C2 determines whether the in-vehicle image acquisition unit 112 and the out-of-vehicle image acquisition unit 113 are running. If at least one of the in-vehicle image acquisition unit 112 and the out-of-vehicle image acquisition unit 113 is stopped, the process proceeds to step S603. On the other hand, if both the in-vehicle image acquisition unit 112 and the out-of-vehicle image acquisition unit 113 are running, the process proceeds to step S604. Note that this example shows the use of both the in-vehicle image acquisition unit 112 and the out-of-vehicle image acquisition unit 113, but this is also applicable when using only one image acquisition unit 115.

[0103] In step S603, the operation control unit 123 of the second vehicle C2 starts the image acquisition unit 115 (in-vehicle image acquisition unit 112, exterior image acquisition unit 113), which is currently stopped.

[0104] In step S604, the operation control unit 123 of the second vehicle C2 records specific image data, which is image data generated by the image acquisition unit 115 with associated information added, in the image data holding unit 131.

[0105] In step S605, the detection unit 122 of the second vehicle C2 determines, based on the illuminance sensor, whether the brightness around the second vehicle C2 is below a reference value. If the brightness around the second vehicle C2 is below the reference value, the process proceeds to step S606. On the other hand, if the brightness around the second vehicle C2 is higher than the reference value, the process proceeds to step S607.

[0106] In step S606, the operation control unit 123 of the second vehicle C2 turns on the light-emitting unit 150 of the second vehicle C2 to activate the light-emitting state.

[0107] In step S607, the operation control unit 123 of the second vehicle C2 determines whether or not a specific object has been detected from the specific image data generated in step S604. That is, the detection unit 122 of the second vehicle C2 sequentially executes a detection process to detect a specific object in the specific image data generated in step S604, and outputs the detection result to the operation control unit 123. If a specific object is detected from the specific image data, the process proceeds to step S608. On the other hand, if a specific object is not detected from the specific image data, the process proceeds to step S610.

[0108] In step S608, the operation control unit 123 of the second vehicle C2 transmits specific object detection information regarding the specific object detected in step S607 to the monitoring server 200. This specific object detection information includes, for example, the detection position of the specific object in the specific image data (imaging range), the size of the specific object, identification information for identifying the specific object, and the direction of movement of the specific object. However, if the second vehicle C2 is located outside the range of the mobile communication network, communication with the monitoring server 200 is not possible, and therefore this transmission process is not performed.

[0109] In step S609, the detection unit 122 of the second vehicle C2 performs tracking of the specific object detected in step S607. As described above, the monitoring server 200 also performs tracking of the specific object, but the second vehicle C2 may also perform tracking of the specific object. In this case, the processing results of the tracking process are sequentially transmitted to the monitoring server 200. This makes it possible to improve the accuracy of the tracking process of the monitoring server 200. Note that if the second vehicle C2 is located outside the range of the mobile communication network, communication with the monitoring server 200 is not possible, so the tracking of the specific object is performed inside the second vehicle C2. In this case, for example, if the image acquisition unit 115 is movable, the image acquisition unit 115 may be moved to track the specific object.

[0110] In step S610, the operation control unit 123 of the second vehicle C2 determines whether the end timing for the specific image data corresponding to the detection information or notification information received in step S601 has arrived. This end timing can be the same as in the example shown in Figure 4. If the end timing for the specific image data has arrived, the process proceeds to step S611. On the other hand, if the end timing for the specific image data has not arrived, the process returns to step S604.

[0111] In step S611, the operation control unit 123 of the second vehicle C2 determines whether the mobile communication network is available. For example, if the second vehicle C2 is parked in a location where the mobile communication network is out of range, it is determined that the mobile communication network is unavailable. If the mobile communication network is available, the process proceeds to step S612. On the other hand, if the mobile communication network is unavailable, the process proceeds to step S613.

[0112] In step S612, the operation control unit 123 of the second vehicle C2 transmits the specific image data generated in step S604 and recorded in the image data storage unit 131 to the monitoring server 200 using a mobile communication network.

[0113] In step S613, the operation control unit 123 of the second vehicle C2 determines whether or not a request for acquisition of specific image data has been received from another communication device. For example, it is assumed that a request for acquisition of specific image data may be received from the owner of the first vehicle C1, related parties (e.g., law enforcement agencies), etc. If a request for acquisition of specific image data has been received from another communication device, the process proceeds to step S614. On the other hand, if there is no request for acquisition of specific image data from another communication device, the operation of the specific image data recording process is terminated. It is preferable that the process in step S613 be continued for a predetermined time (e.g., several minutes to several hours) after the completion timing of the specific image data. It may also be performed as needed after the predetermined time has elapsed.

[0114] In step S614, the operation control unit 123 of the second vehicle C2 transmits the specific image data generated in step S604 and recorded in the image data storage unit 131 directly to the communication device that requested acquisition in step S613, using wireless communication. For example, it is possible to transmit directly from the monitoring device 110 of the second vehicle C2 to the communication device that requested acquisition in step S613 using short-range wireless communication (wireless LAN, Bluetooth, etc.). In this example, the specific image data is shown to be transmitted directly using wireless communication, but it may also be transmitted directly using a wired line, or transferred using a recording medium (for example, a USB (Universal Serial Bus) memory). Furthermore, for example, if the second vehicle C2 moves into the range of a mobile communication network, it may be transmitted using the mobile communication network.

[0115] For example, when user U1, who has been away from vehicle C1, returns to the location of vehicle C1, it is conceivable that the interior of vehicle C1 may have changed. In this case, it is conceivable that the person who caused the change (a specific person) may not be visible in the image data generated by the image acquisition unit 115 of vehicle C1. Even in such a case, user U1 can use the electronic device 300 to request the acquisition of specific image data from vehicles surrounding vehicle C1 (for example, vehicle C2), acquire the specific image data from the surrounding vehicles, and display it on the display unit of the electronic device 300. This makes it easy to acquire specific image data showing the specific person who caused the change inside vehicle C1. In this case, the provision period may be limited to a predetermined period (for example, several hours to several tens of hours), and some kind of authentication may be required as a condition for provision.

[0116] [Example of monitoring server operation] Figure 11 is a flowchart showing an example of specific image data recording processing in the monitoring server 200. This specific image data recording processing is executed by the control unit 220 (see Figure 1) based on a program stored in the storage unit 230 (see Figure 1). This specific image data recording processing will be explained with reference to Figures 1 to 10 as appropriate.

[0117] In step S621, the detection unit 221 determines whether or not it has received detection information from the vehicle being monitored. For example, as shown in Figure 7, if detection information is transmitted from the first vehicle C1, the detection unit 221 determines that it has received detection information from the first vehicle C1. If detection information is received, the process proceeds to step S622. On the other hand, if detection information is not received, the operation of the specific image data recording process is terminated.

[0118] In step S622, the output control unit 222 identifies other vehicles to which notification information is to be sent, based on the location of the vehicle that transmitted the detection information received in step S621. For example, as shown in Figure 7, a notification range CE1 can be set, and the second vehicle C2 to the fifth vehicle C5 located within this notification range CE1 can be identified.

[0119] In step S623, the output control unit 222 transmits notification information to each vehicle identified in step S622, instructing them to perform image data generation and recording processing using the image acquisition unit 115 installed in each vehicle. For example, as shown in Figure 7, notification information is transmitted to the second vehicle C2 to the fifth vehicle C5 located within the notification range CE1.

[0120] In step S624, the recording control unit 223 determines whether it has received specific image data from at least one of the vehicles that received detection information in step S621 and each of the vehicles that sent notification information in step S623. If specific image data has been received from at least one of those vehicles, the process proceeds to step S625. On the other hand, if specific image data has not been received from any of those vehicles, the process proceeds to step S626.

[0121] In step S625, the recording control unit 223 records the specific image data received in step S624 in the specific image data DB 250, associating it with the vehicle that received the detection information in step S621. For example, it records the specific image data 253 as association with the vehicle ID 251 of the target vehicle in which the vehicle ID of the vehicle that received the detection information in step S621 is stored.

[0122] In step S626, the detection unit 221 determines whether it has received specific object detection information from at least one of the vehicles that received detection information in step S621 and each of the vehicles that sent notification information in step S623. If specific object detection information has been received from at least one of those vehicles, the unit proceeds to step S627. On the other hand, if specific object detection information has not been received from any of those vehicles, the unit proceeds to step S631. It is also assumed that there may be vehicles that do not perform the specific object detection process, or vehicles that are unable to perform the specific object detection process. Therefore, the detection unit 221 may perform the specific object detection process based on the specific image data received from each of the vehicles that received detection information in step S621 and each of the vehicles that sent notification information in step S623. In this case, the detection results from each vehicle may be compared with the detection results from the monitoring server 200, and each detection result may be corrected based on the comparison result. This makes it possible to improve the accuracy of the specific object detection process.

[0123] In step S627, the detection unit 221 performs a tracking process to track the specific object based on the specific object detection information received in step S626. As described above, it is also possible to perform the specific object detection process on the monitoring server 200. In this case, the tracking process for the specific object may be performed using the specific object detection result (specific object detection information) performed on the monitoring server 200. Alternatively, the tracking process for the specific object may be performed using both the specific object detection information from each vehicle and the specific object detection information from the monitoring server 200.

[0124] In step S628, the output control unit 222 estimates the direction of movement of the specific object based on the tracking process result in step S627 and determines whether or not the specific object may move outside the notification range. Here, the notification range means the range in which the vehicle to which the notification information is to be transmitted is located. The method for determining whether or not the specific object may move outside the notification range is the same as in the example shown in Figure 8. If there is a possibility that the specific object will move outside the notification range, the process proceeds to step S629. On the other hand, if there is no possibility that the specific object will move outside the notification range, the process proceeds to step S631.

[0125] In step S629, the output control unit 222 identifies other vehicles to which notification information will be newly transmitted, based on the direction of movement of the specific object estimated from the tracking process results in step S627. For example, as shown in Figure 8, a notification range CE2 can be set, and an eighth vehicle C8 located within this notification range CE2 can be identified.

[0126] In step S630, the output control unit 222 sends new notification information to each vehicle identified in step S629, instructing them to perform image data generation and recording processing using the image acquisition unit 115 installed in each vehicle.

[0127] In step S631, the output control unit 222 determines whether the end timing for the specific image data corresponding to the detection information received in step S621 has arrived. This end timing can be, for example, when an instruction to end the specific image data is received from the vehicle that transmitted the detection information received in step S621, or when a predetermined time has elapsed since the detection information was received. If the end timing for the specific image data has arrived, the process proceeds to step S632. On the other hand, if the end timing for the specific image data has not arrived, the process returns to step S624.

[0128] In step S632, the output control unit 222 sends termination information to all vehicles that sent notification information in steps S623 and S630, informing them to terminate the generation and recording processes of specific image data. Upon receiving this termination information, each vehicle terminates the generation and recording processes of specific image data. Alternatively, warning information may be sent to the electronic devices of the owners of the vehicle that received detection information in step S621 and each vehicle that sent notification information in step S623, informing them that a specific event that could potentially expose them to danger has been detected around their respective vehicles. For example, by registering identification information (e.g., device ID) related to the electronic devices of each vehicle owner in association with the vehicle ID 241 (see Figure 2) of each vehicle in the monitoring server 200, it is possible to send warning information to each owner's electronic device. This makes it possible for the owners of the first vehicle C1 and each vehicle in its vicinity to quickly and easily understand that a specific event that could potentially expose them to danger has been detected around their vehicles.

[0129] Furthermore, specific image data stored in the specific image data DB 250 of the monitoring server 200 can be provided upon request from the owner of the vehicle, related parties (e.g., law enforcement agencies), etc., corresponding to the vehicle ID stored in the vehicle ID 251 of the target vehicle.

[0130] Furthermore, for other vehicles (for example, second vehicle C2) surrounding the first vehicle C1 that detected the specific event, the system may perform processes such as generating and recording specific image data, as well as activating the anti-theft system.

[0131] [Example of recording specific image data using equipment other than in-vehicle equipment] Figure 12 schematically shows an example in which the generation and recording processes of specific image data are performed by other equipment based on detection information output from the first vehicle C1. Note that Figure 12 is a modified version of parts of Figures 5 and 7, differing in that it uses the electronic device MC1 and imaging device IM1 owned by user U2. Note that other than this point, it is the same as Figures 5 and 7, so the same reference numerals are used for the common parts and the explanation of the common parts is omitted.

[0132] The electronic device MC1 is a portable device equipped with an imaging unit, and is, for example, an electronic device or information processing device such as a smartphone, tablet terminal, or portable personal computer. Furthermore, the electronic device MC1 is capable of performing the processing necessary to record specific image data, among the processing of the detection unit 122 and the operation control unit 123 of the monitoring device 110 (see Figure 1). Also, for example, if user U2 is riding in a vehicle where the monitoring device 110 is not installed, user U2 can bring the electronic device MC1 into the vehicle, enabling the electronic device MC1 to perform the same detection processing, control processing, etc. as the monitoring device 110.

[0133] The imaging device IM1 is an imaging device installed indoors or outdoors, such as a surveillance camera installed in a parking lot, or a surveillance camera installed inside or outside various facilities (e.g., commercial facilities, public facilities). Furthermore, the imaging device IM1 is capable of performing the processing necessary to record specific image data among the processing of the detection unit 122 and the motion control unit 123 of the monitoring device 110 (see Figure 1).

[0134] Furthermore, specific image data generated by the electronic device MC1 and the imaging device IM1 may be stored on the device itself or transmitted to another device for storage.

[0135] For example, when detection information is output from the first vehicle C1, the electronic device MC1 and the imaging device IM1 can directly receive the detection information or receive notification information transmitted from the monitoring server 200 in response to the detection information. In this case, the electronic device MC1 and the imaging device IM1 execute the generation and recording processes for specific image data. For example, it is conceivable that there are no other vehicles near the first vehicle C1. In this case, it is conceivable that it may be difficult to appropriately acquire specific image data related to the specific event detected by the first vehicle C1. Therefore, as shown in Figure 12, the generation and recording processes for specific image data are performed using other equipment other than the vehicle (for example, the electronic device MC1 and the imaging device IM1). This makes it possible to appropriately acquire specific image data related to the specific event detected by the first vehicle C1.

[0136] [Example of recording specific image data when a specific event is detected by equipment other than a vehicle] Figure 13 schematically shows an example of recording specific image data related to a specific event when a specific event is detected by electronic equipment MC2. Figure 13 is a modified version of a part of Figure 12, differing in that the equipment that detected the specific event is electronic equipment MC2 owned by user U3, instead of the first vehicle C1. Note that, apart from this point, it is the same as Figure 12, so the same reference numerals are used for the common parts and the explanation of the common parts is omitted.

[0137] Figure 13 shows an example, similar to the example in Figure 12, where the generation and recording processes of specific image data are also performed by devices other than in-vehicle equipment. However, the same method is applicable even when the generation and recording processes of specific image data are performed only by in-vehicle equipment.

[0138] The electronic device MC2 is a portable device, such as a smartphone, tablet, or portable personal computer, or an information processing device. The electronic device MC2 is also capable of performing the necessary processing for outputting (or transmitting) detection information from the detection unit 122 and the operation control unit 123 of the monitoring device 110 (see Figure 1). For example, if user U3 is riding in a vehicle where the monitoring device 110 is not installed, user U3 can bring the electronic device MC2 into the vehicle, enabling the electronic device MC1 to perform the same detection processing and control processing as the monitoring device 110. Based on user U3's operations, the electronic device MC2 may detect specific events that could endanger the electronic device MC2 (or user U3). For example, user U3 can cause the electronic device MC2 to detect that a specific event that could endanger the electronic device MC2 (or user U3) has occurred by performing a predetermined operation on the electronic device MC2 (for example, selecting the danger button).

[0139] For example, when detection information is output from the electronic device MC2, the electronic device MC1, the imaging device IM1, and the second vehicle C2 to the eighth vehicle C8 (vehicles capable of receiving detection information or notification information) execute the process of generating and recording specific image data. In this way, if a specific event occurs that could endanger user U3 who possesses the electronic device MC2, the electronic device MC2 detects the specific event and outputs detection information. This makes it possible to use the equipment surrounding the electronic device MC2 to execute the process of generating and recording specific image data. For example, the in-vehicle equipment and imaging device IM1 of parked vehicles (second vehicle C2 to eighth vehicle C8) can generate specific image data at a fixed position. Therefore, it becomes possible to appropriately acquire specific image data related to the specific event detected by the electronic device MC2.

[0140] [Example of the effects of this embodiment] In this embodiment, when a specific event is detected in the first vehicle C1 (or electronic device MC2), the monitoring device 110 can quickly notify surrounding vehicles of this fact. For example, detection information may be output using sound signals, optical signals, etc., to notify surrounding vehicles, or detection information may be transmitted to the monitoring server 200, and the monitoring server 200 may transmit notification information to surrounding vehicles. Other vehicles that receive the detection information (or notification information) can then perform the activation process of the image acquisition unit 115, the generation process of specific image data, and the recording process as necessary. As a result, it is possible to generate and record specific image data related to the specific event detected in the first vehicle C1 (or electronic device MC2) more appropriately. For example, it is possible to appropriately acquire and save data (evidence) of obstacles judged to be dangerous. Furthermore, the specific image data recorded in this way can be easily acquired by the users U1, U3, and other related parties of the first vehicle C1 (or electronic device MC2).

[0141] Furthermore, if a specific event is detected in the first vehicle C1, it is possible to quickly inform surrounding vehicles that the same event may occur around them. In other words, not only does the first vehicle C1 proactively and explicitly notify of the detection information, but surrounding vehicles can proactively and actively receive that detection information. As a result, surrounding vehicles can react quickly even before their own vehicles are in danger and can take some kind of countermeasure (for example, activating an anti-theft system).

[0142] [Examples of executing processing on other devices or systems] In the above examples, detection processing, control processing, etc., are shown to be executed on the monitoring device 110 (or monitoring system 1). However, all or part of each of these processes may be executed on other devices. In this case, the information processing system is composed of each device that executes part of each of these processes. For example, at least part of each process can be executed using various information processing devices and various electronic devices such as in-vehicle devices, user-accessible devices (e.g., smartphones, tablet terminals, personal computers, car navigation systems, IVIs), and servers that can be connected via a predetermined network such as the Internet.

[0143] Furthermore, some (or all) of the information processing system capable of performing the functions of the monitoring device 110 (or monitoring system 1) may be provided by an application that can be provided via a predetermined network such as the Internet. This application may be, for example, SaaS (Software as a Service).

[0144] [Configuration Example and Effects of This Embodiment] The monitoring method according to this embodiment is a vehicle monitoring method performed using a first vehicle C1 and a second vehicle C2 located around the first vehicle C1, which is equipped with an image acquisition unit 115 (an example of an imaging device) capable of capturing images of external subjects. This monitoring method includes a detection process (steps S501, S521, S601) for detecting a specific event that may endanger the first vehicle C1, a notification process (steps S502, S522, S533) for notifying the outside of the first vehicle C1 of the detection information when the specific event is detected, and a control process (steps S511, S512, S541, S542, S601 to S604) for generating image data by the image acquisition unit 115 of the second vehicle C2 when the second vehicle C2 receives the detection information (or notification information). The monitoring program according to this embodiment is a program that causes a computer to execute each of these processes. In other words, the monitoring program according to this embodiment is a program that causes a computer to implement each of the functions that the monitoring system 1 can perform.

[0145] Furthermore, the monitoring method according to this embodiment is a monitoring method that is performed using a first device (electronic device MC2) and a second device (electronic device MC1, imaging device IM1, second vehicle C2 to eighth vehicle C8) located around the first device and equipped with an image acquisition unit 115 (an example of an imaging device) capable of capturing images of external subjects. This monitoring method includes a detection process (steps S501, S521, S601) for detecting a specific event that may endanger the first device, a notification process (steps S502, S522, S533) for notifying the outside of the first device of the detection information when the specific event is detected, and a control process (steps S511, S512, S541, S542, S601 to S604) for generating image data by the image acquisition unit 115 of the second device when the second device receives the detection information (or notification information). Furthermore, the monitoring program according to this embodiment is a program that causes a computer to execute each of these processes. In other words, the monitoring program according to this embodiment is a program that causes a computer to implement each of the functions that the monitoring system 1 can perform.

[0146] With these configurations, if a specific event is detected in the first vehicle C1 (or electronic device MC2), the monitoring device 110 can quickly notify surrounding vehicles of this fact. Therefore, it is possible to more appropriately generate and record specific image data related to the specific event detected in the first vehicle C1 (or electronic device MC2). Furthermore, the users U1, U3, and other related parties of the first vehicle C1 (or electronic device MC2) can easily acquire the specific image data recorded in this manner.

[0147] In the monitoring method according to this embodiment, in the control process (steps S512, S542, S602 to S604), if the image acquisition unit 115 (an example of an imaging device) is running when a specific event is detected, the image data generated by the image acquisition unit 115 from that point onward is recorded in the image data holding unit 131 as specific image data relating to the specific event. If the image acquisition unit 115 is not running when a specific event is detected, the image acquisition unit 115 is started, the image acquisition unit 115 generates image data after startup, and the image data is recorded in the image data holding unit 131 as specific image data.

[0148] With this configuration, even if the image acquisition unit 115 of other vehicles surrounding the vehicle that detected the specific event is turned off, it is possible to activate the image acquisition unit 115 and generate specific image data. Furthermore, since it is possible to record only the image data related to the specific event from the image data generated by the image acquisition unit 115 of other vehicles as specific image data, it becomes easy to identify the specific image data related to the specific event.

[0149] In the monitoring method according to this embodiment, the method further includes a position acquisition process (steps S532, S622) for acquiring the position of the first vehicle C1 and the positions of other vehicles present around the first vehicle C1. In the notification process (steps S533, S623), the position of the first vehicle C1 at the time a specific event is detected is used as the reference position, and other vehicles present within a predetermined range (notification range CE1) from that reference position are identified as the second vehicle C2, and detection information (or notification information) is transmitted to the second vehicle C2 using wireless communication.

[0150] This configuration makes it possible to transmit detection information (or notification information) to other vehicles located within a predetermined range (notification range CE1) with the position of the first vehicle C1 as the reference position. Therefore, it is possible to appropriately record specific image data using the image acquisition unit 115 of vehicles relatively close to the first vehicle C1. Furthermore, since the image acquisition unit 115 of vehicles relatively far from the first vehicle C1 is not used, it is possible to reduce the power consumption of the entire monitoring system 1.

[0151] In the monitoring method according to this embodiment, the notification process (step S502) uses signals (optical signals, sound signals) that can be emitted from the first vehicle C1 to notify the second vehicle C2 of the detection information.

[0152] With this configuration, for example, detection information can be appropriately notified to other vehicles that are not being monitored by the monitoring server 200, or to other vehicles that are outside the service area.

[0153] In the monitoring method according to this embodiment, the control process (steps S543, S535, S611 to S614) executes control to provide specific image data from the second vehicle C2 to the monitoring server 200 or electronic device 300 (an example of an external terminal) using wireless or wired communication.

[0154] With this configuration, specific image data generated in the second vehicle C2 is transmitted to the monitoring server 200, allowing the monitoring server 200 to manage the specific image data. This makes it possible to appropriately provide the specific image data to the user U1 of the first vehicle C1, related parties, etc. Furthermore, since the specific image data generated in the second vehicle C2 can be transmitted to the electronic device 300, the user U1 of the first vehicle C1 can quickly and easily acquire the specific image data.

[0155] In the monitoring method according to this embodiment, the control process (steps S611 to S614) performs at least one of the following: a first provision process that provides specific image data to an external terminal (e.g., electronic device 300) using wireless communication without requiring authentication, and a second provision process that provides specific image data to the external terminal on the condition that authentication has been performed.

[0156] According to this configuration, the first provisioning process makes it possible to extract specific image data generated in another vehicle (e.g., second vehicle C2) from the other vehicle (e.g., second vehicle C2) or the monitoring server 200 without requiring authentication. In other words, it is possible to make the specific image data generated in the other vehicle (e.g., second vehicle C2) publicly available, making it possible for anyone to obtain the specific image data. However, predetermined conditions such as a publication period may be set. Furthermore, the second provisioning process makes it possible to extract specific image data generated in another vehicle (e.g., second vehicle C2) from the other vehicle (e.g., second vehicle C2) or the monitoring server 200 on the condition of authentication. In other words, it makes it possible for only authenticated devices to extract specific image data generated in the other vehicle (e.g., second vehicle C2). This makes it possible, for example, for only specific individuals (user U1 of first vehicle C1, related parties (e.g., police officers)) to obtain the specific image data.

[0157] In the monitoring method according to this embodiment, a detection process (step S605) for detecting the brightness around the second vehicle C2 is further included, and in the control process (step S606), if the brightness around the second vehicle C2 is below a reference value, control is performed to turn on the light-emitting unit 150 of the second vehicle C2.

[0158] With this configuration, when the area around the second vehicle C2 is relatively dark, turning on the light-emitting unit 150 of the second vehicle C2 can enhance the deterrent effect against crime against the second vehicle C2, and it is possible to clearly acquire information about specific objects.

[0159] In the monitoring method according to this embodiment, the method further includes a position acquisition process (step S629) for acquiring the position of a first vehicle C1 and the positions of a plurality of second vehicles C2 present around the first vehicle C1; a specific object detection process (step S626) for detecting a specific object that may endanger the first vehicle C1 and relates to a specific event from first image data generated by an image acquisition unit 115 (an example of an imaging device) of the first vehicle C1 and second image data generated by an image acquisition unit 115 (an example of an imaging device) of the second vehicle C2; ​​and an estimation process (step S627) for estimating the direction of movement of the specific object detected from the first and second image data. In the control process (steps S629, S630), new image data is generated by the image acquisition unit 115 of a new second vehicle C2 based on the direction of movement of the specific object estimated in the estimation process.

[0160] With this configuration, the image acquisition unit 115 of the vehicle in the direction in which the specific object is moving can generate new image data, making it possible to appropriately track the specific object.

[0161] The monitoring server 200 (or monitoring device 110, electronic device MC2, hereinafter the same) is a monitoring device capable of managing a first vehicle (or equipment other than in-vehicle equipment, hereinafter the same) and a second vehicle located around the first vehicle C1, which is equipped with an image acquisition unit 115 (an example of an imaging device) capable of capturing images of external subjects. The monitoring server 200 includes a detection unit 221 (or detection unit 122) that detects specific events that may endanger the first vehicle based on detection information from the first vehicle C1, and an output control unit 222 (or operation control unit 123) (an example of a control unit) that, when a specific event is detected, transmits notification information to the second vehicle C2 to instruct the image acquisition unit 115 of the second vehicle C2 to generate image data. Alternatively, instead of the monitoring server 200, an information processing system composed of multiple devices capable of executing each of the processes realized by the monitoring server 200 may be used.

[0162] With this configuration, if a specific event is detected in the first vehicle C1, the monitoring server 200 can quickly notify surrounding vehicles of this fact. Therefore, it is possible to more appropriately generate and record specific image data related to the specific event detected in the first vehicle C1. Furthermore, the user U1 of the first vehicle C1, related parties, etc., can easily obtain the specific image data recorded in this way.

[0163] The processing steps shown in this embodiment are merely examples of how to implement this embodiment. The order of some of the processing steps may be changed, some of the processing steps may be omitted, or other processing steps may be added, as long as the embodiment is feasible.

[0164] Furthermore, each process in this embodiment is executed based on a program that causes a computer to perform various processing procedures. This embodiment can also be understood as an embodiment of a program that realizes the function of executing each of these processes, and a recording medium that stores that program. For example, by an update process to add new functions to the monitoring system, the program can be stored in the storage device of the monitoring system. This makes it possible to have the updated monitoring system perform each of the processes shown in this embodiment.

[0165] Although embodiments of the present invention have been described above, these embodiments merely illustrate examples of how the present invention can be applied, and are not intended to limit the technical scope of the present invention to the specific configurations of the embodiments described above.

Claims

1. A vehicle monitoring method performed using a first vehicle and a second vehicle located around the first vehicle and equipped with an imaging device capable of capturing images of external subjects, the monitoring method comprising: a detection process for detecting a specific event that may endanger the first vehicle; a notification process for notifying the area outside the first vehicle of the detection information when the specific event is detected; and a control process for generating image data using the imaging device of the second vehicle when the second vehicle receives the detection information.

2. A monitoring method according to claim 1, wherein the control process includes: if the imaging device is running at the time the specific event is detected, the image data generated by the imaging device from that time onward is recorded as specific image data relating to the specific event; and if the imaging device is not running at the time the specific event is detected, the control process is executed to start the imaging device, cause the imaging device to generate image data after startup, and record the image data as the specific image data.

3. A monitoring method according to claim 1, further comprising a position acquisition process for acquiring the position of the first vehicle and the positions of other vehicles present around the first vehicle, wherein the notification process includes using the position of the first vehicle at the time the specific event is detected as a reference position, identifying other vehicles present within a predetermined range from the reference position as second vehicles, and transmitting the detection information to the second vehicle using wireless communication.

4. A monitoring method according to claim 1, wherein the notification process uses a signal that can be emitted from the first vehicle to notify the second vehicle of the detection information.

5. A monitoring method according to claim 2, wherein the control process performs control for providing the specific image data from the second vehicle to an external terminal using wireless communication or wired communication.

6. A monitoring method according to claim 5, wherein the control process performs at least one of the following: a first provisioning process that provides the specific image data to the external terminal using wireless communication without requiring authentication; and a second provisioning process that provides the specific image data to the external terminal on the condition that authentication has been performed.

7. A monitoring method according to claim 1, further comprising a detection process for detecting the brightness around the second vehicle, wherein the control process executes a control to turn on the light-emitting part of the second vehicle if the brightness around the second vehicle is below a reference value.

8. A monitoring method according to claim 1, further comprising: a position acquisition process for acquiring the position of the first vehicle and the positions of a plurality of second vehicles present around the first vehicle; a specific object detection process for detecting a specific object relating to the specific event that may endanger the first vehicle from first image data generated by an imaging device provided on the first vehicle and second image data which is said to be the image data; and an estimation process for estimating the direction of movement of the specific object detected from the first image data and the second image data, wherein the control process causes the imaging device of a new second vehicle to generate new image data based on the direction of movement of the specific object estimated in the estimation process.

9. A monitoring device capable of managing a first vehicle and a second vehicle located around the first vehicle and equipped with an imaging device capable of capturing images of external subjects, comprising: a detection unit that detects a specific event that may endanger the first vehicle based on detection information from the first vehicle; and a control unit that, when the specific event is detected, transmits notification information to the second vehicle to instruct the second vehicle to generate image data using the imaging device of the second vehicle.

10. A monitoring program that causes a computer to execute the monitoring method described in claim 1.

Images