Vehicle monitoring method and vehicle monitoring system

Abstract

To provide a vehicle monitoring method and a vehicle monitoring system that enable a user to visually check how the user's vehicle is being monitored, thereby giving the user a sense of security.SOLUTION: The present invention provides a vehicle monitoring method in a vehicle monitoring system comprising: a plurality of vehicles each equipped with an acquisition unit that monitors an outside of the vehicle to acquire external information, a display unit, and a communication unit that sends and receives the external information; and a server that can send and receive information to and from the plurality of vehicles. The server is configured to: acquire location information of the plurality of vehicles located within a predetermined range; and transmit vehicle information based on the acquired location information to the plurality of vehicles located within the predetermined range or to terminals related to the plurality of vehicles.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a vehicle monitoring method and a vehicle monitoring system. [Background technology]

[0002] Patent Document 1 discloses a parking lot monitoring system. This system is configured to use images captured by multiple on-site monitoring cameras installed in the parking lot and images of a target vehicle taken from vehicles other than the target vehicle as monitoring images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-118473 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with the above system, the user of the target vehicle is not informed of how the target vehicle is being photographed from cameras other than the on-site surveillance cameras, which means that the user does not feel sufficiently secure.

[0005] The present invention has been made to solve the above-mentioned problems, and aims to provide a vehicle monitoring method and a vehicle monitoring system that allow a user to visually see how their vehicle is being monitored, giving the user a sense of security. [Means for solving the problem]

[0006] The present invention is a vehicle monitoring method in a vehicle monitoring system comprising a plurality of vehicles each equipped with an acquisition unit that monitors the outside of the vehicle and acquires external information, a display unit, and a communication unit that transmits and receives the external information, and a server that can transmit and receive information to and from the plurality of vehicles, wherein the server acquires location information of the plurality of vehicles located within a specified range, and transmits vehicle information based on the acquired location information to at least one of the plurality of vehicles located within the specified range and terminals associated with the plurality of vehicles. [Effects of the Invention]

[0007] According to the present invention, it is possible to visually confirm how the user's vehicle is being monitored, thereby giving the user a sense of security. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a schematic diagram of a vehicle monitoring system according to an embodiment of the present invention; [Figure 2] FIG. 2 is a block diagram showing the hardware configuration of a monitoring server. [Figure 3] FIG. 2 is a block diagram showing the hardware configuration of the vehicle system. [Figure 4] 4 is a flowchart showing the operation of the vehicle monitoring system under normal conditions. [Figure 5] FIG. 10 is a diagram showing a screen of a user terminal in a vehicle monitoring system under normal conditions. [Figure 6] FIG. 2 is a diagram showing the screen of a vehicle display in a vehicle monitoring system under normal conditions. [Figure 7] 10 is a flowchart showing the operation of the vehicle monitoring system when a suspicious person intrudes. [Figure 8] FIG. 10 is a diagram showing the screen of a vehicle display in a vehicle monitoring system when an injection intrudes. [Figure 9] 9 is a diagram showing another example of the screen of the vehicle display shown in FIG. 8. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0009] A vehicle monitoring system according to one embodiment of the present invention will be described below with reference to the drawings. This system includes a server 1, multiple vehicles 2, and multiple user terminals 3, all of which are connected via a network 4. The vehicles 2 monitored by this vehicle monitoring system are vehicles that have been registered with the vehicle monitoring system in advance. For example, vehicles that have been registered with the vehicle monitoring system by their users, either free of charge or for a fee, are monitored. Alternatively, vehicles from the same automobile manufacturer can be registered in advance by the automobile manufacturer, so that the vehicle monitoring system can be used immediately upon delivery of the vehicle. The configuration of the vehicle monitoring system will be described in detail below.

[0010] <1. Vehicle monitoring server hardware configuration> Fig. 2 is a block diagram showing the hardware configuration of a server according to this embodiment. As shown in Fig. 2, the server 1 is configured by a computer including a control unit 11, a storage unit 12, a communication interface 13, etc. In Fig. 2, the communication interface 13 is referred to as "communication I / F." This also applies to Fig. 3, which will be described later.

[0011] The control unit 11 includes a CPU, RAM, ROM, etc., and is configured to execute various information processes based on programs and various data. The storage unit 12 is configured with an auxiliary storage device such as an HDD or SSD, and stores a program 121, vehicle-related data 122, various data 123, etc.

[0012] As will be described later, the program 121 is a program for executing vehicle monitoring processing in the server 1, and various monitoring processing executed in the server 1 is performed based on this program. The vehicle-related data 122 includes vehicle position information transmitted and received from the server 1, images captured by the vehicle, detection information when a suspicious person's intrusion is detected, information about the associated user terminal 3, and the like. The various data 123 includes data about the vehicle monitoring system, data for operating the server 1, and the like. However, the storage destination of the data is not particularly limited and can be changed as appropriate. For example, at least a portion of the data stored in the memory unit 12 can also be stored in the RAM or ROM of the control unit 11.

[0013] The communication interface 13 includes, for example, a wireless device that is an interface such as a wireless LAN. The wireless device includes, for example, a wireless module such as Wi-Fi (registered trademark) or Bluetooth (registered trademark). This allows the vehicle system to be connected to a network such as a wireless LAN, a public network such as the Internet, or a wireless network such as a mobile phone network including a communication base station.

[0014] The server 1 does not have to be configured by one computer, but can be configured by a plurality of computers or devices in which the above-mentioned components 11 to 13 are distributed.

[0015] 2. Vehicle system hardware configuration Fig. 3 is a block diagram showing the hardware configuration of the vehicle system according to this embodiment. As shown in Fig. 3, the vehicle system is a system provided in each vehicle 2, and is composed of at least one computer including a control unit 21, a storage unit 22, a display (display unit) 23, a vibration sensor 24, an on-board camera (acquisition unit) 25, a speaker 26, a communication interface (communication unit) 27, a GPS radio wave receiving unit 28, etc.

[0016] The control unit 21 includes a CPU, RAM, ROM, etc., and is configured to execute various information processes based on programs and various data. The storage unit 22 is configured with an auxiliary storage device such as an HDD or SSD, and stores a program 221, captured image data 222, vehicle data 223, map data 234, various data 225, etc.

[0017] As will be described later, program 221 is a program for executing monitoring processing in the vehicle, and various processes for monitoring executed in the vehicle are performed based on this program. Also, as will be described later, this program 221 displays on display 23 the position of the vehicle itself acquired by GPS radio wave receiving unit 28 and the positions of surrounding vehicles capable of mutual monitoring acquired from server 1, superimposed on a surrounding map read from map data 224.

[0018] The captured image data 222 is data relating to captured images captured by the in-vehicle camera 25. The vehicle data 223 is data relating to the position of the vehicle 2 acquired by the GPS radio wave receiving unit 28 or Wi-Fi, and the positions of surrounding vehicles transmitted from the server 1. The map data 224 is data for generating a map to be displayed on the display 23. Map data from a navigation system may also be used as this map data 224. The various data 225 is data for operating the vehicle system, etc. However, the storage destination of the data is not particularly limited and can be changed as appropriate. For example, at least a portion of the data stored in the memory unit 22 may be stored in the RAM or ROM of the control unit 21.

[0019] The display 23 is a display installed in front of the driver's seat to display instruments, etc., or a display installed on the dashboard. Such a display 23 can be formed of a liquid crystal display or the like, or may be a touch panel display.

[0020] The vibration sensor 24 detects vibrations of the vehicle 2, and in particular, detects vibrations that occur in the vehicle 2 when the vehicle 2 is parked (when the engine or motor is stopped). In this embodiment, the purpose is to detect intrusion or contact of a suspicious person into the vehicle when the vehicle is parked.

[0021] The vehicle-mounted camera 25 is composed of four cameras that capture images of the front, right, left, and rear outside the vehicle, and one camera that captures images inside the vehicle. The camera that captures images inside the vehicle is configured to mainly capture images around the driver's seat. Alternatively, a camera in a drive recorder can be used as the vehicle-mounted camera 25 of this embodiment. Furthermore, the number and positions of the vehicle-mounted cameras 25 are not particularly limited, and for example, three or less or five or more cameras for the exterior of the vehicle and two or more cameras for the interior of the vehicle can be provided.

[0022] The speaker 26 emits a warning sound to alert any suspicious person who may be entering the vehicle, but can also be used as a speaker for audio inside the vehicle.

[0023] The communication interface 27 includes a wireless device, such as an interface for a wireless LAN. The wireless device includes a wireless module for Wi-Fi (registered trademark), Bluetooth (registered trademark), etc. This allows the vehicle system to be connected to a network, such as a wireless LAN, a public network such as the Internet, or a wireless network such as a mobile phone network including a communication base station.

[0024] The GPS radio wave receiving unit 28 receives radio waves from three or more GPS satellites to obtain the vehicle position.

[0025] <3. User Device> The user terminal 3 is a known portable computer such as a smartphone or tablet computer owned by the user of the vehicle 2. The user terminal 3 has at least a communication function that enables communication with the server 1 and a display that can display information received from the server 1.

[0026] Furthermore, each user terminal 3 is associated with a vehicle 2 owned by the user of the user terminal 3, and is stored in the server 1 as part of the data 122 relating to the vehicle.

[0027] <4. Operation of the vehicle monitoring system> Next, we will explain the operation of the monitoring system configured as above. Below, we will explain (1) the operation of the monitoring system under normal circumstances, and (2) the operation of the monitoring system when a suspicious person enters one of the vehicles.

[0028] <4-1. Operation of the monitoring system under normal circumstances> The operation of the vehicle monitoring system under normal circumstances will be described with reference to the flowchart of FIG.

[0029] First, when the vehicle 2 starts parking (step S111), the vehicle system transmits its position information to the server 1 (step S112). For example, the vehicle 2 starts parking by stopping the engine, or, in the case of an electric vehicle, by turning off the power to the motor.

[0030] When the server 1 determines that two or more vehicles are parked within a predetermined range, it extracts these vehicles as vehicles that can be mutually monitored (step S121). Various settings are possible for the term "vehicles within a predetermined range." For example, it can be defined as vehicles within a range where each vehicle can capture an image of the other vehicles with its onboard camera (if vehicles A, B, and C can capture an image of each other, vehicles A, B, and C are considered to be within the predetermined range). Alternatively, if other vehicles are parked around a certain vehicle, and all of these vehicles can be captured by another vehicle, all of the vehicles that can be captured can be considered to be within the predetermined range (if vehicles A, B, and C can be captured by other vehicles, vehicles A, B, and C are considered to be within the predetermined range).

[0031] Next, the server 1 transmits vehicle information to the vehicle 2 capable of mutual monitoring and the user terminal 3 of the user of the vehicle 2 (step S122). The vehicle information is, for example, vehicle location information. As a result, a map showing the user's vehicle and vehicles capable of mutual monitoring, along with a message indicating that other vehicles are monitoring the user's vehicle, is displayed on the display of the user terminal 3, as shown in FIG. 5 (step S131). In FIG. 5, the user's vehicle is indicated by a car mark, and surrounding vehicles capable of mutual monitoring are indicated by star marks. Furthermore, as shown in FIG. 6, a similar display is also made on the display 23 of the vehicle 2 (step S113). In this case, even if the engine or the like is stopped, if it is detected that a person is sitting in the driver's seat or passenger seat inside the vehicle, a screen such as that shown in FIG. 6 can be temporarily displayed on the display of the vehicle 2. Note that in step S122, the vehicle information can also be transmitted to either the vehicle 2 or the user terminal 3.

[0032] Through the above-described processing, the user can recognize that mutual monitoring is being carried out by a plurality of vehicles 2, including the user's own vehicle 2.

[0033] <4-2. How the surveillance system behaves when a suspicious person intrudes> The operation of the vehicle monitoring system under normal circumstances will be described with reference to the flowchart of Fig. 7. The flowchart of Fig. 7 shows the processing that continues from the flowchart of Fig. 4.

[0034] First, when a certain vehicle 2 (hereinafter referred to as the target vehicle) detects the intrusion of a suspicious person (YES in step S211), the vehicle system notifies the server of the intrusion of the suspicious person (step S212). The method for detecting the suspicious person is not particularly limited, but can be detected by the vibration sensor 24 described above. For example, if the vehicle door vibrates due to being opened in a manner other than normal unlocking, it can be determined that the intrusion of a suspicious person has occurred. However, the intrusion of a suspicious person can also be detected under other conditions, and is not particularly limited. For example, if the vehicle door is opened in a manner other than normal unlocking and the in-vehicle camera 25 detects the intrusion of a person, it can be determined that the intrusion of a suspicious person has occurred.

[0035] Alternatively, even if a suspicious person does not enter the vehicle, if a vibration of a predetermined magnitude or more is generated in the vehicle and detected, it can be determined that a suspicious person has come into contact with the vehicle. Also, the duration of the vibration can be used as a threshold for determining that a suspicious vehicle has come into contact.

[0036] When the server 1 receives the notification regarding the intrusion of a suspicious individual, it transmits vehicle information regarding vehicles capable of mutual monitoring to the target vehicle (step S221). As a result, a warning message is displayed on the display 23 of the target vehicle 2 together with a map showing the target vehicle and vehicles capable of mutual monitoring, as shown in Fig. 8 (step S213). Therefore, it is possible to notify the suspicious individual who has intruded into the target vehicle that the target vehicle 2 is being monitored by another vehicle. In this case, a warning sound can be emitted from the speaker 26 along with the display on the display 23.

[0037] The server 1 also requests other vehicles monitoring the target vehicle 2 to photograph the target vehicle 2 (step S222). In response to this, the vehicle 2 that has received the photographing request photographs the target vehicle 2 using the on-board camera 25 (step S231) and transmits the photograph to the server 1 (step S232). The server 1 receives the photographed image showing the target vehicle 2 and stores it in the storage unit 12 as part of the vehicle-related data 122 (step S223). This allows the photographed image stored in the server 1 to be used as evidence in the event that damage is caused to the target vehicle 2 due to the intrusion of a suspicious person.

[0038] <5. Features> According to this embodiment, the user is notified via the user terminal 3 or the vehicle's display 23 that mutual monitoring is being carried out between parked vehicles within a predetermined range, which gives the user a sense of security. Even if a suspicious person intrudes into a vehicle under mutual monitoring, the display 23 of that vehicle displays a warning that mutual monitoring is in progress, which can deter the suspicious person from committing a crime.

[0039] Furthermore, since mutual monitoring is performed between parked vehicles 2 within a predetermined range, no additional equipment for monitoring is required.

[0040] <6. Variations> Although one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various modifications are possible without departing from the spirit of the present invention. For example, the following modifications are possible. Furthermore, the gist of the following modifications can be appropriately combined with each other and can also be combined with the above embodiment.

[0041] (1) In the above embodiment, a map showing the target vehicle and other vehicles in its vicinity is displayed on the display 23 of the vehicle 2 or the user terminal 3. In addition, an image of the target vehicle captured by a nearby vehicle can also be displayed. For example, in the example shown in FIG. 9, a captured image 232 of the target vehicle captured by a nearby vehicle is added to the screen of the display 23 of the vehicle showing the warning in FIG. 8. This captured image can be, for example, the image captured in step 231 of FIG. 7. This can make a suspicious person who has entered a vehicle more aware that they are being monitored, further deterring them from committing a crime.

[0042] Images captured by such nearby vehicles can also be added to the screens of Figures 5 and 6. For example, in the flowchart of Figure 4, when the server 1 transmits vehicle information regarding vehicles that can be mutually monitored (step S122), it requests one of the vehicles to take an image of the target vehicle. The captured image is sent to the server 1, which then transmits it to the target vehicle and its user terminal 3. This makes it possible to generate a screen to which images captured by other vehicles are added, as shown in Figure 9. Such captured images correspond to the external information of the present invention.

[0043] (2) The vehicle information transmitted from the server 1 can be displayed on the display 23 of the vehicle 2 as described above. In addition, for example, if the vehicle 2 is equipped with an external display device, the vehicle information can be displayed on this display device. An external display device is a display device such as a display attached to the outside of the vehicle, and is used to transmit information to the outside of the vehicle. Therefore, such a display device can display a screen such as that shown in Figure 5 or Figure 6, or can display only the text shown in Figure 5 or Figure 6. This allows a suspicious person to look at the display device before entering the vehicle, which can deter them from entering the vehicle.

[0044] (3) In the above embodiment, the vibration sensor 24 detects the intrusion of a suspicious person. If it is detected that a suspicious person has engaged in an action that corresponds to a "caution" toward the target vehicle, or if it is detected that a suspicious person has engaged in an action that corresponds to a "warning" toward the target vehicle, it can notify the server 1 of this.

[0045] Actions that qualify as "caution" and "warning" can be determined based on information detected by the in-vehicle camera 25, the vibration sensor 24, etc., and thresholds can be set for the distance between the suspicious person and the target vehicle, the time spent near the target vehicle, the magnitude of the vehicle's vibration, the duration of the vibration, etc. For example, if the distance between the suspicious vehicle and the vehicle comes within a first distance, it can be determined to be a caution, and if the distance further decreases to within a second distance that is shorter than the first distance, it can be determined to be a warning.

[0046] For example, when it is detected that a suspicious person has behaved in a manner that corresponds to "caution" toward the target vehicle, it is possible to request that surrounding vehicles start taking still images or videos of the target vehicle with the in-vehicle camera 25. In this case, a map is displayed on the user terminal 3 of the user of the target vehicle, and any vehicle can be selected from the vehicles surrounding the target vehicle and requested to take still images or videos from that vehicle. Furthermore, when it is detected that a suspicious person has behaved in a manner that corresponds to "warning" toward the target vehicle, it is possible to request that surrounding vehicles emit a warning sound such as a buzzer.

[0047] (4) An emergency button may be provided on the vehicle 2, and when the emergency button is pressed, the server 1 receives the signal and requests surrounding vehicles to take still or video images.

[0048] (5) When the charge level of the battery of the vehicle 2 falls below a predetermined value, even if a request for photographing is received from the server 1, photographing can be prevented.

[0049] (6) It is also possible to provide an incentive by offering rewards to owners who give permission to take photos or provide images (videos and still images). [Explanation of symbols]

[0050] 1: Server 2: Vehicle 23: Display (display unit) 25: In-vehicle camera (acquisition unit) 27: Communication interface (communication section) 3: User terminal

Claims

1. a plurality of vehicles each including an acquisition unit that monitors the outside of the vehicle and acquires external information, a display unit, and a communication unit that transmits and receives the external information; a server capable of transmitting and receiving information to and from a plurality of the vehicles; A vehicle monitoring method in a vehicle monitoring system comprising: The server Acquire position information of a plurality of vehicles present within a predetermined range; transmitting vehicle information based on the acquired location information to at least one of the plurality of vehicles present within the predetermined range and terminals associated with the plurality of vehicles; Vehicle monitoring methods.

2. The server further receiving the external information from at least one of the plurality of vehicles present within a predetermined range; transmitting the external information to at least one of a plurality of the vehicles present within the predetermined range and terminals associated with the plurality of the vehicles; The vehicle monitoring method according to claim 1 .

3. When the vehicle within the predetermined range detects an intrusion of a suspicious person, the vehicle transmits information about the intrusion to the server, The server transmits the vehicle information to the vehicle in which the intrusion of a suspicious person is detected, The vehicle that receives the vehicle information displays the vehicle information on a display unit of the vehicle.

3. A vehicle monitoring method according to claim 1 or 2.

4. the server requests at least one vehicle present around the vehicle in which the intrusion of the suspicious person has been detected to photograph the vehicle in which the intrusion of the suspicious person has been detected; The vehicle in which the intrusion of the suspicious person has been detected transmits the photographed image to the server. The vehicle monitoring method according to claim 3.

5. The vehicle further includes an external display device, The vehicle outputs at least one of the received vehicle information and the received external information to the external display device. The vehicle monitoring method according to claim 2 .

6. a plurality of vehicles each including an acquisition unit that monitors the outside of the vehicle and acquires external information, a display unit, and a communication unit that transmits and receives the external information; a server capable of transmitting and receiving information to and from a plurality of the vehicles; A vehicle monitoring system comprising: The server Acquire position information of a plurality of vehicles present within a predetermined range; The vehicle information based on the acquired location information can be transmitted to at least one of the plurality of vehicles present within the predetermined range and terminals associated with the plurality of vehicles. Vehicle monitoring system.

Images