Display control device, display control server, display control method, and program
The display control device superimposes images from surrounding vehicles to efficiently manage and review drive recorder data, addressing complex information handling in multi-vehicle events.
Patent Information
- Application Number
- JP2023076106
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-02
- Publication Date
- 2024-11-15
AI Technical Summary
Existing drive recorder systems face challenges in efficiently managing and reviewing images from multiple vehicles to understand the circumstances of an event, as not all vehicles record relevant information, leading to complex information handling and review processes.
A display control device and method that superimposes images and information from surrounding vehicles, detected as abnormal, within a predetermined time and distance from the own vehicle, using vehicle-to-vehicle communication and cloud servers to enhance efficient review.
Enables efficient checking of drive recorder images from multiple vehicles by superimposing relevant images, allowing for a clearer understanding of the event circumstances, especially during accidents.
Smart Images

Figure 2024160772000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a display control device, a display control server, a display control method, and a program. [Background technology]
[0002] A drive recorder in a vehicle that mainly captures video outside the vehicle can record video when an event such as an accident is detected. The recorded video becomes valuable evidence for understanding the accident situation and the degree of fault of the people involved. Patent Document 1 discloses a technology that calculates the collision probability of the vehicle and transmits a record storage request to a recorder device mounted on another vehicle by vehicle-to-vehicle communication if the collision probability is equal to or greater than a predetermined value. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2011-131728 A Summary of the Invention [Problem to be solved by the invention]
[0004] According to the above-mentioned Patent Document 1, when an event such as an accident occurs, the drive recorder of another vehicle traveling around the vehicle can store the collected information without overwriting it. If the information recorded in each drive recorder of multiple vehicles including the vehicle can be collected, the amount of information that can be handled to grasp the situation at the time of the event occurrence can be increased. However, since the surrounding vehicles do not necessarily record information that is useful for grasping the situation, if the amount of information that can be handled is large, the work of confirming the information to grasp the situation at the time of the event occurrence becomes complicated. Therefore, it is desired to be able to efficiently confirm the drive recorder images of multiple vehicles including the vehicle.
[0005] The present disclosure has been made in consideration of the above, and aims to enable efficient checking of drive recorder footage of multiple vehicles, including the vehicle itself. [Means for solving the problem]
[0006] In order to solve the above-mentioned problems and achieve the object, the display control device of the present disclosure includes a memory unit that stores a host vehicle image, which is an image captured around the host vehicle, host vehicle information including at least the speed and position of the host vehicle at a predetermined time, and another vehicle image, which is an image captured around another vehicle, and other vehicle information including at least the speed and position of the other vehicle at a predetermined time, and an overlay control unit that detects an abnormality in the host vehicle or the other vehicle based on the host vehicle information and the other vehicle information, and controls the overlay display of the host vehicle image and the other vehicle image, and the overlay control unit overlays the other vehicle image of the other vehicle in which an abnormality is detected within a predetermined time from the time an abnormality is detected in the host vehicle or the other vehicle and within a first distance from the host vehicle.
[0007] The display control server of the present disclosure includes a memory unit that stores a host vehicle image, which is an image captured around the host vehicle, host vehicle information including at least the speed and position of the host vehicle at a predetermined time, another vehicle image, which is an image captured around another vehicle, and other vehicle information including at least the speed and position of the other vehicle at a predetermined time, and an overlay control unit that detects an abnormality in the host vehicle or the other vehicle based on the host vehicle information and the other vehicle information, and controls the overlay display of the host vehicle image and the other vehicle image, and the overlay control unit overlays the other vehicle image of the other vehicle in which an abnormality is detected within a predetermined time from the time an abnormality is detected in the host vehicle or the other vehicle and within a first distance from the host vehicle.
[0008] The display control method of the present disclosure includes a step of storing a host vehicle image, which is an image captured around the host vehicle, host vehicle information including at least the speed and position of the host vehicle at a predetermined time, and another vehicle image, which is an image captured around another vehicle, and other vehicle information including at least the speed and position of the other vehicle at a predetermined time, and a step of detecting an abnormality in the host vehicle or the other vehicle based on the host vehicle information and the other vehicle information, and controlling a superimposed display of the host vehicle image and the other vehicle image, wherein the step of controlling the superimposed display includes a step of superimposing the other vehicle image of the other vehicle in which an abnormality is detected within a predetermined time from the time an abnormality is detected in the host vehicle or the other vehicle and within a first distance from the host vehicle.
[0009] The program of the present disclosure includes a process for storing a host vehicle image, which is an image captured around the host vehicle, host vehicle information including at least the speed and position of the host vehicle at a predetermined time, and another vehicle image, which is an image captured around another vehicle, and other vehicle information including at least the speed and position of the other vehicle at a predetermined time, and a process for detecting an abnormality of the host vehicle or the other vehicle based on the host vehicle information and the other vehicle information, and controlling a superimposed display of the host vehicle image and the other vehicle image, wherein the process for controlling the superimposed display causes a computer to execute a process for superimposing the other vehicle image of the other vehicle in which an abnormality is detected within a predetermined time from the time an abnormality is detected in the host vehicle or the other vehicle and within a first distance from the host vehicle. Effect of the Invention
[0010] According to the present disclosure, it is possible to efficiently check drive recorder footage of multiple vehicles, including the vehicle itself. [Brief description of the drawings]
[0011] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a display control device according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram showing the configuration of the cloud server. [Diagram 3] FIG. 3 is a sequence diagram of recording event data in the cloud server. [Figure 4] FIG. 4 is a sequence diagram for acquiring event data from a cloud server. [Diagram 5] FIG. 5 is a flowchart showing the flow of the display control method of the display control device according to the first embodiment. [Figure 6] FIG. 6 is a schematic diagram showing an example of a display screen in a normal state (non-overlapping state) in the display control device and the vehicle situation at the time of display. [Figure 7] FIG. 7 is a schematic diagram showing an example of a display screen during superimposition in a display control device and the vehicle situation at the time of display. [Figure 8] FIG. 8 is a flowchart showing the flow of a display control method of the display control device according to the second embodiment. [Figure 9] FIG. 9 is a schematic diagram illustrating a transition of the vehicle situation at the time of display by the display control device. [Figure 10] FIG. 10 is a schematic diagram showing how the superimposed display of the video of another vehicle is switched on the display screen in the situation shown in FIG. [Figure 11] FIG. 11 is a flowchart showing the flow of a display control method of the display control device according to the third embodiment. [Figure 12] FIG. 12 is a schematic diagram showing an example of a display screen when superimposed in the third embodiment and the vehicle situation at the time of display. [Figure 13] FIG. 13 is a flowchart showing the flow of a display control method of the display control device according to the fourth embodiment. [Figure 14] FIG. 14 is a flowchart showing the flow of the process (subroutine) of calculating the degree of influence on the host vehicle shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, embodiments of a display control device, a display control method, and a program according to the present disclosure will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiments.
[0013] [First embodiment] 1 is a block diagram showing an example of the configuration of a display control device 10 according to the first embodiment. The display control device 10 is a device that displays video from a drive recorder 90.
[0014] In the first embodiment, for convenience, it is assumed that each vehicle traveling on a road is equipped with a drive recorder 90. Each drive recorder 90 collects vehicle information and images of the surroundings of the vehicle, and provides the vehicle information to another vehicle (another drive recorder 90) through vehicle-to-vehicle communication, and transmits the vehicle information and images of the surroundings of the vehicle to the cloud server 100. Note that vehicle-to-vehicle communication is information communication between vehicles and surrounding vehicles through wireless communication between the vehicles.
[0015] In the following, a usage pattern of the display control device 10 is assumed in which a user who owns a drive recorder 90 mounted on a vehicle checks the recorded video, and the video is displayed on the display control device 10. In this case, the vehicle driven by the user is referred to as the "own vehicle", and a vehicle owned by someone other than the user is referred to as the "other vehicle".
[0016] <Display control device> The display control device 10 includes a display unit 11, a storage unit 12, a transmission / reception unit 13, a superimposition control unit 14, and an operation unit 18. The display control device 10 may be, for example, a PC (personal computer), or a drive recorder 90 including the display unit 11.
[0017] Furthermore, the display control device 10 may be a display control device 10 (display control server) excluding the display unit 11, and the display control server may be realized by a cloud server. When the display control server is realized by a cloud server, the display control server performs a process of recording the host vehicle image, the host vehicle information, and the other vehicle information in association with each time of the host vehicle image, and a process of transmitting the host vehicle image, the other vehicle image, and display position control information of the other vehicle image relative to the host vehicle image in response to a request from a display device (such as a PC) (not shown).
[0018] The display unit 11 displays the video recorded by the drive recorder 90. The display unit 11 may be a non-vehicle PC display. The display unit 11 may be a display device of an in-vehicle infotainment system or a rear-mirror type display device. The display unit 11 is realized by, for example, a liquid crystal display, an organic EL (Electro Luminescence) display, a micro LED (Light Emitting Diode) display, or the like.
[0019] In the first embodiment, the display unit 11 displays an image of the surroundings of the host vehicle C1 (hereinafter, referred to as "host vehicle image"). The display unit 11 also displays an image received from another vehicle C2 (hereinafter, referred to as "other vehicle image") superimposed on the image of the surroundings of the host vehicle C1. Details of the superimposed display of the image will be described later.
[0020] The storage unit 12 is a storage device that stores various types of information. The storage unit 12 includes a main storage device and an auxiliary storage device. The main storage device may be realized by a semiconductor memory element such as a random access memory (RAM), a read only memory (ROM), or a flash memory. The auxiliary storage device may be realized by a hard disk or a solid state drive (SSD). The storage unit 12 may be capable of reading removable media such as an SD memory card.
[0021] The memory unit 12 stores data of the host vehicle C1 (host vehicle image 20, which is an image captured around the host vehicle, and host vehicle information 16, which is vehicle information about the host vehicle). The memory unit 12 stores data of another vehicle C2 (other vehicle image 30, which is an image captured around the other vehicle, and other vehicle information 17, which is vehicle information about the other vehicle). Note that the image refers to moving images. The memory unit 12 also stores a program 15 for the display control device 10.
[0022] The transmission / reception unit 13 transmits and receives information between the inside and outside of the display control device 10. The transmission / reception unit 13 may be realized by, for example, a LAN (Local Area Network) card, a CAN (Controller Area Network) interface device, a Bluetooth (registered trademark) module, a Wi-Fi (registered trademark) module, an antenna, etc. The transmission / reception unit 13 can transmit and receive information to and from the cloud server 100 via a network.
[0023] The superimposition control unit 14 switches between executing / not executing the superimposed display of the host vehicle image 20 and the other vehicle image 30 by the display unit 11, and controls the superimposed display position of each image in the superimposed display. The superimposition control unit 14 is configured by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The superimposition control unit 14 can be realized by the processor executing a program 15 stored in the storage unit 12. The superimposition control unit 14 may also be realized as hardware using an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
[0024] The operation unit 18 performs various operations of the display control device 10. The various operations include a power ON / OFF operation, an operation for controlling video playback, etc. The operation unit 18 can be realized by an operation button, a touch pad, etc. provided on the display control device 10.
[0025] <Outline of the drive recorder and the information acquired> The drive recorder 90 is mounted on a vehicle and has a function of recording an image of the surroundings of the vehicle C1 and recording vehicle information received from another vehicle C2 through vehicle-to-vehicle communication. The drive recorder 90 includes at least an information acquisition unit 91, a camera 92, a transmission / reception unit 93, a superimposition control unit (not shown), and a storage unit (not shown). The transmission / reception unit 93 and the storage unit of the drive recorder 90 have the same functions as the transmission / reception unit 13 and the storage unit 12 of the display control device 10, and therefore a description thereof will be omitted. The superimposition control unit and the information acquisition unit 91 can be realized by a CPU or an MPU in cooperation with a program (not shown), for example. The information acquisition unit 91 acquires vehicle information of another vehicle via the transmission / reception unit 93. The vehicle information includes a vehicle ID unique to the drive recorder 90, position information acquired using a satellite positioning system, the vehicle's traveling speed, vehicle operation information, time information, and the like. The vehicle operation information includes information on the steering operation, the brake operation, and the accelerator operation. The camera 92 captures images of the surroundings of the vehicle. The transmitter / receiver 93 performs vehicle-to-vehicle communication with other drive recorders 90 mounted in surrounding vehicles, and wireless communication with the cloud server 100, to transmit and receive data.
[0026] The superimposition control unit of the drive recorder 90 of the host vehicle C1 records in the storage unit the host vehicle image 20, which is an image captured around the host vehicle C1, the host vehicle information 16, which is the vehicle information of the host vehicle C1, and the other vehicle information 17, which is the vehicle information received from another vehicle C2 by vehicle-to-vehicle communication. Specifically, the superimposition control unit of the drive recorder 90 of the host vehicle C1 records the other vehicle information 17 received from another vehicle C2 within a predetermined distance from the host vehicle C1 by vehicle-to-vehicle communication during driving, the host vehicle image 20, and the host vehicle information 16 of the host vehicle C1 in association with each time of the host vehicle image 20. The data recorded by the superimposition control unit of the drive recorder 90 of the host vehicle C1 is provided to the storage unit 12 of the display control device 10 via a removable medium. When the display control device 10 is a drive recorder, various information is stored in the storage unit 12 as it is.
[0027] The predetermined distance is a value that is set in advance. For example, the predetermined distance may be a distance at which communication is possible by vehicle-to-vehicle communication. The predetermined distance may be 50 m or more and 500 m or less, for example, about 500 m.
[0028] In addition, in the drive recorder 90 of another vehicle C2, the other vehicle information 17 and the other vehicle image 30 are transmitted to the cloud server 100 via the transmitter / receiver 93.
[0029] The display control device 10 can obtain from the cloud server 100 the other vehicle image 30 corresponding to the vehicle ID and the time of the host vehicle image 20, using the vehicle ID of the other vehicle information 17 of another vehicle C2 recorded in association with the host vehicle image 20 and the time of the host vehicle image 20.
[0030] The drive recorder 90 may receive the other vehicle image 30 from another vehicle C2 by vehicle-to-vehicle communication while driving, and record the host vehicle image 20 and the other vehicle image 30 in association with each other. In this case, the display control device 10 can obtain the other vehicle image 30 without using the cloud server 100.
[0031] <Cloud Server> 2 to 4, the configuration and operation of cloud server 100 will be described. Fig. 2 is a block diagram showing the configuration of cloud server 100. Cloud server 100 includes a storage unit 101, a search unit 102, and an extraction unit 103.
[0032] The memory unit 101 is a storage device that stores various information transmitted from each vehicle to the cloud server 100. The memory unit 101 includes a main memory device and an auxiliary memory device. The main memory device may be realized by a semiconductor memory element such as a RAM, a ROM, a flash memory, etc. The auxiliary memory device may be realized by a hard disk, an SSD, etc. The cloud server 100 receives event data from each vehicle (C1, C2) via the network, and records the received event data in the memory unit 101. The event data includes vehicle information obtained by the vehicle (own vehicle information 16, other vehicle information 17) and images captured around the vehicle (own vehicle image 20, other vehicle image 30). As a result, the event data of each vehicle is accumulated and recorded in the memory unit 101 of the cloud server 100.
[0033] The search unit 102 is configured with a processor such as a CPU. When the display control device 10 superimposes and displays the other vehicle image 30, the search unit 10 acquires an other vehicle image request transmitted from the display control device 10 via a network. The other vehicle image request includes the vehicle ID of the other vehicle information 17 recorded by the drive recorder 90 of the host vehicle C1 in association with the host vehicle image 20 and time information of the host vehicle image 20. The search unit 102 searches and identifies the other vehicle image 30 of the requested vehicle ID from the event data recorded in the storage unit 101 based on the vehicle ID of the other vehicle information 17 and the time information of the host vehicle image 20.
[0034] The cut-out unit 103 is configured with a processor such as a CPU. The cut-out unit 103 acquires the other vehicle image 30 corresponding to the other vehicle image request identified by the search unit 102. The cut-out unit 103 cuts out data of the corresponding time range from the entire other vehicle image 30 based on time information of the host vehicle image 20 included in the other vehicle image request. The cloud server 100 transmits the cut-out other vehicle image 30 to the display control device 10 that made the image request via the network. As a result, the display control device 10 acquires the other vehicle image 30 to be used for superimposed display.
[0035] <Transmitting and receiving data on cloud servers> FIG. 3 is a sequence diagram of the cloud server 100 when recording event data.
[0036] The drive recorder 90 of the host vehicle C1 acquires the other vehicle information 17 of the other vehicle C2 through vehicle-to-vehicle communication. The acquired other vehicle information 17 is recorded in the storage unit of the drive recorder 90 in association with the host vehicle image 20 and the host vehicle information 16. At the same time, the drive recorder 90 of the host vehicle C1 transmits the host vehicle image 20 and the host vehicle information 16 to the cloud server 100 as event data of the host vehicle C1. Upon receiving the event data of the host vehicle C1, the cloud server 100 records it in the storage unit 101. In addition, the drive recorder 90 of the other vehicle C2 transmits the other vehicle image 30 and the other vehicle information 17 to the cloud server 100 as event data of the other vehicle C2. Upon receiving the event data of the other vehicle C2, the cloud server 100 records it in the storage unit 101.
[0037] FIG. 4 is a sequence diagram when the display control device 10 (the drive recorder 90 of the host vehicle C1) acquires the event data (the other vehicle video 30) from the cloud server 100. As shown in FIG.
[0038] When the display control device 10 receives an operation for requesting playback of the host vehicle image 20 via the operation unit 18, it starts playback (a display control method described later) of the host vehicle image 20. When performing superimposed display of the other vehicle image 30 during playback of the host vehicle image 20, the display control device 10 transmits a request for other vehicle image (the vehicle ID of the other vehicle information 17 associated with the host vehicle image 20 and the time information of the host vehicle image 20) to the cloud server 100.
[0039] The cloud server 100 that has received the other vehicle image request uses the search unit 102 to identify the corresponding other vehicle image 30, and uses the cut-out unit 103 to cut out image data corresponding to the time information of the host vehicle image 20, thereby generating the other vehicle image 30 for transmission. The cloud server 100 transmits the generated other vehicle image 30 (the other vehicle image 30 processed by the cut-out unit 103) to the display control device 10 (the drive recorder 90 of the host vehicle C1).
[0040] When the display control device 10 acquires the other vehicle image 30 from the cloud server 100, the display device 10 displays the acquired other vehicle image 30 in a superimposed manner on the host vehicle image 20 being played back on the display unit 11.
[0041] <Display control method> Next, a display control method of the first embodiment of the display control device according to the present disclosure will be described with reference to FIG. 5. FIG. 5 is a flowchart showing the flow of the display control method of the display control device 10 according to the first embodiment. FIG. 6 is a schematic diagram showing an example of a display screen in normal operation (non-overlapping) in the display control device 10 and the vehicle status at the time of display. FIG. 7 is a schematic diagram showing an example of a display screen in superimposition in the display control device 10 and the vehicle status at the time of display. The display control method is realized by the superimposition control unit 14 of the display control device 10 executing the program 15. The program 15 causes the computer to execute the following controls.
[0042] The superimposition control unit 14 starts playing the host vehicle image 20 recorded in the storage unit 12 (step S1). In the example shown in Fig. 6, the host vehicle image 20 showing the area ahead of the host vehicle C1 is displayed on most of the screen of the display unit 11. In Fig. 6, two other vehicles C2a and C2b are present in front of the host vehicle C1, and the rear of the first other vehicle C2b as seen from the host vehicle C1 is shown in the host vehicle image 20.
[0043] The superimposition control unit 14 acquires vehicle information within a second distance from the host vehicle C1 (step S2). The superimposition control unit 14 acquires the playback position of the host vehicle C1 from the host vehicle information 16 of the host vehicle C1 at the time in the video, and acquires each playback position of the other vehicle C2 located around the host vehicle C1 from each other vehicle information 17 of the other vehicle C2 recorded in association with the host vehicle video 20. Then, the superimposition control unit 14 extracts the other vehicle C2 located within the second distance from the playback position of the host vehicle C1. The number of the extracted other vehicles C2 may be zero, one, or multiple.
[0044] The second distance is a preset value. For example, the second distance may be a distance at which communication is possible by vehicle-to-vehicle communication. The second distance may be 50 m or more and 500 m or less, for example, about 500 m.
[0045] The superimposition control unit 14 refers to the time information included in the acquired other vehicle information 17 of the other vehicle C2, and determines whether the time information of the host vehicle C1 matches the time information of the other vehicle C2 (step S3). That is, the superimposition control unit 14 synchronizes the time information of the host vehicle image 20 with the time information of the other vehicle image 30 in order to superimpose and display the other vehicle image 30. If the time information matches, the superimposition control unit 14 proceeds to step S4, and if the time information does not match, the superimposition control unit 14 returns to step S2.
[0046] The superimposition control unit 14 determines the positional relationship between the host vehicle C1 and the other vehicle C2 at the time of playback of the host vehicle image 20 from the vehicle ID information of the host vehicle information 16 of the host vehicle C1 and the other vehicle information 17 of the other vehicle C2, and the position information at the time of playback (position at time of playback) (step S4).
[0047] The superimposition control unit 14 determines a superimposition display position on the display unit 11 for each of the extracted vehicle ID information of the other vehicle C2 based on the positional relationship between the vehicle C1 and the other vehicle C2 (step S5). The superimposition display position based on the positional relationship between the vehicle C1 and the other vehicle C2 is determined according to a preset rule described later.
[0048] However, in step S5, the superimposed display position is merely determined, and the other vehicle image 30 is not actually superimposed on the host vehicle image 20 on the display unit 11. In the first embodiment, in the following step S6, it is determined whether or not to perform the superimposed display.
[0049] In the first embodiment, the superimposition control unit 14 determines whether or not an abnormality in the host vehicle C1 is detected (step S6). That is, since the position of the host vehicle C1 is at a distance of zero from the host vehicle C1, the abnormality in the host vehicle C1 corresponds to an abnormality within a second distance from the host vehicle C1.
[0050] The abnormality includes, first, the occurrence of a collision (sudden change in speed) of the host vehicle C1. The abnormality includes, second, the occurrence of a sudden operation. The sudden operation includes a sudden braking operation, steering operation, or accelerator operation in which the amount of change in the instruction value per unit time exceeds a reference value. The abnormality includes the occurrence of a collision accident, or a sudden operation performed to avoid an accident.
[0051] If the superimposition control unit 14 does not detect an abnormality in the host vehicle C1 at the time of playing back the host vehicle image 20, the process returns to step S2. In this case, the superimposition control unit 14 continues playing back the host vehicle image 20 in the normal display mode as shown in Fig. 6 without performing the superimposition display. If the superimposition control unit 14 detects an abnormality in the host vehicle C1 at the time of playing back the host vehicle image 20, the process proceeds to step S7.
[0052] The superimposition control unit 14 specifies that the other vehicle image 30 of another vehicle C2 that detected the abnormality be superimposed on the other vehicle image 30 within a predetermined time from the time when the abnormality was detected for the host vehicle C1 and within a first distance in front of the host vehicle C1 (step S7). In this way, the superimposition is performed on the condition that the abnormality is detected within the second distance from the host vehicle C1 and that the other vehicle C2 that detected the abnormality is present within a predetermined time from the time when the abnormality was detected and within the first distance.
[0053] The predetermined time is a value set in advance. The predetermined time may be, for example, several seconds, several tens of seconds, or several minutes. Usually, in the drive recorder 90, a video of about 1 to 2 minutes before and after the occurrence of an event such as a collision is recorded as a protected file that cannot be overwritten. Therefore, the predetermined time may be the same as the time setting value of the video recorded when this event occurs (for example, including the two minutes before and after the event occurs).
[0054] The first distance is a preset value, but is not limited to a fixed value and may be a variable calculated based on a predetermined calculation formula. The first distance is set to a value that is estimated to indicate that, if an accident occurs around the time of the abnormality detection, another vehicle C2 may be involved in the accident or may capture the situation of the accident.
[0055] An example of the first distance is the "stopping distance" of a vehicle. The stopping distance is the distance the vehicle travels from when the driver recognizes a danger while the vehicle is moving until the vehicle actually stops. The stopping distance Dt is expressed as the sum of the free running distance Dk and the braking distance Ds, as shown in the following formula (1). Dt = Dk + Ds (1)
[0056] The free running distance Dk is the distance traveled by the vehicle during the reaction time from when the driver recognizes the danger, applies the brakes, and when the brakes actually operate. The braking distance Ds is the distance traveled by the vehicle from when the brakes are operated until the vehicle stops. The free running distance Dk and the braking distance Ds are expressed by the following formulas (2) and (3). Dk = Tk × V (2) Ds=V 2 / (254 / μ) (3) Here, Tk is the driver's reaction time (seconds), and V is the vehicle speed (m / second) when the brakes are applied. μ is the friction coefficient. An approximate value according to the road surface conditions can be used for the friction coefficient μ, such as 0.7 for a dry road surface and 0.5 for a wet road surface. The road surface conditions may be obtained from a weather database using time information and position information at the time of playback, or may be obtained by image recognition from the vehicle image 20.
[0057] As a result, in the first embodiment, the other vehicle image 30 of another nearby vehicle C2 that was present within the stopping distance Dt at the time when the abnormality was detected in the host vehicle image 20 is determined as the image to be superimposed and displayed. The superimposition control unit 14 acquires the corresponding other vehicle image 30 from the cloud server 100 by the transmission / reception unit 13, and instructs the display unit 11 to superimpose the acquired other vehicle image 30 on the host vehicle image 20 being played back on the display unit 11. The superimposition control unit 14 causes the display unit 11 to display the playback screen shown in FIG. 7 by specifying the superimposition display position determined in step S5.
[0058] In the example shown in Fig. 7, the host vehicle image 20 of the host vehicle C1 is displayed on most of the screen of the display unit 11, and another vehicle image 30 is superimposed on a portion (a position near the upper right corner) of the host vehicle image 20. In Fig. 7, the host vehicle image 20 shows the rear of another vehicle C2b, which is the first vehicle ahead as seen from the host vehicle C1. The superimposed other vehicle image 30 is an image of the front as seen from the vehicle C2b, and shows the rear of the vehicle C2a traveling ahead of the vehicle C2b.
[0059] For example, assume that the leading vehicle C2a of the three vehicles in Fig. 7 suddenly brakes (suddenly operates the brakes), which causes the following vehicle C2b to suddenly brake, resulting in a sudden braking operation of the host vehicle C1 and a collision accident. In this case, since only the rear part of the vehicle C2b is shown in the host vehicle image 20, it is not possible to grasp the traveling situation of the vehicle C2a from the host vehicle image 20. However, since the rear part of the leading vehicle C2a is clearly shown in the other vehicle image 30 of the vehicle C2b, it is possible to accurately grasp the behavior of each vehicle.
[0060] Returning to Fig. 5, after the superimposed display in step S7, the superimposition control unit 14 determines whether or not to end the playback (step S8). That is, the superimposition control unit 14 determines whether to end the playback of the host vehicle image 20 based on a predetermined playback time of the host vehicle image 20, or determines whether to end the playback of the host vehicle image 20 based on a user operation via the operation unit 18. If the playback is not to be ended, the display control device 10 returns the process to step S2. If the playback is to be ended, the series of processes of the display control method ends.
[0061] <Effects> As described above, in the first embodiment, during video playback, the other vehicle video 30 of the other vehicle C2 that detected the abnormality within a predetermined time and within a first distance from the time when the abnormality was detected for the host vehicle C1 is superimposed, so that the other vehicle video 30 of the other vehicle C2 that is highly likely to have been involved in the occurrence of the abnormality in the video can be automatically superimposed and displayed on the video of the host vehicle C1 (host vehicle video 20). As a result, the drive recorder video of multiple vehicles including the host vehicle C1 can be efficiently checked.
[0062] [Second embodiment] Next, the display control device 10 according to the second embodiment will be described with reference to Figs. 8 to 10. Fig. 8 is a flowchart showing the flow of a display control method of the display control device 10 according to the second embodiment. Fig. 9 is a schematic diagram illustrating the transition of the vehicle situation at the time of display by the display control device 10. Fig. 10 is a schematic diagram showing switching of the superimposed display of the other vehicle image 30 on the display screen in the situation shown in Fig. 9. In the following description, the same or corresponding reference numerals are used for the same components as those of the display control device 10 of the first embodiment, and detailed description thereof will be omitted. In the second embodiment, the basic configuration of the display control device 10 is the same as that of the display control device 10 of the first embodiment, and the display mode of the display unit 11 and the processing in the superimposition control unit 14 are different from those of the first embodiment.
[0063] In the second embodiment, when there are multiple other vehicles C2 in which an abnormality has been detected and to be displayed in an overlay manner, the overlay control unit 14 further determines the position at which to overlay the other vehicle image 30 of the other vehicle C2 in which an abnormality has been detected, based on the time at which the abnormality was detected in the other vehicle C2 and the position at the time at which the abnormality was detected in the other vehicle C2.
[0064] In addition, in the above first embodiment, an example was shown in which the other vehicle image 30 was superimposed based on the detection of an abnormality in the host vehicle C1, but in the second embodiment, the display control device 10 performs the superimposed display of the other vehicle image 30 based on the detection of an abnormality in another vehicle C2 in front of the host vehicle C1.
[0065] Next, a flow of a display control method in the display control device 10 according to the second embodiment will be described with reference to Fig. 8. In Fig. 8, the same or corresponding reference numerals are used for the same processes as those in the first embodiment (Fig. 5), and detailed descriptions thereof will be omitted.
[0066] In Fig. 8, steps S1 to S5 are the same as those in the first embodiment. After determining the superimposition display position for each vehicle ID information, the superimposition control unit 14 judges whether or not an abnormality has been detected in another vehicle C2 located in front of the host vehicle C1 within a second distance from the host vehicle C1 in the image (step S11). The detection of an abnormality in the other vehicle C2 is based on the other vehicle information 17 of the other vehicle C2. If an abnormality in the other vehicle C2 located in front is not detected, the superimposition control unit 14 returns the process to step S2 without performing a superimposition display. If an abnormality in the other vehicle C2 located in front is detected, the superimposition control unit 14 advances the process to step S12.
[0067] The superposition control unit 14 extracts another vehicle C2 that has detected an abnormality within a predetermined time from the time when the abnormality was detected for another vehicle C2 located in front and within a first distance in front of the host vehicle C1, in order of furthest from the host vehicle C1 (step S12).
[0068] For example, assume that other vehicles C2a, C2b, and C2c are traveling ahead of the host vehicle C1 as shown in Fig. 9. When an abnormality such as a sudden braking operation is detected in the three vehicles C2a to C2c ahead of the host vehicle C1, the superimposition control unit 14 extracts the vehicles in the order of the vehicles C2a, C2b, and C2c. That is, when the superimposition control unit 14 detects an abnormality in the multiple other vehicles C2a to C2c, it extracts the other vehicles C2a to C2c in which the abnormality was detected in order of furthest from the host vehicle C1 based on the time when the abnormality was detected and the position at the time when the abnormality was detected.
[0069] Returning to FIG. 8, the superimposition control unit 14 instructs that the extracted other vehicle images 30 of the other vehicles C2a to C2c are sequentially superimposed in the order in which they were extracted (step S13).
[0070] 10, a host vehicle image 20 in front of the host vehicle C1 is displayed on most of the screen of the display unit 11, and a different vehicle image 30 is superimposed on a position near the upper right corner of the host vehicle image 20. In the case of FIG 9, the superimposition control unit 14 sequentially superimposes and displays a different vehicle image 30a of the vehicle C2a, a different vehicle image 30b of the vehicle C2b, and a different vehicle image 30c of the vehicle C2c in this order.
[0071] For example, the other vehicle image 30a shows the event that caused the sudden braking of the leading vehicle C2a, the other vehicle image 30b shows the vehicle C2a that performed the sudden braking, the other vehicle image 30c shows the vehicle C2b that performed the sudden braking, and at the timing of the sudden braking of vehicle C2c, the sudden braking of vehicle C2c is shown in the host vehicle image 20. This allows the user to grasp the chain of events that occurred when an accident occurred (the sequence of sudden braking operations) without having to check the data of the multiple other vehicle images 30a-30c one by one.
[0072] 10 shows an example in which the multiple other vehicle images 30a-30c are superimposed in sequence at the same position, but other display modes may be adopted. For example, the multiple other vehicle images 30a-30c may be displayed in sequence at different positions (for example, displayed in sequence from one end of the screen to the other end). For example, the superimposition start position may be kept the same, and the position of the other vehicle image 30 being superimposed may be slid downward or horizontally when switching the images to be superimposed, so that the other vehicle image 30 being displayed and the next other vehicle image 30 are superimposed side by side.
[0073] The other configurations and processes of the second embodiment are similar to those of the first embodiment.
[0074] <Effects> As described above, according to the second embodiment, the drive recorder images of multiple vehicles including the vehicle C1 can be efficiently checked. Also, in the second embodiment, when there are multiple vehicles C2 that have detected an abnormality within a first distance from the vehicle C1, the images are superimposed based on the time when the abnormality was detected for the vehicle C2 and the position of the vehicle C2 at the time when the abnormality was detected, so that the status of each vehicle can be displayed in an easy-to-understand manner even when multiple vehicles are involved in a chain reaction.
[0075] [Third embodiment] A display control device 10 according to the third embodiment will be described with reference to Figs. 11 and 12. Fig. 11 is a flowchart showing the flow of a display control method of the display control device 10 according to the third embodiment. Fig. 12 is a schematic diagram showing an example of a display screen during superimposition in the third embodiment and the situation of the vehicle at the time of display. In the third embodiment, the basic configuration of the display control device 10 is similar to that of the display control device 10 of the first embodiment, but the display mode of the display unit 11 and the processing in the superimposition control unit 14 are different from those of the first embodiment.
[0076] In the above second embodiment, an example was shown in which other vehicle images 30 of multiple other vehicles C2 in front of the host vehicle C1 were displayed in a superimposed manner in sequence, but in the third embodiment, the display control device 10 displays other vehicle images 30 in front of and behind the host vehicle C1 in a superimposed manner.
[0077] Next, the flow of a display control method in the display control device 10 according to the third embodiment will be described with reference to Fig. 11. Descriptions of processes similar to those in the first embodiment will be omitted.
[0078] 11, in the third embodiment, the superimposition control unit 14 acquires vehicle information within a second distance from the host vehicle C1 in both the forward and backward directions of the host vehicle C1 (step S21), and determines whether the time information of the host vehicle C1 matches the time information of another vehicle C2 in each of the forward and backward directions (step S22).Then, the superimposition control unit 14 determines the positional relationship between the host vehicle C1 and the other vehicle C2 at the time of playback of the host vehicle video 20 from the vehicle ID information of the host vehicle C1 and the other vehicle C2, respectively, and the position information at the time of playback (position at playback) (step S23).
[0079] After step S23, the superimposition control unit 14 determines the superimposition display position on the display unit 11 for each of the extracted vehicle ID information of the other vehicle C2 based on the positional relationship between the host vehicle C1 and the other vehicle C2 in front and behind (step S24). The superimposition control unit 14 determines the display position of the image of the other vehicle C2a in front of the host vehicle C1 and the display position of the image of the other vehicle C2b behind the host vehicle C1 at separate positions that do not superimpose each other. For example, FIG. 12 shows an example in which the other vehicle image 30a of the front vehicle C2a is positioned at the upper right corner of the screen, and the other vehicle image 30b of the rear vehicle C2b is positioned at the upper left corner of the screen. The superimposition display positions may be changeable in response to a user's operational input.
[0080] 11, the superimposition control unit 14 judges whether an abnormality of the host vehicle C1 has been detected (step S6), and if an abnormality has been detected, the superimposition control unit 14 extracts another vehicle C2 that has detected the abnormality within a predetermined time from the time when the abnormality of the host vehicle C1 was detected and within a first distance in front of or behind the host vehicle C1, and specifies that the other vehicle video 30 of the extracted other vehicle C2 be superimposed and displayed (step S25). As a result, the other vehicle video 30 of the other vehicle C2 that has detected the abnormality, which is located in front of and behind the host vehicle C1, is superimposed and displayed at the determined superimposition display position.
[0081] As a result, in the example shown in Figure 12, the host vehicle image 20 is displayed over most of the screen of the display unit 11, while the rear other vehicle image 30b is superimposed at the upper left corner of the screen, and the front other vehicle image 30a is superimposed at the upper right corner of the screen.
[0082] For example, in the case of a rear-end collision due to inattention of the rear vehicle C2b, no abnormality is shown in the host vehicle image 20 and the front other vehicle image 30a, and the rear other vehicle image 30b shows an image of the host vehicle C1 approaching suddenly. In addition, for example, when an accident occurs in the front vehicle C2a, the event that caused the accident is first shown in the front other vehicle image 30a, the host vehicle image 20 shows the front vehicle C2a braking suddenly, and then the rear other vehicle image 30b shows the host vehicle C1 braking suddenly. In the third embodiment, such situations in front and behind the host vehicle C1 are displayed together on the screen of the display unit 11.
[0083] The other configurations and processes of the third embodiment are similar to those of the first embodiment.
[0084] <Effects> As described above, according to the third embodiment, the drive recorder images of multiple vehicles including the host vehicle C1 can be efficiently checked. Also, according to the third embodiment, the position for superimposing and displaying the other vehicle image 30 of the other vehicle C2 is determined based on the positional relationship between the host vehicle C1 and the other vehicle C2 in front and behind the host vehicle C1 at the time when an abnormality in the host vehicle C1 is detected, so that when an event such as an accident occurs, the situation of the host vehicle C1 and the situations in front and behind the host vehicle C1 can be clearly distinguished from each other and understood at the same time. Therefore, the user can more accurately understand the situation of the host vehicle C1 when the event occurs.
[0085] [Fourth embodiment] A display control device 10 according to a fourth embodiment will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the flow of a display control method of the display control device according to the fourth embodiment. In the fourth embodiment, the basic configuration of the display control device 10 is similar to that of the display control device 10 of the first embodiment, but the processing in the superimposition control unit 14 is different from that of the first embodiment.
[0086] In the fourth embodiment, the display control device 10 acquires the degree of influence of another vehicle C2 on the host vehicle C1 depending on the number of other vehicles C2 around the host vehicle C1 at the time an event occurs in the host vehicle image 20, and determines whether or not to superimpose the other vehicle image 30 depending on the acquired degree of influence.
[0087] Specifically, when the number of other vehicles C2 that have detected an abnormality within a first distance from the host vehicle C1 is equal to or greater than a predetermined number, the superimposition control unit 14 determines to superimpose the other vehicle image 30 of the other vehicle C2 that has detected an abnormality. When the number of other vehicles C2 that have detected an abnormality within a first distance from the host vehicle C1 is less than a predetermined number, the superimposition control unit 14 determines not to superimpose the other vehicle image 30 of the other vehicle C2 that has detected an abnormality.
[0088] Next, a flow of a display control method in the display control device 10 according to the fourth embodiment will be described with reference to Fig. 13 and Fig. 14. Descriptions of processes similar to those in the first embodiment will be omitted.
[0089] 13, steps S1 to S6 are the same as those in the first embodiment. When an abnormality in the host vehicle C1 is detected in step S6, the superposition control unit 14 calculates the degree of influence of each of the other vehicles C2 before and after the host vehicle C1 at the time when the abnormality in the host vehicle C1 is detected (step S31).
[0090] FIG. 14 is a flowchart showing the flow of the process of calculating the degree of influence on the host vehicle (step S31) shown in FIG.
[0091] In the process of calculating the degree of influence on the host vehicle C1 (step S31), the superimposition control unit 14 extracts all other vehicles C2 in front of and behind the host vehicle C1 that are within a first distance from the host vehicle C1 in both the front and rear directions of the host vehicle C1 (step S31a). The first distance is the same as in the first embodiment. Extraction is performed for both the front and rear of the host vehicle C1. The number of other vehicles C2 extracted may be zero, one, or multiple.
[0092] Next, the superimposition control unit 14 further extracts a vehicle whose speed value relative to the speed of the host vehicle C1 is within a set value from among the other vehicles C2 extracted in step S31a (step S31b). The speed value may take into consideration one or both of the vehicle speed of the vehicle and the relative speed with respect to the host vehicle C1.
[0093] The superimposition control unit 14 determines whether the number of the other front and rear vehicles C2 extracted in step S31b is equal to or greater than a predetermined number (step S31c). The predetermined number is not particularly limited, and may be any number between 2 and 10, for example. The predetermined number may be set by the user. The number of vehicles may be determined separately for the area in front of the host vehicle C1 and the area behind the host vehicle C1. In this case, it is determined separately whether the number of vehicles in front of the host vehicle C1 is equal to or greater than a predetermined number and whether the number of vehicles behind the host vehicle C1 is equal to or greater than a predetermined number.
[0094] When the number of extracted other front and rear vehicles C2 is equal to or greater than a predetermined number (Yes in step S31c), the superimposition control unit 14 determines that the predetermined number of vehicles before and after the host vehicle C1 are other vehicles C2 that have a high degree of influence on the host vehicle C1 (step S31d). Here, when the number of extracted vehicles is greater than the predetermined number, the other vehicles C2 that are determined to have a high degree of influence on the host vehicle C1 are only the predetermined number of vehicles extracted in step S31b, and for example, the vehicles closest to the host vehicle C1 are selected in order.
[0095] If the number of the extracted other front and rear vehicles C2 is less than a predetermined number (No in step S31c), the superimposition control unit 14 determines that there are no other vehicles C2 that have a high degree of influence on the host vehicle C1 before or after the host vehicle C1 (step S31e). Step S31 ends due to step S31d or S31e.
[0096] After step S31, the superimposition control unit 14 specifies that the other vehicle image 30 of the other vehicle C2, which has a high degree of influence on the host vehicle C1 and has detected an abnormality, be superimposed (step S32). As a result, the other vehicle image 30 of the other vehicle C2, which has a high degree of influence on the host vehicle C1 and has detected an abnormality, is superimposed and displayed at the determined superimposition display position.
[0097] The display mode of the image may be a combination of the second and third embodiments. That is, the other vehicle image 30 is superimposed and displayed at different positions on the screen in front of and behind the host vehicle C1. The display order of the other vehicle image 30 is switched based on the time when an abnormality in the other vehicle C2 is detected and the position of the other vehicle C2 at the time when the abnormality is detected.
[0098] As described above, what is superimposed and displayed in the fourth embodiment is the other vehicle image 30 of a vehicle in which an abnormality has been detected among a predetermined number of vehicles determined to have a high degree of influence on the host vehicle C1. Images of vehicles in which no abnormality has been detected, even if the vehicle has been determined to have a high degree of influence, are not displayed. If it is determined that there is no other vehicle C2 with a high degree of influence, the other vehicle image 30 is not superimposed and displayed. As a result, when a relatively large number of other vehicles C2 are traveling around the host vehicle C1 when an event such as a collision accident occurs, and there are vehicles involved in the event and vehicles not involved, by taking into account the degree of influence on the host vehicle C1, the vehicles to be displayed can be narrowed down so that only vehicles that are highly likely to have been involved in the event (i.e., have a high degree of influence) are superimposed and displayed.
[0099] Furthermore, even if there are other vehicles C2 around the vehicle C1 when the event occurs, if the number of vehicles is small and the possibility of them being involved in the event is low (i.e., the impact is not high), the vehicles to be displayed are narrowed down so as not to be superimposed. Therefore, when playing back the video, it is possible to avoid a sprinkling of superimposed video of an excessive number of other vehicle videos 30, including other vehicles C2 that are not involved in the event, and it is possible to more efficiently grasp the situation when an event such as an accident occurs.
[0100] The other configurations and processes of the fourth embodiment are similar to those of the first embodiment.
[0101] <Effects> As described above, according to the fourth embodiment, the drive recorder images of a plurality of vehicles including the vehicle C1 can be efficiently checked.
[0102] According to the fourth embodiment, when the number of other vehicles C2 that have detected an abnormality within the first distance from the host vehicle C1 is equal to or greater than a predetermined number, the other vehicle video 30 of the other vehicle C2 that has detected an abnormality is superimposed, and when the number of other vehicles C2 that have detected an abnormality within the first distance from the host vehicle C1 is less than the predetermined number, the other vehicle video 30 of the other vehicle C2 that has detected an abnormality is not superimposed, so that the vehicles to be superimposed can be narrowed down according to the degree of influence. Therefore, when playing back the video, it is possible to avoid superimposing the other vehicle video 30 of the other vehicle C2 that is unlikely to be involved in the event.
[0103] The display control device, the display control server, the display control method, and the program according to the present disclosure may be embodied in various different forms other than the embodiments described above.
[0104] Each component of the illustrated display control device is a functional concept, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to that shown in the figure, and all or part of the device may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.
[0105] The configuration of the display control device is realized, for example, as software, by a program loaded into a memory. In the above embodiment, the functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms by only hardware, only software, or a combination of both.
[0106] The above-mentioned components include those that a person skilled in the art can easily imagine and those that are substantially the same. Furthermore, the above-mentioned configurations can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations are possible without departing from the scope of the present invention.
[0107] In the fourth embodiment, the "predetermined number" which is the threshold value for the number of other vehicles C2 may be set to a plurality of values. For example, in step 31c in Fig. 14, the first predetermined number may be set to 5, and if the number of extracted other vehicles before and after the vehicle is 5 or more, the five vehicles before and after the vehicle may be determined to have a high degree of influence, and further, the second predetermined number may be set to 2, and if the number of extracted other vehicles before and after the vehicle is 2 or more but less than 5, the two vehicles before and after the vehicle may be determined to have a high degree of influence, and if the number of extracted other vehicles before and after the vehicle is less than 2, it may be determined that there is no vehicle with a high degree of influence. [Explanation of symbols]
[0108] 10 Display control device 11 Display section 12 Storage section 13 Transmitter / receiver 14 Superimposition control section 15 Programs 16 Vehicle information 17 Other vehicle information 20 Vehicle image (image of the area around the vehicle) 30, 30a, 30b, 30c Other vehicle footage (footage of another vehicle) 90 Drive Recorder 100 Cloud Servers C1 Vehicle C2, C2a, C2b, C2c Different vehicles
Claims
1. a storage unit that stores a subject vehicle image, which is an image captured around the subject vehicle, subject vehicle information including at least the speed and position of the subject vehicle at a predetermined time, and a second vehicle image, which is an image captured around another vehicle, and second vehicle information including at least the speed and position of the second vehicle at a predetermined time; a superimposition control unit that detects an abnormality in the host vehicle or the other vehicle based on the host vehicle information and the other vehicle information, and controls a superimposition display of the host vehicle image and the other vehicle image, the superimposition control unit superimposes and displays the other vehicle image of the other vehicle in which an abnormality has been detected within a predetermined time from a time when an abnormality has been detected in the host vehicle or the other vehicle and within a first distance from the host vehicle. Display control device.
2. The superimposition control unit further When the number of the other vehicles that have detected an abnormality within the first distance from the host vehicle is equal to or greater than a predetermined number, The other vehicle image of the other vehicle in which the abnormality is detected is superimposed and displayed; When the number of the other vehicles in which an abnormality is detected and which are within the first distance from the host vehicle is less than the predetermined number, The other vehicle image of the other vehicle in which an abnormality is detected is not superimposed and displayed. The display control device according to claim 1 .
3. The superimposition control unit further When the number of the other vehicles in which the abnormality is detected within the first distance from the host vehicle is more than one, determining a position at which the other vehicle image of the other vehicle in which an abnormality is detected is to be superimposed on the other vehicle image based on a time at which the abnormality is detected for the other vehicle and a position at which the abnormality is detected for the other vehicle; The display control device according to claim 1 .
4. a storage unit that stores a subject vehicle image, which is an image captured around the subject vehicle, subject vehicle information including at least the speed and position of the subject vehicle at a predetermined time, and a second vehicle image, which is an image captured around another vehicle, and second vehicle information including at least the speed and position of the second vehicle at a predetermined time; a superimposition control unit that detects an abnormality in the host vehicle or the other vehicle based on the host vehicle information and the other vehicle information, and controls a superimposition display of the host vehicle image and the other vehicle image, the superimposition control unit superimposes and displays the other vehicle image of the other vehicle in which an abnormality has been detected within a predetermined time from a time when an abnormality has been detected in the host vehicle or the other vehicle and within a first distance from the host vehicle. Display control server.
5. storing a subject vehicle image, which is an image captured of the surroundings of the subject vehicle, subject vehicle information including at least the speed and position of the subject vehicle at a predetermined time, and a second vehicle image, which is an image captured of the surroundings of another vehicle, and second vehicle information including at least the speed and position of the second vehicle at a predetermined time; detecting an abnormality in the host vehicle or the other vehicle based on the host vehicle information and the other vehicle information, and controlling a superimposed display of the host vehicle image and the other vehicle image; The step of controlling the superimposed display includes a step of superimposing the other vehicle image of the other vehicle in which an abnormality is detected within a predetermined time from a time when an abnormality is detected in the host vehicle or the other vehicle and within a first distance from the host vehicle. Display control method.
6. a process of storing a subject vehicle image, which is an image captured of the surroundings of the subject vehicle, subject vehicle information including at least the speed and position of the subject vehicle at a predetermined time, and a second vehicle image, which is an image captured of the surroundings of another vehicle, and second vehicle information including at least the speed and position of the second vehicle at a predetermined time; a process of detecting an abnormality of the host vehicle or the other vehicle based on the host vehicle information and the other vehicle information, and controlling a superimposed display of the host vehicle image and the other vehicle image; The process of controlling the superimposed display includes a process of superimposing and displaying the other vehicle image of the other vehicle that has detected an abnormality within a predetermined time from a time when an abnormality has been detected in the host vehicle or the other vehicle and within a first distance from the host vehicle; A program that causes a computer to execute the following.
Citation Information
Patent Citations
Recording system
JP2011131728A
