Video display device and video display method

Abstract

To allow a video to be confirmed immediately, the video being captured in a position through which a traveling vehicle has passed.SOLUTION: A video display device 10 includes: a video acquisition unit 21A which acquires a video including shooting location information; a location information acquisition unit 29A which acquires location information of a vehicle; a transmissive display panel 14 installed on the vehicle; an operation unit 15 which can be operated on a surface of the transmissive display panel 14; a specifying unit 24 which specifies a range for display; a reproduction control unit 27 which reproduces the acquired video; and a display control unit 28 which displays, on the transmissive display panel 14, a video of the specified range in the reproduced video. The reproduction control unit 27 displays, when an operation is started, a video captured in the past in the same position as a position of the vehicle where the operation is started, reproduces the video in a forward direction in the case where the operation is performed in a first direction along a traveling direction of the vehicle, or reproduces the video in a rewind direction in the case where the operation is performed in a direction opposite the first direction along the traveling direction of the vehicle.SELECTED DRAWING: Figure 10

Description

[Technical Field]

[0001] The present invention relates to a video display device and a video display method. [Background technology]

[0002] Systems that capture images of the surroundings of a vehicle have been put into practical use, and are used, for example, as drive recorders. When images captured by such systems are not saved as event records or the like, they are temporarily recorded and then overwritten with new images. A technology has been disclosed that allows images from a drive recorder to be played back in a forward or backward direction by performing a flick operation on the screen based on a vanishing point, which is a reference point (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2020-078083 Summary of the Invention [Problem to be solved by the invention]

[0004] With the technology of Patent Document 1, when a vehicle occupant is viewing the surroundings of the vehicle while the vehicle is traveling, it is difficult for the occupant to immediately check images of positions that the vehicle has passed through as it travels.

[0005] The present disclosure has been made in consideration of the above, and aims to enable an operator to instantly check images of positions that a vehicle has passed through while traveling. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the image display device according to the present disclosure includes an image acquisition unit that acquires image including position information at which the image was captured, a position information acquisition unit that acquires position information of a moving body, a transparent display panel that is installed on the moving body and has transparency, an operation unit that can be operated on the surface of the transparent display panel, an identification unit that identifies a range to be displayed on the transparent display panel in the image acquired by the image acquisition unit, a playback control unit that plays back the image acquired by the image acquisition unit, and a display control unit that displays, on the transparent display panel, the image of the range identified by the identification unit in the image played back by the playback control unit, wherein, when operation of the operation unit is started, the playback control unit displays, on the transparent display panel, image that was acquired by the image acquisition unit and was captured in the past at the same position as the position of the moving body when operation of the operation unit was started, and when the operation direction of the operation unit is operated in a first direction along the traveling direction of the moving body, the playback control unit plays back the image in a reverse direction.

[0007] The image display method according to the present disclosure is performed by an image display device, which performs the following steps: when operation of an operation unit that is operable on the surface of a transparent display panel installed on a moving body and has transparency is started, displaying on the transparent display panel an image that was previously captured at the same position as the moving body was at when operation of the operation unit was started; when the operation direction of the operation unit is operated in a first direction along the moving body's direction of travel, playing the image in a forward direction; and when the operation direction of the operation unit is operated in a direction opposite to the first direction along the moving body's direction of travel, playing the image in a reverse direction. [Effects of the Invention]

[0008] According to the present disclosure, it is possible to instantly check images of positions that a vehicle has passed through while traveling. [Brief explanation of the drawings]

[0009] [Figure 1]FIG. 1 is a block diagram showing an example of the configuration of a video display device according to the first embodiment. [Figure 2] FIG. 2 is a schematic diagram illustrating an example of the photographing angle of view of a window glass of a vehicle. [Figure 3] FIG. 3 is a schematic diagram illustrating an example of a rear door glass. [Figure 4] FIG. 4 is a schematic diagram illustrating another example of the rear door glass. [Figure 5] FIG. 5 is a schematic diagram illustrating the photographing angle of view and the specific range. [Figure 6] FIG. 6 is a schematic diagram illustrating an example of an operation on the operation unit in the first embodiment. [Figure 7] FIG. 7 is a flowchart showing an example of the flow of processing in the video display device according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing an example of the relationship between operations and displayed images in the first embodiment. [Figure 9] FIG. 9 is a diagram showing another example of the relationship between operations and displayed images in the first embodiment. [Figure 10] FIG. 10 is a block diagram showing an example of the configuration of a video display device according to the second embodiment. [Figure 11] FIG. 11 is a schematic diagram illustrating an example of an operation on the operation unit in the second embodiment. [Figure 12] FIG. 12 is a flowchart showing an example of the flow of processing in the control device according to the second embodiment. [Figure 13] FIG. 13 is a diagram showing an example of the relationship between operations and displayed images in the second embodiment. [Figure 14] FIG. 14 is a diagram showing another example of the relationship between operations and displayed images in the second embodiment. [Figure 15] FIG. 15 is a block diagram showing an example of the configuration of a video display device according to the third embodiment. [Figure 16] FIG. 16 is a diagram illustrating the relative positional relationship between the subject vehicle and other vehicles. [Figure 17]FIG. 17 is a schematic diagram illustrating an example of an operation on the operation unit in the fourth embodiment. [Figure 18] FIG. 18 is a flowchart showing an example of the flow of processing in the control device according to the fourth embodiment. [Figure 19] FIG. 19 is a diagram showing an example of the relationship between operations and displayed images in the fourth embodiment. [Figure 20] FIG. 20 is a diagram showing another example of the relationship between operations and displayed images in the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of an image display device and an image display method according to the present disclosure will be described in detail below with reference to the accompanying drawings. However, the present invention is not limited to the following embodiments.

[0011] [First embodiment] <Video display device> FIG. 1 is a block diagram showing an example of the configuration of a video display control device (hereinafter referred to as a "control device") 20 according to the first embodiment.

[0012] The present embodiment addresses the problem that it is difficult for a passenger of a moving body to immediately check the conditions, facilities, etc. of locations that the moving body has passed through while viewing the surroundings of the moving body. The present embodiment aims to enable a passenger of a moving body to immediately check the conditions, facilities, etc. of locations that the moving body has passed through while viewing the surroundings of the moving body.

[0013] The image display device 10 reproduces an image of the surroundings of a moving object such as a vehicle, a ship, or a train, and displays it on a transmissive display panel 14 arranged on the moving object. In this embodiment, the image display device 10 reproduces an image of the surroundings of the vehicle in the reverse direction and displays it on a transmissive display panel 14 arranged on the vehicle. In the following embodiments, a vehicle will be used as an example of a moving object.

[0014] Reverse playback means playing back the video in the opposite direction to the time progression, in other words, playing back in a rewinding direction.

[0015] The image display device 10 may be a device installed in a vehicle, or may be a portable device that can be used in a vehicle. Furthermore, the image display device 10 may be realized by including the functions or configuration of a device that is pre-installed in a vehicle, a navigation device, etc. The image display device 10 has a camera 11, a recording unit 12, an interface unit (hereinafter referred to as "IF unit") 13, a transmissive display panel 14, an operation unit 15, and a control device 20.

[0016] The camera 11 is a camera that captures the surroundings of the vehicle. For example, the camera 11 may be a camera specific to the image display device 10 or a camera for capturing overhead images shared with the overhead image display system. The camera 11 may be a group of multiple cameras. For example, the camera 11 may be arranged at a position that allows it to capture images of the front, right, left, and rear of the vehicle. For example, the camera 11 may be provided for each transmissive display panel 14 and capture the surrounding scenery seen through the transmissive display panel 14. In other words, the camera 11 is a camera that can capture images in a direction corresponding to the transmissive display panel 14 to which the present invention is applicable. For example, the camera 11 may be arranged corresponding to each window glass of the vehicle and capture the surrounding scenery seen through each window glass. In this embodiment, the camera 11 constantly captures images while the vehicle's accessory power is on or while the vehicle is operating. The camera 11 outputs the captured images to the image acquisition unit 21 of the control device 20. The video is a moving image composed of, for example, 27.5 frames per second.

[0017] 2 is a schematic diagram illustrating an example of the imaging field of view of a vehicle window glass. As an example, an imaging field of view 200 of the right camera 111, which is one of the multiple cameras constituting the camera 11 and captures the right side, will be described. The right camera 111 that captures the right side is disposed, for example, on the right side mirror. The imaging field of view 200 of the right camera 111 that captures the right side includes a visibility range 201 in which an occupant can view the outside of the vehicle through the right rear door glass 104.

[0018] The recording unit 12 is used for temporary storage of data in the video display device 10. The recording unit 12 is, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a recording unit such as a memory card. Alternatively, the recording unit 12 may be an external recording unit wirelessly connected via a communication device (not shown). The recording unit 12 records the loop recorded video based on a control signal output from the recording control unit 22 of the control device 20. The loop recorded video is video that has been loop recorded, and loop recording will be described later.

[0019] The IF unit 13 is an interface for acquiring vehicle speed information via a CAN (Controller Area Network) or the like.

[0020] The transmissive display panel 14 may be, for example, a display device specific to the image display device 10 or a display device shared with other systems, including a navigation system. The transmissive display panel 14 is suitably, for example, a transmissive organic electroluminescence (EL) display, but is not limited to this and may be of other types. The transmissive display panel 14 is installed around the vehicle, i.e., on the vehicle's outer periphery, and is transparent when no image is displayed. The transmissive display panel 14 displays an image of the vehicle's surroundings. The transmissive display panel 14 displays an image based on a video signal output from the display control unit 28 of the control device 20. The transmissive display panel 14 displays an image captured by the camera 11 or an image recorded in the recording unit 12.

[0021] The transmissive display panel 14 is provided on or constitutes the window glass of a vehicle. When no image is displayed, the transmissive display panel 14 has a transmittance of, for example, 60% or more in the visible light range. When an image is displayed, the transmissive display panel 14 has a transmittance of, for example, less than 20%, or does not transmit light in the area where the image is displayed.

[0022] The transmissive display panel 14 can be applied to a window through which the outside of the vehicle can be seen. For example, the transmissive display panel 14 can be applied to at least one of a windshield 101, a right front door glass 102, a left front door glass 103, a right rear door glass 104, a left rear door glass 105, and a rear glass 106 of the vehicle, as shown in Fig. 2. In the following description, the transmissive display panel 14 will be described as being applied to the right rear door glass 104 of the vehicle.

[0023] FIG. 3 is a schematic diagram illustrating an example of rear door glass. FIG. 4 is a schematic diagram illustrating another example of rear door glass. The shape of the touch panel, which is the transmissive display panel 14 and the operation unit 15, may be the same as the overall shape of the glass to which it is applied, or may be configured as a rectangle smaller than the overall shape of the glass to which it is applied. In the example shown in FIG. 3, the shape of the touch panel, which is the transmissive display panel 14 and the operation unit 15, is the same as the overall shape of the right rear door glass 104. In the example shown in FIG. 4, the shape of the touch panel, which is the transmissive display panel 14 and the operation unit 15, is a rectangle smaller than the overall shape of the right rear door glass 104.

[0024] The operation unit 15 can accept various operations for the video display device 10. The operation unit 15 can be operated on the surface of the transmissive display panel 14. The operation unit 15 is, for example, a touch panel arranged over the display screen of the transmissive display panel 14. For example, the operation unit 15 can accept various operations for the touch panel, such as touch operations, swipe operations, and flick operations, like the screen of a smartphone. For example, the operation unit 15 can accept an operation to play back the video recorded in the recording unit 12. The operation unit 15 outputs operation information to an operation control unit 25 of the control device 20.

[0025] <Control device> The control device 20 is an arithmetic processing device (control device) configured with, for example, a CPU (Central Processing Unit). The control device 20 loads a stored program into memory and executes instructions included in the program. The control device 20 includes an internal memory (not shown) that is used for temporary storage of data in the control device 20, etc. The control device 20 has, as its configuration and functions realized by the program, a video acquisition unit 21, a recording control unit 22, an identification unit 24, an operation control unit 25, a vehicle speed information acquisition unit 26, a playback control unit 27, and a display control unit 28.

[0026] The image acquisition unit 21 acquires images of the surroundings of the vehicle captured by the camera 11. The image acquisition unit 21 may function as an image capture control unit that controls the image capture operation of the camera 11.

[0027] The recording control unit 22 records the video captured by the camera 11 in the recording unit 12. The recording control unit 22 controls the recording of the video captured by the video acquisition unit 21 in the recording unit 12. The recording control unit 22 records the video captured by the video acquisition unit 21 in the recording unit 12 as overwritable video while the vehicle is operating, such as when the vehicle's accessory power is ON. More specifically, the recording control unit 22 continues to record the video captured by the video acquisition unit 21 in the recording unit 12, and when the capacity of the recording unit 12 becomes full, performs loop recording, in which new video is overwritten over old video. The recording control unit 22 only needs to record the captured video for the length of time required for reverse playback. For example, it is sufficient to loop record video for approximately 5 to 10 minutes. The length of time that loop recording is possible is determined by the recording capacity of the recording unit 12. When there are multiple cameras 11, such as one on each side, the recording control unit 22 loop-records the video from each camera.

[0028] The identification unit 24 identifies a predetermined range from the image based on the angle of view of the camera 11 as the specific range to be displayed on the transmissive display panel 14. The identification unit 24 identifies the range in which the occupant can see the outside of the vehicle through the glass, based on the average face (eye) position of the occupant sitting in the seat closest to the glass of the vehicle. For example, in the case of the right rear door glass 104, the identification unit 24 identifies the range in which the occupant can see the outside of the vehicle through the right rear door glass 104, based on the average face (eye) position of the occupant sitting in the right rear seat.

[0029] The identification unit 24 may detect the position and direction of the passenger's face and the position and direction of their eyes from an image captured by an in-vehicle camera (not shown), and change the specific range according to the position and direction of their eyes. The identification unit 24 may detect the position and direction of the passenger's face and the position and direction of their eyes when operation of the operation unit 15 is started, identify the range when operation of the operation unit 15 is started, and display an image of the specific range while operation unit 15 is being operated.

[0030] 5 is a schematic diagram illustrating the shooting angle of the camera 11 and the specific range identified by the identification unit 24. The identification unit 24 identifies a specific range 202 to be displayed on the transmissive display panel 14 in the image 200 captured by the camera 11. The identification unit 24 identifies the specific range 202 in accordance with the shape of the transmissive display panel 14. For example, if the transmissive display panel 14 has the shape shown in FIG. 3, the identification unit 24 identifies the specific range 202 having the same shape as the overall shape of the glass to be applied. For example, if the transmissive display panel 14 has the shape shown in FIG. 4, the identification unit 24 identifies a rectangular specific range 202.

[0031] The operation control unit 25 acquires operation information of operations accepted by the operation unit 15. The operation control unit 25 acquires operation information indicating various operations on the touch panel, such as a touch operation, a swipe operation, and a flick operation, and outputs a control signal. The operation control unit 25 acquires, for example, an operation along the traveling direction, and outputs a control signal indicating the operation information.

[0032] An operation along the direction of travel of the vehicle is an operation in either the front or rear direction of the vehicle. For example, it is a swipe operation from front to rear or from rear to front, like an operation on a seek bar that indicates the playback position during video playback. Therefore, in the case of rear door glass located on the side of a vehicle, an operation in the left or right direction as viewed from inside the vehicle cabin is an operation along the direction of travel of the vehicle.

[0033] Fig. 6 is a schematic diagram illustrating an example of an operation of the operation unit in the first embodiment. Fig. 6 shows a right rear door glass 104 as an example. For example, when a passenger performs a touch operation like on a smartphone screen, the operation control unit 25 outputs a control signal indicating a touch operation to an operation start point P11. For example, when a user performs a swipe operation like on a smartphone screen, the operation control unit 25 outputs a control signal indicating a swipe operation from rear to front as indicated by arrow A1.

[0034] The traveling direction of the vehicle is basically the forward direction. The present invention does not apply when the vehicle is reversing. Therefore, sensing of the traveling direction of the vehicle is not required. In the case of the transmissive display panel 14 disposed on the right rear door glass 104 of the vehicle, for example, the traveling direction from the inside of the vehicle cabin as viewed from the transmissive display panel 14 is preset to be the left. In the case of the transmissive display panel 14 disposed on the left rear door glass 105 of the vehicle, for example, the traveling direction from the inside of the vehicle cabin as viewed from the transmissive display panel 14 is preset to be the right.

[0035] The vehicle speed information acquisition unit 26 acquires vehicle speed information indicating the vehicle speed of the vehicle via a CAN etc. The vehicle speed information acquisition unit 26 is not an essential component of the control device 20.

[0036] The playback control unit 27 controls the playback of video. The playback control unit 27 controls the playback of video recorded in the recording unit 12. Based on a control signal output from the operation control unit 25, the playback control unit 27 controls the playback of loop recorded video recorded in the recording unit 12.

[0037] The playback control unit 27 controls playback of the video in the reverse direction based on the control signal output from the operation control unit 25. When operation of the operation unit 15 is started, the playback control unit 27 causes the transmissive display panel 14 to display the video at the time when operation of the operation unit 15 was started, and when the operation direction of the operation unit 15 is operated along the traveling direction of the vehicle, the playback control unit 27 controls playback of the video recorded by the recording control unit 22 in the reverse direction starting from the video at the time when operation of the operation unit 15 was started. When a touch operation is performed on the transmissive display panel 14, the playback control unit 27 displays the video at the time of the touch operation in a stopped state, and then, when a swipe operation or the like is performed on the transmissive display panel 14, controls playback of the displayed video in the reverse direction.

[0038] The playback control unit 27 may perform control so that the video being captured by the camera 11 is played back in real time. More specifically, when an operation of the operation unit 15 is started, the playback control unit 27 may control the transmissive display panel 14 to display the video being captured from the time the operation of the operation unit 15 was started, and when the operation direction of the operation unit 15 is operated along the traveling direction of the vehicle, the recording control unit 22 to play back the recorded video in the reverse direction. When a touch operation is performed on the transmissive display panel 14, the playback control unit 27 switches to the video being captured from the time of the touch operation, and then, when a swipe operation or the like is performed on the transmissive display panel 14, controls the playback of the displayed video in the reverse direction.

[0039] The playback control unit 27 may change the speed at which the video is played back in the reverse direction based on the operation speed when the operation unit 15 is operated in the direction of travel of the vehicle. In this embodiment, the playback control unit 27 changes the speed at which the video is played back in the reverse direction based on the operation amount per unit time of the swipe operation, in other words, the operation speed. For example, when the operation speed is about 100 mm / sec, the playback control unit 27 performs playback in the reverse direction at 1x speed. For example, when the operation speed is about 50 mm / sec, the playback control unit 27 performs playback in the reverse direction at 0.5x speed. For example, when the operation speed is about 200 mm / sec, the playback control unit 27 performs playback in the reverse direction at 2x speed. The operation speed and the playback speed may be correlated linearly or stepwise.

[0040] The playback control unit 27 may change the speed at which the video is played back in the reverse direction based on the vehicle's traveling speed when the operation of the operation unit 15 is started. More specifically, the playback control unit 27 may change the speed at which the video is played back in the reverse direction based on the vehicle's traveling speed when the operation of the operation unit 15 is started, from the vehicle speed information acquired by the vehicle speed information acquisition unit 26. For example, when the vehicle's traveling speed when the operation of the operation unit 15 is started is between 0 km / h and 20 km / h, the playback control unit 27 performs playback in the reverse direction at 0.5x speed. When the vehicle's traveling speed when the operation of the operation unit 15 is started is between 20 km / h and 60 km / h, the playback control unit 27 performs playback in the reverse direction at 1x speed. When the vehicle's traveling speed when the operation of the operation unit 15 is started is 60 km / h or higher, the playback control unit 27 performs playback in the reverse direction at 2x speed. The vehicle's traveling speed and the playback speed may be linearly or stepwise correlated.

[0041] The display control unit 28 causes the transmissive display panel 14 to display the image of the range identified by the identification unit 24 in the image reproduced by the reproduction control unit 27.

[0042] The display control unit 28 controls the display of the image on the transmissive display panel 14. Based on a control signal from the playback control unit 27, the display control unit 28 outputs a video signal that causes the image to be output to the transmissive display panel 14. More specifically, the display control unit 28 outputs a video signal that displays the image captured by the camera 11 or the image recorded in the recording unit 12 by playback.

[0043] <Information processing in control devices> Next, the flow of processing in the control device 20 will be described with reference to Fig. 7. While the video display device 10 is running, the processing of the flowchart shown in Fig. 7 is executed.

[0044] The control device 20 starts photographing and recording (step S101). More specifically, the image display device 10 starts photographing the periphery of the vehicle using the camera 11. Then, the control device 20 acquires the image of the periphery of the vehicle photographed by the camera 11 using the image acquisition unit 21. Then, the control device 20 causes the recording control unit 22 to loop-record the image photographed by the camera 11 in the recording unit 12. The control device 20 proceeds to step S102.

[0045] The control device 20 determines whether or not an operation has started (step S102). More specifically, the control device 20 determines that an operation has started when the operation control unit 25 receives a touch operation on the operation unit 15. When the operation control unit 25 determines that an operation has started (Yes in step S102), the control device 20 proceeds to step S103. When the operation control unit 25 does not determine that an operation has started (No in step S102), the control device 20 proceeds to step S108.

[0046] When it is determined that the operation has started (Yes in step S102), the control device 20 displays the image at the start of the operation (step S103). More specifically, the control device 20 causes the identification unit 24 to identify a predetermined range from the image based on the angle of view of the camera 11 as the range to be displayed on the transmissive display panel 14. The control device 20 controls the playback control unit 27 to play back the image when the touch operation of the operation unit 15 started. The control device 20 causes the display control unit 28 to display the image when the touch operation of the operation unit 15 started on the transmissive display panel 14 based on the control signal from the playback control unit 27. The control device 20 proceeds to step S104.

[0047] The control device 20 determines whether or not a swipe operation along the traveling direction has been performed (step S104). More specifically, when the operation control unit 25 receives a swipe operation along the traveling direction of the vehicle on the operation unit 15, the control device 20 determines that a swipe operation along the traveling direction has been performed. When the operation control unit 25 determines that a swipe operation along the traveling direction has been performed (Yes in step S104), the control device 20 proceeds to step S105. When the operation control unit 25 does not determine that a swipe operation along the traveling direction has been started (No in step S104), the control device 20 proceeds to step S108.

[0048] If it is determined that a swipe operation along the traveling direction has been performed (Yes in step S104), the control device 20 starts replaying the video in the reverse direction (step S105). More specifically, the control device 20 causes the playback control unit 27 to play back the video recorded by the recording control unit 22 in the reverse direction, starting from the video when the operation of the operation unit 15 was started. The control device 20 causes the display control unit 28 to display the played back video on the transmissive display panel 14 based on a control signal from the playback control unit 27. The control device 20 proceeds to step S106.

[0049] The control device 20 determines whether the operation has ended (step S106). More specifically, the control device 20 determines that the operation has ended when the passenger's finger is released from the operation unit 15 in response to the swipe operation started by the operation control unit 25 in step S104. If the operation control unit 25 determines that the operation has ended (Yes in step S106), the control device 20 proceeds to step S107. If the operation control unit 25 does not determine that the operation has started (No in step S106), the control device 20 executes the processing of step S106 again.

[0050] If it is determined that the operation has ended (Yes in step S106), the control device 20 ends the reverse playback (step S107). More specifically, the control device 20 causes the playback control unit 27 to end the playback of the video in the reverse direction. The control device 20 causes the display control unit 28 to end displaying the video on the transmissive display panel 14 based on the control signal from the playback control unit 27. The control device 20 proceeds to step S108.

[0051] The control device 20 determines whether or not to end the photographing and recording (step S108). For example, the determination to end the photographing and recording is made when the power or motive power of the vehicle is turned off or when an end operation is performed on the operation unit 15. If the control device 20 determines to end the photographing and recording (Yes in step S108), it ends this processing. If the control device 20 does not determine to end the photographing and recording (No in step S108), it executes the processing of step S102 again.

[0052] FIG. 8 is a diagram showing an example of the relationship between operations and displayed images in the first embodiment. FIG. 8 indicates that time passes toward the right. At time ta0, when the touch operation is detected, the recording control unit 22 is recording images from before time ta-2. Furthermore, at time ta0, the camera 11 continues capturing images. The example shown in FIG. 8 shows a state in which the passenger starts a touch operation at time ta0 and the finger that performed the touch operation remains stationary until time ta1. The playback control unit 27 plays back the image at time ta0 as a still image from time ta0 to time ta1, and the display control unit 28 displays the played back image on the transmissive display panel 14.

[0053] Thereafter, the passenger performs a swipe operation in the direction of travel of the vehicle from time ta1 to time ta3. The playback control unit 27 performs backward playback from the video at time ta0, and backward playback of the video from time ta0 to time ta-2, which is video of the same length as the period from time ta1 to time ta3. Time ta2 indicates a point in time during the swipe operation. The backward playback point corresponding to time ta2 is time ta-1.

[0054] At time ta3 when the swipe operation ends, the playback control unit 27 ends the playback, and the display control unit 28 ends the display of the video. When the display of the video ends, the transmissive display panel 14 enters the transmissive state.

[0055] Even after the finger is released from the operation unit 15 at time ta3 when the swipe operation ends, the playback control unit 27 may continue playback in the reverse direction for, for example, about one second, and then the display control unit 28 may end the display of the video.

[0056] At time ta3 when the swipe operation ends, the display control unit 28 may display the image at time ta-2 as a still image for, for example, about one second, and then end the display of the image.

[0057] If a swipe operation is performed again in the same direction after time ta3, the playback control unit 27 performs playback in the reverse direction going back further from time ta-2.

[0058] A case where the speed of reverse playback is changed based on the operation speed of a swipe operation will be described with reference to Fig. 8. For example, when reverse playback is performed at 0.5x speed, at time ta3, the video up to time ta-1 is played back in the reverse direction. For example, when reverse playback is performed at 2x speed, at time ta3, the video up to time ta-2 is played back in the reverse direction.

[0059] FIG. 9 is a diagram showing another example of the relationship between operations and displayed images in the first embodiment. FIG. 9 also shows the passage of time toward the right. In the example shown in FIG. 9, a passenger starts a touch operation at time tb0 and the finger performing the touch operation remains stationary until time tb1. The playback control unit 27 plays back the video being captured from time tb0, and the display control unit 28 displays the video on the transmissive display panel 14. The passenger then performs a swipe operation in the direction of travel of the vehicle from time tb1 to time tb3. The playback control unit 27 plays back the video from time tb1. The playback control unit 27 plays back video from time tb1 to time tb2, which is video of the same duration as the period from time tb1 to time tb3. Time tb2 indicates a point in time during the swipe operation. The playback point in the reverse direction corresponding to time tb2 is time tb1.

[0060] <Effects> As described above, in this embodiment, when operation of the operation unit 15 is started, the transmissive display panel 14 displays the image at the time when operation of the operation unit 15 is started. In this embodiment, when the operation direction of the operation unit 15 is operated along the traveling direction of the vehicle, the image recorded by the recording control unit 22 is played back in the reverse direction from the image at the time when operation of the operation unit 15 was started. According to this embodiment, the image can be instantly played back in the reverse direction by operation. According to this embodiment, it is possible for a vehicle occupant to instantly check the conditions of locations and facilities that the vehicle has passed through while traveling.

[0061] In this embodiment, when operation of the operation unit 15 is started, the image being captured from the time the operation of the operation unit 15 is started is displayed on the transmissive display panel 14. In this embodiment, when the operation direction of the operation unit 15 is operated along the traveling direction of the vehicle, the recording control unit 22 plays back the recorded image in the reverse direction. According to this embodiment, it is possible to instantly check the conditions of locations and facilities that the vehicle has passed through while traveling from the image being captured.

[0062] In this embodiment, the speed at which the video is played back in the reverse direction is changed based on the operation speed when the operation unit 15 is operated in the direction of travel of the vehicle. According to this embodiment, the video playback speed can be intuitively changed according to the operation speed.

[0063] In this embodiment, the speed at which the video is played back in the reverse direction is changed based on the traveling speed of the vehicle when operation of the operation unit 15 is started. According to this embodiment, the playback speed can be appropriately changed according to the traveling speed of the vehicle.

[0064] [Second embodiment] An image display device 10 according to this embodiment will be described with reference to Figs. 10 to 14. Fig. 10 is a block diagram showing an example of the configuration of an image display device according to a second embodiment. Fig. 11 is a schematic diagram explaining an example of an operation in an operation unit in the second embodiment. Fig. 12 is a flowchart showing an example of a processing flow in a control device according to the second embodiment. Fig. 13 is a diagram showing an example of the relationship between an operation and a displayed image in the second embodiment. Fig. 14 is a diagram showing another example of the relationship between an operation and a displayed image in the second embodiment.

[0065] The present embodiment addresses the problem that it is difficult for a vehicle occupant to instantly check the past conditions of the surroundings, including the location where the vehicle is traveling, when viewing the surroundings of the vehicle while the vehicle is traveling. The present embodiment aims to enable a vehicle occupant to instantly check the past conditions of the surroundings, including the location where the vehicle is traveling.

[0066] In this embodiment, the image display device 10A displays an image previously captured at the same position as the vehicle on the transmissive display panel 14. The image display device 10A plays back or forward an image of the surroundings of the vehicle depending on the operation direction, and displays the image on the transmissive display panel 14.

[0067] The basic configuration of the video display device 10A is the same as that of the video display device 10 of the first embodiment. In the following description, the same or corresponding reference numerals are used to designate the same components as those of the video display device 10, and detailed description thereof will be omitted. This embodiment differs from the first embodiment in that it includes a GNSS (Global Navigation Satellite System) receiver 16A and a location information acquirer 29A, and in the processing of the video acquirer 21A, recording controller 22A, identifier 24A, and playback controller 27A.

[0068] The GNSS receiving unit 16A is configured with a GNSS receiver that receives GNSS signals from GNSS satellites, etc. The GNSS receiving unit 16A outputs the received position information signal to a position information acquisition unit 29A of the control device 20.

[0069] The position information acquisition unit 29A acquires position information indicating the current position of the vehicle. The position information acquisition unit 29A calculates the position information of the current position of the vehicle based on the GNSS signal received by the GNSS receiving unit 16A using a known method.

[0070] The video acquisition unit 21A acquires a video including information about the location where the video was taken.

[0071] The video acquisition unit 21A may acquire the video recorded in the recording unit 12.

[0072] The recording control unit 22A associates the video captured by the camera 11 with the shooting position and records it in the recording unit 12. The recording control unit 22A records the video captured by the camera 11 in the recording unit 12 together with the position information acquired by the position information acquisition unit 29A.

[0073] The specifying unit 24A specifies the range to be displayed on the transmissive display panel 14 in the image acquired by the image acquiring unit 21A.

[0074] The playback control unit 27A plays back the video acquired by the video acquisition unit 21 A. The playback control unit 27A performs forward playback or reverse playback according to the operation direction of the operation unit 15.

[0075] Forward playback refers to playing back past footage of a place you plan to travel to, while backward playback refers to playing back past footage of a place you have already passed.

[0076] 11 is a schematic diagram illustrating an example of an operation on the operation unit in the second embodiment. As an example, FIG. 11 shows a right rear door glass 104. For example, a passenger swipes from an operation start point P11 along the direction of arrow A1, which is a first direction, like a so-called seek bar. For example, a passenger swipes from an operation start point P12 along the direction of arrow A2, which is a second direction opposite to the first direction, like a so-called seek bar.

[0077] When operation of the operation unit 15 is started, the playback control unit 27A displays on the transmissive display panel 14 video that was previously captured at the same position as the vehicle's position when operation of the operation unit 15 was started, which video was acquired by the video acquisition unit 21A, and when the operation direction of the operation unit 15 is operated in a first direction along the vehicle's traveling direction, the playback control unit 27A plays the video in a forward direction, and when the operation direction of the operation unit 15 is operated in a direction opposite to the first direction along the vehicle's traveling direction, the playback control unit 27A plays the video in a reverse direction. For example, when a swipe operation is performed in the first direction along the vehicle's traveling direction, the playback control unit 27A plays the past video in a forward direction. For example, when a swipe operation is performed in the direction opposite to the first direction along the vehicle's traveling direction, the playback control unit 27A plays the past video in a reverse direction.

[0078] The playback control unit 27A may play back video that was previously captured at the same position and in the same traveling direction as the vehicle when the operation of the operation unit 15 was started.

[0079] The playback control unit 27A may play back video previously captured by the camera 11 corresponding to the window glass on which the operation unit 15 is located. For example, when the operation unit 15 of the right rear door glass 104 is operated, the playback control unit 27A may play back video previously captured by the camera 11 capturing the right side of the vehicle.

[0080] When there are multiple images captured in the past at the same position and in the same traveling direction as the vehicle when the operation was started, the playback control unit 27A may select the most recently captured image as the playback target.

[0081] When a swipe operation in the same direction is repeated, the playback control unit 27A may play back multiple images previously captured at the same position and direction of travel as the vehicle when the operation was started, so that each swipe operation becomes an older image.

[0082] When there are multiple images captured in the past at the same position and in the same traveling direction as the vehicle when the operation was started, the playback control unit 27A may select images captured a predetermined period of time ago, such as one year ago, as the playback target. In this case, when a swipe operation in the same direction is repeated, the playback target may be older images with each swipe operation, such as playing back images captured a predetermined period of time ago, such as one year ago.

[0083] For example, in the case of a swipe operation like that on a smartphone screen, if the swipe operation is from front to back, in other words, in a first direction, forward playback is performed, and if the swipe operation is from back to front, in other words, in the direction opposite to the first direction, reverse playback is performed.

[0084] The playback control unit 27A may change the speed at which the video is played back based on the operation speed when the operation unit 15 is operated in the direction of travel of the vehicle. In this embodiment, the playback control unit 27A changes the speed of forward playback or reverse playback based on the amount of swipe operation per unit time, in other words, the operation speed. For example, when the operation speed is about 100 mm / sec, the playback control unit 27A performs forward playback or reverse playback at 1x speed. For example, when the operation speed is about 50 mm / sec, the playback control unit 27A performs forward playback or reverse playback at 0.5x speed. For example, when the operation speed is about 200 mm / sec, the playback control unit 27A performs forward playback or reverse playback at 2x speed. The correspondence between the operation speed and the playback speed may be linear or stepwise.

[0085] The playback control unit 27A may change the speed at which the video is played back based on the vehicle's traveling speed when the operation of the operation unit 15 is started. The playback control unit 27A may change the speed at which the video is played back in the forward direction or the reverse direction, depending on the vehicle's traveling speed when the operation of the operation unit 15 is started, from the vehicle speed information acquired by the vehicle speed information acquisition unit 26. For example, when the vehicle's traveling speed when the operation of the operation unit 15 is started is between 0 km / h and 20 km / h, the playback control unit 27A performs forward playback or reverse playback at 0.5x speed. For example, when the vehicle's traveling speed when the operation of the operation unit 15 is started is between 20 km / h and 60 km / h, the playback control unit 27A performs forward playback or reverse playback at 1x speed. For example, when the vehicle's traveling speed when the operation of the operation unit 15 is started is 60 km / h or higher, the playback control unit 27A performs forward playback or reverse playback at 2x speed. The vehicle speed and the playback speed may be correlated linearly or stepwise.

[0086] Next, the flow of processing in the control device 20A will be described with reference to Fig. 12. The processing in steps S111 and S117 is the same as that in steps S102 and S106 in the flowchart shown in Fig. 7.

[0087] When it is determined that the operation has started (Yes in step S111), the control device 20A displays the image previously captured at the same position as when the operation started (step S112). More specifically, the control device 20A causes the identification unit 24 to identify a predetermined range from the image previously captured as the range to be displayed on the transmissive display panel 14. The control device 20A controls the playback control unit 27A to play back the image previously captured at the same position as the vehicle's position when the operation of the operation unit 15 started, which image was acquired by the image acquisition unit 21A. The control device 20A causes the display control unit 28 to display the image on the transmissive display panel 14 based on a control signal from the playback control unit 27A. The control device 20A proceeds to step S113.

[0088] The control device 20A determines whether or not a swipe operation has been performed (step S113). More specifically, the control device 20A determines that a swipe operation has been performed when the operation control unit 25 has received a swipe operation on the operation unit 15. When the operation control unit 25 determines that a swipe operation has been performed (Yes in step S113), the control device 20A proceeds to step S114. When the operation control unit 25 does not determine that a swipe operation has been performed (No in step S113), the control device 20A proceeds to step S119.

[0089] When it is determined that a swipe operation has been performed (Yes in step S113), the control device 20A determines whether the operation direction is the first direction (step S114). When it is determined that the operation direction of the swipe operation is the first direction (Yes in step S114), the control device 20A proceeds to step S115. When it is determined that the operation direction of the swipe operation is not the first direction (No in step S114), the control device 20A proceeds to step S116.

[0090] If it is determined that the operation direction is the first direction (Yes in step S114), the control device 20A starts forward playback (step S115). More specifically, the control device 20A controls the playback control unit 27A to play back in the forward direction from the image when the operation of the operation unit 15 started. The control device 20A controls the display control unit 28 to display the image on the transmissive display panel 14 based on the control signal from the playback control unit 27A. The control device 20A proceeds to step S117.

[0091] If it is not determined that the operation direction is the first direction (No in step S114), the control device 20A starts playing back the video in the reverse direction (step S116). More specifically, the control device 20A controls the playback control unit 27A to play back the video in the reverse direction from the video when the operation of the operation unit 15 was started. The control device 20A controls the display control unit 28 to display the video on the transmissive display panel 14 based on the control signal from the playback control unit 27A. The control device 20A proceeds to step S117.

[0092] If it is determined that the operation has ended (Yes in step S117), the control device 20A ends the playback (step S118). More specifically, the control device 20A causes the playback control unit 27A to end the playback of the video. The control device 20A causes the display control unit 28 to end the display of the video on the transmissive display panel 14 based on the control signal from the playback control unit 27A. The control device 20A proceeds to step S119.

[0093] The control device 20A determines whether or not to terminate the process (step S119). For example, the determination to terminate is made when the power or motive power of the vehicle is turned off or when a termination operation is performed on the operation unit 15. If the control device 20A determines to terminate the process (Yes in step S119), it terminates this process. If the control device 20A does not determine to terminate the process (No in step S119), it executes the process of step S113 again.

[0094] FIG. 13 illustrates an example of processing when a swipe is made in a first direction along the vehicle's traveling direction. FIG. 13 shows that time is passing to the right. The playback control unit 27A acquires previously captured and recorded video that includes the same position information as the vehicle's position information at time ta0 when the touch operation is detected. The example shown in FIG. 13 illustrates a state in which the passenger starts a touch operation at time ta0 and the finger that performed the touch operation remains stationary until time ta1. The playback control unit 27A plays back, as a still image, a video of the past video at time tVa0 that includes the same position information and traveling direction as at time ta0, and the display control unit 28 displays the video on the transmissive display panel 14.

[0095] After that, the passenger performs a swipe operation in a first direction along the traveling direction of the vehicle from time ta1 to time ta2. The playback control unit 27A performs forward playback from time tVa0, and forward plays back the video from time tVa0 to time tVa1, which is video with a length of time equivalent to the period from time ta1 to time ta2.

[0096] At time ta2 when the swipe operation ends, the playback control unit 27 ends the playback, and the display control unit 28 ends the display of the video. When the video display ends, the transmissive display panel 14 enters the transmissive state.

[0097] Even after the finger is released from the operation unit 15 at time ta2 when the swipe operation ends, the playback control unit 27A may continue playback in the reverse direction for, for example, about one second, and then the display control unit 28 may end the display of the video.

[0098] At time ta2 when the swipe operation ends, the display control unit 28 may display the video at time tVa1 as a still image for, for example, about one second, and then end the display of the video.

[0099] If a swipe operation is performed again in the same direction after time ta2, the playback control unit 27A may perform playback further in the forward direction from time tVa1.

[0100] FIG. 14 illustrates an example of processing when a swipe is made in the direction opposite to the vehicle's traveling direction. FIG. 14 also shows the passage of time toward the right. The playback control unit 27A acquires previously captured and recorded video containing the same position information as the vehicle's position information at time tb0 when the touch operation is detected. In the example shown in FIG. 14, the passenger starts a touch operation at time tb0, and there is no movement of the finger that performed the touch operation until time tb1. The playback control unit 27A plays back the video at time tVb0, which contains the same position information and traveling direction as those at time tb0 in the previous video, as a still image, and the display control unit 28 displays the video on the transmissive display panel 14.

[0101] Thereafter, the passenger performs a swipe operation in the direction opposite to the first direction along the traveling direction of the vehicle from time tb1 to time tb2. The playback control unit 27A performs playback in the reverse direction from time tVb0, and plays back in the reverse direction the video from time tVb0 to time tVb-1, which is video with a length of time equivalent to the period from time tb1 to time tb2.

[0102] At time tb2 when the swipe operation ends, the playback control unit 27A ends the playback, and the display control unit 28 ends the display of the video. When the display of the video ends, the transmissive display panel 14 enters the transmissive state.

[0103] Even after the finger is released from the operation unit 15 at time tb2 when the swipe operation ends, the playback control unit 27A may continue playback in the reverse direction for, for example, about one second, and then the display control unit 28 may end the display of the video.

[0104] At time tb2 when the swipe operation ends, the display control unit 28 may display the video at time tVb-1 as a still image for, for example, about one second, and then end the display of the video.

[0105] If a swipe operation is performed again in the same direction after time tb2, the playback control unit 27A may perform playback in the reverse direction from time tVb-1.

[0106] As described above, in this embodiment, when operation of the operation unit 15 is started, the image previously captured by the image acquisition unit 21A at the same position as the vehicle's position when operation of the operation unit 15 is started is displayed on the transmissive display panel 14. In this embodiment, when the operation direction of the operation unit 15 is operated in a first direction along the vehicle's traveling direction, the image is played back in a forward direction, and when the operation direction of the operation unit 15 is operated in a direction opposite to the first direction along the vehicle's traveling direction, the image is played back in a reverse direction. According to this embodiment, the image can be instantly played back in a reverse or forward direction depending on the operation direction. According to this embodiment, it is possible for a vehicle occupant to instantly check the past state of the surrounding area, including the position where the vehicle is traveling.

[0107] In this embodiment, the video captured by the camera 11 is recorded together with the location information in the recording unit 12. According to this embodiment, it is possible to easily obtain past video of the surrounding area including the location where the vehicle is traveling.

[0108] In this embodiment, the speed at which the video is played back is changed based on the operation speed when the operation direction of the operation unit 15 is operated along the traveling direction of the vehicle, or the moving speed of the vehicle when operation of the operation unit 15 is started. According to this embodiment, the video playback speed can be intuitively changed according to the operation speed.

[0109] [Third embodiment] The image display device 10 according to this embodiment will be described with reference to FIG. 15. FIG. 15 is a block diagram showing an example of the configuration of an image display device according to a third embodiment. The image display device 10B displays past images captured by other vehicles and stored in an external server on a transmissive display panel 14. The basic configuration of the image display device 10B is similar to that of the image display device 10A according to the second embodiment. This embodiment differs from the second embodiment in that it includes a communication unit 17B and in the processing performed by the image acquisition unit 21B.

[0110] The images captured by a camera (not shown) mounted on another vehicle are stored in an external server (not shown) via a communication unit (not shown) of the other vehicle, along with information indicating the time, location, direction of travel, etc., at the time of capture.

[0111] The external server stores images captured by cameras mounted on multiple vehicles. In response to a request for image acquisition from the image display device 10B mounted on each vehicle, the external server transmits the stored images to the image display device 10B. More specifically, the external server receives information indicating the vehicle's current position and traveling direction along with the image acquisition request from the vehicle's image display device 10B. The external server detects, from the stored images previously captured by other vehicles, images that include the same position as the current position of the received vehicle and that are traveling in the same direction as the traveling direction of the received vehicle. When multiple images are detected, the external server selects an image according to a predetermined condition, such as the most recent past or a past image from a predetermined period of time ago. The external server then transmits the detected image to the image display device 10B.

[0112] The communication unit 17B is a communication unit. The communication unit 17B may communicate via any method, such as the Internet or a mobile phone line. The communication unit 17B is connected to an external server via a communication network (not shown) so that data can be communicated. The communication unit 17B receives video captured in another vehicle from the external server.

[0113] Video acquisition unit 21B acquires video captured by another vehicle. When operation of operation unit 15 is started, video acquisition unit 21B uses communication by communication unit 17B to transmit information indicating the current position information and traveling direction of the vehicle, along with a video acquisition request, to an external server. Video acquisition unit 21B acquires from the external server video previously captured by another vehicle, which includes the same position as the current position and is in the same traveling direction.

[0114] The playback control unit 27B plays back the video received by the other communication unit 17B from the external server and acquired by the video acquisition unit 21B in accordance with the operation direction of the operation unit 15. The processing of the control device 20B in this embodiment is a processing in which the video to be played back is replaced with the playback of video previously captured by another vehicle at the same position as the operation start point, as compared to the processing in the second embodiment shown in Fig. 12. Also, in Figs. 13 and 14, the displayed video is the video previously captured by another vehicle at the same position as the operation start point.

[0115] As described above, in this embodiment, it is possible to instantly check the past conditions of the surrounding area, including the position where the vehicle is traveling, using images captured by another moving body.

[0116] [Fourth embodiment] An image display device 10B according to this embodiment will be described with reference to Figs. 16 to 20. Fig. 16 is a diagram illustrating the relative positional relationship between the subject vehicle and another vehicle. Fig. 17 is a schematic diagram illustrating an example of an operation in an operation unit in the fourth embodiment. Fig. 18 is a flowchart illustrating an example of a processing flow in a control device according to the fourth embodiment. Fig. 19 is a diagram illustrating an example of a relationship between an operation and a displayed image in the fourth embodiment. Fig. 20 is a diagram illustrating another example of a relationship between an operation and a displayed image in the fourth embodiment.

[0117] The present embodiment addresses the problem that, when a passenger of a moving body is visually checking the surroundings of the moving body while the moving body is moving, it is difficult to immediately check the current state of positions that the moving body has passed through as the moving body has moved, or the current state of positions that the moving body is scheduled to move to in the future. The present embodiment aims to enable a passenger of a moving body to immediately check the current state of positions that the moving body has passed through as the moving body has moved, or the current state of positions that the moving body is scheduled to move to in the future, when the passenger of the moving body is visually checking the surroundings of the moving body while the moving body is moving.

[0118] In this embodiment, the image display device 10B plays back, depending on the operation direction, an image captured by another vehicle in the traveling direction of the vehicle or an image captured by another vehicle in the opposite direction to the traveling direction of the vehicle, and displays it on the transmissive display panel 14. The basic configuration of the image display device 10B is similar to that of the image display device 10B of the third embodiment. In this embodiment, the processing in the image acquisition unit 21B and the playback control unit 27B is different from that of the third embodiment.

[0119] The external server acquires images captured by cameras mounted on multiple vehicles. In response to an image acquisition request from the image display device 10B mounted on each vehicle, the external server transmits the acquired images to the image display device 10B. More specifically, the external server receives information indicating the vehicle's current position and traveling direction along with the image acquisition request from the vehicle's image display device 10B. From the accumulated images captured by the other vehicles, the external server detects other vehicles that are traveling on the same road within a predetermined range from the received current position and that are capable of transmitting images. The external server then detects images from the detected other vehicles. The external server then transmits the detected images to the image display device 10B.

[0120] When operation unit 15 is operated, image acquisition unit 21B may be in a state where it is possible to acquire an image captured by another vehicle present in the traveling direction of the vehicle or in the opposite direction to the traveling direction of the vehicle.

[0121] The image acquisition unit 21B acquires images, including location information, of the surroundings of other vehicles traveling around the vehicle. The image acquisition unit 21B communicates with an external server using wireless communication via the communication unit 17B to acquire the images captured by the other vehicles. When operation of the operation unit 15 is started, the image acquisition unit 21B starts acquiring the images captured by the other vehicles traveling around the vehicle.

[0122] Image acquisition unit 21B may acquire images from other vehicles that are farther away from the vehicle in accordance with the number of times operation unit 15 is operated. For example, image acquisition unit 21B may acquire images captured by other distant vehicles one by one each time operation unit 15 is operated.

[0123] The greater the operation amount or operation speed of the operation unit 15, the more the video acquisition unit 21B may acquire video from another vehicle that is farther away from the vehicle. The video acquisition unit 21B may acquire and play back video from another vehicle that is farther away from the vehicle, for example, based on the operation amount per unit time of the swipe operation, in other words, the operation speed. For example, when the operation speed is less than 100 mm / sec, the video acquisition unit 21B acquires and plays back video from the nearest other vehicle or another vehicle located within 100 m. For example, when the operation speed is 100 mm / sec or more, the video acquisition unit 21B acquires and plays back video from the second nearest other vehicle or another vehicle located within 100 m to 200 m.

[0124] The faster the vehicle's traveling speed is when operation of operation unit 15 is started, the more image acquisition unit 21B may acquire images from other vehicles that are farther away from the vehicle. For example, when the vehicle's traveling speed is between 0 km / h and 20 km / h when operation of operation unit 15 is started, image acquisition unit 21B acquires images from the nearest other vehicle or other vehicles located within 100 m. For example, when the vehicle's traveling speed is between 20 km / h and 60 km / h when operation of operation unit 15 is started, image acquisition unit 21B acquires images from the second nearest other vehicle or other vehicles located within 100 m to 200 m. When the vehicle's traveling speed is 60 km / h or higher when operation of operation unit 15 is started, image acquisition unit 21B acquires images from the third nearest other vehicle or other vehicles located within 200 m to 500 m.

[0125] When the operation direction of the operation unit 15 is operated in a first direction along the vehicle's traveling direction, the playback control unit 27B plays back video footage captured by other vehicles located in the vehicle's traveling direction, and when the operation direction of the operation unit 15 is operated in the opposite direction to the first direction along the vehicle's traveling direction, the playback control unit 27B plays back video footage captured by other vehicles located in the opposite direction to the vehicle's traveling direction.

[0126] The playback control unit 27B plays back video acquired from another vehicle ahead of the vehicle or video acquired from another vehicle behind the vehicle, depending on the operation direction of the operation unit 15. Playback of video acquired from another vehicle ahead is playback of video of the location where the vehicle is scheduled to travel from. Playback of video acquired from another vehicle behind is playback of video of the location where the vehicle has just passed after the vehicle has passed.

[0127] For example, when operated from the front to the rear like a so-called seek bar, the video acquired from the other vehicle in front is played back, and when operated from the rear to the front, the video acquired from the other vehicle behind is played back.

[0128] For example, when a swipe operation is performed from front to rear, in other words, in a first direction, like on a smartphone screen, the video acquired from another vehicle in front is played back, and when a swipe operation is performed from rear to front, in other words, in the direction opposite to the first direction, the video acquired from another vehicle behind is played back.

[0129] 17 shows a right rear door glass 104 as an example. For example, a passenger swipes from an operation start point P11 along the direction of arrow A1, which is a first direction, like a so-called seek bar. For example, a passenger swipes from an operation start point P12 along the direction of arrow A2, which is a second direction opposite to the first direction, like a so-called seek bar.

[0130] When a second swipe operation is performed in the same direction, the playback control unit 27B acquires and plays back video from another vehicle that is farther away from the host vehicle than the other vehicle that was played back during the period from time tVc0 to time tVc1. For example, the playback control unit 27B plays back video captured by the other vehicle Va with the first swipe operation, and plays back video captured by the other vehicle Vb with the second swipe operation. The other vehicles Va and Vb are both traveling in the same direction on the same road as the host vehicle V. The distance from the other vehicle from which video can be acquired may be limited. For example, the other vehicle may be within 1 km of the host vehicle.

[0131] The playback control unit 27B may play back video from other vehicles that are farther away from the vehicle as the operation amount or operation speed of the operation unit 15 increases. The playback control unit 27B may generate video from other vehicles that are farther away from the vehicle, for example, based on the operation amount per unit time of the swipe operation, in other words, the operation speed. For example, when the operation speed is less than 100 mm / sec, the playback control unit 27B plays back video from the nearest other vehicle or another vehicle located within 100 m. For example, when the operation speed is 100 mm / sec or more, the playback control unit 27B plays back video from the second nearest other vehicle or another vehicle located within 100 m to 200 m.

[0132] The playback control unit 27B acquires and plays back video from other vehicles at a distance from the host vehicle based on the vehicle speed information acquired by the vehicle speed information acquisition unit 26, depending on the vehicle's traveling speed when the operation of the operation unit 15 is initiated. For example, if the vehicle's traveling speed is between 0 km / h and 20 km / h when the operation of the operation unit 15 is initiated, the playback control unit 27B plays back video from the nearest other vehicle or from another vehicle located within 100 meters. For example, if the vehicle's traveling speed is between 20 km / h and 60 km / h when the operation of the operation unit 15 is initiated, the playback control unit 27B plays back video from the second nearest other vehicle or from another vehicle located within 100 meters to 200 meters. For example, if the vehicle's traveling speed is 60 km / h or higher when the operation of the operation unit 15 is initiated, the playback control unit 27B plays back video from the third nearest other vehicle or from another vehicle located within 200 meters to 500 meters.

[0133] Next, the flow of processing in the control device 20 will be described with reference to Fig. 18. The processing in steps S121, S123, S124, and S127 to S129 is the same as that in steps S111, S113, S114, and S117 to S119 in the flowchart shown in Fig. 12.

[0134] When it is determined that the operation has started (Yes in step S121), the control device 20B requests the external server to acquire images captured by other vehicles traveling around the vehicle (step S122). More specifically, the control device 20B makes the image acquisition unit 21B capable of acquiring images, including location information, captured around the other vehicles traveling around the vehicle from the external server. The control device 20B proceeds to step S123.

[0135] When it is determined that the operation direction is the first direction (Yes in step S124), the control device 20B acquires video captured by another vehicle present in the traveling direction and starts playing back the video (step S125). More specifically, the control device 20B acquires video captured by another vehicle present in the traveling direction using the video acquisition unit 21B. The control device 20B specifies, using the identification unit 24, a predetermined range from the video captured by another vehicle present in the traveling direction as a range to be displayed on the transmissive display panel 14. The control device 20B plays back, using the playback control unit 27B, the video captured by the other vehicle present in the traveling direction, acquired by the video acquisition unit 21B. The control device 20B causes the display control unit 28 to display the video on the transmissive display panel 14 based on a control signal from the playback control unit 27B. The control device 20B proceeds to step S127.

[0136] If it is not determined that the operation direction is the first direction (No in step S124), the control device 20B acquires video captured by another vehicle located in the opposite direction to the traveling direction, and starts playing back the video (step S126). More specifically, the control device 20B acquires video captured by another vehicle located in the opposite direction to the traveling direction using the video acquisition unit 21B. The control device 20B specifies, using the identification unit 24, a predetermined range from the video captured by the other vehicle located in the opposite direction to the traveling direction, as a range to be displayed on the transmissive display panel 14. The control device 20B plays back, using the playback control unit 27B, the video captured by the other vehicle located in the opposite direction to the traveling direction, acquired by the video acquisition unit 21B. The control device 20B causes the display control unit 28 to display the video on the transmissive display panel 14 based on a control signal from the playback control unit 27B. The control device 20B proceeds to step S127.

[0137] 19 and 20 illustrate an example of processing when the vehicle's operation unit 15 is operated. At time tc0 when the touch operation is detected, the video acquisition unit 21B requests an external server to acquire video from other vehicles traveling in the same direction on the same road around the vehicle. In the example shown in FIGS. 19 and 20, the passenger starts the touch operation at time tc0 and does not move the finger that performed the touch operation until time tc1. At time tc0, the playback control unit 27B does not select or play the requested video.

[0138] 19, the passenger performs a swipe operation in a first direction, which is the traveling direction of the vehicle, during a period from time tc1 to time tc2. The playback control unit 27B selects a video acquired from another vehicle present in the traveling direction, performs forward playback from time tc1, and plays back the video from time tVc0 to time tVc1, which is video with a duration equivalent to the period from time tc1 to time tc2.

[0139] 20, the passenger performs a swipe operation in the direction opposite to the first direction, which is the traveling direction of the vehicle, during the period from time tc1 to time tc2. The playback control unit 27B selects a video acquired from another vehicle located in the opposite direction to the traveling direction, performs forward playback from time tc1, and plays back the video from time tVc0 to time tVc1, which is video with a duration equivalent to the period from time tc1 to time tc2.

[0140] 19 and 20, the display control unit 28 ends the display of the image at time tc2 when the swipe operation ends. When the display of the image ends, the transmissive display panel 14 enters the transmissive state.

[0141] In the examples shown in Figures 19 and 20, even after the finger is released from the operation unit 15 at time tc2 when the swipe operation ends, the playback control unit 27B may continue playing the video acquired from another vehicle for, for example, about one second, and then the display control unit 28 may end the display of the video.

[0142] In the examples shown in Figures 19 and 20, at time tc2 when the swipe operation ends, the display control unit 28 may display the image at time tVc1 as a still image for, for example, about one second, and then end the display of the image.

[0143] As described above, in this embodiment, when the operation direction of the operation unit 15 is operated in a first direction along the traveling direction of the vehicle, video images captured by other vehicles present in the traveling direction of the vehicle are played back, and when the operation direction of the operation unit 15 is operated in a direction opposite to the first direction along the traveling direction of the vehicle, video images captured by other vehicles present in the opposite direction to the traveling direction of the vehicle are played back. According to this embodiment, when a vehicle occupant is viewing the surroundings of the vehicle while the vehicle is traveling, the occupant can instantly check the current conditions of positions that the vehicle has passed through as the vehicle is traveling and the current conditions of positions that the vehicle is scheduled to travel from now on.

[0144] In this embodiment, depending on the number of times the operation unit 15 is operated, it is possible to acquire images from other vehicles that are far away from the vehicle.

[0145] In this embodiment, the greater the operation amount or operation speed of the operation unit 15, the more images can be acquired from other vehicles that are farther away from the vehicle.

[0146] In this embodiment, the faster the vehicle is moving when the operation of the operation unit 15 is started, the more images can be acquired from other vehicles that are farther away from the vehicle.

[0147] The image display device 10 according to the present disclosure may be implemented in various different forms other than the above-described embodiment.

[0148] Each component of the illustrated image display device 10 is a functional concept and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of each device is not limited to that shown in the figure, and all or part of the device may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0149] The configuration of the video display device 10 is realized, for example, as software, by a program loaded into memory. In the above embodiment, the functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms using only hardware, only software, or a combination of both.

[0150] The above-described components include those that can be easily imagined by a person skilled in the art and those that are substantially the same. Furthermore, the above-described configurations can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations are possible within the scope of the gist of the present invention.

[0151] <Modification> Although the above has described touch operations, swipe operations, and flick operations on the operation unit 15, the present invention is not limited to these. For example, the movement of a hand approaching the transmissive display panel 14 may be captured by an in-vehicle camera (for example, installed above each transmissive display panel), and the operation may be performed by tracing the trajectory of the hand. In this case, the present invention may be applied to an operation in which a hand is brought close to the transmissive display panel 14 (operation start) and then moved in the opposite direction to the traveling direction of the vehicle. Alternatively, the present invention may be applied to a gesture operation using a ring-shaped device such as a smart ring.

[0152] In the fourth embodiment, the video is acquired from the other vehicle, an external server, or streaming from the own vehicle, and the other vehicle video is not recorded in the own vehicle. [Explanation of symbols]

[0153] 10. Video display device 11 Camera 12 Recording section 13 IF Section 14 Transmissive display panel 15 Control section 16A GNSS receiver 20 Control device (video display control device) 21 Video acquisition unit 22 Recording control section 24 Specific part 25 Operation control section 26 Vehicle speed information acquisition section 27 Playback control unit 28 Display control unit 29A Location information acquisition section 101 Windshield 102 Right front door glass 103 Left front door glass 104 Right rear door glass 105 Left rear door glass 106 Rear window 200 angle of view 201 View Range 202 Specific Range

Claims

1. an image acquisition unit that acquires an image including location information where the image was captured; a location information acquisition unit that acquires location information of a moving object; a transmissive display panel that is installed on a window of the vehicle and has transparency; an operation unit operable on the surface of the transmissive display panel; a specifying unit that specifies, from the image acquired by the image acquisition unit, a range in which a passenger of the moving body can see outside the vehicle through the window and that has the same shape as the transmissive display panel, as a range to be displayed on the transmissive display panel; a playback control unit that plays back the video acquired by the video acquisition unit; a display control unit that displays, on the transmissive display panel, an image within the range identified by the identification unit in the image played back by the playback control unit; Equipped with When operation of the operation unit is started, the playback control unit plays back the video image previously captured at the same position as the position of the moving body when operation of the operation unit is started, which video image was acquired by the video image acquisition unit, and when the operation direction of the operation unit is operated in a first direction along the traveling direction of the moving body, plays back the video image in a forward direction, and when the operation direction of the operation unit is operated in a direction opposite to the first direction along the traveling direction of the moving body, plays back the video image in a reverse direction. Video display device.

2. an imaging unit that captures images of the surroundings of the moving object; The image captured by the image capturing unit is recorded in a recording unit together with the position information acquired by the position information acquiring unit. a recording control unit for recording the Furthermore, The video acquisition unit acquires the video recorded in the recording unit.

2. The image display device according to claim 1.

3. The image acquisition unit acquires an image captured by another moving object.

2. The image display device according to claim 1.

4. the playback control unit changes the speed at which the video is played back based on an operation speed when the operation direction of the operation unit is operated along the traveling direction of the moving object, or based on a moving speed of the moving object when the operation of the operation unit is started.

3. The image display device according to claim 1.

5. a step of displaying, when an operation of an operation unit operable on a surface of a transmissive display panel is started, an image previously captured at the same position as the position of the moving body within a range in which a passenger of the moving body can see the outside of the vehicle through the window at the time the operation of the operation unit is started, and within a range having the same shape as the transmissive display panel, on the transmissive display panel, the image previously captured at the same position as the moving body at the time the operation of the operation unit is started; playing the video in a forward direction when the operation direction of the operation unit is operated in a first direction along the traveling direction of the moving body, and playing the video in a reverse direction when the operation direction of the operation unit is operated in a direction opposite to the first direction along the traveling direction of the moving body; The image display method is executed by an image display device.

Images