Video display device and video display method

Abstract

To allow a video to be confirmed immediately, the video being captured in a position through which a traveling vehicle has passed.SOLUTION: A video display device 10 includes: a video acquisition unit 21A which acquires a video including shooting location information; a location information acquisition unit 29A which acquires location information of a vehicle; a transmissive display panel 14 installed on the vehicle; an operation unit 15 which can be operated on a surface of the transmissive display panel 14; a specifying unit 24 which specifies a range for display; a reproduction control unit 27 which reproduces the acquired video; and a display control unit 28 which displays, on the transmissive display panel 14, a video of the specified range in the reproduced video. The reproduction control unit 27 displays, when an operation is started, a video captured in the past in the same position as a position of the vehicle where the operation is started, reproduces the video in a forward direction in the case where the operation is performed in a first direction along a traveling direction of the vehicle, or reproduces the video in a rewind direction in the case where the operation is performed in a direction opposite the first direction along the traveling direction of the vehicle.SELECTED DRAWING: Figure 10

Description

Technical Field

[0001] The present invention relates to a video display device and a video display method.

Background Art

[0002] A system for photographing the video around a vehicle has been put into practical use, and is used as, for example, a drive recorder. When the video photographed by such a system is not saved by event recording or the like, it is temporarily recorded and then overwritten by a new video. A technique for forward and backward playback of the video of the drive recorder by performing a flick operation on the screen based on the vanishing point which is a reference point has been disclosed (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] With the technique of Patent Document 1, it is difficult for a vehicle occupant to immediately confirm the video of the position passed by the vehicle while visually recognizing the surroundings of the vehicle during the vehicle's travel.

[0005] The present disclosure has been made in view of the above, and an object thereof is to enable immediate confirmation of the video of the position passed by the vehicle during travel.

Means for Solving the Problems

[0006] To solve the above-mentioned problems and achieve the objective, the video display device according to this disclosure includes: a video acquisition unit that acquires video including location information of where the video was captured; a location information acquisition unit that acquires location information of a moving object; a transparent display panel installed on the moving object and having transparency; an operation unit that can be operated on the surface of the transparent display panel; a specification unit that specifies the range to be displayed on the transparent display panel in the video acquired by the video acquisition unit; a playback control unit that plays back the video acquired by the video acquisition unit; and a display control unit that displays the video of the range specified by the specification unit in the video played back by the playback control unit on the transparent display panel. The playback control unit, when the operation of the operation unit is started, displays on the transparent display panel a video acquired by the video acquisition unit that was previously captured at the same position as the moving object when the operation of the operation unit was started; when the operation direction of the operation unit is operated in a first direction along the direction of travel of the moving object, it plays back the video in the forward direction; and when the operation direction of the operation unit is operated in the opposite direction to the first direction along the direction of travel of the moving object, it plays back the video in the reverse direction.

[0007] The video display method according to this disclosure includes the steps of: when an operation of an operating unit that is installed on a moving body and is operable on the surface of a transparent display panel is started, the video display device performs the steps of: displaying on the transparent display panel a video previously taken at the same position as the moving body at the time the operation of the operating unit was started; and when the operating direction of the operating unit is operated in a first direction along the direction of travel of the moving body, the video is played back in the forward direction, and when the operating direction of the operating unit is operated in the opposite direction to the first direction along the direction of travel of the moving body, the video is played back in the reverse direction. [Effects of the Invention]

[0008] According to this disclosure, it is possible to instantly check the video footage of the location that the vehicle has passed through. [Brief explanation of the drawing]

[0009] [Figure 1]Figure 1 is a block diagram showing an example configuration of a video display device according to the first embodiment. [Figure 2] Figure 2 is a schematic diagram illustrating an example of the field of view when photographing a vehicle's window glass. [Figure 3] Figure 3 is a schematic diagram illustrating an example of a rear door glass. [Figure 4] Figure 4 is a schematic diagram illustrating another example of rear door glass. [Figure 5] Figure 5 is a schematic diagram illustrating the shooting angle of view and the specific range. [Figure 6] Figure 6 is a schematic diagram illustrating an example of operation in the operating section of the first embodiment. [Figure 7] Figure 7 is a flowchart showing an example of the processing flow in the video display device according to the first embodiment. [Figure 8] Figure 8 shows an example of the relationship between operation and displayed image in the first embodiment. [Figure 9] Figure 9 shows another example of the relationship between operation and displayed image in the first embodiment. [Figure 10] Figure 10 is a block diagram showing an example configuration of a video display device according to the second embodiment. [Figure 11] Figure 11 is a schematic diagram illustrating an example of operation in the control unit of the second embodiment. [Figure 12] Figure 12 is a flowchart showing an example of the processing flow in the control device according to the second embodiment. [Figure 13] Figure 13 shows an example of the relationship between operation and displayed image in the second embodiment. [Figure 14] Figure 14 shows another example of the relationship between operation and displayed image in the second embodiment. [Figure 15] Figure 15 is a block diagram showing an example configuration of a video display device according to the third embodiment. [Figure 16] Figure 16 is a diagram illustrating the relative positional relationship between your vehicle and other vehicles. [Figure 17]FIG. 17 is a schematic diagram for explaining an example of an operation in the operation unit in the fourth embodiment. [Figure 18] FIG. 18 is a flowchart showing an example of a processing flow in the control device according to the fourth embodiment. [Figure 19] FIG. 19 is a diagram showing an example of the relationship between an operation and a display image in the fourth embodiment. [Figure 20] FIG. 20 is a diagram showing another example of the relationship between an operation and a display image in the fourth embodiment.

Mode for Carrying Out the Invention

[0010] Hereinafter, embodiments of a video display device and a video display method according to the present disclosure will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited by the following embodiments.

[0011] [First Embodiment] <Video Display Device> FIG. 1 is a block diagram showing a configuration example of a video display control device (hereinafter referred to as "control device") 20 according to the first embodiment.

[0012] In this embodiment, when a passenger of a moving body is visually recognizing the surroundings of the moving body during the movement of the moving body, it is difficult to immediately confirm the state of the position passed by the movement of the moving body, facilities, etc. This embodiment aims to enable the passenger of the moving body to immediately confirm the state of the position passed by the movement of the moving body, facilities, etc.

[0013] The video display device 10 reproduces, for example, a video around a moving body such as a vehicle, a ship, or a railway, and displays it on a transmissive display panel 14 arranged on the moving body. In this embodiment, the video display device 10 reproduces the video around the vehicle in the backward direction and displays it on the transmissive display panel 14 arranged on the vehicle. In the following embodiments, a vehicle will be used as an example of the moving body for explanation.

[0014] Rewinding playback means playing the video in the opposite direction to the passage of time; in other words, playing it in the reverse direction.

[0015] The video display device 10 may be mounted on a vehicle, or it may be a portable device that can be used in a vehicle. Furthermore, the video display device 10 may be implemented by including the functions or configurations of devices or navigation devices that are pre-installed in the vehicle. The video display device 10 includes a camera 11, a recording unit 12, an interface unit (hereinafter referred to as "IF unit") 13, a transparent display panel 14, an operation unit 15, and a control device 20.

[0016] Camera 11 is a camera that photographs the area around the vehicle. Camera 11 may be, for example, a camera specific to the video display device 10, or a camera for overhead images shared with an overhead image display system. Camera 11 may be a group of multiple cameras. Camera 11 is positioned to photograph, for example, the front of the vehicle, the right side of the vehicle, the left side of the vehicle, and the rear of the vehicle. Camera 11 may be provided for each transparent display panel 14 and photograph the surrounding scenery viewed through the transparent display panel 14. In other words, camera 11 is a camera that can photograph in orientations corresponding to the transparent display panel 14 to which the present invention can be applied. Camera 11 may be positioned corresponding to each window glass of the vehicle and photograph the surrounding scenery viewed from each window glass. In this embodiment, camera 11 continuously photographs images while the vehicle's accessory power is ON or while the vehicle is operating. Camera 11 outputs the photographed images to the image acquisition unit 21 of the control device 20. Video is, for example, a moving image composed of 27.5 frames per second.

[0017] Figure 2 is a schematic diagram illustrating an example of the field of view of a vehicle's window glass. As an example, the field of view 200 of the right camera 111, which photographs the right side, is described among the multiple cameras that make up camera 11. The right camera 111, which photographs the right side, is positioned, for example, on the right side mirror. The field of view 200 of the right camera 111, which photographs the right side, includes the viewing range 201 in which an occupant can see the outside of the vehicle from the right rear door glass 104.

[0018] The recording unit 12 is used for temporary storage of data in the video display device 10. The recording unit 12 is, for example, a semiconductor memory element such as RAM (Random Access Memory) or flash memory, or a memory card. Alternatively, it may be an external recording unit wirelessly connected via a communication device (not shown). The recording unit 12 records loop recording video based on control signals output from the recording control unit 22 of the control device 20. Loop recording video is video that has been recorded in a loop, and loop recording will be described later.

[0019] The IF unit 13 is an interface for acquiring vehicle speed information via CAN (Controller Area Network) or the like.

[0020] The transparent display panel 14 may be, for example, a display device specific to the video display device 10, or a display device shared with other systems, including a navigation system. A transparent organic EL (Electro-Luminescence) display is suitable for the transparent display panel 14, but it is not limited to this and other methods may be used. The transparent display panel 14 is installed around the vehicle, i.e., on the outer perimeter of the vehicle, and is transparent when no image is displayed. The transparent display panel 14 displays images of the vehicle's surroundings. The transparent display panel 14 displays images based on video signals output from the display control unit 28 of the control device 20. The transparent display panel 14 displays images captured by the camera 11 or images recorded in the recording unit 12.

[0021] The transmissive display panel 14 is either mounted on the vehicle's window glass or constitutes part of the vehicle's window glass. When no image is displayed, the transmissive display panel 14 has a transmittance of, for example, 60% or more in the visible light region. When an image is displayed, the transmittance of the transmissive display panel 14 in the area where the image is displayed is, for example, less than 20% or no transmittance at all.

[0022] The transparent display panel 14 can be applied to windows that allow visibility to the outside of the vehicle. For example, the transparent display panel 14 can be applied to at least one of the following: the windshield 101, the right front door glass 102, the left front door glass 103, the right rear door glass 104, the left rear door glass 105, and the rear glass 106 of the vehicle, as shown in Figure 2. In the following description, the transparent display panel 14 will be described as being applied to the right rear door glass 104 of the vehicle.

[0023] Figure 3 is a schematic diagram illustrating an example of a rear door glass. Figure 4 is a schematic diagram illustrating another example of a rear door glass. The shape of the touch panel, which is the transparent display panel 14 and the operating unit 15, may be the same as the overall shape of the glass to which it is applied, or it may be a rectangle smaller than the overall shape of the glass to which it is applied. In the example shown in Figure 3, the shape of the touch panel, which is the transparent display panel 14 and the operating unit 15, is the same as the overall shape of the right rear door glass 104. In the example shown in Figure 4, the shape of the touch panel, which is the transparent display panel 14 and the operating unit 15, is a rectangle smaller than the overall shape of the right rear door glass 104.

[0024] The operation unit 15 can receive various operations on the video display device 10. The operation unit 15 can be operated on the surface of the transparent display panel 14. The operation unit 15 is, for example, a touch panel superimposed on the display screen of the transparent display panel 14. For example, the operation unit 15 can receive various operations on the touch panel, such as touch operations, swipe operations, and flick operations, like a smartphone screen. For example, the operation unit 15 can receive an operation to play back video recorded in the recording unit 12. The operation unit 15 outputs operation information to the operation control unit 25 of the control device 20.

[0025] <Control device> The control device 20 is a processing unit (control device) composed of, for example, a CPU (Central Processing Unit). The control device 20 loads the stored program into memory and executes the instructions contained in the program. The control device 20 includes internal memory (not shown), which is used for temporary storage of data in the control device 20. The control device 20 has the following functions realized by its configuration and program: an image acquisition unit 21, a recording control unit 22, a identification unit 24, an operation control unit 25, a vehicle speed information acquisition unit 26, a playback control unit 27, and a display control unit 28.

[0026] The video acquisition unit 21 acquires images of the surrounding area captured by the camera 11, which photographs the area around the vehicle. The video acquisition unit 21 may also function as a shooting control unit that controls the shooting operation of the camera 11.

[0027] The recording control unit 22 records the video captured by the camera 11 to the recording unit 12. The recording control unit 22 controls the recording of the video acquired by the video acquisition unit 21 to the recording unit 12. During periods when the vehicle is operating, such as when the vehicle's accessory power is ON, the recording control unit 22 records the video acquired by the video acquisition unit 21 to the recording unit 12 as overwritable video. More specifically, the recording control unit 22 continues to record the video acquired by the video acquisition unit 21 to the recording unit 12, and when the capacity of the recording unit 12 is full, it performs loop recording, overwriting the old video with new video. The recording control unit 22 only needs to record the captured video for the time required for playback in the reverse direction. For example, loop recording of about 5 to 10 minutes of video is sufficient. The time that can be loop recorded is determined by the recording capacity of the recording unit 12. If there are multiple cameras 11, such as one on the left and one on the right, the recording control unit 22 loop records the video from each camera.

[0028] The identification unit 24 identifies a predetermined range from the image based on the field of view of the camera 11 as a specific range to be displayed on the transparent display panel 14. The identification unit 24 identifies the range in which an occupant can see outside the vehicle through the glass, starting from the average face (eye) position of an occupant in the seat closest to the vehicle's glass. For example, in the case of the right rear door glass 104, the identification unit 24 identifies the range in which an occupant can see outside the vehicle through the right rear door glass 104, starting from the average face (eye) position of an occupant seated in the right rear seat.

[0029] The identification unit 24 may detect the position and orientation of the passenger's face and the position and orientation of their eyes from the video footage captured by an in-vehicle camera (not shown), and may change the specified range according to the position and orientation of the eyes. The identification unit 24 may also detect the position and orientation of the passenger's face and the position and orientation of their eyes when the operation of the control unit 15 is started, specify the range in which the operation of the control unit 15 is started, and display the video footage of the specified range while the operation of the control unit 15 is in progress.

[0030] Figure 5 is a schematic diagram illustrating the shooting angle of view of the camera 11 and the specific range identified by the identification unit 24. The identification unit 24 identifies a specific range 202 to be displayed on the transparent display panel 14 in the video 200 captured by the camera 11. The identification unit 24 identifies the specific range 202 according to the shape of the transparent display panel 14. For example, if the transparent display panel 14 has the shape shown in Figure 3, the identification unit 24 identifies a specific range 202 that has the same shape as the entire surface of the glass to which it is applied. For example, if the transparent display panel 14 has the shape shown in Figure 4, the identification unit 24 identifies a rectangular specific range 202.

[0031] The operation control unit 25 acquires operation information for operations received by the operation unit 15. The operation control unit 25 acquires operation information indicating various operations on the touch panel, such as touch operations, swipe operations, and flick operations, and outputs a control signal. The operation control unit 25 acquires operations along the direction of travel, for example, and outputs a control signal indicating operation information.

[0032] An operation in line with the vehicle's direction of travel refers to an operation in either the forward or backward direction of the vehicle. For example, it refers to a swipe operation from front to back or back to front, such as when using a seek bar to indicate the playback position during video playback. Therefore, for the rear door glass located on the side of the vehicle, an operation in the left-right direction, as viewed from inside the vehicle's interior, is an operation in line with the vehicle's direction of travel.

[0033] Figure 6 is a schematic diagram illustrating an example of operation in the control unit in the first embodiment. As an example, Figure 6 shows the right rear door glass 104. The control unit 25 outputs a control signal indicating a touch operation to the operation start point P11 when, for example, a passenger performs a touch operation such as on a smartphone screen. The control unit 25 outputs a control signal indicating a swipe operation from rear to front, as indicated by arrow A1, when, for example, a user performs a swipe operation such as on a smartphone screen.

[0034] The vehicle's direction of travel is fundamentally forward. This invention does not apply when the vehicle is reversing. Therefore, sensing the vehicle's direction of travel is unnecessary. In the case of a transparent display panel 14 located on the right rear door glass 104 of the vehicle, for example, the direction of travel is pre-set to the left when viewed from the inside of the vehicle towards the transparent display panel 14. In the case of a transparent display panel 14 located on the left rear door glass 105 of the vehicle, for example, the direction of travel is pre-set to the right when viewed from the inside of the vehicle towards the transparent display panel 14.

[0035] The vehicle speed information acquisition unit 26 acquires vehicle speed information indicating the vehicle's speed via CAN or the like. The vehicle speed information acquisition unit 26 is not an essential component of the control device 20.

[0036] The playback control unit 27 controls the playback of video. The playback control unit 27 controls the playback of video recorded in the recording unit 12. Based on the control signal output from the operation control unit 25, the playback control unit 27 controls the playback of loop-recorded video recorded in the recording unit 12.

[0037] The playback control unit 27 controls the playback of the video in the reverse direction based on the control signal output from the operation control unit 25. When operation of the operation unit 15 is started, the playback control unit 27 displays the video at the time the operation of the operation unit 15 was started on the transparent display panel 14. If the operation direction of the operation unit 15 is operated in line with the direction of travel of the vehicle, the playback control unit 27 controls the playback of the video recorded by the recording control unit 22 in the reverse direction from the video at the time the operation of the operation unit 15 was started. When the transparent display panel 14 is touched, the playback control unit 27 displays the video at the time of the touch in a paused state. Subsequently, when the transparent display panel 14 is swipeed or otherwise operated, the playback control unit 27 controls the playback of the currently displayed video in the reverse direction.

[0038] The playback control unit 27 may control the camera 11 to play back the video being captured in real time. More specifically, when the operation of the operation unit 15 is started, the playback control unit 27 may display the video being captured from the time the operation of the operation unit 15 was started on the transparent display panel 14, and when the operation direction of the operation unit 15 is operated along the direction of travel of the vehicle, it may control the recording control unit 22 to play back the video recorded in the reverse direction. When the transparent display panel 14 is touched, the playback control unit 27 switches to the video being captured from the time of the touch, and then, when the transparent display panel 14 is swiped or otherwise operated, it controls the currently displayed video to play back in the reverse direction.

[0039] The playback control unit 27 may change the playback speed of the video in the reverse direction based on the operation speed when the operation direction of the operation unit 15 is operated along the direction of travel of the vehicle. In this embodiment, the playback control unit 27 changes the playback speed in the reverse direction based on the amount of operation per unit time of the swipe operation, in other words, the operation speed. For example, the playback control unit 27 performs reverse playback at 1x speed when the operation speed is about 100 mm / sec. For example, the playback control unit 27 performs reverse playback at 0.5x speed when the operation speed is about 50 mm / sec. For example, the playback control unit 27 performs reverse playback at 2x speed when the operation speed is about 200 mm / sec. The operation speed and playback speed may be correlated linearly or steppedly.

[0040] The playback control unit 27 may change the playback speed of the video in the reverse direction based on the vehicle's speed when the operation of the operation unit 15 is initiated. More specifically, the playback control unit 27 may change the playback speed of the video in the reverse direction according to the vehicle's speed when the operation of the operation unit 15 is initiated, based on the vehicle speed information acquired by the vehicle speed information acquisition unit 26. For example, if the vehicle's speed at the time the operation of the operation unit 15 is initiated is 0 km / h or more and 20 km / h or less, the playback control unit 27 performs reverse playback at 0.5 times the normal speed. If the vehicle's speed at the time the operation of the operation unit 15 is initiated is 20 km / h or more and 60 km / h or less, the playback control unit 27 performs reverse playback at 1 times the normal speed. If the vehicle's speed at the time the operation of the operation unit 15 is initiated is 60 km / h or more, the playback control unit 27 performs reverse playback at 2 times the normal speed. The vehicle's speed and the playback speed may be correlated linearly or steppedly.

[0041] The display control unit 28 displays the video within the range identified by the identification unit 24 in the video played back by the playback control unit 27 on the transparent display panel 14.

[0042] The display control unit 28 controls the display of video on the transparent display panel 14. Based on the control signal from the playback control unit 27, the display control unit 28 outputs a video signal that causes the video to be output to the transparent display panel 14. More specifically, the display control unit 28 outputs a video signal to be displayed by playing back the video being captured by the camera 11 or the video recorded in the recording unit 12.

[0043] <Information Processing in Control Devices> Next, the processing flow in the control device 20 will be explained using Figure 7. While the video display device 10 is running, the processing shown in the flowchart in Figure 7 is executed.

[0044] The control device 20 starts shooting and recording (step S101). More specifically, the video display device 10 starts shooting the area around the vehicle with the camera 11. The control device 20 then acquires the video of the area around the vehicle captured by the camera 11 using the video acquisition unit 21. The control device 20 then performs loop recording of the video captured by the camera 11 to the recording unit 12 using the recording control unit 22. The control device 20 then proceeds to step S102.

[0045] The control device 20 determines whether or not an operation has been started (step S102). More specifically, the control device 20 determines that an operation has been started if the operation control unit 25 has received a touch operation to the operation unit 15. If the control device 20 determines that an operation has been started by the operation control unit 25 (Yes in step S102), it proceeds to step S103. If the control device 20 does not determine that an operation has been started by the operation control unit 25 (No in step S102), it proceeds to step S108.

[0046] If it is determined that an operation has started (Yes in step S102), the control device 20 displays the video at the start of the operation (step S103). More specifically, the control device 20 uses the identification unit 24 to identify a predetermined range from the video based on the field of view of the camera 11 as the range to be displayed on the transparent display panel 14. The control device 20 uses the playback control unit 27 to control the playback control to play back the video at the time the touch operation of the operation unit 15 was started. The control device 20 uses the display control unit 28 to display the video at the time the touch operation of the operation unit 15 was started on the transparent display panel 14 based on the control signal from the playback control unit 27. The control device 20 then proceeds to step S104.

[0047] The control device 20 determines whether or not there is a swipe operation in the direction of travel (step S104). More specifically, the control device 20 determines that there is a swipe operation in the direction of travel if the operation control unit 25 has received a swipe operation in the direction of travel of the vehicle to the operation unit 15. If the control device 20 determines that there is a swipe operation in the direction of travel as determined by the operation control unit 25 (Yes in step S104), it proceeds to step S105. If the control device 20 does not determine that a swipe operation in the direction of travel has been initiated as determined by the operation control unit 25 (No in step S104), it proceeds to step S108.

[0048] If it is determined that a swipe operation has occurred in the direction of travel (Yes in step S104), playback of the video in the reverse direction begins (step S105). More specifically, the control device 20 uses the playback control unit 27 to play back the video recorded by the recording control unit 22, starting from the video when the operation of the operation unit 15 was started, in the reverse direction. The control device 20 uses the display control unit 28 to display the played-back video on the transparent display panel 14 based on the control signal from the playback control unit 27. The control device 20 then proceeds to step S106.

[0049] The control device 20 determines whether the operation has ended (step S106). More specifically, the control device 20 determines that the operation has ended when the rider's finger leaves the operation unit 15 in response to the swipe operation initiated in step S104 by the operation control unit 25. If the control device 20 determines that the operation has ended by the operation control unit 25 (Yes in step S106), it proceeds to step S107. If the control device 20 does not determine that the operation has started by the operation control unit 25 (No in step S106), it repeats the process in step S106.

[0050] If the control device determines that the operation is complete (Yes in step S106), it terminates playback in the reverse direction (step S107). More specifically, the control device 20 terminates playback of the video in the reverse direction via the playback control unit 27. The control device 20 terminates displaying the video on the transparent display panel 14 via the display control unit 28 based on the control signal from the playback control unit 27. The control device 20 proceeds to step S108.

[0051] The control device 20 determines whether or not to terminate shooting and recording (step S108). For example, it is determined that shooting and recording should be terminated when the vehicle's power or motor is turned OFF, or when a termination operation is performed on the operation unit 15. If the control device 20 determines that shooting and recording should be terminated (Yes in step S108), it terminates this process. If the control device 20 does not determine that shooting and recording should be terminated (No in step S108), it repeats the process in step S102.

[0052] Figure 8 shows an example of the relationship between operation and displayed image in the first embodiment. Figure 8 shows that time progresses to the right. The recording control unit 22 records the image from before time ta-2 at time ta0 when a touch operation is detected. Also, the camera 11 continues to capture images at time ta0. In the example shown in Figure 8, the passenger starts a touch operation at time ta0 and there is no movement of the touch finger until time ta1. The playback control unit 27 plays back the image from time ta0 as a still image from time ta0 to time ta1, and the display control unit 28 displays the played-back image on the transparent display panel 14.

[0053] Subsequently, the passenger performs a swipe operation in the direction of the vehicle's movement from time ta1 to time ta3. The playback control unit 27 performs playback in the reverse direction from the video at time ta0, and plays back the video from time ta0 to time ta-2, which has a duration equivalent to the period from time ta1 to time ta3. Time ta2 indicates an intermediate point in the swipe operation. The point in the reverse playback corresponding to time ta2 is time ta-1.

[0054] At time ta3, when the swipe operation is completed, the playback control unit 27 terminates playback, and the display control unit 28 terminates the display of the video. When the display of the video ends, the transparent display panel 14 becomes transparent.

[0055] Even after the finger is released from the operation unit 15 at time ta3 when the swipe operation is completed, the playback control unit 27 may continue playback in the reverse direction for, for example, about 1 second, before the display control unit 28 terminates the display of the video.

[0056] At time ta3, when the swipe operation is completed, the display control unit 28 may display the video from time ta-2 as a still image for, for example, about 1 second, before ending the video display.

[0057] If a swipe operation is performed again in the same direction after time ta3, the playback control unit 27 performs playback in the reverse direction, going back even further from time ta-2.

[0058] Figure 8 illustrates how the playback speed in the reverse direction can be changed based on the speed of the swipe operation. For example, when reversing playback at 0.5x speed, at time ta3, the video will be played back up to time ta-1. For example, when reversing playback at 2x speed, at time ta3, the video will be played back up to a point before time ta-2.

[0059] Figure 9 shows another example of the relationship between operation and displayed image in the first embodiment. In Figure 9 as well, time progresses to the right. In the example shown in Figure 9, the passenger starts a touch operation at time tb0 and there is no movement of the finger performing the touch operation until time tb1. The playback control unit 27 plays back the video being recorded from time tb0, and the display control unit 28 displays the video on the transparent display panel 14. After that, the passenger performs a swipe operation in the direction of the vehicle's movement from time tb1 to time tb3. The playback control unit 27 plays back the video from time tb1 to time tb2, which is a video of the same duration as the period from time tb1 to time tb3. Time tb2 indicates an intermediate point in the swipe operation. The point in the backward playback corresponding to time tb2 is time tb1.

[0060] <Effects> As described above, in this embodiment, when operation of the control unit 15 is initiated, the video of the moment when operation of the control unit 15 was initiated is displayed on the transparent display panel 14. In this embodiment, when the operation direction of the control unit 15 is operated along the direction of travel of the vehicle, the recording control unit 22 plays back the recorded video in reverse order from the video when operation of the control unit 15 was initiated. According to this embodiment, the video can be played back immediately in reverse order by operation. According to this embodiment, the occupants of the vehicle can immediately check the state of the location and facilities that the vehicle has passed through.

[0061] In this embodiment, when operation of the control unit 15 is initiated, the video being recorded from the time the operation of the control unit 15 was initiated is displayed on the transparent display panel 14. In this embodiment, when the operation direction of the control unit 15 is operated in line with the direction of travel of the vehicle, the recording control unit 22 plays back the recorded video in the reverse direction. According to this embodiment, the state of the location and facilities passed by the vehicle's movement can be immediately confirmed from the image being recorded.

[0062] In this embodiment, the playback speed of the video in the reverse direction is changed based on the operating speed when the operating direction of the operating unit 15 is operated along the direction of travel of the vehicle. According to this embodiment, the playback speed of the video can be intuitively changed according to the operating speed.

[0063] In this embodiment, the playback speed of the video in the reverse direction is changed based on the vehicle's speed when the operation of the control unit 15 is initiated. According to this embodiment, the playback speed can be appropriately changed according to the vehicle's speed.

[0064] [Second Embodiment] The video display device 10 according to this embodiment will be described with reference to Figures 10 to 14. Figure 10 is a block diagram showing an example configuration of the video display device according to the second embodiment. Figure 11 is a schematic diagram illustrating an example of operation in the operation unit in the second embodiment. Figure 12 is a flowchart showing an example of the processing flow in the control device according to the second embodiment. Figure 13 is a diagram showing an example of the relationship between operation and displayed video in the second embodiment. Figure 14 is a diagram showing another example of the relationship between operation and displayed video in the second embodiment.

[0065] This embodiment addresses the problem that it is difficult for a vehicle occupant to immediately confirm the past state of the surroundings, including the vehicle's current position, while the vehicle is in motion and the occupant is visually observing the area around the vehicle. This embodiment aims to enable a occupant of a moving object to immediately confirm the past state of the surroundings, including the position of the moving object.

[0066] In this embodiment, the video display device 10A displays video footage previously captured at the same location as the vehicle on the transparent display panel 14. Depending on the direction of operation, the video display device 10A plays the video footage of the vehicle's surroundings in either the reverse or forward direction and displays it on the transparent display panel 14.

[0067] The video display device 10A has the same basic configuration as the video display device 10 of the first embodiment. In the following description, components similar to those of the video display device 10 are denoted by the same reference numerals or corresponding reference numerals, and their detailed descriptions are omitted. This embodiment differs from the first embodiment in that it includes a GNSS (Global Navigation Satellite System) receiving unit 16A and a location information acquisition unit 29A, and in the processing of the video acquisition unit 21A, the recording control unit 22A, the identification unit 24A, and the playback control unit 27A.

[0068] The GNSS receiving unit 16A consists of a GNSS receiver and other components that receive GNSS signals from GNSS satellites. The GNSS receiving unit 16A outputs the received position information signal to the position information acquisition unit 29A of the control device 20.

[0069] The location information acquisition unit 29A acquires location information indicating the vehicle's current location. Based on the GNSS signal received by the GNSS receiver unit 16A, the location information acquisition unit 29A calculates the vehicle's current location information using a known method.

[0070] The video acquisition unit 21A acquires video that includes location information of where the video was taken.

[0071] The video acquisition unit 21A may acquire the video recorded in the recording unit 12.

[0072] The recording control unit 22A records the video captured by the camera 11 in the recording unit 12, associating it with the shooting position. The recording control unit 22A also records the video captured by the camera 11 in the recording unit 12 along with the location information acquired by the location information acquisition unit 29A.

[0073] The identification unit 24A identifies the range of the video acquired by the video acquisition unit 21A that should be displayed on the transparent display panel 14.

[0074] The playback control unit 27A plays back the video acquired by the video acquisition unit 21A. The playback control unit 27A performs forward playback or backward playback according to the operating direction of the operation unit 15.

[0075] Forward playback means playing back past footage of the area you are about to travel to. Backward playback means playing back past footage of the area you have already passed through.

[0076] Figure 11 is a schematic diagram illustrating an example of operation in the control unit in the second embodiment. As an example, Figure 11 shows the right rear door glass 104. For example, the passenger swipes from the starting point P11 along the direction of the first direction, arrow A1, as if using a so-called seek bar. For example, the passenger swipes from the starting point P12 along the direction of the second direction, arrow A2, which is the opposite direction to the first direction, as if using a so-called seek bar.

[0077] When operation of the operation unit 15 is started, the playback control unit 27A displays on the transparent display panel 14 video footage acquired by the video acquisition unit 21A at the same position as the vehicle when operation of the operation unit 15 was started. If the operation direction of the operation unit 15 is operated in the first direction along the direction of travel of the vehicle, the video is played back in the forward direction. If the operation direction of the operation unit 15 is operated in the opposite direction to the first direction along the direction of travel of the vehicle, the video is played back in the reverse direction. For example, if the operation of the operation unit 15 is performed in the first direction along the direction of travel of the vehicle, the playback control unit 27A plays back past video footage in the forward direction. For example, if the operation of the playback control unit 27A is performed in the opposite direction to the first direction along the direction of travel of the vehicle, the playback control unit 27A plays back past video footage in the reverse direction.

[0078] The playback control unit 27A may play back video footage previously taken at the same position and direction of travel as the vehicle when the operation of the operation unit 15 was initiated.

[0079] The playback control unit 27A may play back previously captured video footage using the camera 11 corresponding to the window glass on which the operation unit 15 is located. For example, if the operation unit 15 of the right rear door glass 104 is operated, the playback control unit 27A may play back previously captured video footage using the camera 11 that captures the right side of the vehicle.

[0080] If multiple video recordings exist from the past at the same position and direction of travel as the vehicle when the operation is started, the playback control unit 27A may select the most recently recorded video as the playback target.

[0081] If a swipe operation in the same direction is repeated, the playback control unit 27A may play back multiple videos previously taken at the same position and direction of travel as the vehicle when the operation started, so that each swipe operation plays an older video.

[0082] If there are multiple video recordings taken in the past at the same position and direction of travel as the vehicle when the operation is started, the playback control unit 27A may play back a video recorded a predetermined period ago, such as one year ago. In this case, if the swipe operation in the same direction is repeated, the playback may play back an older video, such as one year ago, so that each swipe operation plays back an older video.

[0083] For example, in the case of a swipe operation like on a smartphone screen, swiping from forward to backward, or in other words, in the first direction, will play in the forward direction. Swiping from backward to forward, or in other words, in the opposite direction to the first direction, will play in the backward direction.

[0084] The playback control unit 27A may change the playback speed of the video based on the operating speed when the operating direction of the operating unit 15 is operated along the direction of travel of the vehicle. In this embodiment, the playback control unit 27A changes the playback speed in the forward or backward direction based on the amount of operation per unit time of the swipe operation, in other words, the operating speed. For example, if the operating speed of the playback control unit 27A is about 100 mm / sec, the playback control unit 27A performs forward or backward playback at 1x speed. For example, if the operating speed of the playback control unit 27A is about 50 mm / sec, the playback control unit 27A performs forward or backward playback at 0.5x speed. For example, if the operating speed of the playback control unit 27A is about 200 mm / sec, the playback control unit 27A performs forward or backward playback at 2x speed. The correspondence between the operating speed and the playback speed may be linear or stepped.

[0085] The playback control unit 27A may change the playback speed of the video based on the vehicle's speed when the operation of the control unit 15 is initiated. The playback control unit 27A may also change the playback speed of the video in the forward or backward direction according to the vehicle's speed when the operation of the control unit 15 is initiated, based on the vehicle speed information acquired by the vehicle speed information acquisition unit 26. For example, if the vehicle's speed at the time the operation of the control unit 15 is initiated is between 0 km / h and 20 km / h, the playback control unit 27A performs forward or backward playback at 0.5x speed. For example, if the vehicle's speed at the time the operation of the control unit 15 is initiated is between 20 km / h and 60 km / h, the playback control unit 27A performs forward or backward playback at 1x speed. For example, if the vehicle's speed at the time the operation of the control unit 15 is initiated is 60 km / h or more, the playback control unit 27A performs forward or backward playback at 2x speed. The correspondence between the vehicle's driving speed and the playback speed may be linear or stepped.

[0086] Next, the processing flow in the control device 20A will be explained using Figure 12. Steps S111 and S117 perform the same processing as steps S102 and S106 in the flowchart shown in Figure 7.

[0087] If it is determined that an operation has started (Yes in step S111), the control device 20A displays video footage previously taken at the same position as the start of the operation (step S112). More specifically, the control device 20A uses the identification unit 24 to identify a predetermined range from previously taken video footage as the range to be displayed on the transparent display panel 14. The control device 20A uses the playback control unit 27A to play back video footage acquired by the video acquisition unit 21A, which was previously taken at the same position as the vehicle when the operation of the operation unit 15 was started. The control device 20A uses the display control unit 28 to display the video on the transparent display panel 14 based on the control signal from the playback control unit 27A. The control device 20A then proceeds to step S113.

[0088] The control device 20A determines whether or not a swipe operation has occurred (step S113). More specifically, the control device 20A determines that a swipe operation has occurred if the operation control unit 25 has received a swipe operation to the operation unit 15. If the control device 20A determines that a swipe operation has occurred by the operation control unit 25 (Yes in step S113), it proceeds to step S114. If the operation control unit 25 does not determine that a swipe operation has occurred (No in step S113), it proceeds to step S119.

[0089] If the control device 20A determines that a swipe operation has occurred (Yes in step S113), it determines whether the direction of the operation is the first direction (step S114). If the control device 20A determines that the direction of the swipe operation is the first direction (Yes in step S114), it proceeds to step S115. If the control device 20A does not determine that the direction of the swipe operation is the first direction (No in step S114), it proceeds to step S116.

[0090] If it is determined that the operating direction is the first direction (Yes in step S114), the control device 20A starts forward playback (step S115). More specifically, the control device 20A controls the playback control unit 27A to play the video forward from the point when the operation of the operation unit 15 was started. The control device 20A uses the display control unit 28 to display the video on the transparent display panel 14 based on the control signal from the playback control unit 27A. The control device 20A then proceeds to step S117.

[0091] If the control device 20A does not determine that the operating direction is the first direction (No in step S114), the control device 20A starts playback of the video in the reverse direction (step S116). More specifically, the control device 20A controls the playback control unit 27A to play the video in the reverse direction from the video when the operation of the operation unit 15 was started. The control device 20A uses the display control unit 28 to display the video on the transparent display panel 14 based on the control signal from the playback control unit 27A. The control device 20A proceeds to step S117.

[0092] If the control device 20A determines that the operation is complete (Yes in step S117), it terminates playback (step S118). More specifically, the control device 20A terminates video playback via the playback control unit 27A. The display control unit 28 terminates the display of the video on the transparent display panel 14 based on the control signal from the playback control unit 27A. The control device 20A proceeds to step S119.

[0093] The control device 20A determines whether to terminate or not (step S119). For example, termination may be determined when the vehicle's power or motor is turned OFF, or when a termination operation is performed on the operation unit 15. If the control device 20A determines that termination is to be performed (Yes in step S119), it terminates this process. If the control device 20A does not determine that termination is to be performed (No in step S119), it repeats the process in step S113.

[0094] Figure 13 illustrates an example of processing when swiping in the first direction along the vehicle's direction of travel. Figure 13 shows that time is progressing to the right. The playback control unit 27A acquires previously captured and recorded video that includes the same position information as the vehicle's position information at time ta0 when the touch operation was detected. In the example shown in Figure 13, the passenger starts a touch operation at time ta0 and there is no movement of the finger that performed the touch operation until time ta1. The playback control unit 27A plays back the video from the past video at time tVa0, which includes the same position information and direction of travel as at time ta0, as a still image, and the display control unit 28 displays the video on the transparent display panel 14.

[0095] Subsequently, the passenger performs a swipe operation in the first direction along the vehicle's direction of travel from time ta1 to time ta2. The playback control unit 27A performs forward playback from time tVa0, playing back the video from time tVa0 to time tVa1, which has a duration equivalent to the period from time ta1 to time ta2.

[0096] At time ta2, when the swipe operation is completed, the playback control unit 27 terminates playback, and the display control unit 28 terminates the display of the video. When the display of the video ends, the transparent display panel 14 becomes transparent.

[0097] Even after the finger is released from the operation unit 15 at time ta2 when the swipe operation is completed, the playback control unit 27A may continue playback in the reverse direction for, for example, about 1 second, before the display control unit 28 terminates the display of the video.

[0098] At time ta2, when the swipe operation is completed, the display control unit 28 may display the video from time tVa1 as a still image for, for example, about 1 second, before ending the video display.

[0099] If a swipe operation is performed again in the same direction after time ta2, the playback control unit 27A may perform playback in the forward direction from time tVa1.

[0100] Figure 14 illustrates an example of processing when swiping in the opposite direction to the vehicle's direction of travel. In Figure 14, time is also shown to be progressing to the right. The playback control unit 27A acquires previously captured and recorded video containing the same location information as the vehicle's location information at time tb0 when the touch operation was detected. In the example shown in Figure 14, the passenger starts a touch operation at time tb0, and there is no movement of the finger that performed the touch operation until time tb1. The playback control unit 27A plays back the video at time tVb0 containing the same location information and direction of travel as at time tb0 in the past video, and the display control unit 28 displays the video on the transparent display panel 14.

[0101] Subsequently, the passenger swipes in the opposite direction to the first direction along the vehicle's direction of travel, from time tb1 to time tb2. The playback control unit 27A performs playback in the reverse direction from time tVb0, playing back the video from time tVb0 to time tVb-1, which has a duration equivalent to the period from time tb1 to time tb2.

[0102] At time tb2, when the swipe operation is completed, the playback control unit 27A terminates playback, and the display control unit 28 terminates the display of the video. As the video display ends, the transparent display panel 14 becomes transparent.

[0103] Even after the finger is released from the operation unit 15 at time tb2 when the swipe operation is completed, the playback control unit 27A may continue playback in the reverse direction for, for example, about 1 second, before the display control unit 28 terminates the display of the video.

[0104] At time tb2, when the swipe operation is completed, the display control unit 28 may display the video from time tVb-1 as a still image for, for example, about 1 second, before ending the video display.

[0105] If a swipe operation is performed again in the same direction after time tb2, the playback control unit 27A may perform playback in the reverse direction from time tVb-1.

[0106] As described above, in this embodiment, when operation of the control unit 15 is initiated, the video acquisition unit 21A displays on the transparent display panel 14 video footage previously taken at the same position as the vehicle at the time the operation of the control unit 15 was initiated. In this embodiment, when the operation direction of the control unit 15 is operated in the first direction along the vehicle's direction of travel, the video is played back in the forward direction, and when the operation direction of the control unit 15 is operated in the direction opposite to the first direction along the vehicle's direction of travel, the video is played back in the reverse direction. According to this embodiment, the video can be played back immediately in the reverse or forward direction depending on the direction of operation. According to this embodiment, the occupants of the vehicle can immediately check past conditions of the surroundings, including the position where the vehicle is traveling.

[0107] In this embodiment, the video captured by the camera 11 is recorded in the recording unit 12 along with location information. According to this embodiment, past video footage of the surrounding area, including the location where the vehicle is traveling, can be easily acquired.

[0108] In this embodiment, the playback speed of the video is changed based on the operating speed when the operating direction of the operating unit 15 is operated along the direction of travel of the vehicle, or based on the vehicle's movement speed when the operation of the operating unit 15 is started. According to this embodiment, the video playback speed can be intuitively changed according to the operating speed.

[0109] [Third Embodiment] The video display device 10 according to this embodiment will be described with reference to Figure 15. Figure 15 is a block diagram showing an example configuration of the video display device according to the third embodiment. The video display device 10B displays past video footage taken by other vehicles, which is stored on an external server, on the transparent display panel 14. The basic configuration of the video display device 10B is the same as that of the video display device 10A in the second embodiment. In this embodiment, the communication unit 17B is included, and the processing in the video acquisition unit 21B differs from that of the second embodiment.

[0110] Video footage captured by cameras (not shown) mounted on other vehicles is stored on an external server (not shown) via the communication unit (not shown) of the other vehicle, along with information indicating the time of capture, location, and direction of travel.

[0111] The external server stores video footage captured by cameras mounted on multiple vehicles. In response to video acquisition requests from the video display devices 10B mounted on each vehicle, the external server transmits the stored video footage to the video display devices 10B. More specifically, the external server receives information indicating the vehicle's current position and direction of travel along with the video acquisition request from the vehicle's video display device 10B. The external server detects from the stored video footage previously captured on other vehicles that includes the same position as the receiving vehicle and the same direction of travel as the receiving vehicle. If multiple videos are detected, the external server selects the video according to predetermined conditions, such as the most recent past or the past from a predetermined period ago. The external server then transmits the detected video to the video display device 10B.

[0112] The communication unit 17B is a communication unit. The communication unit 17B may communicate using either the internet or a mobile phone line. The communication unit 17B connects to an external server for data communication via a communication network (not shown). The communication unit 17B receives video footage taken in other vehicles from the external server.

[0113] The video acquisition unit 21B acquires video footage taken by other vehicles. When operation of the operation unit 15 is initiated, the video acquisition unit 21B uses communication via the communication unit 17B to send information indicating the current location and direction of travel of its own vehicle to an external server along with a video acquisition request. The video acquisition unit 21B acquires video footage from the external server that was previously taken by other vehicles, which includes the same location as the current location and is in the same direction of travel.

[0114] The playback control unit 27B plays back the video received by the external communication unit 17B and acquired by the video acquisition unit 21B from an external server, in accordance with the operating direction of the operation unit 15. The processing of the control device 20B in this embodiment is the same as the processing in the second embodiment shown in Figure 12, but the playback video is replaced with the playback of video previously taken by another vehicle at the same position as the operation start point. Also, in Figures 13 and 14, the past video taken by another vehicle at the same position as the operation start point becomes the displayed video.

[0115] As described above, in this embodiment, it is possible to instantly check past conditions of the surroundings, including the location where the vehicle is traveling, using video footage captured by another mobile device.

[0116] [Fourth Embodiment] The video display device 10B according to this embodiment will be described with reference to Figures 16 to 20. Figure 16 is a diagram illustrating the relative positional relationship between the vehicle and other vehicles. Figure 17 is a schematic diagram illustrating an example of operation in the control unit in the fourth embodiment. Figure 18 is a flowchart illustrating an example of the processing flow in the control device according to the fourth embodiment. Figure 19 is a diagram illustrating an example of the relationship between operation and displayed video in the fourth embodiment. Figure 20 is a diagram illustrating another example of the relationship between operation and displayed video in the fourth embodiment.

[0117] This embodiment addresses the problem that it is difficult for a passenger of a moving vehicle to immediately confirm the current state of the locations they have passed through or the current state of the locations they are scheduled to move to, while they are visually observing the surroundings of the vehicle during its movement. This embodiment aims to enable a passenger of a moving vehicle to immediately confirm the current state of the locations they have passed through or the current state of the locations they are scheduled to move to, while they are visually observing the surroundings of the vehicle during its movement.

[0118] In this embodiment, the video display device 10B plays back video footage captured by another vehicle located in the direction of travel of the vehicle, or video footage captured by another vehicle located in the opposite direction of travel of the vehicle, depending on the direction of operation, and displays it on the transparent display panel 14. The basic configuration of the video display device 10B is the same as that of the video display device 10B in the third embodiment. In this embodiment, the processing in the video acquisition unit 21B and the playback control unit 27B differs from that of the third embodiment.

[0119] The external server acquires video footage captured by cameras mounted on multiple vehicles. In response to video acquisition requests from the video display devices 10B mounted on each vehicle, the external server transmits the acquired video footage to the video display devices 10B. More specifically, the external server receives information indicating the vehicle's current position and direction of travel, along with the video acquisition request, from the vehicle's video display device 10B. From the stored video footage captured by other vehicles, the external server detects other vehicles traveling on the same road within a predetermined range from the received current position that are capable of transmitting video footage. The external server then detects video footage from the detected other vehicles. Finally, the external server transmits the detected video footage to the video display device 10B.

[0120] The video acquisition unit 21B may be configured to acquire video footage taken by other vehicles located in the direction of travel of the vehicle or in the opposite direction of travel when the operation unit 15 is operated.

[0121] The video acquisition unit 21B acquires video footage, including location information, from other vehicles traveling around the vehicle, capturing images of the surrounding area. The video acquisition unit 21B communicates with an external server using wireless communication via the communication unit 17B to acquire video footage captured by other vehicles. When the operation unit 15 is activated, the video acquisition unit 21B begins acquiring video footage captured by other vehicles traveling around the vehicle.

[0122] The video acquisition unit 21B may acquire video from other vehicles located at a distance from the vehicle, depending on the number of times the operation unit 15 is operated. For example, the video acquisition unit 21B may acquire video from one vehicle at a time each time the operation unit 15 is operated.

[0123] The video acquisition unit 21B may acquire video from other vehicles located further away from the vehicle, depending on the amount or speed of operation of the operation unit 15. The video acquisition unit 21B may acquire and play back video from other vehicles located further away from the vehicle, for example, based on the amount of operation per unit time of a swipe operation, in other words, the operation speed. For example, if the operation speed is less than 100 mm / sec, the video acquisition unit 21B will acquire and play back video from the nearest other vehicle or from another vehicle located within 100 m. For example, if the operation speed is 100 mm / sec or more, the video acquisition unit 21B will acquire and play back video from the second nearest other vehicle or from another vehicle located between 100 m and 200 m.

[0124] The video acquisition unit 21B may acquire video from other vehicles located further away from the vehicle, depending on the vehicle's speed when the operation of the control unit 15 is initiated. For example, if the vehicle's speed at the time the operation of the control unit 15 is initiated is between 0 km / h and 20 km / h, the video acquisition unit 21B acquires video from the nearest other vehicle or from another vehicle located within 100 m. For example, if the vehicle's speed at the time the operation of the control unit 15 is initiated is between 20 km / h and 60 km / h, the video acquisition unit 21B acquires video from the second nearest other vehicle or from another vehicle located within 100 m to 200 m. If the vehicle's speed at the time the operation of the control unit 15 is initiated is 60 km / h or more, the video acquisition unit 21B acquires video from the third nearest other vehicle or from another vehicle located within 200 m to 500 m.

[0125] The playback control unit 27B plays back video footage captured by another vehicle located in the direction of travel of the vehicle when the operation direction of the operation unit 15 is operated in a first direction along the direction of travel of the vehicle, and plays back video footage captured by another vehicle located in the opposite direction to the direction of travel of the vehicle when the operation direction of the operation unit 15 is operated in the opposite direction to the direction of travel of the vehicle.

[0126] The playback control unit 27B plays back video footage acquired from another vehicle in front of the vehicle or from another vehicle behind the vehicle, depending on the direction of operation of the operation unit 15. Playback of video footage acquired from another vehicle in front is video footage of the area the vehicle is about to travel to. Playback of video footage acquired from another vehicle behind is video footage of the area the vehicle has just passed, after the vehicle has passed.

[0127] For example, if you operate it from front to back, like a so-called seek bar, it will play video footage acquired from other vehicles in front, and if you operate it from back to front, it will play video footage acquired from other vehicles behind.

[0128] For example, if you swipe from front to back, like on a smartphone screen, in the first direction, the video footage acquired from another vehicle in front will be played. If you swipe from back to front, in the opposite direction to the first direction, the video footage acquired from another vehicle in the rear will be played.

[0129] Figure 17 shows the right rear door glass 104 as an example. For example, the passenger swipes from the starting point P11 along the direction of the first direction, arrow A1, as if using a so-called seek bar. For example, the passenger swipes from the starting point P12 along the direction of the second direction, arrow A2, which is the opposite direction to the first direction, as if using a so-called seek bar.

[0130] If a swipe operation is performed again in the same direction, the playback control unit 27B acquires and plays video from another vehicle that is further away from the self-vehicle than the other vehicle whose video was played back during the period from time tVc0 to time tVc1. For example, with the first swipe operation, the playback control unit 27B plays the video taken by the other vehicle Va, and with the second swipe operation, it plays the video taken by the other vehicle Vb. Both other vehicles Va and Vb are traveling on the same road in the same direction as the self-vehicle V. The distance from other vehicles that enables video acquisition may be limited. For example, other vehicles within 1 km of the self-vehicle.

[0131] The playback control unit 27B may play video from other vehicles located further away from the vehicle, depending on the amount or speed of operation of the operation unit 15. The playback control unit 27B may play video from other vehicles located further away from the vehicle based, for example, on the amount of operation per unit time of a swipe operation, in other words, the operation speed. For example, if the operation speed is less than 100 mm / sec, the playback control unit 27B will play video from the nearest other vehicle or another vehicle located within 100 m. For example, if the operation speed is 100 mm / sec or more, the playback control unit 27B will play video from the second nearest other vehicle or another vehicle located between 100 m and 200 m.

[0132] The playback control unit 27B uses the vehicle speed information acquired by the vehicle speed information acquisition unit 26 to acquire and play back video from other vehicles located at a distance from the vehicle, according to the vehicle's speed when the operation of the operation unit 15 is initiated. For example, if the vehicle's speed at the time the operation of the operation unit 15 is initiated is between 0 km / h and 20 km / h, the playback control unit 27B plays back video from the nearest other vehicle or from another vehicle located within 100 m. For example, if the vehicle's speed at the time the operation of the operation unit 15 is initiated is between 20 km / h and 60 km / h, the playback control unit 27B plays back video from the second nearest other vehicle or from another vehicle located within 100 m to 200 m. For example, if the vehicle's speed at the time the operation of the operation unit 15 is initiated is 60 km / h or more, the playback control unit 27B plays back video from the third nearest other vehicle or from another vehicle located within 200 m to 500 m.

[0133] Next, the processing flow in the control device 20 will be explained using Figure 18. Steps S121, S123, S124, and S127 through S129 perform the same processing as steps S111, S113, S114, and S117 through S119 in the flowchart shown in Figure 12.

[0134] If it is determined that the operation has started (Yes in step S121), the control device 20B requests the external server to acquire video footage taken by other vehicles traveling in the vicinity (step S122). More specifically, the control device 20B, using the video acquisition unit 21B, makes it possible to acquire video footage including location information of the surrounding area of ​​other vehicles traveling around the vehicle from the external server. The control device 20B then proceeds to step S123.

[0135] If it is determined that the operating direction is the first direction (Yes in step S124), the control device 20B acquires video footage taken by other vehicles in the direction of travel and starts playing the video (step S125). More specifically, the control device 20B acquires video footage taken by other vehicles in the direction of travel using the video acquisition unit 21B. The control device 20B uses the identification unit 24 to identify a predetermined range from the video footage taken by other vehicles in the direction of travel as the range to be displayed on the transparent display panel 14. The control device 20B uses the playback control unit 27B to play back the video footage taken by other vehicles in the direction of travel, which was acquired by the video acquisition unit 21B. The control device 20B uses the display control unit 28 to display the video on the transparent display panel 14 based on the control signal from the playback control unit 27B. The control device 20B proceeds to step S127.

[0136] If the operating direction is not determined to be the first direction (No in step S124), the control device 20B acquires video footage taken by another vehicle located in the opposite direction of travel and starts playing the video (step S126). More specifically, the control device 20B acquires video footage taken by another vehicle located in the opposite direction of travel using the video acquisition unit 21B. The control device 20B uses the identification unit 24 to identify a predetermined range from the video footage taken by the other vehicle located in the opposite direction of travel as the range to be displayed on the transparent display panel 14. The control device 20B uses the playback control unit 27B to play back the video footage taken by the other vehicle located in the opposite direction of travel, which was acquired by the video acquisition unit 21B. The control device 20B uses the display control unit 28 to display the video on the transparent display panel 14 based on the control signal from the playback control unit 27B. The control device 20B proceeds to step S127.

[0137] Figures 19 and 20 illustrate an example of processing when the vehicle's control panel 15 is operated. At time tc0, when a touch operation is detected, the video acquisition unit 21B requests an external server to acquire video from other vehicles traveling on the same road in the same direction around the vehicle. In the example shown in Figures 19 and 20, the passenger starts a touch operation at time tc0, but there is no movement of the finger that performed the touch operation until time tc1. At time tc0, the playback control unit 27B does not select or play back the requested video.

[0138] In the example shown in Figure 19, the passenger swipes in the first direction, which is the direction of travel of the vehicle, from time tc1 to time tc2. The playback control unit 27B selects video footage acquired from other vehicles in the direction of travel and plays it back in the forward direction from time tc1, playing back the video footage from time tVc0 to time tVc1, which has a time length equivalent to the period from time tc1 to time tc2.

[0139] In the example shown in Figure 20, the passenger swipes in the direction opposite to the first direction of travel, which is the direction of the vehicle's movement, from time tc1 to time tc2. The playback control unit 27B selects video footage acquired from another vehicle located in the opposite direction of travel, and plays it forward from time tc1, playing back the video footage from time tVc0 to time tVc1, which has a duration equivalent to the period from time tc1 to time tc2.

[0140] In the examples shown in Figures 19 and 20, the display control unit 28 terminates the display of the video at time tc2 when the swipe operation is completed. Once the video display ends, the transparent display panel 14 becomes transparent.

[0141] In the examples shown in Figures 19 and 20, even after the finger is removed from the operation unit 15 at time tc2 when the swipe operation is completed, the playback control unit 27B may continue playing the video acquired from the other vehicle for, for example, about 1 second, before the display control unit 28 terminates the display of the video.

[0142] In the examples shown in Figures 19 and 20, at time tc2 when the swipe operation is completed, the display control unit 28 may display the video from time tVc1 as a still image for, for example, about 1 second, before ending the video display.

[0143] As described above, in this embodiment, when the operating direction of the operating unit 15 is operated in the first direction along the direction of travel of the vehicle, video footage taken by another vehicle located in the direction of travel of the vehicle is played back, and when the operating direction of the operating unit 15 is operated in the direction opposite to the first direction along the direction of travel of the vehicle, video footage taken by another vehicle located in the opposite direction to the direction of travel of the vehicle is played back. According to this embodiment, when a vehicle occupant is visually observing the surroundings of the vehicle while it is in motion, it is possible to immediately check the current state of the position that the vehicle has passed through and the current state of the position that it is scheduled to pass through.

[0144] In this embodiment, video footage from other vehicles located at a distance from the vehicle can be acquired depending on the number of operations performed on the control unit 15.

[0145] In this embodiment, the greater the amount or speed of operation of the control unit 15, the more video footage can be acquired from other vehicles that are farther away from the vehicle.

[0146] In this embodiment, the faster the vehicle is moving when the operation of the control unit 15 is initiated, the more video footage can be acquired from other vehicles that are further away from the vehicle.

[0147] The video display device 10 according to this disclosure may be implemented in various different forms other than those described above.

[0148] Each component of the illustrated video display device 10 is a functional concept and does not necessarily have to be physically configured as shown. In other words, the specific form of each device is not limited to that shown, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load and usage conditions of each device.

[0149] The configuration of the video display device 10 is realized, for example, as software, such as a program loaded into memory. In the above embodiment, these were described as functional blocks realized by the cooperation of hardware or software. That is, these functional blocks can be realized in various forms by hardware alone, software alone, or a combination thereof.

[0150] The above-described components include those that are easily conceivable by those skilled in the art, and those that are substantially identical. Furthermore, the above-described components can be combined as appropriate. In addition, various omissions, substitutions, or modifications of the components are possible without departing from the spirit of the present invention.

[0151] <Variation> The above describes touch, swipe, and flick operations on the operation unit 15, but is not limited to these. For example, the movement of a hand close to the transparent display panel 14 may be captured by an in-vehicle camera (for example, installed above each transparent display panel), and the operation may be performed using the hand's trajectory. In this case, the operation may be applied to bringing the hand close to the transparent display panel 14 (start of operation) and moving the hand in the opposite direction of the vehicle's movement. Alternatively, it may be applied to gesture operation using a ring-shaped device such as a smart ring.

[0152] In the fourth embodiment, video acquisition can be performed by streaming from another vehicle, an external server, or the vehicle itself, and the vehicle itself does not record video from other vehicles. [Explanation of symbols]

[0153] 10 Video display device 11 Cameras 12 Records Section 13 IF section 14 Transparent display panel 15 Control section 16A GNSS receiver 20 Control device (video display control device) 21 Video Acquisition Unit 22 Recording Control Unit 24 Specific part 25 Operation Control Unit 26 Vehicle speed information acquisition section 27 Regeneration Control Unit 28 Display Control Unit 29A Location information acquisition section 101 Windshield 102 Right front door glass 103 Left front door glass 104 Right rear door glass 105 Left rear door glass 106 Rear window 200 angle of view 201 Visibility 202 Specific range

Claims

1. An image acquisition unit that acquires an image including position information where the image was taken; A position information acquisition unit that acquires the position information of the moving body; A transmissive display panel that is installed on the window of the moving body and has transparency; An operation unit that can be operated on the surface of the transmissive display panel; A specifying unit that specifies, from the image acquired by the image acquisition unit, the range that a passenger of the moving body visually recognizes the outside of the vehicle through the window as the range to be displayed on the transmissive display panel; A playback control unit that plays back the image acquired by the image acquisition unit; A display control unit that causes the transmissive display panel to display an image within the range specified by the specifying unit in the image played back by the playback control unit; Comprising: When the operation of the operation unit is started, the playback control unit causes the transmissive display panel to display an image taken in the past at the same position as the position of the moving body when the operation of the operation unit was started, which was acquired by the image acquisition unit. When the operation direction of the operation unit is operated in a first direction along the traveling direction of the moving body, the image is played back in the forward direction. When the operation direction of the operation unit is operated in a direction opposite to the first direction along the traveling direction of the moving body, the image is played back in the reverse direction. An image display device.

2. An imaging unit that images the surroundings of the moving body; A recording control unit that records the image captured by the imaging unit in a recording unit together with the position information acquired by the position information acquisition unit; Further comprising: The image acquisition unit acquires the image recorded in the recording unit. The image display device according to claim 1.

3. The image acquisition unit acquires an image taken in another moving body. The image display device according to claim 1.

4. When the operation direction of the operation unit is operated along the traveling direction of the moving body, or based on the operation speed when the operation of the operation unit is started or the moving speed of the moving body when the operation of the operation unit is started, the playback control unit changes the speed at which the image is played back. The image display device according to claim 1 or 2.

5. When an operation of an operation unit that can be operated on the surface of a transmissive display panel installed on a window of a moving body and having transparency is started, an image taken in the past at the same position as the position of the moving body when the operation of the operation unit was started, within the range that a passenger of the moving body visually recognizes the outside of the vehicle through the window at the time when the operation of the operation unit was started, is caused to be displayed on the transmissive display panel. When the operation direction of the operation unit is operated in a first direction along the traveling direction of the moving body, the video is played in the forward direction, and when the operation direction of the operation unit is operated in a direction opposite to the first direction along the traveling direction of the moving body, the step of playing the video in the reverse direction; A video display method executed by a video display device.

Images