Video display device and video display method

Abstract

To provide a video display device for facilitating to change a video by a touch operation on a touch panel.SOLUTION: In the display device mounted on a vehicle, a video processing unit is configured to change a first video displayed on a first display area to a second video of a video pattern corresponding to a touch operation on a touch panel out of a predetermined plurality of video patterns, and a graphics processing unit is configured to change a first graphic pertaining to a first video range displayed on a second display area to a second graphic pertaining to a second video range out of a predetermined plurality of graphics.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention generally relates to a technique for displaying an image generated based on an image signal output from a camera installed in a vehicle. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there has been known a vehicle surroundings monitoring device capable of monitoring images captured by a plurality of cameras provided in a vehicle.

[0003] In addition, a vehicle surroundings monitoring device has been disclosed that detects the vehicle's steering state and provides camera images required by the driver in a switchable display on a monitor so that the driver can easily understand the relationship between the camera images (see Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-223524 Summary of the Invention [Problem to be solved by the invention]

[0005] With the spread of multiple monitors, large monitors, meter displays, etc., the physical area in which images can be displayed is wider than ever before. However, monitors located in front of the steering wheel cannot be touched because the steering wheel is an obstacle, and if the monitor is located near the A-pillar on the passenger side, it is physically impossible to touch because it is out of reach of the arm. This makes it difficult to easily switch images displayed on the monitor.

[0006] In this regard, even if a button for switching between images displayed at a distance were provided at hand in consideration of the technology described in Patent Document 1, the image and the button would be far away from each other, making it difficult to understand the correspondence between them. In this case, the operation for switching between the image and the previous image would become complicated, and providing a new button would increase costs.

[0007] The present invention has been made in consideration of the above points, and aims to propose an image display device or the like that allows an image to be easily changed by touching a touch panel. [Means for solving the problem]

[0008] In order to solve this problem, the present invention provides an image display device mounted on a vehicle, which comprises an image processing unit that generates, based on an image signal output from a camera installed in the vehicle, an image to be displayed in a first display area set in a first location where user operability is poor, and a graphic processing unit that generates a graphic to be displayed in a second display area set overlaid on a touch panel installed in a second location where user operability is good, the graphic relating to the range of the image to be displayed in the first display area, wherein the image processing unit changes the first image displayed in the first display area to a second image of a video pattern corresponding to a touch operation on the touch panel from a plurality of predetermined video patterns, and the graphic processing unit changes the first graphic relating to the range of the first image displayed in the second display area to a second graphic relating to the range of the second image from a plurality of predetermined graphics.

[0009] For example, with the above configuration, even if the image is displayed in a location where it cannot be physically operated, the user can quickly change the image from the specified image pattern to the desired image pattern by touching the graphic related to the range of the image. [Effects of the Invention]

[0010] According to the present invention, a highly convenient video display device can be realized. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a diagram illustrating an example of an overall configuration of a driving assistance system. [Figure 2] FIG. 1 is a diagram illustrating an example of a video display device. [Figure 3] FIG. 1 is a diagram illustrating an example of a hardware configuration of a video display device. [Figure 4] FIG. 2 is a diagram illustrating an example of a functional configuration of a video display device. [Figure 5] FIG. 10 is a diagram illustrating an example of a setting region. [Figure 6] FIG. 10 is a diagram illustrating an example of a graphic. [Figure 7] FIG. 10 is a diagram illustrating an example of a video display process. [Figure 8] FIG. 10 is a diagram illustrating an example of a screen transition. [Figure 9] FIG. 1 is a diagram illustrating an example of a video display device. [Figure 10] FIG. 1 is a diagram illustrating an example of a video display device. DETAILED DESCRIPTION OF THE INVENTION

[0012] (I) Embodiment An embodiment of the present invention will be described in detail below. However, the present invention is not limited to the embodiment. For example, in this embodiment, monitor A displays a camera image within the shooting range and shooting direction of a camera installed in a vehicle. Monitor B with a touch panel displays an image indicating the camera's shooting range and shooting direction on a map. A user changes the camera's shooting range and shooting direction by performing a slide operation on the image displayed on monitor B. Monitor A changes the display to a camera image within the camera's shooting range and shooting direction changed by the user.

[0013] Next, an embodiment of the present invention will be described with reference to the drawings. The following description and drawings are examples for explaining the present invention, and some omissions and simplifications have been made as appropriate for clarity of explanation. The present invention can be implemented in various other forms. Unless otherwise specified, each component may be singular or plural.

[0014] In the following description, the same elements in the drawings are given the same numbers, and the description will be omitted as appropriate. When describing elements of the same type without distinguishing between them, the common part (the part excluding the branch number) of the reference sign including the branch number may be used, and when describing elements of the same type while distinguishing between them, the reference sign including the branch number may be used. For example, when describing cameras without distinguishing between them, they may be written as "camera 102," and when describing individual cameras while distinguishing between them, they may be written as "front camera 102-1."

[0015] The designations "first," "second," "third," etc. in this specification are used to identify components and do not necessarily limit the number or order. Furthermore, numbers used to identify components are used in different contexts, and numbers used in one context do not necessarily indicate the same configuration in another context. Furthermore, this does not prevent a component identified by a certain number from also serving the function of a component identified by another number.

[0016] 1 shows an example of the overall configuration of a driving assistance system 100. The driving assistance system 100 is mounted on a vehicle 101, and provides various types of information to a user such as a driver, thereby assisting the driving of the vehicle 101.

[0017] Cameras 102 equipped with wide-angle lenses, fisheye lenses, or the like that can observe a wide range are provided on the front, rear, left, and right sides of the vehicle 101. These cameras 102 can observe (photograph) the entire area around the vehicle 101, including the road surface. For example, the driving assistance system 100 includes a front camera 102-1, a rear camera 102-2, a left side camera 102-3, and a right side camera 102-4.

[0018] The front camera 102-1 is a camera 102 that is provided facing the front of the vehicle 101, and is provided on a front part of the vehicle 101, such as the front bumper or front grille. The rear camera 102-2 is a camera 102 that is provided facing the rear of the vehicle 101, and is provided on a rear part of the vehicle 101, such as the rear bumper or rear garnish. The left side camera 102-3 is a camera 102 that is provided facing the left side of the vehicle 101, and is provided on a left door mirror or other part of the left side of the vehicle 101. The right side camera 102-4 is a camera 102 that is provided facing the right side of the vehicle 101, and is provided on a right door mirror or other part of the right side of the vehicle 101.

[0019] For example, the driving assistance system 100 generates an image based on an image signal obtained by capturing an image of the surroundings of the vehicle 101 using a camera 102, and displays the generated image on an image display device 103. The image may be a camera image or a composite image.

[0020] The camera image is an image acquired by the camera 102, for example, an image of an electronic rearview mirror. Examples of the image of an electronic rearview mirror include an image of a door mirror, an image of a fender mirror, an image of a room mirror, an image of a rear under mirror, and the like.

[0021] The composite image includes a perspective view and a top view. The perspective view is an image displayed in perspective from a viewpoint other than directly above the vehicle 101, and is an image that includes a background image of the surroundings of the vehicle 101 viewed from diagonally above or from the side, and an icon representing the vehicle 101. The top view is an image from a viewpoint directly above the vehicle 101, and is an image that includes a background image of the surroundings of the vehicle 101 viewed from above, and an image of the top surface of the vehicle 101.

[0022] FIG. 2 is a diagram showing an example of the video display device 103 that displays video.

[0023] The image display device 103 is provided below the front window, more specifically, on the dashboard 201. The image display device 103 has a plurality of display areas. The image display device 103 has at least an image display area 210 and a graphic display area 220 set therein.

[0024] The video display area 210 is a display area set in front of the steering wheel 202 as seen by the driver. The video display area 210 functions as an instrument panel and displays various types of video. The graphic display area 220 is a display area set near the center console. The graphic display area 220 displays graphics related to the range of the video displayed in the video display area 210. A graphic is an image formed by combining visual elements such as shapes, symbols, and letters (typography). Graphics related to the range of the video include an image showing the range of the video (video range image), an image showing the direction in which the video was captured, and an image showing the position of the vehicle 101 on a map and the direction in which the vehicle 101 is traveling, and specific examples will be described later using FIG. 8.

[0025] Note that the video display area 210 and the graphic display area 220 are not necessarily configured to be set on the same display device. For example, as shown in Figures 9 and 10, the video display device 103 may have the video display area 210 set on a display device different from the graphic display area 220 set on a display device.

[0026] 3 shows an example of the hardware configuration of the video display device 103. The video display device 103 includes an image processing device 310 and a navigation device 320.

[0027] The image processing device 310 is, for example, a camera ECU (Electronic Control Unit), and is mainly configured with a microcontroller including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The image processing device 310 controls the camera 102 that captures images of the surroundings of the vehicle 101, and generates an image based on an image signal output from the camera 102. The image processing device 310 also generates graphics related to the range of the generated image. The functions of the image processing device 310 will be described later with reference to FIG. 4.

[0028] The navigation device 320 is, for example, a touch screen, and displays images such as videos and graphics generated by the image processing device 310 and receives input operations from the user. More specifically, the navigation device 320 includes a monitor 321 that displays images and a touch panel 322 on which the user performs input operations. The touch panel 322 is superimposed on the graphic display area 220 set on the monitor 321. The touch panel 322 generates input information in response to the user's input operations. The input information includes the coordinates (touch coordinates) of the point touched on the touch panel 322.

[0029] The touch sensor of touch panel 322 may be any type of sensor, such as a pressure sensor, electrostatic sensor, or optical sensor, as long as it can acquire touch coordinates. Touch panel 322 may be provided on the entire surface of monitor 321, or may be provided on a part of monitor 321. For example, when a navigation device 320 is adopted in which touch panel 322 is provided in graphic display area 220 but not in video display area 210, costs can be reduced.

[0030] Note that, in addition to the touch panel 322, the operation unit that can be used for input operations may include various operation buttons, rotary dials, joysticks, etc. provided around the monitor 321. Additionally, the navigation device 320 may store map data or the like for route guidance, and provide route guidance to a destination point set by the user based on this map data and current position data of the vehicle 101 detected by a GPS device or the like (not shown).

[0031] Furthermore, the navigation device 320 is communicably connected to a sensor 330. The sensor 330 is a wheel speed sensor that detects the wheel speed of the vehicle 101, a steering angle sensor that detects the steering angle of the vehicle 101, etc. Detection information (wheel speed, steering angle, etc.) detected by the sensor 330 is input to the vehicle control ECU 340.

[0032] The vehicle control ECU 340 is mainly configured with a microcontroller including a CPU, ROM, RAM, etc. The vehicle control ECU 340 controls the drive of actuators 351 via a control unit 350 based on information input from the image processing device 310, the navigation device 320, and the sensors 330, and executes various processes to support the driving of the vehicle 101. The control unit 350 is a steering control unit, a throttle control unit, a brake control unit, etc. The actuators 351 are a power steering actuator, a throttle actuator, a brake actuator, etc.

[0033] The image processing device 310, the navigation device 320, and the sensor 330 are connected to the vehicle control ECU 340 via an in-vehicle LAN (Local Area Network) 360-1 for communicating sensor information. The control unit 350 is connected to the vehicle control ECU 340 via an in-vehicle LAN 360-2 for communicating vehicle information.

[0034] In the present embodiment, the video display device 103 has been described as including the image processing device 310 and the navigation device 320, but is not limited to this configuration. For example, the video display device 103 may or may not include the camera 102. The video display device 103 may also include the image processing device 310, and may be configured such that the monitor 321 and the touch panel 322 are communicably connected to it.

[0035] FIG. 4 shows an example of the functional configuration of the video display device 103.

[0036] The image processing device 310 includes a control unit 410 and a storage unit 420. The control unit 410 controls the entire image processing device 310. The control unit 410 may be a programmable logic device such as a CPU, FPGA, or GPU (Graphics Processing Unit), or a computing element represented by an integrated circuit such as an ASIC. In this case, in order to perform 3D graphic image processing at high speed, the control unit 410 may include specialized hardware such as a GPU specialized for image processing, or a computing element capable of high-speed calculations (for example, an FPGA).

[0037] The storage unit 420 stores setting information 421 such as parameters used in image processing, graphics, etc. The storage unit 420 may also store a control program (image processing program). The control program is executed when the image processing device 310 is started, thereby realizing the functions of the image processing device 310 (information processing unit 411, display control unit 412, etc.).

[0038] The information processing unit 411 acquires input information from the input unit 431, which is a function of the touch panel 322. From the acquired input information, the information processing unit 411 determines the video to be displayed in the video display area 210, the graphic to be displayed in the graphic display area 220, the video to be changed, etc.

[0039] The display control unit 412 (an example of an image processing unit) generates an image to be displayed in the image display area 210 set in a first location where user operability is poor, based on an image signal output from the camera 102 provided in the vehicle 101. The image generated by the display control unit 412 may be a camera image, a composite image, or a combination of the camera image and the composite image. The location where operability is poor is a location where touch operation is physically impossible or where touch operation is difficult, etc. The display control unit 412 (an example of a graphics processing unit) also generates a graphic to be displayed in the graphic display area 220 set to be superimposed on the touch panel 322 provided in a second location where user operability is good. The graphic is, for example, a graphic related to the range of the image displayed in the image display area 210. The location where operability is good is a location where touch operation is physically possible or where touch operation is easy, etc.

[0040] The display control unit 412 transmits to the navigation device 320 a display control signal for displaying the video in the video display area 210 and a display control signal for displaying a graphic relating to the range of the video in the graphic display area 220. The output unit 432 of the navigation device 320 displays the video and the graphic on the monitor 321 based on the display control signal from the image processing device 310. Note that the display control unit 412 may be specialized hardware.

[0041] 5 shows an example of a setting area (setting area 500) associated with touch panel 322 for the user to switch (change) the image. Setting area 500 is an area for identifying a touch operation for changing the image.

[0042] When the operation screen 510 is displayed in the graphic display area 220, a plurality of predetermined setting areas 500 are superimposed on the operation screen 510 and associated with the touch panel 322. Each of the plurality of setting areas 500 is associated with one predetermined video pattern.

[0043] In this way, a plurality of setting areas 500 are associated with touch panel 322, and a video pattern is associated with each of the plurality of setting areas 500. Video display device 103 displays an image of the video pattern associated with setting area 500 that has been touched on touch panel 322. According to the above configuration, for example, a user who is accustomed to touch operations to change an image can roughly grasp the position of setting area 500 without looking at graphic display area 220, and therefore can safely and quickly display a desired image without having to stare at graphic display area 220.

[0044] Furthermore, one predetermined graphic is associated with each of the multiple setting areas 500. That is, one video pattern and a graphic related to the range of the video of that video pattern are associated with one setting area 500. Therefore, when a touch operation is detected in the setting area 500, the video of the video pattern associated with that setting area 500 is displayed in the video display area 210, and the graphic related to the range of the video of that video pattern is displayed in the graphic display area 220.

[0045] In this embodiment, setting areas 500-1 to 500-10 are defined as the setting area 500. A video pattern showing the area ahead of the vehicle 101 and a graphic related to the range of the video of the video pattern (for example, graphic 600-1 described later) are associated with setting area 500-1. A video pattern showing the area behind the vehicle 101 and a graphic related to the range of the video of the video pattern (for example, graphic 600-2 described later) are associated with setting area 500-2. A video pattern showing the area to the left of the vehicle 101 and a graphic related to the range of the video of the video pattern (for example, graphic 600-3 described later) are associated with setting area 500-3. A video pattern showing the area to the left of the vehicle 101 and a graphic related to the range of the video of the video pattern (for example, graphic 600-4 described later) are associated with setting area 500-4. The setting area 500-5 is associated with a video pattern showing the left rear of the vehicle 101 and a graphic (for example, graphic 600-5 described below) relating to the range of the video of the video pattern. The setting area 500-6 is associated with a video pattern showing the right direction of the vehicle 101 and a graphic (for example, graphic 600-6 described below) relating to the range of the video of the video pattern. The setting area 500-7 is associated with a video pattern showing the right front of the vehicle 101 and a graphic (for example, graphic 600-7 described below) relating to the range of the video of the video pattern. The setting area 500-8 is associated with a video pattern showing the right rear of the vehicle 101 and a graphic (for example, graphic 600-8 described below) relating to the range of the video of the video pattern. The setting area 500-9 is associated with a video pattern showing the surroundings of the vehicle 101 and a graphic (for example, graphic 600-9 described below) relating to the range of the video (for example, a perspective view) of the video pattern. The setting area 500-10 is an area that accepts a touch operation to stop the display of the video.

[0046] 5 has been described as an example in which ten setting regions 500 are associated with the operation screen 510, but other numbers of divisions (two, three, ..., eleven, ..., etc.) can be appropriately adopted. For example, a configuration in which setting region 500-4 and setting region 500-7 are not provided, a configuration in which setting region 500-9 is not provided, and a configuration in which setting region 500-10 is not provided may be adopted. Also, for example, a configuration in which other setting regions 500 are provided and a video pattern showing the surroundings of the vehicle 101 and a graphic related to the range of the video of the video pattern (for example, a top view) are associated with the other setting regions 500 may be adopted.

[0047] Furthermore, the method of associating a touch operation with a video pattern and a graphic is not limited to the method using the setting area 500. For example, a video pattern and a graphic may be associated with a slide direction 520 of a slide operation. In this case, the video display device 103 displays a video of a video pattern associated with the slide direction 520 of a slide operation on the touch panel 322. According to the above configuration, for example, a user can display a desired video by performing a slide operation in the direction of the desired video, so that the desired video can be displayed intuitively without gazing at the graphic display area 220. Note that the slide directions 520-1 to 520-8 correspond to the setting areas 500-1 to 500-8, respectively.

[0048] The correspondence between touch operations (setting area 500, slide area 520, etc.) and video patterns and graphics may be realized by information such as a table, or may be described (coded) in the program source as branching processing, etc., and realized by that branching processing, etc.

[0049] 6 shows an example of a graphic 600 associated with the setting area 500. On the operation screen 510, graphics 600-1 to 600-9 relating to the range of the image of the vehicle 101 are displayed.

[0050] Graphic 600-1 is a video range image of the front of the vehicle 101. Graphic 600-2 is a video range image of the rear of the vehicle 101. Graphic 600-3 is a video range image of the left of the vehicle 101. Graphic 600-4 is a video range image of the left front of the vehicle 101. Graphic 600-5 is a video range image of the left rear of the vehicle 101. Graphic 600-6 is a video range image of the right of the vehicle 101. Graphic 600-7 is a video range image of the right front of the vehicle 101. Graphic 600-8 is a video range image of the right rear of the vehicle 101.

[0051] Here, graphics 600-1 to 600-8 are images that indicate the angle of view of the image of vehicle 101 and indicate the direction in which the image was captured, and in this example, each graphic 600 is triangular in shape. However, the shape of each graphic 600 can be any shape that indicates the direction in which the image was captured, and may be an arrow or a sector.

[0052] The graphic 600-9 is an image of the video range around the vehicle 101. The graphic 600-10 is an image showing roads on a map. The graphic 600-11 is an example of an image showing the vehicle 101 (vehicle image), and is an image showing the position and traveling direction of the vehicle 101 on the map.

[0053] 7 shows an example of the video display process. The video display process starts when a specified input operation for the user to check a desired video is accepted. The specified input operation may be a touch operation on the touch panel 322, a press of an operation button, or some other operation.

[0054] In S701, the video display device 103 displays a video in the video display area 210, and displays a video range image (operation screen 510) in the graphic display area 220. The video displayed in the video display area 210 in S701 may be a video of a predetermined video pattern, a video of a video pattern set in the previous video display process, or a video of another video pattern. The number of videos (number of videos) may be one or more. The number of videos may be set by the user.

[0055] In S702, the video display device 103 determines whether or not a predetermined touch operation (change operation) for changing the video displayed in the video display area 210 has been detected. If the video display device 103 determines that a change operation has been detected, it proceeds to S703, and if it determines that a change operation has not been detected, it returns to S702. The change operation may be a touch operation on the touch panel 322 (graphic display area 220), such as a touch operation of staying on the video range image for a predetermined time (long press), or a touch operation of tapping the video range image twice within a predetermined time (double tap).

[0056] In S703, the video display device 103 displays the image to be changed in the video display area 210 and the graphic display area 220. The image to be changed displayed in the video display area 210 is an image indicating that the image of the video pattern associated with the setting area 500 to which the changed graphic 600 is associated is the image to be changed. The image to be changed displayed in the graphic display area 220 is an image indicating that the changed graphic 600 is the image to be changed.

[0057] In S704, the video display device 103 determines whether the touch coordinates have been changed. If the video display device 103 determines that the touch coordinates have been changed, it proceeds to S705, and if it determines that the touch coordinates have not been changed, it proceeds to S706.

[0058] In S705, the video display device 103 displays an image according to the touch coordinates. For example, the video display device 103 identifies the setting area 500 that includes the touch coordinates. More specifically, the video display device 103 determines whether the touch coordinates are included in the first setting area 500 (any of the setting areas 500-1 to 500-9). If the touch coordinates are included in the first setting area 500, the video display device 103 generates an image of a video pattern associated with the setting area 500 and displays it in the video display area 210. Furthermore, the video display device 103 displays the graphic 600 associated with the setting area 500 in the graphic display area 220. Next, the video display device 103 determines whether the touch coordinates are included in the second setting area 500 (setting area 500-10). If the touch coordinates are included in the second setting area 500, the video display device 103 stops displaying the image in the video display area 210.

[0059] In this way, video display device 103 changes the first video displayed in video display area 210 to a second video having a video pattern corresponding to a touch operation on touch panel 322 from among a plurality of predetermined video patterns. Video display device 103 also changes first graphic 600 relating to the range of the first video displayed in graphic display area 220 to second graphic 600 relating to the range of the second video from among a plurality of predetermined graphics 600. According to the above configuration, even if a video is displayed in video display area 210 set in a location where operability is poor, for example, the user can check the range of the video displayed in graphic display area 220 and change the video instantly by touching touch panel 322.

[0060] In S706, the video display device 103 determines whether or not a confirmation operation has been detected. If the video display device 103 determines that a confirmation operation has been detected, it proceeds to S707, and if it determines that a confirmation operation has not been detected, it returns to S704. A confirmation operation is an input operation for confirming the image to be displayed in the video display area 210, and includes an operation of removing a finger from the touch panel 322, a touch operation on the touch panel 322 with multiple fingers (multi-tap), etc.

[0061] In S707, the video display device 103 hides the image to be changed and ends the video display process.

[0062] FIG. 8 shows an example of screen transitions in the video display area 210 and the graphics display area 220. As shown in FIG.

[0063] Video screen 810 is an example of a screen displayed in video display area 210. Video screen 810 displays a vehicle image 811 showing vehicle 101, video 812 showing vehicle 101 and / or the area around vehicle 101, a change target image 813 showing video 812 to be changed, information on the meter panel such as driving speed, and the like.

[0064] The graphic screen 820 is an example of a screen displayed in the graphic display area 220. The graphic screen 820 is a screen that includes a map screen. A car mark image 821, a road image 822, and the like are displayed on the graphic screen 820. The car mark image 821 indicates the position and traveling direction of the vehicle 101 on the map. The road image 822 indicates the road on the map along which the vehicle 101 is traveling.

[0065] Graphic screen 820-1 is an example of a map screen. Graphic screens 820-2 to 820-4 are examples of operation screen 510. Graphic screens 820-2 to 820-4 display a video range image 823 and a change target image 824 superimposed on the map screen. Video range image 823 is an image showing the range of video 812. Change target image 824 is an image showing video range image 823 of video 812 that is the change target.

[0066] In this example, the video display device 103 generates, as the graphic 600 to be displayed in the graphic display area 220, a car mark image 821 indicating the position of the vehicle 101 on the map and the direction of travel of the vehicle 101, and a video range image 823 indicating the range of the video 812. According to the above configuration, for example, the user can understand the direction in which the video 812 is displayed on the map.

[0067] When a specified input operation is performed on the graphic screen 820-1, the screen transitions from the video screen 810-1 to the video screen 810-2, and from the graphic screen 820-1 to the graphic screen 820-2.

[0068] A left door mirror image 812-1 and a right door mirror image 812-2 are displayed on the video screen 810-2. A video field image 823-1 of the left door mirror image 812-1 and a video field image 823-2 of the right door mirror image 812-2 are displayed on the graphic screen 820-2.

[0069] In this example, the video display device 103 generates, as the graphic 600 to be displayed in the graphic display area 220, a car mark image 821 indicating the vehicle 101 and a sector-shaped video range image 823 centered on the car mark image 821. With the above configuration, for example, the user can easily understand the direction in which the video 812 is displayed relative to the vehicle 101.

[0070] On graphic screen 820-2, the user can make the video 812 the target for change by long pressing on video range image 823 of the video 812 that the user wants to change. For example, when video range image 823-1 on video screen 810-2 is long pressed, the screen transitions from video screen 810-2 to video screen 810-3, and the screen transitions from graphic screen 820-2 to graphic screen 820-3.

[0071] A change target image 813 indicating that the left door mirror image 812-1 is to be changed is displayed on the video screen 810-3. The change target image 813 may be, for example, an image that changes the color of the frame in which the left door mirror image 812-1 is displayed, an image that thickens the frame, or any other image that highlights the left door mirror image 812-1. A change target image 824 indicating that the left door mirror image 812-1 is to be changed is displayed on the graphic screen 820-3. The change target image 824 may be, for example, an image that changes the color of the frame in which the image range image 823-1 is displayed, an image that thickens the frame, or any other image that highlights the image range image 823-1.

[0072] On the graphic screen 820-3, the user can change to the desired image 812 by performing a slide operation to the setting area 500 associated with the image pattern of the desired image 812.

[0073] In this way, the video display device 103 displays each video 812 of the multiple video patterns in the video display area 210, and displays a video range image 823 of each video 812 of the multiple video patterns in the graphic display area 220. The video display device 103 then monitors a predetermined touch operation on the touch panel 322 with respect to the video range image 823 displayed in the graphic display area 220. The video display device 103 displays a change target image 813 in the video display area 210, indicating that the video 812 corresponding to the video range image 823 on which the predetermined touch operation has been performed is to be changed. The video display device 103 also displays a change target image 824 in the graphic display area 220, indicating that the video 812 corresponding to the video range image 823 is to be changed. In the above configuration, for example, when a user performs a predetermined touch operation on the video range image 823 of the video 812 that the user wants to change, the change target image 813 and the change target image 824 are displayed, indicating that the video 812 is to be changed. According to the above configuration, even when a plurality of images 812 and image range images 823 are displayed, the user can easily grasp the target of the change.

[0074] On the graphic screen 820-3, for example, when a touch operation on the setting area 500-2 is detected, the screen transitions from the video screen 810-3 to the video screen 810-4, and the screen transitions from the graphic screen 820-3 to the graphic screen 820-4.

[0075] The video screen 810-4 displays a rearview mirror image 812-3 of a video pattern behind the vehicle 101, which is associated with the setting area 500-2. The rearview mirror image 812-3 shows a vehicle traveling behind the vehicle 101. The graphic screen 820-4 displays a video range image 823-3 (an example of the graphic 600-2) associated with the setting area 500-2. Note that if the video range image 823-2 and the video range image 823-3 overlap, the video range image 823-3 to be changed is displayed in front. In this case, the outline of the video range image 823-3 displayed in front may be offset inward, as shown in FIG. 8, so that the video range image 823 is easier to see.

[0076] Next, other configurations of the video display device 103 will be described with reference to FIGS.

[0077] As shown in Fig. 9, the video display device 103 may include a monitor 910 and a tablet terminal 920. The monitor 910 is provided at the back of the steering wheel 202, where it is difficult for the user to operate it. The monitor 910 has a video display area 210. The tablet terminal 920 is provided in the center console, where it is easy for the user to operate it. The tablet terminal 920 has a graphic display area 220.

[0078] 10, the video display device 103 may include a monitor 1010 and a tablet terminal 1020. The monitor 1010 is provided across the entire width of the dashboard 201. An image display area 210 of the monitor 1010 is set near the A-pillar on the passenger side, a location that is difficult for the user to operate. The tablet terminal 1020 is provided on the steering wheel 202, a location that is easy for the user to operate. A graphic display area 220 is set on the tablet terminal 1020.

[0079] In this way, the video display device 103 may be a display device in which the video display area 210 is set and a display device in which the graphic display area 220 is set, which are different display devices. Furthermore, the video display area 210 and the graphic display area 220 do not have to be adjacent display areas.

[0080] (II) Supplementary Note The above-described embodiment includes, for example, the following content.

[0081] In the above-described embodiment, the present invention is described as being applied to a video display device, but the present invention is not limited to this and can be widely applied to various other systems, devices, methods, and programs.

[0082] Furthermore, in the above-described embodiments, some or all of the programs may be installed from a program source into a device such as a computer that realizes the video display device 103. The program source may be, for example, a program distribution server connected via a network or a computer-readable recording medium (e.g., a non-transitory recording medium). Furthermore, in the above description, two or more programs may be realized as one program, or one program may be realized as two or more programs.

[0083] Furthermore, the screens shown and described in the above-described embodiment are merely examples, and any design may be used as long as the information received is the same.

[0084] Furthermore, the screens shown and described in the above-described embodiment are merely examples, and any design may be used as long as the information presented is the same.

[0085] In addition, in the above description, information such as programs, tables, files, etc. that realize each function can be stored in a storage device such as a memory, a hard disk, or an SSD (Solid State Drive), or in a recording medium such as an IC card, an SD card, or a DVD.

[0086] Furthermore, the above-described configurations may be modified, rearranged, combined, or omitted as appropriate within the scope of the present invention. [Explanation of symbols]

[0087] 103: Image display device, 210: Image display area, 220: Graphic display area.

Claims

1. A video display device mounted on a vehicle, an image processing unit that displays a plurality of images in a first display area that is set behind the steering wheel and serves as an instrument panel based on an image signal output from a camera provided in the vehicle; a graphic processing unit that displays a vehicle image, which is a graphic representing the vehicle, in a second display area that is set to be superimposed on a touch panel that is provided in a location different from the location where the first display area is provided and that has good operability for a user, and that displays, for each of the plurality of images displayed in the first display area, an image range image, which is a graphic according to the shooting range and shooting direction of a camera based on the image, with the vehicle image at the center; When a predetermined touch operation is performed on one of the plurality of image range images displayed in the second display area, the graphics processing unit displays the one video range image as a change target; the video processing unit displays one video corresponding to the one video range image among the plurality of videos as a change target; In response to a slide operation performed without lifting the finger from the predetermined touch operation, the graphics processing unit changes the one video range image to a video range image corresponding to a change in the shooting range and shooting direction of the camera in accordance with the slide operation; the image processing unit changes the one image into an image corresponding to a change in a shooting range and a shooting direction of a camera in accordance with the one slide operation; When the finger is released after the slide operation, the image processing unit confirms the image after the change of the one image; If the one video range image to be changed overlaps with another video range image in response to the slide operation, the graphics processing unit shifts the outline of the one video range image to be changed and displays it in front of the other video range image. Video display device.

2. The vehicle image indicates the position of the vehicle on a map and the direction of travel of the vehicle.

2. The image display device according to claim 1.

3. The video range image is a sector-shaped image centered on the vehicle image.

2. The image display device according to claim 1.

4. A video display method executed by a video display device mounted on a vehicle, comprising: a first display area that is set behind the steering wheel and serves as an instrument panel, and displays a plurality of images based on an image signal output from a camera provided in the vehicle; a vehicle image, which is a graphic representing the vehicle, is displayed in a second display area that is set to be superimposed on a touch panel that is provided in a second location different from the location where the first display area is provided and that has good operability for a user; and for each of the plurality of images displayed in the first display area, an image range image, which is a graphic according to the shooting range and shooting direction of a camera based on the image, is displayed with the vehicle image at the center; When a predetermined touch operation is performed on one of the plurality of image range images displayed in the second display area, Displaying the one video range image as a change target; displaying one of the plurality of images corresponding to the one image range image as a change target; In response to a slide operation performed without lifting the finger from the predetermined touch operation, changing the one image range image to an image range image corresponding to the change in the camera's shooting range and shooting direction in accordance with the slide operation; changing the one image to an image corresponding to the change in the shooting range and shooting direction of the camera in accordance with the slide operation; When the finger is released after the slide operation, the image after the change of the first image is confirmed; If the one video range image to be changed overlaps with another video range image in response to the slide operation, the outline of the one video range image to be changed is shifted and displayed in front of the other video range image. Video display method.

Images