Control device, control method, and program

The control device and method address the cost increase by identifying and excluding faulty display areas without additional components, ensuring continued functionality and safety in display systems.

JP7840105B2Active Publication Date: 2026-04-03PANASONIC AUTOMOTIVE SYST CO LTD
View PDF 9 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-07-20
Publication Date
2026-04-03

AI Technical Summary

Technical Problem

The increase in manufacturing cost due to the need for additional components to detect failure ranges in display devices, as seen in existing technologies, is a challenge.

Method used

A control device and method that acquires region information from a first display screen, identifies faulty areas based on user input, and adjusts the display to exclude these areas, utilizing a separate second display screen for input when necessary, without requiring additional detection components.

Benefits of technology

This approach reduces manufacturing costs by eliminating the need for extra components to identify faulty regions and ensures that important information can still be displayed, even with partial failures, enhancing user safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007840105000001
    Figure 0007840105000001
  • Figure 0007840105000002
    Figure 0007840105000002
  • Figure 0007840105000003
    Figure 0007840105000003
Patent Text Reader

Abstract

To provide a control device, a control method and a program that can suppress a sharp rise in manufacturing costs due to an increase in the number of components for specifying a failure region.SOLUTION: A control device 30 comprises: an acquisition section (a control section 33) for acquiring region information related to a display region of a first display screen 11 which displays an image; and a processing section (a failure range specifying section 31) for specifying a failure region included in the display region on the basis of the acquired region information, and outputting the specified failure region.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a control device, a control method, and a program.

Background Art

[0002] Patent Document 1 discloses a display device for a vehicle that displays various information related to the vehicle. This display device includes a detection unit that detects the occurrence of a failure for each of a plurality of displays, and a control unit that, based on a detection signal of the occurrence of a failure by the detection unit, causes an image to be displayed on the display without a failure in descending order of importance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the display device of Patent Document 1, when detecting a partial failure range of a display, components for detecting the failure range need to be provided. Therefore, there is a problem that the manufacturing cost of the display device increases due to an increase in the number of components. [[ID=3,7]]

[0005] Therefore, an object of the present disclosure is to provide a control device, a control method, and a program that can suppress an increase in manufacturing cost due to an increase in the number of components for specifying a failure region.

Means for Solving the Problems

[0006] A control device according to an aspect of the present disclosure includes an acquisition unit that acquires region information regarding a display region of a first display screen that displays an image, and a processing unit that specifies a failure region included in the display region based on the acquired region information and outputs the specified failure region. A second display device, which has a second display screen separate from the first display screen, receives input of a normal area in which an image can be displayed normally, or the faulty area in which an image cannot be displayed normally, and the acquisition unit acquires the area information, including the normal area or the faulty area, from the second display device. It has.

[0007] Furthermore, a control method according to one aspect of this disclosure includes acquiring region information relating to the display area of ​​a first display screen that displays an image, identifying a fault area included in the display area based on the acquired region information, and outputting the identified fault area. The second display device, which has a second display screen separate from the first display screen, receives input of a normal area in which an image can be displayed normally, or the faulty area in which an image cannot be displayed normally, and acquires the area information including the normal area or the faulty area from the second display device. Includes.

[0008] Furthermore, a program relating to one aspect of this disclosure causes a computer to execute a control method. [Effects of the Invention]

[0009] The control device and the like of this disclosure can suppress the increase in manufacturing costs caused by an increase in the number of parts required to identify the fault region. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1 is a schematic diagram showing a display system according to an embodiment. [Figure 2] Figure 2 is a block diagram showing a display system according to an embodiment. [Figure 3] Figure 3 is a schematic diagram showing the normal area, fault area, and fault detection image of the first display screen in the display system according to the embodiment. [Figure 4] Figure 4 is a flowchart showing an example of the operation of the display system according to the embodiment. [Figure 5] Figure 5 is a schematic diagram illustrating the case where a predetermined tile-shaped image is incorrectly selected from the fault detection images displayed on the first display screen. [Figure 6] Figure 6 is a block diagram showing a display system according to a modified example 1 of the embodiment. [Figure 7] Figure 7 is a schematic diagram showing how a normal area is input to a second display screen displaying a fault detection image in a display system according to a modified example 1 of the embodiment. [Figure 8] Figure 8 is a block diagram showing a display system according to a modified example 2 of the embodiment. [Figure 9] FIG. 9 is a schematic diagram showing a case where a failure detection image is displayed on a first display screen in a display system according to Modification 2 of the embodiment. [Figure 10] FIG. 10 is a flowchart showing an operation example of the display system according to Modification 2 of the embodiment. MODE FOR CARRYING OUT THE INVENTION

[0011] Note that each of the embodiments described below shows comprehensive or specific examples. Numerical values, shapes, materials, components, arrangement positions and connection forms of components, steps, order of steps, etc. shown in the following embodiments are merely examples and are not intended to limit the present disclosure. In addition, among the components in the following embodiments, components not described in the independent claims are described as optional components.

[0012] Also, each figure is a schematic diagram and is not necessarily drawn precisely. In each figure, the same constituent members are denoted by the same reference numerals.

[0013] Hereinafter, the embodiments will be specifically described with reference to the drawings.

[0014] (Embodiment) <Configuration and Function> First, the display system 1 of the present embodiment will be described with reference to FIGS. 1 to 3.

[0015] FIG. 1 is a schematic diagram showing the display system 1 according to the embodiment. FIG. 2 is a block diagram showing the display system 1 according to the embodiment. FIG. 3 is a schematic diagram showing a normal area, a failure area, a failure detection image, etc. of the first display screen 11.

[0016] As shown in FIG. 1, the display system 1 is a system for displaying a plurality of images on the first display screen 11 of one or more first display devices 10. Specifically, in the display system 1, the display positions of a plurality of images can be set automatically or manually by the user on the first display screen 11 of one or more first display devices 10.

[0017] Further, in the display system 1, when a part of the first display screen 11 fails, an image is displayed in an area other than the failed part. For example, even if a part of the first display screen 11 of a certain first display device 10 among one or more first display devices 10 fails, the one or more first display devices 10 can cooperate to display a plurality of images excluding the failed part.

[0018] Further, the display system 1 is used in a vehicle 2 or the like on which one or more first display devices 10 are mounted. For this reason, in the present embodiment, the plurality of images are images displayed based on an application, and include, for example, information such as vehicle instruments, the operating status of in-vehicle devices, navigation information, captured images, and information on surrounding vehicles. Vehicle instruments include a speedometer, a direction indicator light, a warning light, an odometer, a shift position, a fuel gauge, a water temperature gauge, etc. In-vehicle devices are, for example, an audio device, an in-vehicle lighting device, and a seat device. Navigation information is information for guiding a driver to the current position and the route to the destination when the vehicle 2 is running. The captured image is an image captured by an imaging device mounted on the vehicle 2 of the surrounding area or the interior of the vehicle. Information on surrounding vehicles is information indicating the presence or absence, the number, the speed, and the distance from the vehicle 2 to other vehicles of other vehicles existing around the vehicle 2.

[0019] Specifically, as shown in FIG. 2, the display system 1 includes one or more first display devices 10 and a control device 30.

[0020] [First Display Device 10] The first display device 10 is a display device such as a PC (Personal Computer) equipped with an LCD display, a mobile terminal, a car navigation system installed in a vehicle 2, an electronic mirror system, or a multi-information display.

[0021] Figure 1 illustrates several first display devices 10, including a car navigation system 10a positioned in the center of the vehicle's width, an electronic mirror system functioning as a left side mirror 10b and a right side mirror 10c, and multiple multi-information displays 10d, 10e, and 10f. These first display devices 10 are arranged side by side so that the user of the vehicle 2 can view multiple first display devices 10 at once.

[0022] When multiple first display devices 10 are installed side by side in a vehicle 2, the multiple first display devices 10 can be controlled in coordination by the display system 1 to display a single image or each display an image individually. In this embodiment, unless otherwise specified, the description will focus on one first display device 10.

[0023] The first display device 10 includes a first display screen 11 and an input unit 12.

[0024] The first display screen 11 is a display having a display area and capable of displaying an image in the display area. The display area is the entire area of ​​the first display screen 11 and includes the fault area described later. The first display screen 11 is a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel. The first display screen 11 displays a GUI (Graphical User Interface) for manipulating images such as maps for car navigation systems, menu images for various in-vehicle devices, or search images.

[0025] The input unit 12 is a touch sensor capable of receiving user input and detecting the contact position of an operating object on the operating surface. The input unit 12 is positioned so as to overlap with the display area of ​​the first display screen 11. The input unit 12 detects, for example, operations such as bringing an operating object into contact with the operating surface, or moving the operating object along the operating surface while in contact with it. The input unit 12 outputs a signal to the control device 30 corresponding to the user's operation.

[0026] As shown in Figures 3(a) and (b), a portion of the first display screen 11 may malfunction under normal conditions. In this case, the input unit 12 may not malfunction. In this case, as shown in Figures 3(c) and (d), area information for identifying the faulty area, including the faulty area, is input to the input unit 12. The area information is information about the display area of ​​the first display screen 11 that displays the image. The area information includes a normal area where the image can be displayed normally, or a faulty area where the image cannot be displayed normally. When input, the size and position coordinates of the normal area and the faulty area on the display area are linked. A faulty area is an area in the display area of ​​the first display screen 11 where the image cannot be displayed normally. A normal area is the area in the display area of ​​the first display screen 11 excluding the faulty area, and where the image can be displayed normally.

[0027] For example, when inputting region information to the input unit 12, the first display screen 11 displays a fault detection image, which is a GUI for inputting region information. The fault detection image is a series of tile-like images arranged in a matrix on the first display screen 11, as shown in Figure 3(c). When the user selects a normal range or a fault range on the fault detection image on the first display screen 11 using an operator, the control device 30 changes the color of the selected tile-like image, as shown by the dot hatching in Figure 3(d). This allows the user to recognize the selected range. In this way, by selecting a tile-like image displayed on the first display screen 11 according to the normal range or fault range on the fault detection image on the first display screen 11, the normal range or fault range is input to the input unit 12. Therefore, the input unit 12 can receive region information including the normal range or fault range through user operation. The input unit 12 outputs the received region information to the control device 30.

[0028] The size of each of the multiple tile-like images that make up the fault detection image can be set arbitrarily. For example, a tile-like image with 2 tiles vertically and 2 tiles horizontally may be displayed as the fault detection image, or, as shown in Figure 3(c), a tile-like image with 4 tiles vertically and 7 tiles horizontally may be displayed as the fault detection image. Furthermore, the shape of the tile-like image may be circular, polygonal, or other shapes, and may also be diagonal, wavy, or dotted. Moreover, the shape of the tile-like image may be any other known shape and is not limited to these shapes.

[0029] Note that Figure 3(d) illustrates a case where the normal area corresponding to the normal range is selected as a tiled image of A1-A7, B1-B4, C1-C4, and D1-D4, but it is not limited to this. For example, when selecting a fault area corresponding to a fault range, the user would select a tiled image of B5-B7, C5-C7, and D5-D7.

[0030] Whether selecting a normal area or a faulty area, the faulty area can be detected not by using a tiled image as the fault detection image, but also by the user touching the operating object to the first display screen 11, or by moving the object to enclose the faulty area while in contact with it.

[0031] [Control device 30] As shown in Figure 2, the control device 30 controls the first display device 10 to display multiple images on the first display screen 11 of one or more first display devices 10. The control device 30 also controls the first display device 10 to display a fault detection image, which is a GUI for inputting area information, on the first display screen 11. Specifically, when a user starts an application to determine the fault area, the control device 30 controls the first display device 10 to display the fault detection image on the application. As described above, since the user inputs normal areas or fault areas into the input unit 12, the control device 30 can identify normal areas other than the fault area when a part of the first display screen 11 malfunctions. Furthermore, the control device 30 may also control the display to show an image in the identified normal area.

[0032] Specifically, the control device 30 includes a control unit 33, a fault range identification processing unit 31, and a display configuration adjustment unit 32.

[0033] The control unit 33 controls the fault range identification processing unit 31. Specifically, the control unit 33 acquires area information related to the display area of ​​the first display screen 11 that displays an image from the first display device 10. The control unit 33 outputs the acquired area information to the fault range identification processing unit 31, causing the fault range identification processing unit 31 to identify the fault area based on the area information. The control unit 33 is an example of an acquisition unit. The control unit 33 may also be an example of a processing unit. In addition, an acquisition unit such as an input interface may be provided separately in the control device 30.

[0034] The fault range identification processing unit 31, under the control of the control unit 33, identifies fault areas within the display area based on area information acquired from the control unit 33. Specifically, if the user inputs a normal area into the input unit 12, the area information includes the normal area, and therefore the fault range identification processing unit 31 identifies areas other than the normal area in the display area of ​​the first display screen 11 as fault areas. Also, if the user inputs a fault area into the input unit 12, the area information includes the fault area, and therefore the fault range identification processing unit 31 can identify fault areas in the display area of ​​the first display screen 11. The fault range identification processing unit 31 outputs the identified fault areas to the control unit 33. The fault range identification processing unit 31 is an example of a processing unit.

[0035] Furthermore, the control unit 33 controls the display configuration adjustment unit 32. Specifically, the display configuration adjustment unit 32 acquires the fault area identified by the fault area identification processing unit 31 via the control unit 33 and, under the control of the control unit 33, adjusts the display range on the first display screen 11 based on the fault area. In other words, the display configuration adjustment unit 32 may reconstruct the display area constructed on the first display screen 11 so that images are displayed only in the normal area excluding the identified fault area.

[0036] The display configuration adjustment unit 32, under the control of the control unit 33, performs drawing processing to adjust the brightness, contrast, gamma value, color tone, etc., of the image to be displayed in the reconstructed normal area, based on the reconstructed normal area and the drawing command for executing the drawing process. The display configuration adjustment unit 32 outputs the image after the drawing process to the control unit 33. The control unit 33 outputs the image after the drawing process to the first display device 10 so that the image after the drawing process is displayed in the reconstructed normal area.

[0037] As a result, even if a part of the first display screen 11 malfunctions, the control device 30 can identify the faulty area included in the display area. Therefore, the display system 1 can display an image in the normal area excluding the identified faulty area.

[0038] <Processing Actions> The control device 30, control method, and program processing operation according to this embodiment will be described.

[0039] (Example of operation) First, we will explain the case where a part of one of the first display screens 11 malfunctions, using Figures 4 and 5, etc.

[0040] Figure 4 is a flowchart showing an example of the operation of the display system 1 according to the embodiment. Figure 5 is a schematic diagram showing the case when a predetermined tile-shaped image is incorrectly selected from the fault detection images displayed on the first display screen 11.

[0041] First, a display device for determining the fault area is selected (S11). Specifically, the user launches an application for determining the fault area and selects a display device for determining the fault area from the GUI displayed on the application. In this example, it is assumed that a part of the first display device 10 is faulty. Therefore, the user operates on the first display screen 11 of the first display device 10 to select the first display device 10 as the display device for determining the fault area.

[0042] Next, a display device for user input is selected (S12). In this example, the display device for user input is selected as the first display device 10.

[0043] Next, the control device 30 outputs the fault detection image to the first display screen 11, as shown in Figure 3(c) (S13). As a result, the fault detection image is displayed on the first display screen 11.

[0044] Next, as shown in Figure 3(c), the user selects a normal area corresponding to the normal range or a fault area (area information) corresponding to the fault range in the fault detection image displayed on the first display screen 11 of the first display device 10 and inputs it to the input unit 12 (S14). The control device 30 changes the color of the tile-shaped image corresponding to the area information input to the input unit 12 and displays it on the first display screen 11.

[0045] Next, the user checks the normal area or fault area displayed on the first display screen 11 (S15). For example, as shown in Figure 5, the user may mistakenly select the tiled image B5 corresponding to the fault area as the normal area. Even in this case, by tapping the mistakenly selected tiled image B5 again, the tiled image B5 can be deselected from the normal area selection, as shown in Figure 3(d).

[0046] Next, the control device 30 prompts the user to confirm whether the normal area or fault area has been correctly entered (S16). In this case, the control device 30 may display a selection image on the first display screen 11 to confirm whether the normal area or fault area has been correctly entered. The selection image may be, for example, an image such as YES or NO.

[0047] If the user has not correctly entered the normal area or fault area (NO in S16), for example, if the user selects an image indicating NO, which means the first display screen 11 has not been entered correctly, the process returns to step S13 and a fault detection image is drawn. In this case, for example, the control device 30 draws the fault detection image on the first display screen 11. This allows the user to re-enter the normal area or fault area (area information) into the input unit 12.

[0048] On the other hand, if the user correctly inputs a normal area or a fault area (YES in S16), for example, if the user selects a selection image indicating that they have correctly input the first display screen 11, the control device 30 acquires the normal area or fault area (area information) input to the input unit 12 from the first display device 10. The fault range identification processing unit 31 of the control device 30, under the control of the control unit 33, identifies the fault area included in the display area based on the acquired area information. As shown in Figure 3(d), if the user inputs a normal area corresponding to the normal range to the input unit 12, the area information includes the normal area, so areas other than the normal area in the display area of ​​the first display screen 11 can be identified as fault areas. The fault range identification processing unit 31 outputs the identified fault area to the control unit 33 (S17). Then, the processing operation of the flowchart in Figure 4 is completed.

[0049] Thus, even if a fault area is formed on the first display screen 11, the control device 30 can identify the fault area included in the display area. Therefore, the display system 1 can display the image in the normal area excluding the identified fault area.

[0050] For example, the control unit 33 controls the display configuration adjustment unit 32 to cause the display configuration adjustment unit 32 to generate an image after the drawing process has been performed. The control device 30 outputs to the first display device 10 so that the image after the drawing process has been performed is displayed in the normal area, thereby displaying the image only in the normal area, excluding the faulty area from the display area.

[0051] <Effects and Effects> Next, the effects of the control device 30, control method, and program according to this embodiment will be described.

[0052] As described above, the control device 30 according to this embodiment includes an acquisition unit (control unit 33) that acquires area information relating to the display area of ​​the first display screen 11 that displays an image, and a processing unit (fault range identification processing unit 31) that identifies a fault area included in the display area based on the acquired area information and outputs the identified fault area.

[0053] According to this, since the area information includes the display area of ​​the first display screen 11, if a part of the first display screen 11 is malfunctioning, the malfunctioning area can be identified based on the area information. As a result, the control device 30 does not need to use any parts or devices to identify the malfunctioning area of ​​the first display screen 11.

[0054] Therefore, the control device 30 can suppress the increase in manufacturing costs caused by an increase in the number of parts required to identify the fault region.

[0055] In particular, once the control device 30 identifies a faulty area, it can reconstruct the display using the identified faulty area to show the image only in the normal area. In this case, since the image can be displayed only in the reconstructed normal area, a partial failure in one first display screen 11 does not need to be treated as a failure of the entire first display screen 11. As a result, an extreme narrowing of the display area can be suppressed, allowing for effective use of the normal area other than the faulty area. For example, if the control device 30 according to this embodiment is used in a vehicle 2, even if a part of the first display screen 11 fails, important information can still be presented to the user, thus ensuring user safety.

[0056] Furthermore, the control method according to this embodiment includes acquiring region information relating to the display area of ​​the first display screen 11 that displays an image, identifying a faulty area included in the display area based on the acquired region information, and outputting the identified faulty area.

[0057] This control method also produces the same effects as described above.

[0058] Furthermore, the program according to this embodiment is a program that causes a computer to execute a control method.

[0059] This program also produces the same effects as described above.

[0060] Furthermore, in the control device 30 according to this embodiment, the first display device 10 having the first display screen 11 receives input of either a normal area in which an image can be displayed normally, or a faulty area in which an image cannot be displayed normally. The acquisition unit then acquires area information including the normal area or the faulty area from the first display device 10.

[0061] According to this, the control device 30 can acquire region information including normal areas, or region information including faulty areas. Therefore, if the control device 30 acquires region information including normal areas, it can identify areas other than normal areas from the display area as faulty areas. Also, if the control device 30 acquires region information including faulty areas, it can identify faulty areas in the display area.

[0062] Furthermore, in the control device 30 according to this embodiment, the processing unit outputs a fault detection image to the first display screen 11 for inputting at least one of the normal area and the fault area. The acquisition unit then acquires area information including the input normal area or fault area.

[0063] According to this, since the fault detection image is displayed on the first display screen 11, the user can directly input the normal area or fault area corresponding to the normal range or fault range on the fault detection image on the first display screen 11. As a result, the control device 30 can acquire area information including the normal area or fault area, and thus identify the fault area on the first display screen 11.

[0064] (Modification 1 of the embodiment) This modified example differs from the embodiment in that it uses two display devices and the first display device 110 does not have an input unit. Unless otherwise specified, the other components in this modified example are the same as in the embodiment, and the same reference numerals are used for the same components, and a detailed description of the components is omitted.

[0065] First, the display system 1a of this modified example will be explained using Figures 6 and 7.

[0066] Figure 6 is a block diagram showing a display system 1a according to modified embodiment 1. Figure 7 is a schematic diagram showing how a normal area is input to the second display screen 21 displaying a fault detection image in the display system 1a according to modified embodiment 1.

[0067] The first display device 110 in this modified example includes a first display screen 11 and does not include an input unit such as a touch sensor.

[0068] In this modified display system 1a, in addition to the first display device 110 and the control device 30, a second display device 120 is also provided.

[0069] The second display device 120 is a display unit such as a car navigation system, an electronic mirror system, or a multi-information display mounted on the vehicle 2 in Figure 1. Alternatively, the second display device 120 may be a mobile terminal such as a smartphone, or a PC equipped with a display screen and an input unit such as a touch sensor.

[0070] The second display device 120 includes a second display screen 21 and an input unit 22.

[0071] The second display screen 21 is a display having a display area and capable of displaying images in that area. The display area is the entire area of ​​the second display screen 21 and includes the fault area described later. The second display screen 21 is a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel. The second display screen 21 displays a GUI (Graphical User Interface) for manipulating images such as maps for car navigation systems, menu images for various in-vehicle devices, or search images. The second display screen 21 may have the same configuration as the first display screen 11.

[0072] The input unit 22 is a touch sensor capable of receiving user input and detecting the contact position of an operating object on the operating surface. The input unit 22 is positioned so as to overlap with the display area of ​​the second display screen 21. The input unit 22 detects, for example, operations such as bringing an operating object into contact with the operating surface, or moving the operating object along the operating surface while in contact with it. The input unit 22 outputs a signal to the control device 30 corresponding to the user's operation.

[0073] As shown in Figure 7(a), a portion of the first display screen 11 may malfunction. In this case, if the first display device 110 does not have an input unit such as a touch sensor, the second display device 120, which has an input unit 22, can be used to allow the user to input area information to identify the faulty area into the input unit 22, as shown in Figures 7(b) and (c). For example, when the user inputs area information into the input unit 22, the second display screen 21 displays a fault detection image, which is a GUI for inputting area information. By the user selecting a normal range or a faulty range on the fault detection image on the first display screen 11 using an operating device, the control device 30 changes the color of the selected tile-like image, as shown by the dot hatching in Figures 7(b) and (c). At this time, the control device 30 also changes the color of the tile-like image on the first display screen 11 in conjunction with changing the color of the tile-like image on the second display screen 21. As a result, the user can recognize the selected range by using the first display device 110 and the second display device 120. In this way, the user selects a tile-like image on the fault detection image on the first display screen 11 according to the normal range or fault range, and the normal range or fault range is input to the input unit 22. Therefore, the input unit 22 can receive area information including the normal range or fault range through user operation. The input unit 22 outputs the received area information to the control device 30.

[0074] Next, an example of the operation of the control device 30, control method, and program according to this modified example will be explained using Figure 4 and other figures.

[0075] This example assumes a scenario where a portion of one of the first display screens 11 malfunctions. Furthermore, since this example is similar to Figure 4, the same steps are used for operations identical to those in Figure 4 of the embodiment, and explanations are omitted as appropriate.

[0076] First, a display device is selected to determine the extent of the fault (S11). In this example, it is assumed that a part of the first display device 110 is faulty. Therefore, the user operates on the first display screen 11 of the first display device 110 to select the first display device 110 as the display device for determining the extent of the fault.

[0077] Next, a display device for user input is selected (S12). In this example, the display device for user input is selected as the second display device 120.

[0078] Next, the control device 30 outputs the fault detection image to the first display screen 11 and the second display screen 21, as shown in Figure 7(a) (S13). The control device 30 may also output the fault detection image to the second display screen 21 only.

[0079] Next, the user selects a normal area corresponding to the normal range or a fault area corresponding to the fault range (area information) from the fault detection image displayed on the second display screen 21 of the second display device 120, and inputs it into the input unit 22 of the second display device 120 (S14). For example, as shown in Figures 7(b) and (c), the user selects a tile-shaped image (fault detection image) displayed on the first display screen 11 using an operating device and inputs it into the input unit 22. The control device 30 changes the color of the tile-shaped image corresponding to the area information input into the input unit 22 and displays it on the first display screen 11 and the second display screen 21. This allows the user to input area information while viewing the fault detection image displayed on both the first display screen 11 and the second display screen 21. Therefore, the user can input the normal range or fault range with high accuracy.

[0080] Next, the user checks the normal area or faulty area displayed on the second display screen 21 (S15).

[0081] Next, the control device 30 prompts the user to confirm whether the normal area or fault area has been correctly entered (S16). In this case, the control device 30 may display a selection image on the second display screen 21 to confirm whether the normal area or fault area has been correctly entered.

[0082] If the user has not correctly entered the normal area or fault area (NO in S16), for example, if the user selects an image indicating NO, which means the first display screen 11 has not been entered correctly, the process returns to step S13 and a fault detection image is drawn. This allows the user to re-enter the normal area or fault area (area information) into the input unit 22.

[0083] On the other hand, if the user correctly inputs a normal area or a fault area (YES in S16), for example, if the user selects a selection image indicating YES that they have correctly entered the first display screen 11, the fault area identification processing unit 31 outputs the identified fault area to the control unit 33 (S17). Then, the processing operation shown in the flowchart of Figure 4 is terminated.

[0084] Thus, even if the first display device 110 does not have an input unit such as a touch sensor, the control device 30 can identify the faulty area of ​​the first display screen 11 by using the second display device 120 which has an input unit 22. For this reason, the display system 1a can display an image in the normal area excluding the identified faulty area.

[0085] Next, the effects of the control device 30, control method, and program related to this modified example will be described.

[0086] As described above, in the control device 30 according to this modified example, the second display device 120, which has a second display screen 21 separate from the first display screen 11, receives input of either a normal area where an image can be displayed normally, or a faulty area where an image cannot be displayed normally. The acquisition unit also acquires area information, including the normal area or the faulty area, from the second display device 120.

[0087] According to this, the control device 30 can acquire region information including normal areas, or region information including faulty areas. Therefore, if the control device 30 acquires region information including normal areas, it can identify areas other than normal areas from the display area as faulty areas. Also, if the control device 30 acquires region information including faulty areas, it can identify faulty areas in the display area.

[0088] Furthermore, even if the first display device 110 does not have an input unit, or if the input unit malfunctions, the faulty area in the display area of ​​the first display device 110 can be identified by using another second display device 120 installed in the vehicle 2, for example.

[0089] Furthermore, in the control device 30 according to this modified example, the processing unit outputs a fault detection image for inputting a normal area or a fault area to the second display screen 21. The acquisition unit then acquires area information including the normal area or the fault area.

[0090] According to this, since the fault detection image is displayed on the second display screen 21, the user can directly input the normal area or fault area corresponding to the normal range or fault area on the fault detection image on the second display screen 21 via the second display device 120. As a result, the control device 30 can acquire area information including the normal area or fault area, and thus identify the fault area on the first display screen 11.

[0091] (Modified example 2 of the embodiment) This modified example differs from the embodiment in that it uses a second display device 120a equipped with an imaging unit 23. Unless otherwise specified, the other components in this modified example are the same as in the embodiment, and the same reference numerals are used for the same components, and a detailed description of the components is omitted.

[0092] First, the display system 1b of this modified example will be explained using Figures 8 and 9.

[0093] Figure 8 is a block diagram showing a display system 1b according to a modified example 2 of the embodiment. Figure 9 is a schematic diagram showing a case in which a fault detection image is displayed on the first display screen 11 in the display system 1b according to a modified example 2 of the embodiment.

[0094] In this modified example, the display system 1b includes a second display device 120a in addition to the first display device 110a and the control device 30. The first display device 110a in this modified example includes a first display screen 11 and an input unit 12 such as a touch sensor, but it does not have to include the input unit 12.

[0095] In the modified display system 1b, the first display screen 11 of the first display device 110a may be cracked and malfunctioning. In this case, if the user operates the first display screen 11 with their finger or the like, the user may get injured. Therefore, in this modified example, it is assumed that the display area of ​​the first display screen 11 is imaged using the second display device 120a.

[0096] The second display device 120a is a mobile terminal such as a smartphone, a camera sensor, or a PC equipped with a camera. In addition to the second display screen 21 and the input unit 22, the second display device 120a is equipped with an imaging unit 23 that has an imaging function.

[0097] The imaging unit 23 captures the display area of ​​the first display screen 11 when the user operates the second display device 120a. By capturing the display area of ​​the first display screen 11, the imaging unit 23 can acquire area information, which is an image that includes both normal and faulty areas. The imaging unit 23 outputs the acquired area information to the control device 30.

[0098] The fault range identification processing unit 31 of the control device 30 acquires region information and also acquires from the control unit 33 an image (the expected value of the image displayed on the first display screen 11) that has undergone drawing processing and is input to the first display screen 11 of the first display device 110a. By comparing the region information with the image that has undergone drawing processing, the fault range identification processing unit 31 can identify the fault area included in the display area.

[0099] Furthermore, to facilitate the identification of fault regions, when the imaging unit 23 takes an image, the fault detection image may be displayed in the display area of ​​the first display screen 11, as shown in Figure 9. Although Figure 9 illustrates a grid-like fault detection image, the fault detection image may be circular or polygonal tile-like, diagonal, wavy, dot-like, etc. The fault detection image may also be of other known shapes and is not limited to these. By having the imaging unit 23 take an image of the display area of ​​the first display screen 11 on which the fault detection image is displayed, the fault range identification processing unit 31 may identify the fault region included in the display area based on the image (region information) taken by the imaging unit 23.

[0100] Next, an example of the operation of the control device 30, control method, and program according to this modified example will be explained using Figure 10 and other figures. Figure 10 is a flowchart showing an example of the operation of the display system 1b according to modified example 2 of the embodiment.

[0101] This example assumes a scenario where a portion of one of the first display screens 11 malfunctions. Furthermore, this example uses the same steps as the example in Figure 4 of the embodiment, and explanations are omitted as appropriate.

[0102] First, a display device is selected to determine the extent of the fault (S11). In this example, it is assumed that a part of the first display device 110a is faulty. Therefore, the user operates on the second display screen 21 of the second display device 120a to select the first display device 110a as the display device to determine the extent of the fault.

[0103] Next, the device for user input is selected (S12). In this example, the device for user input is selected as the second device 120a.

[0104] Next, the control device 30 outputs a fault detection image to the first display screen 11, as shown in Figure 9 (S13). Note that if the control device 30 can recognize the fault area from the image, step S13 may be omitted.

[0105] Next, the user uses the second display device 120a to capture an image of the display area of ​​the first display screen 11 (S24). As a result, the second display device 120a can acquire an image (area information) that includes both the normal area and the faulty area.

[0106] Next, the second display device 120a displays the captured image on the second display screen 21. This allows the user to confirm the image, which includes the normal area corresponding to the captured normal range and the faulty area corresponding to the faulty range (S25).

[0107] Next, the control device 30 prompts the user to confirm whether the normal area and fault area have been correctly input (recognized) (S26). In other words, the control device 30 prompts the user to confirm whether the normal area and fault area determined from the captured image are set to the intended range. For example, the control device 30 displays the area determined to be a fault area in red and the area determined to be a normal area in blue on the first display screen 11. This allows the user to confirm whether the normal area and fault area have been correctly recognized. In this case, a selection image to confirm whether the normal area and fault area are set to the intended range may be displayed on the second display screen 21.

[0108] If the user determines that the normal area and fault area are not set to the intended range (NO in S26), for example, if the user selects an image indicating NO, meaning that the display area of ​​the first display screen 11 is not set to the intended range, the process returns to step S13 and a fault detection image is drawn. This allows the user to capture the display area of ​​the first display screen 11 again using the second display device 120a.

[0109] On the other hand, if the user determines that the display area of ​​the first display screen 11, which includes the normal area or the fault area, is set to the intended range (YES in S26), for example, if the user selects an image indicating YES that the display area of ​​the first display screen 11 is set to the intended range, the fault area identification processing unit 31 outputs the identified fault area to the control unit 33 (S17). Then, the processing operation of the flowchart in Figure 10 is terminated.

[0110] Thus, even without directly inputting the normal and faulty areas, the control device 30 can identify the faulty area of ​​the first display screen 11 by acquiring an image of the display area of ​​the first display screen 11. Therefore, the display system 1b can display the image in the normal area excluding the identified faulty area.

[0111] Next, the effects of the control device 30, control method, and program related to this modified example will be described.

[0112] As described above, in the modified control device 30, the second display device 120a, which has a second display screen 21 separate from the first display screen 11, captures the display area of ​​the first display screen 11, and acquires an image as area information that includes a normal area where the image can be displayed normally and a faulty area where the image cannot be displayed normally. The acquisition unit then acquires the image including the normal area and the faulty area as area information from the second display device 120a.

[0113] According to this, the control device 30 can acquire region information including normal regions and fault regions. Therefore, when the control device 30 acquires region information, it can easily identify normal regions and fault regions from the display region.

[0114] Furthermore, even if the first display screen 11 of the first display device 110a is cracked and malfunctioning, the faulty area in the display area of ​​the first display device 110a can be identified by using, for example, the second display device 120a owned by the user.

[0115] Furthermore, in the modified control device 30, the second display device 120a has an imaging unit 23. The region information is an image captured by the imaging unit 23 of the second display device 120a of the display area of ​​the first display screen 11.

[0116] According to this, the control device 30 can acquire area information simply by the user using the imaging unit 23 of the second display device 120a to image the display area of ​​the first display screen 11. Therefore, fault areas can be easily identified without having to separately mount a component for detecting fault areas on the first display device 110a or the like.

[0117] Furthermore, in the modified control device 30, the processing unit outputs a fault detection image to the first display screen 11 for inputting the normal area and the fault area. The acquisition unit then captures the display area of ​​the first display screen 11 displaying the fault detection image, thereby acquiring an image including the normal area and the fault area as area information.

[0118] According to this, a fault detection image as shown in Figure 9 is displayed on the first display screen 11. Therefore, the user can input area information, including the normal area and fault area, on the first display screen 11 into the control device 30 simply by using the second display device 120a to capture an image of the display area of ​​the first display screen 11. As a result, the control device 30 can acquire area information and easily identify the fault area on the first display screen 11.

[0119] (Other variations) Although the control device, control method, and program relating to this disclosure have been described above based on the embodiments described above, this disclosure is not limited to these embodiments. Various modifications to the embodiments that a person skilled in the art can conceive of may also be included in the scope of this disclosure, as long as they do not depart from the spirit of this disclosure.

[0120] For example, the control device, control method, and control unit included in the program according to the above embodiment are typically implemented as an LSI (Large-Scale Integrated Circuit). These may be individually integrated into a single chip, or some or all of them may be integrated into a single chip.

[0121] Furthermore, integrated circuit implementation is not limited to LSIs; it may also be achieved using dedicated circuits or general-purpose processors. Field-Programmable Gate Arrays (FPGAs), which can be programmed after LSI manufacturing, or reconfigurable processors, which allow for the reconfiguration of the connections and settings of circuit cells within the LSI, may also be used.

[0122] In the above embodiment, each component may be implemented by dedicated hardware or by executing a software program suitable for each component. Each component may also be implemented by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0123] Furthermore, all figures used above are illustrative to illustrate the present disclosure, and the embodiments of this disclosure are not limited to the figures exemplified.

[0124] Furthermore, the division of functional blocks in the block diagram is just one example; multiple functional blocks can be implemented as a single functional block, a single functional block can be divided into multiple parts, or some functions can be moved to other functional blocks. In addition, the functions of multiple functional blocks with similar functions can be processed in parallel or time-sharing by a single piece of hardware or software.

[0125] Furthermore, the order in which each step in the flowchart is performed is illustrative for the purpose of specifically illustrating this disclosure, and may be in a different order. Also, some of the above steps may be performed simultaneously (in parallel) with other steps. [Industrial applicability]

[0126] This disclosure can be applied, for example, to vehicles equipped with multiple display devices, and to other devices and systems other than vehicles. [Explanation of symbols]

[0127] 10, 10a, 10b, 10c, 10d, 10e, 10f, 110, 110a 1st display device 11 1st display screen 21 Second display screen 23 Imaging Unit 30 Control device 31. Fault Scope Identification Processing Unit (Processing Unit) 33 Control Unit (Acquisition Unit) 120, 120a 2nd display device

Claims

1. An acquisition unit that acquires area information relating to the display area of ​​the first display screen that displays an image, The system includes a processing unit that identifies a faulty area included in the display area based on the acquired area information and outputs the identified faulty area, A second display device having a second display screen separate from the first display screen receives input from either a normal area in which an image can be displayed normally, or the fault area in which an image cannot be displayed normally. The acquisition unit acquires the region information, including the normal region or the fault region, from the second display device. Control device.

2. The first display device having the first display screen receives input from either the normal region in which an image can be displayed normally, or the fault region in which an image cannot be displayed normally. The acquisition unit acquires the region information, including the normal region or the fault region, from the first display device. The control device according to claim 1.

3. The processing unit outputs a fault detection image for inputting the normal area or the fault area to the first display screen. The acquisition unit acquires the region information, including the input normal region or fault region. The control device according to claim 2.

4. The second display device, which has a second display screen separate from the first display screen, acquires an image of the display area of ​​the first display screen, including the normal area where the image can be displayed normally and the faulty area where the image cannot be displayed normally, as the area information. The acquisition unit acquires the captured image, including the normal region and the fault region, from the second display device as region information. The control device according to claim 1.

5. The second display device has an imaging unit, The region information is an image captured by the imaging unit of the second display device, which captures the display region of the first display screen. The control device according to claim 4.

6. The processing unit outputs a fault detection image for inputting the normal region and the fault region to the first display screen. The acquisition unit acquires the captured image, which includes the normal area and the faulty area, as area information by capturing the display area of ​​the first display screen that displays the fault detection image. The control device according to claim 4 or 5.

7. The processing unit outputs a fault detection image for inputting the normal area or the fault area to the second display screen. The acquisition unit acquires the region information, including the input normal region or fault region. The control device according to claim 1.

8. To obtain area information regarding the display area of ​​the first display screen that displays the image, Based on the acquired region information, the system identifies the fault region included in the display region and outputs the identified fault region. A second display device having a second display screen separate from the first display screen receives input from a normal area in which an image can be displayed normally, or from the fault area in which an image cannot be displayed normally. This includes obtaining the region information, including the normal region or the faulty region, from the second display device. Control method.

9. Cause a computer to execute the control method described in claim 8. program.

Citation Information

Patent Citations

  • Multi-large screen display device

    JP2000310982A

  • Portable terminal

    JP2011033720A

  • Display device, display system, display method and program

    JP2011077825A

  • Image display terminal, and method and program for controlling image display terminal

    JP2013114049A

  • Display device and display method

    JP2017083372A