Designation method, adjustment device, and computer program

Abstract

This designation method facilitates adjustment of a display system that combines images displayed by a plurality of display devices to generate one image. In this designation method, a sampling region to be used for adjustment of display of images by a plurality of display devices when the plurality of display devices are combined to display one image content is designated in an adjustment device. The adjustment device is provided with an arithmetic circuit and can access a storage device and a display. The adjustment device causes the plurality of display devices to display an adjustment image previously stored in the storage device through the arithmetic circuit, acquires, from an imaging device, a captured image obtained by capturing the adjustment image displayed by each of the plurality of display devices, displays the acquired captured image on the display, presents candidates for a sampling region to a user while superimposing the candidates on the captured image displayed on the display, and accepts designation of the sampling region determined on the basis of the candidates for the sampling region in accordance with an operation from the user via an input device.

Description

Designation method, adjustment device, and computer program

[0001] The present disclosure relates to a designation method, an adjustment device, and a computer program for designating a sampling area used to adjust display by a plurality of display devices in a display system that combines a plurality of display devices to display one video content.

[0002] When an image is projected from a projection device, there is a method of generating adjustment data using a captured image of the projection (for example, Patent Documents 1 to 3, etc.).

[0003] There are display systems that combine multiple display devices to display a single video content. However, such display systems also require adjustment of seams due to individual differences in color and brightness of the images displayed on each display device. Therefore, in such display systems, the generation of adjustment data is complex. First, an adjustment device that adjusts the display on the display devices in the display system samples the images displayed on each display device. The adjustment device also compares the images in the sampling areas and adjusts the parameters of each display device so that each sampling area displays an image with similar color and brightness.

[0004] JP 2017-50667 A JP 11-113019 A JP 2017-203877 A

[0005] However, when adjusting a display device using a captured image of a video, the sampling area used for the adjustment is important, but specifying such a sampling area increases the workload of the user.

[0006] The present disclosure provides a sampling area designation method, adjustment device, and computer program that reduce the workload of designating sampling areas for adjusting the color and brightness of an image.

[0007] The specification method disclosed herein is a method for specifying, in an adjustment device, sampling areas to be used for adjusting the display of video on multiple display devices when multiple display devices are combined to display a single video content. The adjustment device used in the specification method includes an arithmetic circuit and is capable of accessing a storage device and a display. The adjustment device causes the multiple display devices to display adjustment images pre-stored in the storage device, and acquires, from a capture device, captured images of the adjustment images displayed on the multiple display devices. The adjustment device causes the arithmetic circuit to display the acquired captured images on the display, and presents candidate sampling areas to a user by superimposing them on the captured images displayed on the display. The adjustment circuit accepts, through the arithmetic circuit, the specification of a sampling area determined based on the candidate sampling areas in response to a user's operation via an input device.

[0008] Such general and specific aspects may be realized by a system, a method, and a computer program, as well as a combination thereof.

[0009] The specification method, adjustment device, and computer program disclosed herein can reduce the workload of specifying sampling areas to be used for adjusting multiple display devices in a display system that has multiple display devices and combines the multiple display devices to display a single video content.

[0010] 1A is a block diagram showing the configuration of an adjustment system and an adjustment device according to the present disclosure. FIG. 1B is a block diagram showing the configuration of a display device adjusted by the adjustment system of FIG. 1A. FIG. 1C is a block diagram showing the configuration of an imaging device used in the adjustment system of FIG. 1A. FIG. 1D is a block diagram showing an example of an adjustment screen used in the adjustment system of the present disclosure. FIG. 1E is a block diagram showing a first example of candidate sampling areas used for color correction in the adjustment device of the present disclosure. FIG. 1F is a block diagram showing a first example of candidate sampling areas used for color correction in the adjustment device of the present disclosure. FIG. 1G is a block diagram showing a second example of candidate sampling areas used for color correction in the adjustment device of the present disclosure. FIG. 1H is a block diagram showing a third example of candidate sampling areas used for color correction in the adjustment device of the present disclosure. FIG. 1I is a block diagram showing an example of candidate sampling areas used for color correction in the adjustment device of the present disclosure. FIG. 1J is a block diagram showing a first example of candidate sampling areas used for brightness correction in the adjustment device of the present disclosure. FIG. 1J is a block diagram showing a second example of candidate sampling areas used for brightness correction in the adjustment device of the present disclosure. FIG. 1J is a block diagram showing a third example of candidate sampling areas used for brightness correction in the adjustment device of the present disclosure. FIG. 1I is a block diagram showing a fourth example of candidate sampling areas used for brightness correction in the adjustment device of the present disclosure. 10 shows a flowchart illustrating an example of processing in a display device adjusted by an adjustment device.

[0011] [Embodiments] Hereinafter, embodiments of the present disclosure will be described using the drawings, with appropriate reference to the drawings. However, in the detailed description, unnecessary parts of the description of the prior art and substantially identical configurations may be omitted. This is for the sake of simplicity. Furthermore, the following description and the accompanying drawings are disclosed to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter of the claims.

[0012] The designation method, adjustment device, and computer program according to the present disclosure are used to adjust a display system that combines multiple images displayed by multiple display devices into a single image. Specifically, the designation method, adjustment device, and computer program according to the present disclosure designate a sampling area to be used to adjust the display balance due to individual differences in color and brightness among the multiple display devices. For example, the designation method, adjustment device, and computer program according to the present disclosure can be used to designate a sampling area to be used for color correction or black correction.

[0013] In this disclosure, "color correction" refers to a correction that balances the colors displayed by multiple display devices included in a display system. Note that color correction is also referred to as color correction. Color correction may also involve adjusting brightness in accordance with the color. Therefore, color correction is also referred to as color luminance correction. In a display system, if multiple display devices are not adjusted, even if each display device displays the same color (e.g., red), the display devices may appear to display different colors. Therefore, when the same color is displayed on different display devices in a display system, internal parameters are adjusted in advance so that the same color appears the same when displayed on different display devices. Specifically, parameters are adjusted so that the sampling area of ​​the image displayed on each display device meets specified conditions. Note that when color correction is performed on multiple display devices, each display device is adjusted so that the color displayed on each display device is the specified color.

[0014] Furthermore, "black correction" is a correction that balances the black color displayed by multiple display devices included in a display system. Black correction adjusts the brightness and hue of the black color displayed by multiple display devices. Note that black correction is also referred to as brightness correction. In a display system, if multiple display devices are not adjusted, even if each display device displays the same black or dark color, it may appear to display it at different brightnesses. Therefore, when displayed on different display devices in a display system, internal parameters are adjusted in advance so that the same color appears to have the same brightness. Specifically, parameters are adjusted so that the sampling area of ​​the image displayed by each display device meets specified conditions. Note that when black correction is performed on multiple display devices, the brightness of the other display devices is adjusted to match that of the display device that displays the brightest among the multiple display devices. This is because a display device that displays brighter than the performance limit of the display device cannot be matched to a display device that displays darker.

[0015] Furthermore, a "sampling area" is an area of ​​the entire image projection area that is used for adjustments such as color correction and black correction. When performing adjustments such as color correction and black correction on multiple display devices included in a display device, the images displayed by each display device are compared. At this time, the entire image projection area may be compared and adjusted, or only a portion of the image projection area may be compared and adjusted. The area to be compared is called the sampling area.

[0016] 1A , an adjustment system 1 according to an embodiment includes an adjustment device 10, multiple display devices 20A and 20B, an imaging device 30, and a network 40. The first display device 20A and the second display device 20B form a display system 2. Each display device 20A, 20B is controlled by a control device (not shown) to display a different image, and a single video content can be generated as a whole. In such a display system 2, the adjustment system 1 adjusts parameters related to the display of each display device 20A, 20B, thereby balancing the color, brightness, and other aspects of a single video content generated by the multiple display devices.

[0017] In the example shown in FIG. 1A , the display system 2 is described as including two display devices 20A and 20B, but the number of display devices included in the display system 2 is not limited. Therefore, the number of display devices adjusted by the adjustment system 1 is also not limited. In the following description, each of the display devices 20A and 20B is described as a projection device that projects an image onto a screen (not shown). However, the type of the display devices 20A and 20B is not limited. The multiple display devices 20A and 20B may be multiple displays arranged adjacent to each other. Although not shown, the display system 2 may also include an information processing device connected to the multiple display devices 20A and 20B. In the display system 2, for example, each of the display devices 20A and 20B can project an image transmitted from the information processing device to display a single video content.

[0018] 1A, the adjustment device 10 is an information processing device including an arithmetic circuit 11, an input device 12, an output device 13, a communication circuit 14, and a storage device 15. The adjustment device 10 can acquire images captured by an imaging device 30, in which images are displayed on a plurality of display devices 20A, 20B, and adjust parameters related to the display of each of the display devices 20A, 20B using the acquired images.

[0019] The arithmetic circuit 11 is a controller that controls the entire adjustment device 10. For example, the arithmetic circuit 11 reads and executes an adjustment program P stored in the storage device 15 to realize various processes related to the adjustment of parameters related to the display of each of the display devices 20A, 20B. The arithmetic circuit 11 may be various processors such as a CPU, an MPU, a GPU, an FPGA, a DSP, an ASIC, or a dedicated hardware circuit.

[0020] The input device 12 is used for user operations and data input. The input device 12 can be, for example, an operation button, a keyboard, a mouse, a touch panel, a microphone, etc. The output device 13 is used for outputting processing results and data. The output device 13 can be, for example, output means such as a display, a speaker, etc.

[0021] The communication circuit 14 performs data communication with the display devices 20A and 20B and the image capture device 30. The data communication is performed wired and / or wirelessly, and may be in accordance with, for example, a known communication standard. For example, wired data communication may be performed by using, as the communication circuit 14, a communication controller of a semiconductor integrated circuit that operates in accordance with the Ethernet (registered trademark) standard and / or the USB (registered trademark) standard. Wireless data communication may be performed by using, as the communication circuit 14, a communication controller of a semiconductor integrated circuit that operates in accordance with the IEEE 802.11 standard for wireless local area networks (LANs) and / or the fourth-, fifth-, and sixth-generation mobile communication systems, known as 4G, 5G, and 6G, for mobile communications.

[0022] The storage device 15 is a storage medium that stores various information. The storage device 15 is realized, for example, by a RAM, a ROM, a flash memory, a solid-state drive (SSD), a hard disk drive, or other storage device, or by an appropriate combination thereof. The storage device 15 stores an adjustment program P, which is a computer program executed by the arithmetic circuit 11, and various data such as an adjustment image 151 used in image adjustment.

[0023] <Display Device> The display devices 20A and 20B project onto a screen images transmitted from an information processing device such as the adjustment device 10. At this time, each of the display devices 20A and 20B receives a different image, and by projecting the image, it is possible to generate a single image content.

[0024] As shown in FIG. 1B , the first display device 20A includes an arithmetic circuit 21, an input device 22, an output device 23, a communication circuit 24, an HDMI (registered trademark) receiving circuit 25, an HDMI transmitting circuit 26, a storage device 27, and an optical mechanism 28. The arithmetic circuit 21, the input device 22, the output device 23, the communication circuit 24, and the storage device 27 are realized by the same specific means as the arithmetic circuit 11, the input device 12, the output device 13, the communication circuit 14, and the storage device 15 described above with reference to FIG. 1A . The HDMI receiving circuit 25 enables reception of data from an external device (not shown). The HDMI transmitting circuit 26 enables transmission of data to an external device (not shown). The display device 20A is capable of communicating video and audio signals with an external device using the HDMI receiving circuit 25 and the HDMI transmitting circuit 26. The display device 20A also includes an optical mechanism 28 that projects an image. The optical mechanism 28 includes a light source such as a laser diode, an LED, or a lamp. The optical mechanism 28 includes an optical unit including a liquid crystal element that modulates light emitted from the light source, a light modulation element such as a DMD (Digital Mirror Device), and a projection lens system that guides the image light modulated by the light modulation element to the projection surface. Note that the second display device 20B has the same configuration as the first display device 20A, and is therefore not shown in the drawings.

[0025] <Photographing Device> The photographing device 30 photographs the images displayed on the display devices 20A and 20B. Here, it is preferable that the photographing device 30 is capable of photographing an entire image formed by combining multiple images used in the display system 2. In the example shown in Fig. 1A, the photographing device 30 photographs an image including an image displayed on a screen by the first display device 20A and an image displayed on a screen by the second display device 20B.

[0026] As shown in Fig. 1C , the photographing device 30 includes an arithmetic circuit 31, an input device 32, an output device 33, a communication circuit 34, a storage device 35, an optical mechanism 36, etc. The arithmetic circuit 21, the input device 22, the output device 23, the communication circuit 24, and the storage device 27 are realized by the same specific means as the arithmetic circuit 11, the input device 12, the output device 13, the communication circuit 14, and the storage device 15 described above with reference to Fig. 1A . The optical mechanism 36 includes a series of mechanisms related to the acquisition of image data, and acquires image data in accordance with control from the arithmetic circuit 31. Specifically, the optical mechanism 36 includes an image sensor, an optical system element, an A / D converter, etc.

[0027] <Processing in Adjustment Device> The processing executed by the arithmetic circuit 11 will now be described in detail.

[0028] The arithmetic circuit 11 transmits adjustment images 151 stored in advance in the storage device 15 to the plurality of display devices 20A, 20B via the communication circuit 14, and causes the display devices 20A, 20B to display the adjustment images 151. Here, the adjustment images 151 displayed on the display devices 20A, 20B only need to include information specifying the display range of each of the display devices 20A, 20B. For example, the adjustment images 151 may be images displayed in a predetermined color, or may be images composed only of a specific color. Furthermore, the adjustment images 151 do not need to be different for each of the display devices 20A, 20B. Therefore, the arithmetic circuit 11 can transmit the same adjustment images 151 to all of the display devices 20A, 20B.

[0029] Note that, here, an example will be described in which the adjustment image 151 is stored in advance in the storage device 15 of the adjustment device 10. However, the adjustment image 151 may be stored in another storage medium. For example, the same adjustment image 151 may be stored in the storage device of each of the display devices 20A and 20B. Alternatively, the adjustment image 151 may be stored in an external storage device (not shown).

[0030] The arithmetic circuit 11 acquires, via the communication circuit 14, captured images obtained by capturing the adjustment images displayed on the plurality of display devices 20A, 20B from the image capturing device 30. The arithmetic circuit 11 also stores the acquired captured images in the storage device 15.

[0031] The arithmetic circuit 11 displays the acquired captured image on the display 13, which is the output device 13. At this time, the arithmetic circuit 11 presents to the user candidate sampling areas to be compared with reference values ​​for adjustment. Specifically, the candidate sampling areas are superimposed on the captured image and displayed on the display 13. The arithmetic circuit 11 also accepts changes to the candidate sampling areas displayed on the display 13. For example, the user can input an operation to change the candidate sampling areas via the input device 12. This allows the user to set an optimal sampling area based on the presented candidate sampling areas, while being able to confirm the sampling area in the captured image.

[0032] FIG. 2 shows an example of an application screen 500 displayed on the display 13. The application screen 500 shown in FIG. 2 is displayed on the display 13 by executing an adjustment program P, which is application software stored in the storage device 15. For example, the application screen 500 includes a display unit 501 that displays an image captured by the image capture device 30. In the example shown in FIG. 1A, the adjustment system 1 includes one image capture device 30. However, the adjustment system 1 may include multiple image capture devices. In such a case, the user can select the image capture device to use from the multiple image capture devices. FIG. 2 shows an example in which the image capture device with identification information "Camera1" is selected.

[0033] The display unit 501 in FIG. 2 shows an example of displaying a captured image in which two display devices 20A and 20B project images (an image displaying "1" and an image displaying "2") aligned horizontally on a screen. However, the method of projecting images in the display system 2 is not limited. For example, three display devices may be used to project images aligned horizontally. Alternatively, two of the four display devices may be used to project images aligned horizontally on the lower row, and two other display devices may be used to project images aligned horizontally on the upper row. Even in such a case, the display unit 501 displays a captured image including the projected images from all of the display devices.

[0034] Although not illustrated, the display unit 501 may display a captured image including a portion of the projected images from multiple display devices. For example, when a large number of display devices are used, it is not possible to include the projected images from all of the display devices in the display unit 501. Therefore, when a single captured image cannot include the entire projected image, the adjustment system 1 may have multiple image capturing devices. Furthermore, each of the multiple image capturing devices may capture a projected image of a designated display device. When multiple image capturing devices are included, the display unit 501 can display the projected image captured by the selected image capturing device.

[0035] The captured image displayed on the display unit 501 in FIG. 2 includes two images projected by the two display devices 20A and 20B, respectively. However, the arithmetic circuit 11 cannot determine which display device 20A or 20B is projecting which image. Therefore, the user inputs an operation signal via the input device 12 to associate the images displayed by each display device 20A or 20B with a corresponding display range in the captured image. The arithmetic circuit 11 then associates the display range with the display device in accordance with the received operation signal and stores information about the association in the storage device 15. In the example shown in FIGS. 1A and 2 , the user associates the first display device 20A with range "1" and the second display device 20B with range "2."

[0036] The display unit 501 also presents candidate sampling areas to be used for adjustment. FIG. 2 illustrates an example in which an application screen 500 presents wide ranges adjacent to the boundaries between the display ranges of the first display device 20A and the second display device 20B as candidate sampling areas 502a and 502b. The application screen 500 also includes display units 503a and 503b that display numerical values ​​indicating the position and size of each candidate sampling area 502a and 502b. In the application screen 500 illustrated in FIG. 2, the coordinates of the upper right point of the candidate sampling area 502a for the first display device 20A are (340, 1580), and the size is 1770 × 1630. In the application screen 500 illustrated in FIG. 2, the coordinates of the upper right point of the candidate sampling area 502b for the second display device 20B are (2350, 1600), and the size is 1550 × 1220. For example, the user can change the size of the sampling area candidate 502a by dragging and adjusting the sampling area candidate 502a via the input device 12. The user can change the size of the sampling area candidate 502b by dragging and adjusting the sampling area candidate 502b via the input device 12. Alternatively, the user can change the size of the sampling area candidate 502a by changing the numerical value displayed in the display unit 503a via the input device 12. The user can change the size of the sampling area candidate 502b by changing the numerical value displayed in the display unit 503b via the input device 12.

[0037] More specifically, the arithmetic circuitry 11 may set the inside of the frames of the sampling area candidates 502a and 502b as the areas to be sampled. Therefore, the arithmetic circuitry 11 performs sampling using the images within the frames of the sampling area candidates 502a and 502b displayed on the application screen 500. For example, the arithmetic circuitry 11 may present the outer frames of the images displayed on each of the display devices 20A and 20B to the user as the sampling area candidates 502a and 502b.

[0038] The application screen 500 also includes an operation unit 504 for returning to the previous screen and an operation unit 505 for proceeding to the next screen. To determine the candidate sampling areas 502a and 502b, the user operates the input device 12, for example, to press the operation unit 505 for proceeding to the next screen. This causes the arithmetic circuit 11 to perform sampling in the determined sampling area and execute adjustment processing. Note that the arithmetic circuit 11 averages and compares pixel values ​​in each of the determined multiple sampling areas. Therefore, the sizes of the sampling areas do not need to be the same.

[0039] 3A to 3D each show an example of sampling area candidates presented when performing color correction. FIGS. 3A and 3B show examples of sampling area candidates 502a and 502b when images are displayed horizontally by two display devices 20A and 20B. FIG. 3A shows an example in which rectangular areas covering almost the entire area where images displayed on different display devices are adjacent are presented to the user as sampling area candidates. Therefore, in the example shown in FIG. 3A, the arithmetic circuit 11 presents areas as large as the display ranges of the respective display devices as sampling area candidates 502a and 502b, as in the example shown in FIG. 2. FIG. 3B shows an example in which rectangular areas adjacent to the display range of each display device 20A and 20B are presented as sampling area candidates 502a and 502b, respectively. For example, when images projected onto a screen from each display device 20A and 20B are captured by the image capture device 30, shadows may be cast on some areas. Furthermore, the images may not be displayed uniformly across the entire screen, resulting in unevenness. In these cases, if there are areas with shadows or unevenness, it is better to adjust the image by excluding the shadowed or uneven areas rather than correcting the entire image. Furthermore, such shadows and unevenness are more likely to occur at the edges of the image than at the center. Furthermore, when viewed by the human eye, adjusting the alignment of the joints between projected images is more likely to make the entire combined image appear adjusted than adjusting the entire image. Therefore, as shown in FIG. 3B , the adjustment device 10 may preliminarily designate portions near the joints and adjacent to the display range of the other display device as sampling area candidates 502a and 502b.

[0040] Figure 3C shows an example of sampling area candidates 502a-502c when video is displayed in a horizontal row by three display devices. In the example shown in Figure 3C, similar to Figure 3B, each of the sampling area candidates 502a-502c is set in a position adjacent to the other display ranges in each display range. Figure 3D shows an example of sampling area candidates 502a-1-502d-1 when video is displayed in two horizontal rows, one above the other, by four display devices. In the example shown in Figure 3D, each of the sampling area candidates 502a-1-502d-1 is also set in a position adjacent to the other display ranges in each display range.

[0041] 4A to 4D each show an example of sampling area candidates used when performing black correction. FIGS. 4A to 4B show an example in which multiple display devices display images such that adjacent display ranges partially overlap. FIGS. 4A and 4B show example sampling area candidates 502a, 502ab, and 502b when images are displayed horizontally in a row by two display devices 20A and 20B. FIG. 4A shows an example in which large non-overlapping areas of each display range and overlapping areas are presented as three different sampling area candidates 502a, 502ab, and 502b. FIG. 4B also shows an example in which partial areas of the display ranges of each display device 20A and 20B that are adjacent to the display range of the other display device and overlapping areas are presented as different sampling area candidates 502a, 502ab, and 502b. When performing black correction in such an overlapping case, the surrounding brightness is adjusted according to the number of overlaps. For example, each of the sampling area candidates 502a and 502b may be adjusted to be brighter than the portion of the sampling area candidate 502ab. The brightness of the sampling area candidates 502a and 502b is adjusted to be approximately the same as the combined brightness of the portion of the sampling area candidate 502ab displayed by the display device 20A and the portion of the sampling area candidate 502ab displayed by the display device 20B.

[0042] Figure 4C shows an example of sampling area candidates 502a-502c when an image is displayed horizontally by three display devices. The example shown in Figure 4C includes four sampling area candidates 502a, 502b-1, 502b-2, and 502c that are set in portions adjacent to other display ranges, and two sampling area candidates 502ab and 502bc that are set in overlapping portions. Figure 4D also shows an example of sampling area candidates when four display devices display images with portions overlapping in two horizontal display ranges, each in two upper and lower rows. The example shown in Figure 4D includes four non-overlapping sampling area candidates 502a, 502b, 502c, and 502d, four sampling area candidates with two overlaps (502ab, 502ad, 502bd, and 502cd), and one sampling area candidate with four overlaps (502abcd). For example, the sampling area candidates 502a, 502b, 502c, and 502d may be adjusted to be brighter than the sampling area candidates 502ab, 502ad, 502bd, and 502cd. For example, the brightness obtained by adding together the portions of the sampling area candidate 502abcd displayed by each display device 20 may be adjusted to be approximately the same as the brightness obtained by adding together the portions of the sampling area candidate 502ab displayed by each display device 20. Similarly, the brightness obtained by adding together the portions of the sampling area candidate 502abcd displayed by each display device 20 may be adjusted to be approximately the same as the brightness obtained by adding together the portions of the sampling area candidate 502ac, the portion of the sampling area candidate 502bd, the portion of the sampling area candidate 502cd, and the brightness of each of the sampling area candidates 502a, 502b, 502c, and 502d displayed by each display device 20.

[0043] In the above description, Figures 3A to 3D were used to illustrate candidate sampling areas for use in color correction, taking as an example a case where the display areas do not overlap. On the other hand, when adjacent display areas are projected so that they partially overlap, for example, only the area excluding the overlapping portion can be used as the sampling area. In this case, the overlapping portion of the multiple display areas may be projected using edge blending of the images projected from each display device. Here, "edge blending" refers to a technique used to combine images projected from multiple display devices. For example, when projecting images from multiple display devices, the images are projected so that the projection areas of adjacent display devices partially overlap. Furthermore, the brightness of the images in the overlapping area is gradually cross-faded to make the seam less noticeable. This technique of making the seam less noticeable is called "edge blending." Furthermore, when there is overlap as shown in Figure 4B, only the adjacent non-overlapping areas may be used as candidate sampling areas 502a and 502b, and the area 502a and 502b may not be sampled, and the sampling results of the candidate areas 502a and 502b may be used.

[0044] 4A to 4D, the above description shows candidate sampling areas to be used for black correction, taking as an example a case where the display ranges of the displays partially overlap. In contrast, when the display devices do not overlap, for example, the correction parameters of the other display devices may be adjusted to match the color and brightness of the image projected from the brightest display device, and then the image may be projected.

[0045] Furthermore, the arithmetic circuit 11 may set as candidate sampling areas areas other than areas that meet specific conditions. For example, areas where there is a large change in brightness may be areas where some kind of shadow is cast. Therefore, the arithmetic circuit 11 may set as candidate sampling areas areas other than areas where a specific change in brightness occurs.

[0046] The arithmetic circuit 11 calculates correction parameters for adjusting values ​​indicating sampling areas in the captured image so that they are represented by a specified reference value. For example, the arithmetic circuit 11 may accept selection of one display device from multiple display devices 20A and 20B. The arithmetic circuit 11 may also specify the sampling result of the sampling area of ​​the selected display device as the reference value. Furthermore, the arithmetic circuit 11 calculates correction parameters so that the display of the non-selected display devices is adjusted to the specified reference value.

[0047] The image of the sampling area used to generate the correction parameters does not have to be the captured image used to determine the sampling area. For example, the arithmetic circuit 11 can determine the correction parameters using an image captured after the sampling area is set.

[0048] When performing color correction, the arithmetic circuit 11 causes each of the display devices 20A and 20B to display light of each of the colors red (R), green (G), and blue (B) as an adjustment image. Furthermore, when performing color correction, the arithmetic circuit 11 may also cause light of each of the colors cyan (C), magenta (M), yellow (Y), and white (W) to be displayed as an adjustment image. Furthermore, the arithmetic circuit 11 uses the captured image for each color to determine a correction parameter for each color.

[0049] When performing black correction, the arithmetic circuit 11 causes each of the display devices 20A and 20B to display black as an adjustment image. The arithmetic circuit 11 also obtains correction parameters from the captured image using the sampling area with the brightest gradation as a reference value.

[0050] The arithmetic circuit 11 transmits the calculated correction parameters to the target display devices 20A, 20B, and adjusts the parameters of each of the display devices 20A, 20B.

[0051] In this way, in the adjustment system 1, when combining and displaying images respectively displayed on multiple display devices 20A, 20B, the workload of specifying sampling areas to be used for adjusting the multiple display devices 20A, 20B can be reduced, and sampling areas can be specified that improve the adjustment accuracy.

[0052] <Processing in Adjustment Device> The adjustment process executed by the arithmetic circuit 11 will be described using the flowcharts shown in Fig. 5 and Fig. 6. The description shown in Fig. 5 describes the process related to various settings before moving on to the actual adjustment process. The arithmetic circuit 11 executes the adjustment program P to display a predetermined application screen on the display 13, and the adjustment process begins. The flowchart in Fig. 5 mainly shows the process in response to user operations via the application screen. Furthermore, the description shown in Fig. 6 describes the process executed by the arithmetic circuit 11 in the actual adjustment process.

[0053] The arithmetic circuit 11 receives a selection of the image capturing device 30 to be used in the adjustment (S001). Specifically, the arithmetic circuit 11 receives the selection of the image capturing device 30 to be used in the adjustment on the application screen 500 displayed on the display 13 via the input device 12 operated by the user.

[0054] The arithmetic circuit 11 receives the layout settings for the display devices 20A and 20B (S002). Specifically, the arithmetic circuit 11 receives the settings for how many display devices to use and how the multiple display devices are to be arranged to display images. In this case, too, the arithmetic circuit 11 receives the settings via the input device 12 operated by the user on the application screen 500 displayed on the display 13.

[0055] The arithmetic circuit 11 accepts a selection of the display devices 20A, 20B to be used (S003). Specifically, the arithmetic circuit 11 accepts a selection of the number of display devices set in step S002 as display devices to be used in the display system 2 via the input device 12 operated by the user on the application screen 500 displayed on the display 13. Here, the display devices 20A, 20B to be used in the display system 2 are to be adjusted by the adjustment system 1.

[0056] The arithmetic circuit 11 associates the display devices 20A and 20B selected in step S003 with each of the display ranges of the layout set in step S002 (S004). In this case, too, the arithmetic circuit 11 receives an operation signal for associating the display devices that project images onto each display range via the input device 12 operated by the user on the application screen 500 displayed on the display 13.

[0057] The arithmetic circuit 11 sets the exposure of the image capturing device 30 (S005). Specifically, the arithmetic circuit 11 operates the exposure setting via the input device 12 operated by the user on the application screen 500 displayed on the display 13. For example, the arithmetic circuit 11 causes the display devices 20A and 20B to output a test image or light. The arithmetic circuit 11 also causes the image capturing device 30 to capture an image and adjust the exposure.

[0058] The arithmetic circuit 11 accepts the adjustment conditions (S007). Here, too, the arithmetic circuit 11 accepts the adjustment conditions via the input device 12 operated by the user on the application screen 500 displayed on the display 13. For example, the adjustment conditions can accept a reference display device among the multiple display devices 20A and 20B. For example, if the arithmetic circuit 11 accepts that the first display device 20A is to be used as the reference, the arithmetic circuit 11 generates adjustment parameters in subsequent processing to match the display image of the second display device 20B to the display image of the first display device 20A. Also, for example, if the arithmetic circuit 11 accepts that a display device that displays a dark display image is to be used as the reference, the arithmetic circuit 11 generates adjustment parameters in subsequent processing to match a display device that displays a bright display image to a display device that displays a dark display image. For example, in accepting the adjustment conditions, the arithmetic circuit 11 may project a specific image onto each of the display devices 20A and 20B, display the captured image on the application screen 500, and allow the user to select the adjustment conditions.

[0059] The arithmetic circuit 11 sequentially outputs images (light) to each of the display devices 20A and 20B, and detects the display range in which the image is displayed by each of the display devices 20A and 20B (S008). The following method can be considered as a method for detecting the display range of each of the display devices 20A and 20B. For example, the arithmetic circuit 11 first causes both the first display device 20A and the second display device 20B to display a black image (255), and acquires an image captured by the image capture device 30 (captured image Ia). Next, the arithmetic circuit 11 causes the first display device 20A to display a white image (0), and the second display device 20B to display a black image (255), and acquires an image captured by the image capture device 30 (captured image Ib). Next, the arithmetic circuit 11 causes the first display device 20A to display a black image (255), and the second display device 20B to display a white image (0), and acquires an image captured by the image capture device 30 (captured image Ic). The arithmetic circuit 11 then subtracts the signal value of each pixel in the captured image Ib from the signal value of each pixel in the captured image Ia to determine the display range of the first display device 20A. Similarly, the arithmetic circuit 11 subtracts the signal value of each pixel in the captured image Ic from the signal value of each pixel in the captured image Ia to determine the display range of the second display device 20B. The display devices 20A and 20B display signals with values ​​of 0 or 255. However, the values ​​of each pixel in the captured images do not necessarily equal 0 or 255, depending on the characteristics of the display devices 20A and 20B, the environmental influences, and so on. For example, if the signal value of the display image is 0, the value will be relatively close to 0, and if the signal value of the display image is 255, the value will be relatively close to 255.

[0060] The arithmetic circuit 11 determines and presents sampling area candidates using a predetermined method based on the display ranges of each display device 20A, 20B detected in step S008 (S009). For example, if it is determined that the entire display range is to be the sampling area, the arithmetic circuit 11 presents sampling area candidates 502a, 502b superimposed on the display range on the display unit 501 of the application screen 500, as shown in Fig. 3A. Alternatively, if it is determined that adjacent portions of the display range are to be the sampling area, the arithmetic circuit 11 presents sampling area candidates 502a, 502b superimposed on the display range on the display unit 501 of the application screen 500, as shown in Fig. 3B.

[0061] The arithmetic circuit 11 sets sampling areas based on the sampling area candidates presented in step S009 (S010). For example, the arithmetic circuit 11 accepts an operation to adjust or confirm the sampling area candidates 502 a, 502 b on the application screen 500 displayed on the display 13 via the input device 12 operated by the user, and accepts the setting of the sampling area.

[0062] Next, the arithmetic circuit 11 proceeds to the processing of the flowchart shown in FIG. 6, and moves to the actual adjustment processing using the sampling area of ​​the sampling accepted in step S009.

[0063] First, the arithmetic circuit 11 transmits a setting signal for the photographing conditions to the photographing device 30 via the communication circuit 14 (S101). The photographing conditions specified by the setting signal transmitted by the arithmetic circuit 11 are optimally set by an application program, for example. Alternatively, the photographing conditions may be conditions set by the user. Specifically, the photographing conditions may include conditions such as shutter speed, aperture, and gain.

[0064] The arithmetic circuit 11 receives a response indicating the completion of the setting from the photographing device 30 via the communication circuit 14 in response to the setting signal transmitted in step S101 (S102).

[0065] The arithmetic circuit 11 selects the adjustment item (S103). In the case of color correction, the adjustment items may be red (R), green (G), and blue (B). In the case of color correction, the adjustment items may be cyan (C), magenta (M), yellow (Y), and white (W). In the case of black correction, the adjustment item may be black. For example, the items to be adjusted and the order of adjustment may be determined in advance, and the arithmetic circuit 11 may select the items to be adjusted in the determined order.

[0066] The arithmetic circuit 11 transmits a setting signal for the projection conditions determined for each display device 20A, 20B via the communication circuit 14 to each display device 20A, 20B (S104). The projection conditions determined by the setting signal transmitted by the arithmetic circuit 11 are, for example, preset conditions for the first time. When the process is repeated, the projection conditions are changed according to the sampling results in step S108, which will be described later. The projection condition setting signal also includes a projection request.

[0067] The arithmetic circuit 11 receives, via the communication circuit 14, responses from each of the display devices 20A and 20B in response to the setting signal transmitted in step S104, indicating completion of the setting and execution of projection (S105).

[0068] When the arithmetic circuit 11 receives the projection response in step S104, it transmits a shooting operation signal to the image capturing device 30 via the communication circuit 14 (S106).

[0069] The arithmetic circuit 11 then receives, via the communication circuit 14, from the photographing device 30, the photographed image photographed in accordance with the photographing operation signal transmitted in step S106 (S107).

[0070] The arithmetic circuit 11 samples the signal of the sampling area set in step S009 from the photographed image received in step S107 (S108).

[0071] The arithmetic circuit 11 determines whether the signal sampled in step S108 is within the condition range (S109). For example, the arithmetic circuit 11 may calculate the average signal value of each pixel in the sampled area, compare the calculated average with a predetermined threshold, and determine that the signal falls within the condition range if the calculated average is below the threshold (or above the threshold). Alternatively, the arithmetic circuit 11 may compare the signal of each pixel in the sampled area with a predetermined threshold, and determine that the signal falls within the condition range if a predetermined percentage or more of the pixels are below the threshold (or above the threshold).

[0072] If the projection conditions are not within the range (NO in S109), the arithmetic circuit 11 adjusts the projection conditions (S110), returns to step S104, and repeats the processing of steps S104 to S109.

[0073] On the other hand, if the result is within the range of the condition (YES in S109), the arithmetic circuit 11 determines whether adjustment has been completed for all items (S111). Specifically, the arithmetic circuit 11 determines whether adjustment has been completed for all adjustment items: red (R), green (G), blue (B), cyan (C), magenta (M), yellow (Y), white (W), and black. Note that the specific processing may differ depending on the color.

[0074] If the adjustment is not completed (NO in S111), the process returns to step S103, a new unadjusted item is selected, and the processes of steps S103 to S111 are repeated.

[0075] <Processing in the Imaging Device> The processing executed in the imaging device 30 in response to a signal received from the adjustment device 10 will be described with reference to the flowchart shown in FIG.

[0076] The arithmetic circuit 31 receives a setting signal for the photographing conditions transmitted from the adjustment device 10 via the communication circuit 34 (S201).

[0077] The arithmetic circuit 31 sets the photographing conditions using the setting signal received in step S201 (S202), and transmits a response indicating completion of the setting of the photographing signal to the adjustment device 10 via the communication circuit 34 (S203).

[0078] Thereafter, at the timing of photographing, the arithmetic circuit 11 receives the photographing operation signal transmitted from the adjustment device 10 via the communication circuit 34 (S204).

[0079] In response to the shooting operation signal received in step S204, the arithmetic circuit 31 captures an image (S205). The captured image includes the image projected onto the screen from the display devices 20A and 20B. The arithmetic circuit 31 also transmits the captured image captured in step S205 to the adjustment device 10 via the communication circuit 34 (S206).

[0080] The arithmetic circuit 31 returns to step S204 and repeats the processes of S204 to S207 until the series of processes for adjustment in the adjustment system 1 is completed (YES in S207).

[0081] <Processing in Display Device> Using the flowchart shown in FIG. 8, processing executed in the first display device 20A in response to a signal received from the adjustment device 10 will be described.

[0082] The arithmetic circuit 21 receives a setting signal for the projection conditions transmitted from the adjustment device 10 via the communication circuit 24 (S301).

[0083] The arithmetic circuit 21 sets the projection conditions using the setting signal received in step S301 (S302). The arithmetic circuit 21 also projects an image under the conditions set in step S302 (S303). Then, the arithmetic circuit 21 transmits a response indicating execution of projection to the adjustment device 10 (S304).

[0084] The arithmetic circuit 21 returns to step S301 and repeats the processes of S301 to S305 under the new projection conditions until the adjustment of the first display device 20A is completed (YES in S305).

[0085] The second display device 20B also executes the same processing as described above, and therefore a description using a flowchart will be omitted.

[0086] The adjustment system 1 of the present disclosure reduces the workload of specifying an area for adjusting the color and brightness of an image, and also makes it possible to specify an area that improves the adjustment accuracy.

[0087] Overview of the Embodiments (1) A designation method of the present disclosure is a designation method for designating a sampling area to be used for adjusting the display of an image by a plurality of display devices when the plurality of display devices are combined to display one image content in an adjustment device connected to a plurality of display devices and an image capture device, wherein the adjustment device includes an arithmetic circuit and is capable of accessing a storage device and a display, and the arithmetic circuit causes the plurality of display devices to display an adjustment image that is pre-stored in the storage device, obtains, from the image capture device, a captured image obtained by capturing the adjustment image displayed by the plurality of display devices, displays the obtained captured image on the display, presents candidate sampling areas to a user by superimposing the captured image displayed on the display, and may accept designation of a sampling area determined based on the candidate sampling areas in response to an operation from the user via an input device.

[0088] This reduces the workload of specifying sampling areas, and allows the specification of sampling areas that improves adjustment accuracy.

[0089] (2) In the designation method of (1), the arithmetic circuit may present the outer frames of images displayed on different display devices to the user as candidates for the sampling area.

[0090] This allows the entire range of the image displayed on each display device to be presented as a candidate sampling area.

[0091] (3) In the designation method of (1), the arithmetic circuit may present to the user, as a candidate for the sampling area, a part of the image displayed on each display device, where the image is adjacent to another image.

[0092] This allows a portion of the image displayed on each display device to be presented as a candidate for the sampling area.

[0093] (4) In the designation methods (1) to (3), changes may be accepted for the presented sampling area candidates.

[0094] This allows the user to easily specify an appropriate sampling area by using the presented sampling area candidates.

[0095] (5) The adjustment device of the present disclosure is connected to a plurality of display devices and an imaging device, and adjusts images displayed by the plurality of display devices when the plurality of display devices are combined to display a single video content, and includes an arithmetic circuit and is capable of accessing a storage device and a display, wherein the arithmetic circuit: causes the plurality of display devices to display an adjustment image previously stored in the storage device; acquires, from the imaging device, a captured image obtained by capturing the adjustment image displayed by the plurality of display devices; displays the acquired captured image on the display; presents to the user candidate sampling areas to be used for adjusting the image by superimposing the captured image displayed on the display; accepts, via an input device, a designation of a sampling area determined by the user based on the candidate sampling areas; and may use the accepted image of the sampling area to determine correction parameters for adjusting the display.

[0096] This reduces the workload of specifying sampling areas, and allows the specification of sampling areas that improves adjustment accuracy.

[0097] (6) In the adjustment device of (5), the arithmetic circuit may receive a selection of one display device from the plurality of display devices, and determine correction parameters for adjusting the non-selected display devices in accordance with the selected display device.

[0098] This allows the images displayed by the other display devices to be matched with the image displayed by the selected display device.

[0099] (7) The computer program disclosed herein is a computer program that, in an adjustment device connected to multiple display devices and an imaging device, specifies a sampling area to be used to adjust the display of video on the multiple display devices when the multiple display devices are combined to display one video content, and causes an information processing device to execute a specification method described in any of (1) to (5).

[0100] This reduces the workload of specifying sampling areas, and allows the specification of sampling areas that improves adjustment accuracy.

[0101] The designation method, adjustment device and computer program according to all claims of the present disclosure are realized by hardware resources, such as a processor, a memory and cooperation with a computer program.

[0102] The specification method, adjustment device, and computer program of the present disclosure are useful for adjusting a display system that combines images displayed by multiple display devices into a single image.

Claims

1. A method for specifying a sampling area to be used for adjusting the display of an image by a plurality of display devices when the plurality of display devices are combined to display a single image content in an adjustment device connected to a plurality of display devices and an imaging device, the adjustment device having an arithmetic circuit and capable of accessing a storage device and a display, the arithmetic circuit: causes the plurality of display devices to display an adjustment image previously stored in the storage device; acquires from the imaging device a captured image obtained by capturing the adjustment image displayed by the plurality of display devices; displays the acquired captured image on the display; presents candidates for the sampling area to a user by superimposing the captured image displayed on the display; and accepts designation of a sampling area determined based on the candidates for sampling area in response to an operation from the user via an input device.

2. The method according to claim 1, wherein the arithmetic circuit presents to the user the outer frames of images displayed on different display devices as candidates for the sampling area.

3. The method of claim 1, wherein the arithmetic circuit presents to the user a portion of the image displayed on each display device where the images are adjacent to each other as a candidate for the sampling area.

4. The method according to claim 1, wherein the arithmetic circuit accepts changes to the presented sampling area candidates.

5. An adjustment device connected to a plurality of display devices and a photographing device, for adjusting images displayed by the plurality of display devices when the plurality of display devices are combined to display one video content, comprising an arithmetic circuit and capable of accessing a storage device and a display, wherein the arithmetic circuit: causes the plurality of display devices to display an adjustment image previously stored in the storage device; obtains from the photographing device a photographed image obtained by photographing the adjustment image displayed by the plurality of display devices; displays the obtained photographed image on the display; presents to a user candidate sampling areas to be used for adjusting the image by superimposing the photographed image displayed on the display; accepts via an input device a designation of a sampling area determined by the user based on the candidate sampling areas; and uses the image of the sampling area received to determine correction parameters for adjusting the display.

6. The adjustment device according to claim 5, wherein the arithmetic circuit receives a selection of one display device from among the plurality of display devices, and determines correction parameters for adjusting a non-selected display device in accordance with the selected display device.

7. A computer program for specifying a sampling area to be used for adjusting the image display by a plurality of display devices when the plurality of display devices are combined to display one image content in an adjustment device connected to a plurality of display devices and an image capture device, the computer program causing an information processing device to execute the method according to claim 1.