Designating method, adjusting device, and computer program

Abstract

A designation method makes adjustment of a display system that combines images displayed by a plurality of display devices into one image easy. The designation method uses a sampling region in adjustment of display of images by a plurality of display devices when the plurality of display devices display one image content in an adjustment device. The adjustment device has an arithmetic circuit, and can access a storage device and a display. The adjustment device causes the plurality of display devices to display an adjustment image that is stored in the storage device in advance by the arithmetic circuit, acquires a captured image obtained by capturing the adjustment image displayed by the plurality of display devices from a capturing device, causes the display to display the acquired captured image, presents a candidate of the sampling region to a user superimposed on the captured image displayed in the display, and accepts designation of the sampling region determined based on the candidate of the sampling region according to an operation from the user via an input device.

Description

Technical Field

[0001] This disclosure relates to a method, adjustment device, and computer program for specifying a sampling area used in adjusting a display implemented by multiple display devices in a display system that combines multiple display devices to display one image content. Background Technology

[0002] There are methods that generate adjustment data using the captured image of the projected image when the image is projected from the projection device (e.g., Patent Documents 1 to 3).

[0003] However, while display systems exist that combine multiple display devices to display a single image, these systems require adjustments to address seams caused by individual differences in color and brightness among the images displayed on each device. Therefore, generating the adjustment data becomes complex in such systems. First, an adjustment device within the display system, which adjusts the display implemented by the display devices, samples the images displayed by each device. Then, the adjustment device compares the images in the sampled areas and adjusts the parameters of each display device to ensure that each sampled area displays an image with the same level of color and brightness.

[0004] Prior art literature

[0005] Patent documents

[0006] Patent Document 1: Japanese Patent Application Publication No. 2017-50667

[0007] Patent Document 2: Japanese Patent Application Publication No. 11-113019

[0008] Patent Document 3: Japanese Patent Application Publication No. 2017-203877 Summary of the Invention

[0009] -The problem the invention aims to solve-

[0010] However, when using captured images to adjust the display device, the sampling area used in the adjustment is important, but specifying such a sampling area will increase the user's workload.

[0011] This disclosure provides a method, adjustment device, and computer program for specifying a sampling area to reduce the workload of specifying a sampling area for adjusting the color and brightness of an image.

[0012] -Methods used to solve problems-

[0013] The specified method of this disclosure is a method for specifying a sampling area used in adjusting the display of an image implemented by multiple display devices when multiple display devices are combined to display one image content in an adjustment device. The adjustment device used in the specified method includes an arithmetic circuit and can access a storage device and a display. The adjustment device, through the arithmetic circuit, causes multiple display devices to display adjustment images pre-stored in the storage device, and acquires a captured image obtained by capturing the adjustment images displayed by the multiple display devices from an imaging device. The adjustment device, through the arithmetic circuit, causes the display to display the acquired captured image, and prompts the user with a candidate sampling area superimposed on the captured image displayed on the display. The adjustment circuit, through the arithmetic circuit, accepts the specification of the sampling area determined based on the candidate sampling area according to the user's operation via the input device.

[0014] Such general and specific approaches can also be achieved through systems, methods, computer programs, and combinations thereof.

[0015] -Invention Effects-

[0016] The specified method, adjustment device, and computer program of this disclosure can reduce the workload of specifying the sampling area used in the adjustment of multiple display devices in a display system having multiple display devices and combining multiple display devices to display one image content. Attached Figure Description

[0017] Figure 1A This is a block diagram illustrating the structure of the adjustment system and adjustment device involved in this disclosure.

[0018] Figure 1B It is shown in Figure 1A A block diagram of the structure of the display device adjusted in the adjustment system.

[0019] Figure 1C It is shown in Figure 1A A block diagram of the structure of the shooting device used in the adjustment system.

[0020] Figure 2 An example of an adjustment screen used in the adjustment system disclosed herein is shown.

[0021] Figure 3A The first example of a candidate sampling area for color correction is shown in the adjustment device of this disclosure.

[0022] Figure 3B The second example of a candidate sampling area for color correction in the adjustment device of this disclosure is shown.

[0023] Figure 3C The third example of a candidate sampling area for color correction is shown in the adjustment device of this disclosure.

[0024] Figure 3D The fourth example of a candidate sampling area for color correction is shown in the adjustment device of this disclosure.

[0025] Figure 4A The first example of a candidate sampling area for brightness correction in the adjustment device of this disclosure is shown.

[0026] Figure 4B The second example of a candidate sampling area for brightness correction in the adjustment device of this disclosure is shown.

[0027] Figure 4C The third example of a candidate sampling area for brightness correction in the adjustment device of this disclosure is shown.

[0028] Figure 4D The fourth example of a candidate sampling area for brightness correction in the adjustment device of this disclosure is shown.

[0029] Figure 5 A flowchart illustrating an example of the processing in the adjustment apparatus of this disclosure is shown.

[0030] Figure 6 Show Figure 5 The flowchart is a detailed process for adjusting the flowchart.

[0031] Figure 7 A flowchart illustrating an example of processing in a shooting device connected to an adjustment device is shown.

[0032] Figure 8 A flowchart illustrating an example of processing in a display device adjusted by an adjustment device is shown. Detailed Implementation

[0033] [Implementation Method]

[0034] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, in the detailed description, some unnecessary parts relating to prior art and substantially the same structures will sometimes be omitted. This is to simplify the description. In addition, the following description and the accompanying drawings are disclosed to enable those skilled in the art to fully understand the present disclosure and are not intended to limit the subject matter of the claims.

[0035] The specified method, adjustment apparatus, and computer program disclosed herein are used to adjust a display system that combines multiple images displayed by multiple display devices to display a single image. Specifically, the specified method, adjustment apparatus, and computer program disclosed herein specify sampling areas used to adjust the display balance caused by individual differences in hue and brightness among the multiple display devices. For example, using the specified method, adjustment apparatus, and computer program disclosed herein, sampling areas used in color correction and black level correction can be specified.

[0036] In this disclosure, "color correction" refers to the correction that balances and matches the tones displayed by multiple display devices included in a display system. Furthermore, color correction is sometimes also referred to as hue correction. Additionally, brightness is sometimes adjusted along with hue during color correction. Therefore, color correction is sometimes also referred to as color brightness correction. In a display system, even when the same color (e.g., red) is displayed on each display device without adjustment, different colors may sometimes appear to be displayed. Therefore, in a display system, when displaying from different display devices, internal parameters are pre-adjusted to ensure that the same color appears to be the same. Specifically, the parameters are adjusted so that the sampling area of ​​the image displayed from each display device meets given conditions. Furthermore, when color correction is performed on multiple display devices, each display device is adjusted so that the color displayed from each display device is displayed as a specified color.

[0037] Additionally, "black correction" is a correction that balances and matches the blacks displayed by multiple display devices included in a display system. Black correction adjusts the brightness and hue of blacks across multiple display devices. Furthermore, black correction is sometimes also referred to as brightness correction. In a display system, even when displaying the same black or dark color on each display device without adjustment, the blacks may sometimes appear to be displayed with different brightness levels. Therefore, in a display system, when displaying from different display devices, internal parameters are pre-adjusted to ensure that the same color appears to have the same brightness. Specifically, parameters are adjusted so that the sampling areas of the images displayed on each display device are within given conditions. Furthermore, when performing black correction on multiple display devices, adjustments are made to match the brightness of other display devices with the brightest display device among the multiple display devices. This is because it is impossible to match a bright display device with a darker display device beyond the performance limits of the display devices.

[0038] Furthermore, the "sampling area" is the region within the overall projection area of ​​an image used for adjustments such as color correction and black level correction. When adjusting the color correction, black level correction, etc., of multiple display devices included in a display apparatus, the images displayed by each display device are compared. At this time, adjustments can be made by comparing the entire projection area of ​​the image, or by comparing a portion of the projection area of ​​the image. The area that will be compared is defined as the sampling area.

[0039] <System Adjustment>

[0040] like Figure 1A As shown, the adjustment system 1 according to the embodiment includes: an adjustment device 10, multiple display devices 20A and 20B, a shooting device 30, and a network 40. The first display device 20A and the second display device 20B constitute the display system 2. Each display device 20A and 20B is controlled by a control device (not shown) to display different images, and the whole system can generate a single image content. In such a display system 2, the adjustment system 1 can balance and match the hue, brightness, etc. of the single image content generated by the multiple display devices by adjusting the parameters associated with the display of each display device 20A and 20B.

[0041] exist Figure 1A In the example shown, display system 2 includes two display devices 20A and 20B, but the number of display devices included in display system 2 is not limited. Therefore, the number of display devices adjusted in adjustment system 1 is also not limited. Furthermore, in the following description, each display device 20A and 20B is an example of a projection device that projects images onto a screen (not shown). However, the type of display devices 20A and 20B is not limited. Multiple display devices 20A and 20B can also be multiple monitors arranged adjacent to each other. Although the illustrations are omitted, display system 2 can include an information processing device connected to multiple display devices 20A and 20B. In display system 2, for example, each display device 20A and 20B displays one image content by projecting an image sent from the information processing device.

[0042] <Adjustment device>

[0043] like Figure 1A As shown, the adjustment device 10 is an information processing device including an arithmetic circuit 11, an input device 12, an output device 13, a communication circuit 14, and a storage device 15. The adjustment device 10 can acquire images captured by the imaging device 30 and displayed on multiple display devices 20A and 20B, and adjust the parameters associated with the display of each display device 20A and 20B using the acquired images.

[0044] The arithmetic circuit 11 is a controller responsible for the overall control of the adjustment device 10. For example, the arithmetic circuit 11 reads and executes the adjustment program P stored in the storage device 15 to perform various processes related to the adjustment of parameters associated with the display of each display device 20A, 20B. The arithmetic circuit 11 can also be various processors such as CPU, MPU, GPU, FPGA, DSP, ASIC, or designed as a dedicated hardware circuit.

[0045] Input device 12 is used for inputting operations and data performed by the user. Input device 12 may be, for example, an operation button, keyboard, mouse, touch panel, microphone, etc. Output device 13 is used for outputting processing results and data. Output device 13 may be, for example, a display, speaker, or other output unit.

[0046] The communication circuit 14 performs data communication with the display devices 20A and 20B and the imaging device 30. Data communication is conducted via wired and / or wireless means, following known communication standards. For example, wired data communication can be performed by using a communication controller of a semiconductor integrated circuit operating according to local area network (LAN) standards and / or USB (USB) standards, etc., as the communication circuit 14. Alternatively, wireless data communication can be performed by using a communication controller of a semiconductor integrated circuit operating according to the IEEE 802.11 standard related to wireless LAN (Local Area Network) and / or so-called 4G / 5G / 6G fourth / 5G / 6G mobile communication systems, etc., related to mobile communication, as the communication circuit 14.

[0047] Storage device 15 is a storage medium for storing various types of information. Storage device 15 may be implemented using, for example, RAM, ROM, flash memory, SSD (Solid State Drive), hard disk drive, other storage devices, or appropriate combinations thereof. Storage device 15 stores various data such as the computer program executed by the arithmetic circuit 11, i.e., the adjustment program P, and the adjustment image 151 used in image adjustment.

[0048] <Display Device>

[0049] Display devices 20A and 20B project images sent from information processing devices such as adjustment device 10 onto the screen. At this time, each display device 20A and 20B receives different images and projects them, thereby generating one image content.

[0050] like Figure 1BAs shown, the first display device 20A includes: an arithmetic circuit 21, an input device 22, an output device 23, a communication circuit 24, an HDMI (registered trademark) receiving circuit 25, an HDMI transmitting circuit 26, a storage device 27, and an optical mechanism 28. The arithmetic circuit 21, input device 22, output device 23, communication circuit 24, and storage device 27 communicate with a user... Figure 1A The aforementioned arithmetic circuit 11, input device 12, output device 13, communication circuit 14, and storage device 15 are implemented using the same specific units. The HDMI receiving circuit 25 can receive data from an external device (not shown). Additionally, the HDMI transmitting circuit 26 can transmit data to an external device (not shown). The display device 20A can use the HDMI receiving circuit 25 and the HDMI transmitting circuit 26 to communicate image and audio signals with an external device. Furthermore, the display device 20A includes an optical mechanism 28 for projecting images. The optical mechanism 28 includes light sources such as laser diodes, LEDs, and lamps. The optical mechanism 28 also includes an optical unit containing a liquid crystal element that modulates the light emitted from the light source, a light modulation element such as a DMD (Digital Mirror Device), and a projection lens system that guides the image light modulated by the light modulation element to the projection surface. Since the second display device 20B has the same structure as the first display device 20A, it is not shown in the figure.

[0051] <Filming Device>

[0052] The imaging device 30 captures images displayed on the display devices 20A and 20B. Preferably, the imaging device 30 can capture the entirety of a single image formed by multiple images used in the combined display system 2. Figure 1A In the example shown, the imaging device 30 captures an image that includes the image displayed on the screen by the first display device 20A and the image displayed on the screen by the second display device 20B.

[0053] like Figure 1C As shown, the imaging device 30 includes: an arithmetic circuit 31, an input device 32, an output device 33, a communication circuit 34, a storage device 35, and an optical mechanism 36. The arithmetic circuit 21, input device 22, output device 23, communication circuit 24, and storage device 27 communicate with the user... Figure 1A The aforementioned arithmetic circuit 11, input device 12, output device 13, communication circuit 14, and storage device 15 are implemented using the same specific units. The optical mechanism 36 includes a series of mechanisms associated with image data acquisition, acquiring image data according to control from the arithmetic circuit 31. Specifically, the optical mechanism 36 includes an imaging element, optical system elements, an A / D converter, etc.

[0054] <Processing in the Adjustment Device>

[0055] The processing performed by the arithmetic circuit 11 will be explained in detail.

[0056] The arithmetic circuit 11 transmits the pre-stored adjustment image 151 in the storage device 15 to multiple display devices 20A and 20B via the communication circuit 14, causing the display devices 20A and 20B to display the adjustment image 151. Here, the adjustment image 151 displayed by the display devices 20A and 20B only needs to contain information determining the display range based on each display device 20A and 20B. For example, the adjustment image 151 can be an image displayed as a given color, or it can be an image composed only of specific colors. Furthermore, the adjustment image 151 does not need to be a different image for each of the display devices 20A and 20B. Therefore, the arithmetic circuit 11 can transmit the same adjustment image 151 to all display devices 20A and 20B.

[0057] Furthermore, this description uses an example where the adjustment image 151 is pre-stored in the storage device 15 of the adjustment device 10. However, the adjustment image 151 can also be stored in other storage media. For example, the same adjustment image 151 can be stored in the storage devices of each display device 20A, 20B. Alternatively, the adjustment image 151 can also be stored in an external storage device (not shown).

[0058] The arithmetic circuit 11 acquires captured images of adjustment images displayed on multiple display devices 20A and 20B from the imaging device 30 via the communication circuit 14. Additionally, the arithmetic circuit 11 causes the storage device 15 to store the acquired captured images.

[0059] The processing circuit 11 displays the acquired image on the display 13, which serves as the output device 13. At this time, for adjustment, the processing circuit 11 prompts the user with candidate sampling regions to be compared with a reference value. Specifically, the candidate sampling regions are overlaid with the captured image and displayed on the display 13. Furthermore, the processing circuit 11 handles changes to the candidate sampling regions displayed on the display 13. For example, the user can input a change to the candidate sampling regions via the input device 12. Thus, the user can set the optimal sampling region based on the suggested candidate sampling regions, according to the state that can be confirmed by the captured image.

[0060] exist Figure 2 The image shows an example of an application screen 500 displayed on monitor 13. Figure 2The application screen 500 shown is displayed on the monitor 13 by executing the application software, i.e., the adjustment program P, stored in the storage device 15. For example, the application screen 500 includes a display unit 501 that displays images captured by the imaging device 30. Figure 1A In the example shown, adjustment system 1 includes one shooting device 30. However, adjustment system 1 can include multiple shooting devices. In that case, the user can select the shooting device to use from multiple shooting devices. Figure 2 This is an example of a shooting device that selects the identification information of "Camera 1".

[0061] Figure 2 The display unit 501 shows an example of a captured image showing two display devices 20A and 20B projecting images (an image displayed as "1" and an image displayed as "2") horizontally arranged in a row on the screen. However, the method of image projection in the display system 2 is not limited. For example, images can be projected by arranging three display devices horizontally in a row. Alternatively, two of the four display devices can be arranged horizontally in a row on the lower layer to project images, and the other two can be arranged horizontally in a row on the upper layer to project images. In such cases, the display unit 501 also displays a captured image that includes projected images from all the display devices.

[0062] Furthermore, although the explanation of the usage illustrations is omitted, the display unit 501 can also display a captured image that includes a portion of the projected images from multiple display devices. For example, when a large number of display devices are used, the display unit 501 cannot display projected images from all of them. Therefore, in cases where the entire projected image cannot be contained in a single captured image, the adjustment system 1 can also have multiple capturing devices. Additionally, each of the multiple capturing devices can capture a projected image of a designated display device. When multiple capturing devices are present, the display unit 501 can display the projected image captured by the selected capturing device.

[0063] Figure 2 The captured image displayed on the display unit 501 includes two images projected by two display devices 20A and 20B respectively. However, the processing circuit 11 cannot determine which display device 20A or 20B projected which image. Therefore, the user inputs an operation signal via the input device 12 to associate the display area of ​​each display device 20A or 20B with the captured image. Furthermore, the processing circuit 11 associates the display area with the display device according to the received operation signal, and the storage device 15 stores information related to the association. Figure 1A as well as Figure 2In the example shown, the user associates the first display device 20A with the range of "1" and the second display device 20B with the range of "2".

[0064] Additionally, the display unit 501 displays a list of candidates for the sampling area used during the adjustment. Figure 2 This is an example where the application screen 500 displays candidates 502a and 502b for sampling areas that are close to the boundaries of the display area based on the first display device 20A and the display area based on the second display device 20B, respectively. Furthermore, the application screen 500 includes display units 503a and 503b that display numerical values ​​representing the position and size of the candidates 502a and 502b for each sampling area. Figure 2 In the application screen 500 shown, the coordinates of the upper right point of the candidate 502a in the sampling area of ​​the first display device 20A are (340, 1580), and the size is 1770 × 1630. Additionally, in Figure 2 In the application screen 500 shown, the coordinates of the upper right point of the candidate 502b in the sampling area of ​​the second display device 20B are (2350, 1600), and the size is 1550 × 1220. For example, the user can change the size of the candidate 502a in the sampling area by dragging it via the input device 12. Similarly, the user can change the size of the candidate 502b in the sampling area by dragging it via the input device 12. Alternatively, the user can change the size of the candidate 502a in the sampling area by changing the value displayed on the display unit 503a via the input device 12. Likewise, the user can change the size of the candidate 502b in the sampling area by changing the value displayed on the display unit 503b via the input device 12.

[0065] More specifically, the processing circuit 11 can also designate the area within the frames of the candidate sampling areas 502a and 502b as the area to be sampled. Therefore, the processing circuit 11 uses the image within the frames of the candidate sampling areas 502a and 502b displayed in the application screen 500 for sampling. For example, the processing circuit 11 can also prompt the user with the outer frames of the images displayed on each display device 20A and 20B as candidate sampling areas 502a and 502b.

[0066] The application screen 500 also includes an operation unit 504 for returning to the previous screen and an operation unit 505 for entering the next screen. When candidates 502a and 502b for sampling areas are determined, the user, for example, operates the input device 12 and presses the operation unit 505 to enter the next screen. As a result, the arithmetic circuit 11 samples the determined sampling areas and performs adjustment processing. Furthermore, the arithmetic circuit 11 averages and compares the pixel values ​​in each of the determined sampling areas. Therefore, the size of each sampling area can be different.

[0067] Figures 3A-3D Examples of candidate sampling regions suggested when color correction is performed are shown. Figure 3A as well as Figure 3B This is an example of candidate 502a and 502b of the sampling area when the image is displayed in a horizontal column by two display devices 20A and 20B. Figure 3A This is an example of presenting the user with a rectangle representing almost the entire area of ​​adjacent regions of images displayed on different display devices as candidate sampling areas. Therefore, in Figure 3A In one example shown, the operational circuit 11 and Figure 2 Similarly, a wider region, similar in extent to each display range, is selected as a candidate sampling region, 502a, 502b, for prompting. Figure 3B This is an example of suggesting rectangular areas, 502a and 502b, as sampling areas, based on a portion of the display area of ​​each display device 20A and 20B that is close to the display area of ​​other display devices. For example, when the imaging device 30 captures images projected from each display device 20A and 20B onto the screen, sometimes shadows are cast in certain areas. Additionally, sometimes the entire image on the screen is not displayed uniformly, resulting in unevenness. In these cases, when there are shadowed or uneven areas, it is preferable to adjust only the shadowed or uneven areas rather than correcting the entire image as a whole. Furthermore, such shadows and unevenness are more likely to occur at the edges of the image than at the center. Also, when viewed by the human eye, adjusting the seams between projected images to match them is more likely to appear as a complete adjusted image than matching the entire image as a whole. Therefore, as... Figure 3B As shown, the adjustment device 10 can also pre-select a portion of the area close to the seam and the display range of other display devices as candidates 502a, 502b for the sampling area.

[0068] Figure 3C An example of candidate sampling areas 502a to 502c is shown when images are displayed horizontally in a row using three display devices. Figure 3CThe example shown is the same as Figure 3B Similarly, candidates 502a to 502c in each sampling area are set to positions close to other display areas within each display range. Additionally, Figure 3D This example illustrates candidate sampling areas 502a-1 to 502d-1 when images are displayed horizontally in two display areas on each of the upper and lower layers using four display devices. Figure 3D In the example shown, the candidates 502a-1 to 502d-1 of each sampling area are also set to positions close to other display ranges within each display range.

[0069] Figures 4A to 4D Examples of candidate sampling regions used when performing black correction are shown. Figures 4A-4B The image shown is an example of multiple display devices displaying an image in a manner in which a portion of an adjacent display area overlaps. Figure 4A as well as Figure 4B An example of candidate sampling areas 502a, 502ab, 502b is shown when images are displayed in a horizontal column using two display devices 20A and 20B. Figure 4A This is an example of using the non-overlapping, wider areas and the overlapping areas of each display range as three different candidate sampling areas (502a, 502ab, 502b) for prompting. Additionally, Figure 4B This example illustrates how different sampling areas 502a, 502ab, and 502b are selected based on the portion of the display area of ​​each display device 20A and 20B that is close to the display area of ​​other display devices, as well as overlapping areas. When performing black correction in cases of overlap, the brightness of the surrounding area is adjusted according to the amount of overlap. For example, each of the sampling area candidates 502a and 502b can be adjusted to be brighter than a portion of the sampling area candidate 502ab. The brightness of the sampling area candidates 502a and 502b is adjusted to the same level as the combined brightness of the portions of the sampling area candidate 502ab displayed on display device 20A and display device 20B.

[0070] Figure 4C An example of candidate sampling areas 502a to 502c is shown when images are displayed horizontally in a row using three display devices. Figure 4C The example shown includes: four sampling regions, 502a, 502b-1, 502b-2, and 502c, set as parts of other display areas, and two sampling regions, 502ab and 502bc, set as overlapping portions. Additionally, Figure 4DThis illustrates one example of a candidate sampling area in a scenario where a portion of an image is displayed horizontally in two overlapping display areas on two separate upper and lower layers using four display devices. Figure 4D The example shown includes: four non-overlapping sample regions, candidates 502a, 502b, 502c, and 502d; four overlapping sample regions, candidates 502ab, 502ad, 502bd, and 502cd; and one overlapping sample region, candidate 502abcd. For example, the sample regions candidates 502a, 502b, 502c, and 502d can also be adjusted to be brighter than the sample regions candidates 502ab, 502ad, 502bd, and 502cd. For example, the combined brightness of the portions of the sample regions candidate 502abcd displayed by each display device 20 can also be adjusted to the same level as the combined brightness of the portions of the sample regions candidate 502ab displayed by each display device 20. Similarly, the combined brightness of the candidate 502abcd portions of the sampling areas displayed by each display device 20, the combined brightness of the 502ac portions displayed by each display device 20, the combined brightness of the 502bd portions, the combined brightness of the 502cd portions, and the individual brightness of 502a, 502b, 502c, and 502d can all be adjusted to the same level.

[0071] Furthermore, in the above description, the use of Figures 3A to 3D The example given is a candidate sampling area for color correction, assuming that the display areas do not overlap. On the other hand, when the projection is a partial overlap of adjacent display areas, it is possible to use only the area excluding the overlapping portion as the sampling area. In this case, edge blending can also be used to project the overlapping portion of multiple display areas onto the images projected from each display device. Here, "edge blending" refers to a technique used when combining images projected from multiple display devices. For example, when images are projected from multiple display devices, the images are projected such that a portion of the projection areas of adjacent display devices overlaps. Furthermore, the brightness of the images in the overlapping area is gradually faded to make the seam inconspicuous. This method of making the seam inconspicuous is called "edge blending." Additionally, when there is... Figure 4B In such cases of overlap, only non-overlapping adjacent regions can be used as candidates 502a and 502b for sampling regions, while the portion of 502ab is not used as the object of sampling, and the sampling results of the candidates 502a and 502b of the region can be used.

[0072] Additionally, in the above explanation, the use of Figures 4A to 4DThe example illustrates a candidate sampling area used in black correction, taking the case where a portion of the display areas overlap. Conversely, when the display devices do not overlap, for example, the correction parameters of other display devices can be adjusted to project an image in a way that matches the color and brightness of the image projected from the brightest display device.

[0073] Furthermore, the arithmetic circuit 11 can also exclude regions that meet specific conditions from being considered as candidate sampling regions. For example, in locations with significant brightness variations, the presence of shadows is also taken into account. Therefore, the arithmetic circuit 11 can also exclude locations that produce specific brightness variations from being considered as candidate sampling regions.

[0074] The arithmetic circuit 11 calculates correction parameters to adjust the values ​​representing the sampling area in the captured image to be expressed using a specified reference value. For example, the arithmetic circuit 11 can also accept the selection of one display device from multiple display devices 20A, 20B. Furthermore, the arithmetic circuit 11 can also specify the sampling result of the selected display device's sampling area as the reference value. Further, the arithmetic circuit 11 can also calculate correction parameters so that the display of unselected display devices is adjusted to the specified reference value.

[0075] Furthermore, the image of the sampling region used in generating the correction parameters may not be the same image captured for determining the sampling region. For example, the arithmetic circuit 11 can use an image captured after the sampling region has been set to calculate the correction parameters.

[0076] When performing color correction, the arithmetic circuit 11 causes each display device 20A and 20B to display red (R), green (G), and blue (B) light as adjustment images. Additionally, when performing color correction, the arithmetic circuit 11 can also display cyan (C), magenta (M), yellow (Y), and white (W) light as adjustment images. Furthermore, the arithmetic circuit 11 uses captured images of each color to calculate correction parameters for each color.

[0077] Furthermore, when performing black correction, the arithmetic circuit causes each display device 20A and 20B to display a black image for adjustment. Additionally, the arithmetic circuit 11 calculates correction parameters based on the captured image, using the brightest grayscale sampling area as a reference value.

[0078] The arithmetic circuit 11 sends the calculated correction parameters to the display devices 20A and 20B of the target, and adjusts the parameters of each display device 20A and 20B.

[0079] In this way, when combining the images displayed on multiple display devices 20A and 20B in the adjustment system 1, the workload of specifying the sampling area used in the adjustment of multiple display devices 20A and 20B can be reduced, and the sampling area that improves the adjustment accuracy can be specified.

[0080] <Processing in the Adjustment Device>

[0081] use Figure 5 as well as Figure 6 The flowchart shown illustrates the adjustment process performed by the arithmetic circuit 11. Figure 5 The description shown pertains to the processing related to various settings up to the actual adjustment process. The arithmetic circuit 11, through the execution of the adjustment program P, displays a given application screen on the display 13 and begins the adjustment process. Figure 5 The flowchart illustrates the processing primarily via the application screen and corresponding user actions. Additionally, Figure 6 The illustration shows the processing performed by the arithmetic circuit 11 during the actual adjustment process.

[0082] The arithmetic circuit 11 accepts the selection of the shooting device 30 used in the adjustment (S001). Specifically, the arithmetic circuit 11 accepts the selection of the shooting device 30 used in the adjustment via the input device 12 operated by the user on the application screen 500 displayed on the display 13.

[0083] The arithmetic circuit 11 accepts configuration settings for the display devices 20A and 20B (S002). Specifically, it accepts settings regarding how many display devices are used or how the images are configured to be displayed on multiple display devices. In this case, the arithmetic circuit 11 also accepts the settings on the application screen 500 displayed on the monitor 13 via the user-operated input device 12.

[0084] The arithmetic circuit 11 accepts the selection of display devices 20A and 20B to be used (S003). Specifically, the arithmetic circuit 11 accepts the selection of display devices for the number set in step S002 on the application screen 500 displayed on the display 13 via the input device 12 operated by the user, and uses them as display devices in the display system 2. Here, the display devices 20A and 20B used in the display system 2 become the adjustment objects in the adjustment system 1.

[0085] The arithmetic circuit 11 establishes associations between the display devices 20A and 20B selected in step S003 and the display ranges configured in step S002, respectively (S004). In this case, the arithmetic circuit 11 also receives operation signals that establish associations between the display devices that project images and each display range via the user-operated input device 12 on the application screen 500 displayed on the display 13.

[0086] The arithmetic circuit 11 sets the exposure of the imaging device 30 (S005). Specifically, the arithmetic circuit 11 operates the exposure setting via the user-operated input device 12 on the application screen 500 displayed on the display 13. For example, the arithmetic circuit 11 causes the display devices 20A and 20B to output test images or light. In addition, the arithmetic circuit 11 causes the imaging device 30 to capture images and adjust the exposure.

[0087] The arithmetic circuit 11 accepts adjustment conditions (S007). Here, the arithmetic circuit 11 accepts adjustment conditions on the application screen 500 displayed on the display 13 via the user-operated input device 12. For example, regarding adjustment conditions, it can accept the display device set as the reference among multiple display devices 20A and 20B. For example, when the first display device 20A is accepted as the reference, the arithmetic circuit 11 generates adjustment parameters in subsequent processing such that the display image based on the second display device 20B matches the display image based on the first display device 20A. In addition, for example, when the display device that displays a darker display image is accepted as the reference, the arithmetic circuit 11 generates adjustment parameters in subsequent processing such that the display device displaying a brighter display image matches the display device displaying a darker display image. For example, in accepting adjustment conditions, the arithmetic circuit 11 can cause each display device 20A and 20B to project a specific image, display the captured image on the application screen 500, and allow the user to select adjustment conditions.

[0088] The arithmetic circuit 11 causes each display device 20A and 20B to sequentially output images (light), and detects the display area of ​​the images displayed by each display device 20A and 20B (S008). As a method for detecting the display area based on each display device 20A and 20B, the following method is considered. For example, the arithmetic circuit 11 first causes both the first display device 20A and the second display device 20B to display black images (255), acquiring an image captured by the imaging device 30 (image Ia). Next, the arithmetic circuit 11 causes the first display device 20A to display a white image (0), and causes the second display device 20B to display a black image (255), acquiring an image captured by the imaging device 30 (image Ib). Then, the arithmetic circuit 11 causes the first display device 20A to display a black image (255), and causes the second display device 20B to display a white image (0), acquiring an image captured by the imaging device 30 (image Ic). Subsequently, the arithmetic circuit 11 calculates the display range of the first display device 20A by subtracting the signal values ​​of each pixel of the captured image Ib from the signal values ​​of each pixel of the captured image Ia. Similarly, the display range of the second display device 20B is calculated by subtracting the signal values ​​of each pixel of the captured image Ic from the signal values ​​of each pixel of the captured image Ia. Furthermore, the display devices 20A and 20B display signals with values ​​of 0 or 255. However, the values ​​of each pixel of the captured images may not be 0 or 255 depending on the characteristics of the display devices 20A and 20B, the environment, etc. For example, when the signal value of the displayed image is 0, it may be a value closer to 0; when the signal value of the displayed image is 255, it may be a value closer to 255.

[0089] Based on the display ranges of each display device 20A and 20B detected in step S008, the arithmetic circuit 11 determines candidates for sampling areas using a predetermined method and provides a prompt (S009). For example, if the entire display range is determined to be the sampling area, the arithmetic circuit 11 displays a prompt on the display section 501 of the application screen 500. Figure 3A The candidate sampling areas 502a and 502b are overlapped with the display area as shown. Furthermore, when it is determined that a portion adjacent to the display area is designated as the sampling area, the processing circuit 11 displays a prompt on the display section 501 of the application screen 500. Figure 3B As shown, the candidate samples 502a and 502b of the sampling area overlap with the display range.

[0090] The arithmetic circuit 11 sets the sampling area based on the candidates of the sampling area prompted in step S009 (S010). For example, on the application screen 500 displayed on the display 13, the arithmetic circuit 11 accepts the operation of adjusting or determining the candidates 502a and 502b of the sampling area via the input device 12 operated by the user, and accepts the setting of the sampling area.

[0091] Next, the operational circuit 11 proceeds to... Figure 6 The flowchart shown illustrates the process of transferring the sampled area received in step S009 to the actual adjustment process.

[0092] First, the arithmetic circuit 11 sends a shooting condition setting signal to the shooting device 30 via the communication circuit 14 (S101). The shooting conditions specified by the setting signal sent by the arithmetic circuit 11 are set to optimal, for example, by an application program. Alternatively, the shooting conditions can also be set by the user. Specifically, the shooting conditions can include shutter speed, aperture, gain, and other conditions.

[0093] The arithmetic circuit 11 receives a response from the imaging device 30 indicating the end of the setting via the communication circuit 14 in response to the setting signal sent in step S101 (S102).

[0094] The arithmetic circuit 11 selects the adjustment item (S103). In the case of color correction, the adjustment item can be red (R), green (G), or blue (B). Additionally, in the case of color correction, the adjustment item can be cyan (C), magenta (M), yellow (Y), or white (W). Furthermore, in the case of black correction, the adjustment item can be black. For example, the adjustment target and the adjustment order can be predetermined, and the arithmetic circuit 11 selects the adjustment target item according to the predetermined order.

[0095] The arithmetic circuit 11 sends a setting signal for the projection conditions determined for each display device 20A, 20B via the communication circuit 14 (S104). The projection conditions specified by the setting signal sent by the arithmetic circuit 11 are, for example, preset conditions in the first instance. Furthermore, in the case of repeated processing, the projection conditions are changed according to the sampling results in step S108 described later. In addition, the setting signal for the projection conditions includes a projection request.

[0096] The arithmetic circuit 11 receives responses from each display device 20A and 20B indicating the end of setting and the execution of projection in response to the setting signal sent in step S104 via the communication circuit 14 (S105).

[0097] When the processing circuit 11 receives the response to the projection in step S104, it sends a shooting operation signal to the shooting device 30 via the communication circuit 14 (S106).

[0098] After this, the processing circuit 11 receives the captured image from the imaging device 30 via the communication circuit 14 (S107).

[0099] The processing circuit 11 samples the signal of the sampling area set in step S009 in the captured image received in step S107 (S108).

[0100] The arithmetic circuit 11 determines whether the signal sampled in step S108 is within the condition range (S109). For example, the arithmetic circuit 11 may also calculate the average signal value of each pixel in the sampled area, compare the calculated average value with a given threshold, and if the calculated average value is below (or above) the threshold, it is set to be within the condition range. Alternatively, the arithmetic circuit 11 may also compare the signal of each pixel in the sampled area with a given threshold, and if a given proportion of each pixel is below (or above) the threshold, it is set to be within the condition range.

[0101] If the conditions are not met (in S109, no), the arithmetic circuit 11 adjusts the projection conditions (S110), returns to step S104, and repeats the processing of steps S104 to S109.

[0102] On the other hand, if the conditions are met (Yes in S109), the arithmetic circuit 11 determines that the adjustment of all items has been completed (S111). Specifically, the arithmetic circuit 11 determines whether the adjustment of all items for red (R), green (G), blue (B), cyan (C), magenta (M), yellow (Y), white (W), and black has been completed. Furthermore, the specific processing may differ depending on the color.

[0103] If the adjustment is not completed (in S111, no), return to the processing of step S103, select a new unadjusted item, and repeat the processing of steps S103 to S111.

[0104] <Processing in the filming device>

[0105] use Figure 7 The flowchart shown illustrates the processing performed in the imaging device 30 based on the signal received from the adjustment device 10.

[0106] The arithmetic circuit 31 receives the shooting condition setting signal sent from the adjustment device 10 via the communication circuit 34 (S201).

[0107] The arithmetic circuit 31 sets the shooting conditions according to the setting signal received in step S201 (S202). In addition, the arithmetic circuit 31 sends a response indicating the end of the setting of the shooting signal to the adjustment device 10 via the communication circuit 34 (S203).

[0108] Subsequently, during the timing of the shooting, the arithmetic circuit 11 receives the shooting operation signal sent from the adjustment device 10 via the communication circuit 34 (S204).

[0109] In response to the image capture operation signal received in step S204, the processing circuit 31 captures an image (S205). The captured image includes the image projected onto the screen from the display devices 20A and 20B. Furthermore, the processing circuit 31 transmits the captured image from step S205 to the adjustment device 10 via the communication circuit 34 (S206).

[0110] The arithmetic circuit 31 returns to step S204 and repeats the process of S204 to S207 until the series of processes for adjustment in the adjustment system 1 are completed (in S207, yes).

[0111] Processing in Display Devices

[0112] use Figure 8 The flowchart shown illustrates the processing performed in the first display device 20A based on the signal received from the adjustment device 10.

[0113] The arithmetic circuit 21 receives the projection condition setting signal sent from the adjustment device 10 via the communication circuit 24 (S301).

[0114] The arithmetic circuit 21 sets the projection conditions according to the setting signal received in step S301 (S302). Furthermore, the arithmetic circuit 21 projects the image according to the conditions set in step S302 (S303). Next, the arithmetic circuit 21 sends a response indicating the execution of the projection to the adjustment device 10 (S304).

[0115] The arithmetic circuit 21 returns to step S301 until the adjustment of the first display device 20A is completed (in S305, yes), and repeats the processing of S301 to S305 according to the new projection conditions.

[0116] Furthermore, the same process as described above is performed in the second display device 20B, so the explanation of the flowchart is omitted.

[0117] In the adjustment system 1 disclosed herein, the workload of specifying areas for adjusting the color and brightness of an image can be reduced, and areas that improve adjustment accuracy can be specified.

[0118] Overview of Implementation Methods

[0119] (1) The specified method of this disclosure may be, in an adjustment device connected to multiple display devices and an imaging device, specifying a sampling area used in adjusting the display of the image implemented by the multiple display devices when combining the multiple display devices to display one image content.

[0120] The adjustment device includes a computing circuit and can access a storage device and a display.

[0121] Through the aforementioned computing circuit.

[0122] The plurality of display devices shall display the adjustment images pre-stored in the storage device.

[0123] The imaging device acquires a captured image obtained by capturing an adjustment image displayed on the plurality of display devices.

[0124] The acquired image is displayed on the monitor.

[0125] The candidate sample in the sampling area is superimposed on the captured image displayed on the monitor to prompt the user.

[0126] The designation of a sampling region is accepted based on the candidate determination of the sampling region, according to the operation of the user via the input device.

[0127] This reduces the workload of the designated sampling area and allows for the designation of sampling areas that improve adjustment accuracy.

[0128] (2) In the method specified in (1), it can also be,

[0129] The computing circuit uses the outlines of images displayed on different display devices as candidate suggestions for the sampling area to the user.

[0130] Therefore, it is possible to suggest the entire range of images displayed by each display device as candidates for the sampling area.

[0131] (3) In the method specified in (1), it can also be,

[0132] The computing circuit will suggest to the user regions that are adjacent to each other in a portion of the images displayed by each display device as candidate sampling regions.

[0133] Therefore, it is possible to suggest a portion of the image displayed by each display device as a candidate sampling area.

[0134] (4) In the methods specified in (1) to (3), it can also be,

[0135] Changes will be accepted for the candidates in the suggested sampling area.

[0136] Therefore, by using the suggested sampling area candidates, users can easily specify the appropriate sampling area.

[0137] (5) The adjustment device disclosed herein may be connected to multiple display devices and a shooting device to adjust the image displayed by the multiple display devices when the multiple display devices are combined to display one image content.

[0138] The adjustment device includes a computing circuit and can access a storage device and a display.

[0139] The operational circuit:

[0140] The plurality of display devices shall display the adjustment images pre-stored in the storage device.

[0141] The imaging device acquires a captured image obtained by capturing an adjustment image displayed on the plurality of display devices.

[0142] The acquired image is displayed on the monitor.

[0143] The user is prompted to overlap the candidate sampling area used in image adjustment with the captured image displayed on the monitor.

[0144] The sampling region is designated by the user based on the candidates of the sampling region via the input device.

[0145] Using the image of the sampled area, determine the correction parameters for adjusting the display.

[0146] This reduces the workload of the designated sampling area and allows for the designation of sampling areas that improve adjustment accuracy.

[0147] (6) In the adjusting device of (5), it can also be,

[0148] The operational circuit:

[0149] The selection of one display device is made from the plurality of display devices.

[0150] Determine the correction parameters for adjusting the unselected display devices based on the selected display devices.

[0151] Therefore, it is possible to match the display image based on the selected display device with the display image based on other display devices.

[0152] (7) The computer program of this disclosure specifies, in an adjustment device connected to multiple display devices and an imaging device, a sampling area used in adjusting the display of the image implemented by the multiple display devices when combining the multiple display devices to display one image content.

[0153] The computer program causes the information processing device to perform the specified method described in any one of (1) to (5).

[0154] This reduces the workload of the designated sampling area and allows for the designation of sampling areas that improve adjustment accuracy.

[0155] The specified methods, adjustment devices, and computer programs described in all claims of this disclosure are implemented using hardware resources, such as processors, memory, and collaboration with computer programs.

[0156] Industrial availability

[0157] The specified method, adjustment device, and computer program of this disclosure are useful in adjusting a display system that combines images displayed by multiple display devices and sets them as a single image.

Claims

1. A method for specifying a sampling area used in adjusting the display of an image implemented by the multiple display devices when the multiple display devices are combined to display one image content, in an adjustment device connected to multiple display devices and an imaging device. The adjustment device includes a computing circuit and can access a storage device and a display. Through the aforementioned computing circuit. The plurality of display devices shall display the adjustment images pre-stored in the storage device. The imaging device acquires a captured image obtained by capturing an adjustment image displayed on the plurality of display devices. The acquired image is displayed on the monitor. The candidate sample in the sampling area is superimposed on the captured image displayed on the monitor to prompt the user. The designation of a sampling region is accepted based on the candidate determination of the sampling region, according to the operation of the user via the input device.

2. The specified method according to claim 1, wherein, The computing circuit uses the outlines of images displayed on different display devices as candidate suggestions for the sampling area to the user.

3. The specified method according to claim 1, wherein, The computing circuit will suggest to the user regions that are adjacent to each other in a portion of the images displayed by each display device as candidate sampling regions.

4. The specified method according to claim 1, wherein, The processing circuit accepts changes for the candidates in the suggested sampling area.

5. An adjustment device connected to a plurality of display devices and a shooting device, for adjusting an image displayed by the plurality of display devices when the plurality of display devices are combined to display one image content. The adjustment device includes a computing circuit and can access a storage device and a display. The operational circuit: The plurality of display devices shall display the adjustment images pre-stored in the storage device. The imaging device acquires a captured image obtained by capturing an adjustment image displayed on the plurality of display devices. The acquired image is displayed on the monitor. The user is prompted to overlap the candidate sampling area used in image adjustment with the captured image displayed on the monitor. The sampling region is designated by the user based on the candidates of the sampling region via the input device. Using the image of the sampled area, determine the correction parameters for adjusting the display.

6. The adjusting device according to claim 5, wherein, The operational circuit: The selection of one display device is made from the plurality of display devices. Determine the correction parameters for adjusting the unselected display devices based on the selected display devices.

7. A computer program, in an adjustment device connected to a plurality of display devices and a shooting device, specifies a sampling area used in adjusting the display of an image implemented by the plurality of display devices when the plurality of display devices are combined to display one image content. The computer program causes the information processing device to perform the method of claim 1.

Images