Adjustment method for display picture, display system, and program for information processing

Abstract

To shorten an adjustment time when correcting a hue of a screen using a picked-up picture obtained by imaging a projection screen.SOLUTION: An adjustment method includes: acquiring a first picked-up picture obtained by imaging a range including a first entire picture AP1 and an object picture OP; acquiring a fourth gradation value for which a gradation value that a fourth unit picture UP has is corrected based on a gradation value of a first unit picture UP and a gradation value of a second unit picture UP in the first picked-up picture; acquiring a fifth gradation value for which a gradation value that a fifth unit picture UP has is corrected based on the gradation value of the first unit picture UP and a gradation value of a third unit picture UP in the first picked-up picture; calculating a first gradation value difference which is a differential between a gradation value of the object picture OP and the fourth gradation value; calculating a second gradation value difference which is a differential between the gradation value of the object picture OP and the fifth gradation value; and correcting a display picture using a first correction value in a case where the first gradation value difference is equal to or greater than the second gradation value difference.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a display image adjustment method, a display system, and an information processing program. [Background technology]

[0002] When performing multi-projection using multiple projectors, a technique is sometimes used to correct the color tone of the screen using an image captured of the projection screen in order to eliminate individual differences in the color tone of the projected screen between projectors.

[0003] For example, Patent Document 1 discloses a technology in which single-color raster images of red, green, and blue, each of which is prepared for a preset gradation, are projected one by one, the projected raster images are photographed, and the color tone of the projected image is corrected based on the photographing results. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-129739 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the technology disclosed in Patent Document 1, it is necessary to repeatedly capture a single-color raster image by changing the brightness. As a result, the number of capture patterns increases, which lengthens the adjustment time and reduces user convenience. [Means for solving the problem]

[0006] A method for adjusting a display image according to one aspect of the present invention includes: a first unit image located in a first region and having a first gradation value; a second unit image located in a second region and having the first gradation value; a third unit image located in a third region and having the first gradation value; a fourth unit image located in a fourth region and having a second gradation value different from the first gradation value; and a fifth unit image located in a fifth region and having a third gradation value different from the first gradation value and the second gradation value; a first display device displays a first whole image, in which a distance between the first region and the fourth region is equal to or less than a distance from the first region to the fourth region, a distance between the second region and the fourth region is equal to or less than a distance from the second region to the fifth region, a distance between the third region and the fifth region is equal to or less than a distance from the first region to the fifth region, and a distance between the third region and the fifth region is equal to or less than a distance from the third region to the fourth region; acquiring a first captured image capturing an area including the fourth unit image in the first captured image, based on the gradation value of the first unit image and the gradation value of the second unit image in the first captured image, to obtain a fourth gradation value obtained by correcting the gradation value of the fourth unit image in the first captured image; acquiring a fifth gradation value obtained by correcting the gradation value of the fifth unit image in the first captured image, based on the gradation value of the first unit image and the gradation value of the third unit image in the first captured image; calculating a first gradation value difference which is a difference between the gradation value of the target image and the fourth gradation value; calculating a second gradation value difference which is a difference between the gradation value of the target image in the first captured image and the fifth gradation value; and if the first gradation value difference is equal to or greater than the second gradation value difference, correcting the display image displayed by the first display device using a first correction value, and if the first gradation value difference is less than the second gradation value difference, correcting the display image displayed by the first display device using the second correction value.

[0007] A display system according to one aspect of the present invention includes a first unit image located in a first region and having a first grayscale value, a second unit image located in a second region and having the first grayscale value, a third unit image located in a third region and having the first grayscale value, a fourth unit image located in a fourth region and having a second grayscale value different from the first grayscale value, and a fifth unit image located in a fifth region and having a third grayscale value different from each of the first grayscale value and the second grayscale value, and a distance from the second region to the fourth region is a first display device that displays a first entire image, in which a distance from the second region to the fourth region is equal to or less than a distance from the second region to the fourth region, a distance from the third region to the fifth region is equal to or less than a distance from the first region to the fifth region, a distance from the third region to the fifth region is equal to or less than a distance from the first region to the fifth region, and a distance from the third region to the fifth region is equal to or less than a distance from the third region to the fourth region; acquiring a fourth gradation value obtained by correcting a gradation value of a fourth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the second unit image in the first captured image; acquiring a fifth gradation value obtained by correcting a gradation value of a fifth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the third unit image in the first captured image; and an information processing device that executes the following operations: calculates a first gradation value difference which is a difference between the gradation value of the target image in the first captured image and the fourth gradation value; calculates a second gradation value difference which is a difference between the gradation value of the target image in the first captured image and the fifth gradation value; and, if the first gradation value difference is equal to or greater than the second gradation value difference, corrects a display image displayed by the first display device using a first correction value, and if the first gradation value difference is less than the second gradation value difference, corrects the display image displayed by the first display device using the second correction value.

[0008] A display system according to another aspect of the present invention includes a first unit image located in a first region and having a first gradation value, a second unit image located in a second region and having the first gradation value, a third unit image located in a third region and having the first gradation value, a fourth unit image located in a fourth region and having a second gradation value different from the first gradation value, and a fifth unit image located in a fifth region and having a third gradation value different from each of the first gradation value and the second gradation value, and a distance from the second region to the fourth region is a first display device that displays a first entire image, in which a distance from the second region to the fourth region is equal to or less than a distance from the second region to the fourth region, a distance from the third region to the fifth region is equal to or less than a distance from the first region to the fifth region, a distance from the third region to the fifth region is equal to or less than a distance from the first region to the fifth region, and a distance from the third region to the fifth region is equal to or less than a distance from the third region to the fourth region; a second display device that displays a target image that is a target for correction of gradation values; and a first display device that captures an area including the first entire image and the target image. An imaging device that generates a captured image, acquiring the first captured image, acquiring a fourth gradation value obtained by correcting a gradation value of a fourth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the second unit image in the first captured image, acquiring a fifth gradation value obtained by correcting a gradation value of a fifth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the third unit image in the first captured image, and acquiring a fifth gradation value obtained by correcting a gradation value of a fifth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the third unit image in the first captured image. and an information processing device that executes the following operations: calculating a first gradation value difference which is a difference between the gradation value of the target image and the fourth gradation value; calculating a second gradation value difference which is a difference between the gradation value of the target image in the first captured image and the fifth gradation value; and correcting a display image displayed by the first display device using a first correction value if the first gradation value difference is equal to or greater than the second gradation value difference, and correcting the display image displayed by the first display device using the second correction value if the first gradation value difference is less than the second gradation value difference.

[0009] An information processing program according to one aspect of the present invention includes a first unit image located in a first region and having a first gradation value, a second unit image located in a second region and having the first gradation value, a third unit image located in a third region and having the first gradation value, a fourth unit image located in a fourth region and having a second gradation value different from the first gradation value, and a fifth unit image located in a fifth region and having a third gradation value different from each of the first gradation value and the second gradation value, and a distance from the second region to the fourth region is a first overall image, in which a distance from the first area to the fourth area is equal to or less than a distance from the second area to the fourth area, a distance from the third area to the fifth area is equal to or less than a distance from the first area to the fifth area, and a distance from the third area to the fifth area is equal to or less than a distance from the third area to the fifth area, and a distance from the third area to the fifth area is equal to or less than a distance from the third area to the fourth area, is displayed on a first display device; and a first captured image captured by an imaging device of a range including the first overall image and a target image that is a target for correction of gradation values ​​is obtained. acquiring the first captured image; acquiring a fourth gradation value obtained by correcting a gradation value of a fourth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the second unit image in the first captured image; acquiring a fifth gradation value obtained by correcting a gradation value of a fifth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the third unit image in the first captured image; acquiring a fifth gradation value obtained by correcting a gradation value of a fifth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the third unit image in the first captured image; calculating a first gradation value difference which is a difference between the gradation value of the target image in the first captured image and the fourth gradation value; calculating a second gradation value difference which is a difference between the gradation value of the target image in the first captured image and the fifth gradation value; and correcting the display image displayed by the first display device using the first correction value if the first gradation value difference is equal to or greater than the second gradation value difference, and correcting the display image displayed by the first display device using the second correction value if the first gradation value difference is less than the second gradation value difference. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing the configuration of a display system 1. [Diagram 2] FIG. 1 is a block diagram showing the configuration of a display system 1. [Diagram 3] FIG. 2 is a block diagram showing the configuration of a first projector 20-1. [Figure 4] FIG. 1 is a block diagram showing an example of the configuration of an information processing device 10. [Diagram 5] 4 is an example of a captured image of an entire image AP1. [Figure 6] 4 is a flowchart showing the operation of the information processing device 10. [Figure 7] 4 is a flowchart showing the operation of the information processing device 10. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments for carrying out the present invention will be described with reference to the drawings. However, in each drawing, the dimensions and scale of each part are appropriately different from the actual ones. In addition, since the embodiments described below are preferred specific examples of the present invention, various technically preferable limitations are attached, but the scope of the present invention is not limited to these embodiments unless otherwise specified in the following description to the effect that the present invention is limited.

[0012] 1: First embodiment 1-1: Overall composition 1 and 2 are block diagrams showing a configuration of a display system 1 according to a first embodiment. The display system 1 includes an information processing device 10, a first projector 20-1, a second projector 20-2, and an imaging device 30. The information processing device 10, the first projector 20-1, the second projector 20-2, and the imaging device 30 are connected to each other via a communication network NET so as to be able to communicate with each other.

[0013] The first projector 20-1 and the second projector 20-2 project a projection image onto, for example, a wall surface or a screen, thereby displaying a display image. The imaging device 30 captures the display image displayed on the wall surface or screen by the first projector 20-1, and the display image displayed on the wall surface or screen by the second projector 20-2. The imaging device 30 also outputs the captured captured image to the information processing device 10. The imaging device 30 captures various images under the control of the information processing device 10. For example, a camera provided on a PC, a tablet terminal, or a smartphone is preferably used as the imaging device 30, but is not limited thereto, and may be an external camera such as a WEB camera. The information processing device 10 calculates color correction values ​​of the first projector 20-1 and the second projector 20-2 using the captured image acquired from the imaging device 30. For example, a PC, a tablet terminal, or a smartphone is preferably used as the information processing device 10, but is not limited thereto. 1, two projectors, the first projector 20-1 and the second projector 20-2, are shown, but this is merely an example. The display system 1 can include any number of projectors 20.

[0014] In the display system 1, first, as shown in FIG. 1, the first projector 20-1 projects a target image OP having a target gradation value and an entire image AP1. The entire image AP1 is a unit image UP having a plurality of gradation values ​​shifted from the gradation value of the target image OP, and is composed of a plurality of unit images UP[0] to UP[n] (n is an integer equal to or greater than 1), each of which has a single gradation value. In the example shown in FIG. 1, the target image OP is displayed superimposed on the entire image AP1. After that, the information processing device 10 calculates a correction value for correcting the gradation value of the first projector 20-1 based on the imaging result of the target image OP and the entire image AP1 by the imaging device 30. Note that in FIG. 1, the first projector 20-1 is an example of a "first display device". Also, the entire image AP1 is an example of a "first entire image".

[0015] Next, as shown in FIG. 2, in the display system 1, the first projector 20-1 whose gradation value has been corrected projects a target image OP having a target gradation value. Also, the second projector 20-2 projects an entire image AP2. The entire image AP2 is a unit image UP having a plurality of gradation values ​​whose gradation is shifted from the gradation value of the target image OP, and is composed of a plurality of unit images UP[0] to UP[n] (n is an integer of 1 or more) each having a single gradation value. After that, the information processing device 10 calculates a correction value for correcting the gradation value of the second projector 20-2 based on the imaging result of the target image OP and the entire image AP2 by the imaging device 30. Note that in FIG. 2, the second projector 20-2 is an example of a "first display device". Meanwhile, the first projector 20-1 is an example of a "second display device". Also, the entire image AP2 is an example of a "first entire image". The entire image AP1 is an example of a "second entire image". The whole image AP1 and the whole image AP2 may be the same image or different images. Furthermore, the positions of the unit images UP[0] to UP[n] in the whole images AP1 and AP2 are arbitrary.

[0016] 1-2: Projector configuration FIG. 3 is a block diagram showing the configuration of the first projector 20-1. The first projector 20-1 includes a projection device 210, a processing device 220, a storage device 230, and a communication device 240. The elements of the first projector 20-1 are connected to each other by a single or multiple buses for communicating information. Each element of the first projector 20-1 is composed of a single or multiple devices, and some elements of the first projector 20-1 may be omitted. Note that the second projector 20-2 is not shown in the figure because it is configured in the same way as the first projector 20-1.

[0017] The projection device 210 is a device that projects the target image OP and the entire image AP1 acquired from the information processing device 10 by the acquisition unit 221 described later onto a wall or a screen. The projection device 210 projects various images under the control of the processing device 220. The projection device 210 includes, for example, a light source, a liquid crystal panel, and a projection lens, and modulates light from the light source using the liquid crystal panel. The projection device 210 also projects the modulated light onto a screen, a wall, or the like via the projection lens. Although the projection device 210 has been exemplified as including a liquid crystal panel, the present invention is not limited thereto. For example, the projection device 210 may include a digital mirror device. It is sufficient that the projection device 210 can project the target image OP and the entire image AP1 onto a wall or a screen.

[0018] The processing device 220 is a processor that controls the entire first projector 20-1, and is configured, for example, by a single chip or multiple chips. The processing device 220 is configured, for example, by a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, and a register. Note that some or all of the functions of the processing device 220 may be realized by hardware such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The processing device 220 executes various processes in parallel or sequentially.

[0019] The storage device 230 is a recording medium readable by the processing device 220, and stores a plurality of programs including the control program PR2 executed by the processing device 220. The storage device 230 may be configured with at least one of, for example, a Read Only Memory (ROM), an Erasable Programmable ROM (EPROM), an Electrically Erasable Programmable ROM (EEPROM), a Random Access Memory (RAM), etc. The storage device 230 may be called a register, a cache, a main memory, a primary storage device, or the like.

[0020] The communication device 240 is hardware as a transmitting / receiving device for communicating with other devices. The communication device 240 is also called, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 240 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 240 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include those conforming to wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include those conforming to wireless LAN, Bluetooth (registered trademark), etc.

[0021] The processing device 220 reads out and executes the control program PR2 from the storage device 230, thereby functioning as an acquisition unit 221 and a projection control unit 222. Note that the control program PR2 may be transmitted from another device, such as a server that manages the first projector 20-1, via the communication network NET.

[0022] The acquisition unit 221 acquires the target image OP and the entire image AP1 from the information processing device 10 via the communication device 240.

[0023] The projection control unit 222 causes the projection device 210 to project the target image OP and the entire image AP1 acquired by the acquisition unit 221 onto a wall or a screen.

[0024] Although not shown, the first projector 20-1 also has other functions that are included in a normal projector.

[0025] 1-3: Configuration of information processing device 4 is a block diagram showing a configuration example of the information processing device 10. The information processing device 10 is typically a PC, but is not limited to this, and may be, for example, a tablet terminal or a smartphone. The information processing device 10 includes a processing device 110, a storage device 120, a display device 130, and a communication device 140. The elements of the information processing device 10 are connected to each other by a single bus or multiple buses for communicating information.

[0026] The processing device 110 is a processor that controls the entire information processing device 10, and is composed of, for example, a single chip or multiple chips. The processing device 110 is composed of, for example, a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, and a register. Note that some or all of the functions of the processing device 110 may be realized by hardware such as a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA). The processing device 110 executes various processes in parallel or sequentially.

[0027] The storage device 120 is a recording medium that can be read and written by the processing device 110, and stores a plurality of programs including the control program PR1 executed by the processing device 110. The storage device 120 may also store images projected by the first projector 20-1 and the second projector 20-2. The storage device 120 may also store layout information relating to the arrangement of the first projector 20-1 and the second projector 20-2. The storage device 120 may be configured by at least one of, for example, a Read Only Memory (ROM), an Erasable Programmable ROM (EPROM), an Electrically Erasable Programmable ROM (EEPROM), a Random Access Memory (RAM), and the like. The storage device 120 may also be called a register, a cache, a main memory, a main storage device, or the like.

[0028] The display device 130 is a device that displays images and text information. The display device 130 displays various images under the control of the processing device 110. For example, various display panels such as a liquid crystal display panel and an organic EL (Electro Luminescence) display panel are suitably used as the display device 130.

[0029] The communication device 140 is hardware as a transmitting / receiving device for communicating with other devices. The communication device 140 is also called, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 140 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 140 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include those conforming to wired LAN, IEEE1394, and USB. Examples of the wireless communication interface include those conforming to wireless LAN, Bluetooth (registered trademark), etc.

[0030] The processing device 110 reads out and executes the control program PR1 from the storage device 120, thereby functioning as a detection unit 111, a generation unit 112, an output unit 113, a first acquisition unit 114, a second acquisition unit 115, a third acquisition unit 116, a first calculation unit 117, a second calculation unit 118, and a correction unit 119. Note that the control program PR1 may be transmitted from another device, such as a server that manages the information processing device 10, via a communication network NET.

[0031] The detection unit 111 detects the projection position of the image projected by the first projector 20-1 onto a wall or a screen. Specifically, the detection unit 111 causes the first projector 20-1 to project a dot pattern or a chessboard pattern. Then, the detection unit 111 acquires information from the imaging device 30 indicating where each part in the projection image projected by the first projector 20-1 is located in the camera pixels of the imaging device 30. Furthermore, the detection unit 111 detects the position of the projection image projected by the first projector 20-1 in the camera coordinate system in the imaging device 30 based on the acquired information. Similarly, the detection unit 111 detects the projection position of the image projected by the second projector 20-2 onto a wall or a screen.

[0032] The generation unit 112 generates a target image OP and whole images AP1 and AP2.

[0033] FIG. 5 is an example of a target image OP and an entire image AP1. In the example shown in FIG. 5, the entire image AP1 is composed of a plurality of unit images UP. The plurality of unit images UP include unit images UP[A], UP[0], UP[0'], UP[k], and UP[k']. Here, the unit image UP[A] is an example of a "first unit image." The unit image UP[0] is an example of a "second unit image." The unit image UP[0'] is an example of a "third unit image." The unit image UP[k] is an example of a "fourth unit image." The unit image UP[k'] is an example of a "fifth unit image."

[0034] In addition, in the entire image AP1, the area where the unit image UP[A] is located is referred to as the "first area". Similarly, in the entire image AP1, the area where the unit image UP[0] is located is referred to as the "second area". In the entire image AP1, the area where the unit image UP[0'] is located is referred to as the "third area". In the entire image AP1, the area where the unit image UP[k] is located is referred to as the "fourth area". In the entire image AP1, the area where the unit image UP[k'] is located is referred to as the "fifth area". Here, the second area and the fourth area are located close to each other. Specifically, the distance from the second area to the fourth area is equal to or less than the distance from the first area to the fourth area. Also, the distance from the second area to the fourth area is equal to or less than the distance from the second area to the fifth area. Similarly, the third area and the fifth area are located close to each other. Specifically, the distance from the third region to the fifth region is equal to or less than the distance from the first region to the fifth region, and the distance from the third region to the fifth region is equal to or less than the distance from the third region to the fourth region.

[0035] Moreover, the target image OP is located in a sixth region near the center of the entire image AP1. Specifically, the distance from the center position of the entire image AP1 to the sixth region is shorter than the distance from the center position of the entire image AP1 to the first region. Moreover, the distance from the center position of the entire image AP1 to the sixth region is shorter than the distance from the center position of the entire image AP1 to the second region. Moreover, the distance from the center position of the entire image AP1 to the sixth region is shorter than the distance from the center position of the entire image AP1 to the third region. Moreover, the distance from the center position of the entire image AP1 to the sixth region is shorter than the distance from the center position of the entire image AP1 to the fourth region. Moreover, the distance from the center position of the entire image AP1 to the sixth region is shorter than the distance from the center position of the entire image AP1 to the fifth region.

[0036] Furthermore, unit images UP[A], UP[0], and UP[0'] have the same gradation value, the "first gradation value." Meanwhile, unit image UP[k] has a "second gradation value" that is different from the "first gradation value." Moreover, unit image UP[k'] has a "third gradation value" that is different from both the "first gradation value" and the "second gradation value."

[0037] In FIG. 4, the output unit 113 outputs the target image OP and the entire image AP1 to the first projector 20-1. The output unit 113 also outputs the entire image AP2 to the second projector 20-2. Note that the output unit 113 outputting the target image OP and the entire image AP1 to the first projector 20-1 is an example of "displaying the target image OP and the entire image AP1 on a first display device." Similarly, the output unit 113 outputting the target image OP and the entire image AP2 to the second projector 20-2 is an example of "displaying the target image OP and the entire image AP2 on a second display device."

[0038] The first acquisition unit 114 acquires a captured image capturing a range including the entire image AP1 and the target image OP captured by the imaging device 30. The captured image acquired by the first acquisition unit 114 is an example of a "first captured image."

[0039] Here, the RGB values ​​of each pixel in the captured image captured by the imaging device 30 are expressed as (R camera ,G camera ,B camera ), the gradation values ​​r and g of each unit image UP constituting the entire image AP1 are calculated by the following formula: r=R camera / (R camera +G camera +B camera ) Formula (1) g=G camera / (R camera +G camera +B camera ) Formula (2) The RGB values ​​indicating chromaticity are an example of gradation values.

[0040] The second acquisition unit 115 acquires a gradation value obtained by correcting the gradation value of the unit image UP[k] based on the gradation value of the unit image UP[A] and the gradation value of the unit image UP[0] in the first captured image. The corrected gradation value is an example of the "fourth gradation value."

[0041] In the captured image, the gradation value r of the unit image UP[0] is r0, and the gradation value r of the unit image UP[A] is r A , the uncorrected gradation value r of the unit image UP[k] is r k , the fourth gradation value, which is the corrected gradation value r, is r k2 =r k +Δr k In this case, Δr k is expressed by the following formula: Δr k =r0-r A Formula (3) That is, the fourth gradation value r k2 will have the following value: r k2 =r k +Δr k =r k +r0-r A Formula (4)

[0042] Similarly, the gradation value g of the unit image UP[0] in the captured image is g0, and the gradation value g of the unit image UP[A] is g A , the gradation value g of the unit image UP[k] before correction is g k , the fourth gradation value g, which is the corrected gradation value g, is k2 =g k +Δg k In this case, Δg k is expressed by the following formula: Δg k =g0-g A Formula (5) That is, the fourth gradation value g k2 will have the following value: g k2 =g k +Δg k =g k +g0-g A Formula (6)

[0043] Note that formulas (3) to (6) are merely examples, and Δr k , r k2 , Δg k , g k2 The formula for calculating is not limited to these. In the captured image of the whole image AP1 exemplified in FIG. 5, the unit image adjacent to the left of the unit image UP[k] is set as unit image UP[0]. The unit image adjacent above the unit image UP[k] is set as unit image UP[1]. The unit image adjacent to the right of the unit image UP[k] is set as unit image UP[2]. The unit image adjacent below the unit image UP[k] is set as unit image UP[3]. The gradation value r of the unit image UP[0] is set as r0, and the gradation value g is set as g0. Similarly, the gradation value r of the unit image UP[1] is set as r1, and the gradation value g is set as g1. The gradation value r of the unit image UP[2] is set as r2, and the gradation value g is set as g2. The gradation value r of the unit image UP[3] is set as r3, and the gradation value g is set as g3. Here, the average value of r0, r1, r2, and r3 may be used instead of r0 in the formulas (3) and (4). Similarly, instead of g0 in equations (5) and (6), the average value of g0, g1, g2, and g3 may be used.

[0044] The gradation value r calculated by the formulas (4) and (6) is k2 , g k2 means the gradation value of the unit image UP[k] measured in the first captured image when the unit image UP[k] is displayed at the position of the unit image UP[A].

[0045] 4, the third acquisition unit 116 acquires a gradation value obtained by correcting the gradation value of the unit image UP[k'] based on the gradation value of the unit image UP[A] and the gradation value of the unit image UP[0'] in the first captured image. The corrected gradation value is an example of a "fifth gradation value." Note that the method of calculating the fifth gradation value acquired by the third acquisition unit 116 is similar to the method of calculating the fourth gradation value acquired by the second acquisition unit 115, and therefore a description thereof will be omitted.

[0046] The first calculation unit 117 calculates a gradation value difference Δrg1 which is the difference between the gradation value of the target image OP in the first captured image and the fourth gradation value. This gradation value difference is an example of a “first gradation value difference”.

[0047] The gradation value r of the target image OP in the first captured image is expressed as r target , the gradation value g is g target In this case, the first gradation value difference Δrg1 is calculated by the following formula.

number

[0048] The second calculation unit 118 calculates the gradation value difference Δrg2, which is the difference between the gradation value of the target image OP in the first captured image and the fifth gradation value. This gradation value difference is an example of a "second gradation value difference." Note that the method of calculating the second gradation value difference Δrg2 by the second calculation unit 118 is similar to the method of calculating the first gradation value difference Δrg1 by the first calculation unit 117, and therefore a description thereof will be omitted.

[0049] When the first gradation value difference Δrg1 is equal to or greater than the second gradation value difference Δrg2, the correction unit 119 corrects the display image by the first projector 20-1 by using, as a correction value, the difference between the gradation value of the target image OP in the entire image AP as the projection image and the third gradation value, which is the gradation value of the unit image UP[k'] that is the fifth unit image. This correction value is an example of a "first correction value." When the first gradation value difference Δrg1 is less than the second gradation value difference Δrg2, the correction unit 119 corrects the display image by the first projector 20-1 by using, as a correction value, the difference between the gradation value of the target image OP in the entire image AP as the projection image and the second gradation value, which is the gradation value of the unit image UP[k] that is the fourth unit image. This correction value is an example of a "second correction value."

[0050] For the sake of simplicity, in the above description, the correction unit 119 derives a correction value for correcting the image displayed by the first projector 20-1 by comparing only the gradation values ​​of two unit images UP, the unit image UP[k] which is the fourth unit image and the unit image UP[k'] which is the fifth unit image. However, in reality, the correction unit 119 performs the same calculation for all unit images UP constituting the entire image AP to find the unit image UP with the smallest Δrg. Then, the correction unit 119 finds the difference between the gradation value of the target image OP and the gradation value of the found unit image UP as the correction value.

[0051] Furthermore, the information processing device 10 may divide the gradation displayed by the first projector 20-1 into a plurality of levels using a plurality of thresholds, and then execute the above-mentioned correction process for each gradation level. The information processing device 10 may also perform a similar correction process for the second projector 20-2. These details will be described in the following description of the operation of the embodiment.

[0052] 1-4: Operation of the embodiment 6 and 7 are flowcharts showing an example of the operation of the information processing device 10. Hereinafter, the example of the operation of the information processing device 10 will be described with reference to FIGS.

[0053] In this operation example, the display gradation of the first projector 20-1 and the second projector 20-2 is divided into eight equal parts, and these gradation levels are indicated using numerical values ​​from 0 to 7. The information processing device 10 calculates a correction value for correcting the gradation values ​​of the first projector 20-1 and the second projector 20-2 for each of these gradation levels. When the display gradation is 10 bits, the relationship between the gradation level m and the display gradation t(m) is as follows: t(0)=0,t(1)=146,t(2)=292,t(3)=438,t(4)=584,t(5)=730,t(6)=876,t(7)=1023

[0054] In step S1, the processing device 110 included in the information processing device 10 functions as a detection unit 111. The processing device 110 detects the projection positions of the images projected by the first projector 20-1 and the second projector 20-2 onto a wall or a screen.

[0055] In step S2, the processing device 110 included in the information processing device 10 executes a first correction of the reference projector. Here, the "reference projector" refers to a projector used as a reference for correction when calculating a correction value of a "non-reference projector" described below. Note that, as an example, in this operation example, the first projector 20-1 in FIG. 1 and FIG. 2 is the "reference projector", and the second projector 20-2 is the "non-reference projector".

[0056] FIG. 7 is a flow chart showing the sub-steps that make up step S2.

[0057] In sub-step S21, the processing device 110 included in the information processing device 10 functions as a generating unit 112. The processing device 110 generates a target image OP and an entire image AP1. Here, the target image OP has white with n=7, which is the maximum gradation level of the first projector 20-1, as a target color to be corrected. Specifically, the RGB values ​​of the target image OP are (R PJ / G PJ / B PJ )=(t(7) / t(7) / t(7))=(1023 / 1023 / 1023). Moreover, the entire image AP1 has a unit image UP having a correction value calculation color that is the target of correction, and a unit image UP having a modified color of the shooting value used for correction in the captured image of the entire image AP1. In the example shown in FIG. 5, the unit image UP having the correction value calculation color is UP[k]. The correction value calculation color of the unit image UP[k] is a white color shifted by a predetermined amount from the white color of n=6. Specifically, the RGB value of the gradation value of the unit image UP[k] having the correction value calculation color is (R PJ / G PJ / B PJ )=(t(6)+d R / t(6)+d G / t(6)+d B )=(876+d R / 876+d G / 876+d B ) where d R , d G , and d B is the amount of shift in the gradation for each of R, G, and B, and is one of the values ​​in the range from -80 to 80 divided into 20 gradation steps. R , d G , and d B The unit images UP have a plurality of correction value calculation colors set using the above and below. On the other hand, the unit images UP having the correction color of the shooting value are the unit images UP[0] to UP[3] adjacent to UP[k] in the vertical and horizontal directions. The correction value calculation color of the unit images UP[0] to UP[3] is white, where n=6. Specifically, the RGB values ​​of the gradation values ​​of the unit images UP[0] to UP[3] are (R PJ / G PJ / B PJ )=(t(6) / t(6) / t(6))=(876 / 876 / 876).

[0058] In sub-step S22, the processing device 110 included in the information processing device 10 functions as the output unit 113. The processing device 110 outputs the target image OP and the entire image AP1 to the first projector 20-1.

[0059] In sub-step S23, the processing device 110 included in the information processing device 10 functions as a first acquisition unit 114. The processing device 110 acquires a captured image captured by the imaging device 30, the captured image being an area including the entire image AP1 and the target image OP. Furthermore, the processing device 110 acquires RGB values ​​of each pixel (R camera ,G camera ,B camera ) to get the

[0060] In sub-step S24, the processing device 110 included in the information processing device 10 functions as a second acquisition unit 115. The processing device 110 acquires a fourth gradation value obtained by correcting the gradation value of the unit image UP[k] based on the gradation value of the unit image UP[A] and the gradation values ​​of the unit images UP[0] to UP[3] in the captured image acquired in sub-step S23. In this operation example, the fourth gradation value is k2 =r k +Δr k In this case, Δr k is expressed by the following formula: Δr k =(r 0+ r 1+ r 2+ r 3) / 4-r A Formula (3') Similarly, Δg k is expressed by the following formula: Δg k =(g 0+ g 1+ g 2+ g 3) / 4-g A Formula (4')

[0061] In sub-step S25, the processing device 110 included in the information processing device 10 functions as a third acquisition unit 116. The processing device 110 acquires a fifth gradation value obtained by correcting the gradation value of the unit image UP[k'] based on the gradation value of the unit image UP[A] and the gradation values ​​of the unit images UP[0'] to UP[3'] in the captured image acquired in sub-step S23. Note that the unit images UP[0'] to UP[3'] are unit images UP adjacent to the unit image UP[k'] vertically and horizontally.

[0062] In sub-step S26, the processing device 110 included in the information processing device 10 functions as a first calculation unit 117. The processing device 110 calculates a first gradation value difference Δrg1 which is the difference between the gradation value of the target image OP in the captured image acquired in sub-step S23 and the fourth gradation value.

[0063] In sub-step S27, the processing device 110 included in the information processing device 10 functions as a second calculation unit 118. The processing device 110 calculates a second gradation value difference Δrg2 which is the difference between the gradation value of the target image OP in the captured image acquired in sub-step S23 and the fifth gradation value.

[0064] In sub-step S28, the processing device 110 included in the information processing device 10 functions as a correction unit 119. The processing device 110 compares the first gradation value difference Δrg1 with the second gradation value difference Δrg2. If the first gradation value difference Δrg1 is equal to or greater than the second gradation value difference Δrg2, the processing device 110 selects the second gradation value difference Δrg2. If the first gradation value difference Δrg1 is less than the second gradation value difference Δrg2, the processing device 110 selects the first gradation value difference Δrg1.

[0065] In sub-step S29, the processing device 110 of the information processing device 10 functions as the correction unit 119. As a result of the comparison of the first gradation value difference Δrg1 and the second gradation value difference Δrg2 being performed between all unit images in sub-step S28, min If derived (substep S29 / YES), the processing device 110 executes the process of substep S30. If the comparison between the first gradation value difference Δrg1 and the second gradation value difference Δrg2 in substep S28 has not been executed between all unit images (substep S29 / NO), the processing device 110 executes the process of substep S24.

[0066] In sub-step S30, the processing device 110 included in the information processing device 10 functions as a correction unit 119. The processing device 110 corrects the minimum gradation value difference Δrg min The shift amount (d R / d G / d B ) is the rough correction value (α R (6) / α G (6) / α B (6)).

[0067] In step S3 of FIG. 6, the processing device 110 in the information processing device 10 executes the second correction of the reference projector. The first correction is a rough correction value (α R (6) / α G (6) / α B On the other hand, the second correction in step S3 is a process for obtaining a rough correction value (α R (6) / α G (6) / α B (6)) to obtain a more precise final correction value (β R (6) / β G (6) / β B (6)) is derived.

[0068] Also in step S3, the processing device 110 executes operations similar to those in sub-steps S21 to S30 shown in Fig. 7. For simplicity of explanation, the following will explain only the processing in step S3 that differs from sub-steps S21 to S30 constituting step S2.

[0069] In sub-step S21, the processing device 110 generates a target image OP and an entire image AP1'. In the entire image AP1', the RGB values ​​of the gradation values ​​of the unit image UP[k] are (R PJ / G PJ / B PJ )=(t(6)+d R +α R (6) / t(6)+d G +α G (6) / t(6)+d B+ α B (6))=(876+d R +α R (6) / 876+d G +α G (6) / 876+d B+ α B (6)) where d R , d G , and d B are the amount of shift in the gradation for each of R, G, and B, and are values ​​in the range from -40 to -40 divided into 8 gradation steps.R , d G , and d B The image processing unit UP has a plurality of correction value calculation colors set using the above formula.

[0070] In other words, in step S2, if the first gradation value difference Δrg1 is equal to or greater than the second gradation value difference Δrg2, the processing device 110 sets the whole image AP1 corrected using the first correction value as a new whole image AP1'. On the other hand, in step S2, if the first gradation value difference Δrg1 is less than the second gradation value difference Δrg2, the processing device 110 sets the whole image AP1 corrected using the second correction value as a new whole image AP1'.

[0071] In sub-step S30, the processing device 110 included in the information processing device 10 functions as a correction unit 119. The processing device 110 corrects the minimum gradation value difference Δrg min The shift amount (d R +α R (6) / d G +α G (6) / d B +α B (6)) is the final correction value (β R (6) / β G (6) / β B (6)).

[0072] In the above description, the processing device 110 of the information processing device 10 calculates a final correction value (β R (6) / β G (6) / β B In the second loop, the processing device 110 of the information processing device 10 calculates a final correction value (β R (5) / β G (5) / βB Similarly, the processing device 110 of the information processing device 10 calculates a final correction value (β R (n) / β G (n) / β B Calculate (n).

[0073] In step S4 of FIG. 6, the processing device 110 corrects the gradation value of the unit image UP[k] having a color shifted from n=6 to n=1 using the unit images UP[0] to UP[3] having the corrected color, which is white, of n=6 to n=1, to obtain a final correction value (β R (n) / β G (n) / β B If the processing device 110 has already calculated the final correction value (β(n)) for six tones (YES in step S4), the processing device 110 executes the process in step S5. On the other hand, the processing device 110 uses the unit images UP[0] to UP[3] having the corrected color, which is white, from n=6 to n=1, to correct the tone value of the unit image UP[k] having a color shifted from the tone of n=6 to n=1, and calculates the final correction value (β R (n) / β G (n) / β B If (n)) has not yet been calculated (step S4 / NO), the processes of steps S2 and S3 are executed for the gradations for which the final correction values ​​have not yet been calculated.

[0074] In step S5, the processing device 110 in the information processing device 10 executes a first correction of the non-reference projector. Here, as described above, the second projector 20-2 is defined as the "non-reference projector."

[0075] Also in step S5, the processing device 110 executes operations similar to those of sub-steps S21 to S30 shown in Fig. 7. For the sake of simplicity, only the processing of step S5 that differs from sub-steps S21 to S30 constituting step S2 will be described below.

[0076] In sub-step S21, the processing device 110 generates a target image OP and an entire image AP2. Here, the target image OP has white, which is the maximum gradation level of the first projector 20-1, n=7, as a target color to be corrected. Specifically, the RGB values ​​of the gradation values ​​of the target image OP are (R PJ / G PJ / B PJ )=(t(7) / t(7) / t(7))=(1023 / 1023 / 1023). Moreover, the entire image AP2 has a unit image UP having a correction value calculation color, and a unit image UP having a corrected color of the shooting value in the captured image of the entire image AP1. In the example shown in FIG. 5, the unit image UP having the correction value calculation color is UP[k]. The correction value calculation color of the unit image UP[k] is a white color shifted by a predetermined amount from the white color of n=7. Specifically, the RGB value of the gradation value of the unit image UP[k] is (R PJ / G PJ / B PJ )=(t(7)+d R / t(7)+d G / t(7)+d B )=(1023+d R / 1023+d G / 1023+d B If the RGB values ​​of the unit image UP[k] exceed 1023, the RGB values ​​are fixed at 1023. where d R , d G , and d B are the amount of shift in the gradation for each of R, G, and B, and are values ​​between -80 and -80 divided into 20 gradation steps. R , d G , and d B The unit images UP have a plurality of correction value calculation colors set using the above and below. On the other hand, the unit images UP having the correction color of the shooting value are the unit images UP[0] to UP[3] adjacent to UP[k] in the vertical and horizontal directions. The correction value calculation color of the unit images UP[0] to UP[3] is white, where n=7. Specifically, the RGB values ​​of the gradation values ​​of the unit images UP[0] to UP[3] are (R PJ / GPJ / B PJ )=(t(7) / t(7) / t(7))=(1023 / 1023 / 1023).

[0077] In sub-step S22, the processing device 110 included in the information processing device 10 functions as the output unit 113. The processing device 110 outputs the target image OP to the first projector 20-1. The processing device 110 also outputs the whole image AP2 to the second projector 20-2.

[0078] In sub-step S23, the processing device 110 included in the information processing device 10 functions as a first acquisition unit 114. The processing device 110 acquires a captured image captured by the imaging device 30, the captured image being an area including the entire image AP2 and the target image OP. Furthermore, the processing device 110 acquires from the captured image the RGB values ​​of the gradation values ​​of each pixel (R camera ,G camera ,B camera ) to get the

[0079] In sub-step S30, the processing device 110 included in the information processing device 10 functions as a correction unit 119. The processing device 110 corrects the minimum gradation value difference Δrg min The shift amount (d R / d G / d B ) is the rough correction value (α R (7) / α G (7) / α B (7)).

[0080] In step S6 of FIG. 6, processing device 110 included in information processing device 10 executes a second correction of the non-reference projectors.

[0081] Also in step S6, the processing device 110 executes operations similar to those of sub-steps S21 to S30 shown in Fig. 7. For the sake of simplicity, only the differences between the processing of step S6 and sub-steps S21 to S30 constituting step S2 will be described below.

[0082] In sub-step S21, the processing device 110 generates a target image OP and an entire image AP2'. In the entire image AP2', the RGB values ​​of the gradation values ​​of the unit image UP[k] are (R PJ / G PJ / B PJ )=(t(7)+d R +α R (7) / t(7)+d G +α G (7) / t(7)+d B+ α B (7))=(1023+d R +α R (7) / 1023+d G +α G (7) / 1023+d B+ α B (7)) where d R , d G , and d B are the amount of shift in the gradation for each of R, G, and B, and are values ​​in the range from -40 to 40 divided into 8 gradation steps. R , d G , and d B In addition, when the RGB value of the unit image UP[k] exceeds 1023, the RGB value is fixed at 1023.

[0083] In sub-step S30, the processing device 110 included in the information processing device 10 functions as a correction unit 119. The processing device 110 corrects the minimum gradation value difference Δrg min The shift amount (d R +α R (7) / d G +α G (7) / dB +α B (7)) to the final correction value (β R (7) / β G (7) / β B (7)).

[0084] In the above description, the processing device 110 uses the unit images UP[0] to UP[3] having the corrected color, which is white for n=7, to calculate a final correction value (β R (n) / β G (n) / β B In the second loop, the processing device 110 calculates a final correction value (β R (6) / β G (6) / β B Similarly, the processing device 110 calculates a final correction value (β R (n) / β G (n) / β B Calculate (n).

[0085] In step S7 of FIG. 6, the processing device 110 corrects the gradation value of the unit image UP[k] having a color shifted from n=7 to n=1 using the unit images UP[0] to UP[3] having the corrected color, which is white, of n=7 to n=1, to obtain a final correction value (β R (n) / β G (n) / β B If the processing device 110 has already calculated the final correction value (β(n)) for seven tones (step S7 / YES), the processing device 110 executes the process of step S8. On the other hand, the processing device 110 uses the unit images UP[0] to UP[3] having the corrected color, which is white, from n=7 to n=1, to correct the tone value of the unit image UP[k] having a color shifted from the tone of n=7 to n=1, and calculates the final correction value (β R (n) / βG (n) / β B If (n)) has not yet been calculated (step S7 / NO), the processes of steps S5 and S6 are executed for the gradations for which the final correction values ​​have not yet been calculated.

[0086] In step S8, the processing device 110 included in the information processing device 10 functions as the correction unit 119. The processing device 110 calculates the final correction values ​​(β R (n) / β G (n) / β B (n) (n is an integer between 1 and 6) to the first projector 20-1. In addition, the processing device 110 writes the final correction values ​​(β R (n) / β G (n) / β B (n) (n is an integer between 1 and 7) is written to the second projector 20-2.

[0087] In the above description of the operation, the first projector 20-1 is the reference projector and the second projector 20-2 is the non-reference projector, but this is merely an example.

[0088] For example, of the first projector 20-1 and the second projector 20-2, the projector that displays an image with a color tone closest to the ideal value may be set as the reference projector.

[0089] Specifically, each of the first projector 20-1 and the second projector 20-2 displays a judgment image for judging the quality of the gradation value of the display image. The judgment image is, for example, a display image displayed in all white. Alternatively, the judgment image may be the above-mentioned target image OP. The imaging device 30 captures the judgment image displayed by the first projector 20-1. The captured judgment image is an example of a "third captured image". The imaging device 30 also captures the judgment image displayed by the second projector 20-2. The captured judgment image is an example of a "second captured image". The information processing device 10 acquires the gradation value r and the gradation value g of the second captured image and the gradation value r and the gradation value g of the third captured image. The information processing device 10 calculates the difference between the gradation value r and the gradation value g of the second captured image and a reference gradation value set in advance. The calculated gradation value difference is an example of a "fourth gradation value difference". Furthermore, the information processing device 10 calculates the difference between the gradation value r and the gradation value g of the third captured image and the reference gradation value. The calculated gradation value difference is an example of a "third gradation value difference." When the third gradation value difference is smaller than the fourth gradation value difference, the first projector 20-1, i.e., the "second display device," becomes the reference projector.

[0090] 2: Variations The present disclosure is not limited to the above-described embodiments. Specific modified embodiments are exemplified below.

[0091] 2-1: Variation 1 In the above embodiment, the display system 1 includes two projectors: the first projector 20-1 and the second projector 20-2. However, the display system 1 may include any number of projectors.

[0092] When the display system 1 includes three or more projectors, the information processing device 10 may calculate the average value of the gradation values ​​of the display images displayed by the three or more projectors, and set the projector that displays the display image with the gradation value closest to the average value as the reference projector.

[0093] For example, when the display system 1 includes three projectors, the first projector 20-1, the second projector 20-2, and the third projector 20-3 each display a judgment image for judging the quality of the gradation value of the display image. The third projector 20-3 is an example of a "third display device". Moreover, the judgment image is, for example, a display image displayed in all white. Alternatively, the judgment image may be the target image OP. The imaging device 30 captures the judgment image displayed by the first projector 20-1. The captured judgment image is an example of a "third captured image". Moreover, the imaging device 30 captures the judgment image displayed by the second projector 20-2. The captured judgment image is an example of a "second captured image". The imaging device 30 captures the judgment image displayed by the third projector 20-3. The captured judgment image is an example of a "fourth captured image". The information processing device 10 acquires the gradation value r and the gradation value g of the second captured image, the gradation value r and the gradation value g of the third captured image, and the gradation value r and the gradation value g of the fourth captured image. The information processing device 10 calculates the gradation value r that is the average value of the gradation value r of the second captured image, the gradation value r of the third captured image, and the gradation value r of the fourth captured image. Similarly, the information processing device 10 calculates the gradation value g that is the average value of the gradation value g of the second captured image, the gradation value g of the third captured image, and the gradation value g of the fourth captured image. In addition, the information processing device 10 calculates the difference between the gradation value r of the second captured image and the gradation value r that is the average value. Similarly, the information processing device 10 calculates the difference between the gradation value g of the second captured image and the gradation value g that is the average value. These calculated gradation value differences are an example of the "fourth gradation value difference". The information processing device 10 also calculates the difference between the gradation value r of the third captured image and the average gradation value r, and the difference between the gradation value g of the third captured image and the average gradation value g. These calculated gradation value differences are an example of a "third gradation value difference." The information processing device 10 also calculates the difference between the gradation value r of the fourth captured image and the average gradation value r, and the difference between the gradation value g of the fourth captured image and the average gradation value g. These calculated gradation value differences are an example of a "fifth gradation value difference."When the fourth grayscale value difference is smaller than both the third grayscale value difference and the fifth grayscale value difference, the first projector 20-1, that is, the "second display device", becomes the reference projector.

[0094] In this case, the information processing device 10 corrects the display image of the third projector 20-3 using the target image OP displayed on the first projector 20-1 and the whole image AP3 displayed on the third projector 20-3. The whole image AP3 displayed on the third projector 20-3 is an image similar to the whole image AP1 displayed on the first projector 20-1 and the whole image AP2 displayed on the second projector 20-2. The whole image AP3 is an example of a "third whole image."

[0095] Specifically, the entire image AP3 is composed of a plurality of unit images UP including a sixth unit image UP, a seventh unit image UP, an eighth unit image UP, a ninth unit image UP, and a tenth unit image UP. The sixth unit image UP is located in a sixth region and has a sixth gradation value. The seventh unit image UP is located in a seventh region and has a sixth gradation value. The eighth unit image UP is located in an eighth region and has a sixth gradation value. The ninth unit image UP is located in a ninth region and has a seventh gradation value different from the sixth gradation value. The tenth unit image UP is located in a tenth region and has an eighth gradation value different from each of the sixth gradation value and the seventh gradation value. The distance from the seventh region to the ninth region is equal to or less than the distance from the sixth region to the ninth region. The distance from the seventh region to the ninth region is equal to or less than the distance from the seventh region to the tenth region. The distance from the eighth region to the tenth region is equal to or less than the distance from the sixth region to the tenth region. The distance from the eighth region to the tenth region is equal to or less than the distance from the eighth region to the ninth region.

[0096] The information processing device 10 acquires a fifth captured image capturing a range including the entire image AP3 and the target image OP. The information processing device 10 also acquires a ninth gradation value obtained by correcting the gradation value of the ninth unit image UP in the fifth captured image based on the gradation value of the sixth unit image UP and the gradation value of the seventh unit image UP in the fifth captured image. The information processing device 10 also acquires a tenth gradation value obtained by correcting the gradation value of the tenth unit image UP in the fifth captured image based on the gradation value of the sixth unit image UP and the gradation value of the eighth unit image UP in the fifth captured image. The information processing device 10 also calculates a third gradation value difference, which is the difference between the gradation value of the target image OP in the fifth captured image and the ninth gradation value. The information processing device 10 also calculates a fourth gradation value difference, which is the difference between the gradation value of the target image OP and the tenth gradation value in the fifth captured image. Furthermore, if the third gradation value difference is equal to or greater than the fourth gradation value difference, the information processing device 10 corrects the display image displayed by the third display device using the third correction value. If the third gradation value difference is less than the fourth gradation value difference, the information processing device 10 corrects the display image displayed by the third display device using the fourth correction value.

[0097] Alternatively, if the display system 1 has three or more projectors, the information processing device 10 may set as the reference projector the projector that displays the display screen closest to the center among multiple display images displayed on a wall or screen by the three or more projectors.

[0098] For example, if the display system 1 has three projectors, and the display image displayed by the first projector 20-1 is between the display image displayed by the second projector 20-2 and the display image displayed by the third projector 20-3, the information processing device 10 may set the first projector 20-1 as the reference projector.

[0099] 2-2: Variation 2 In the above operation example, the processing device 110 included in the information processing device 10 performed the first correction and the second correction in the gradation of n=6 of the reference projector in the first loop. Next, the processing device 110 performed the first correction and the second correction in the gradation of n=5 of the reference projector in the second loop. Thereafter, the processing device 110 performed the first correction and the second correction in the gradation of n=7-p of the reference projector in the p-th loop (p is an integer between 3 and 6). However, the processing device 110 included in the information processing device 10 may simultaneously perform the first correction and the second correction in multiple gradations of the reference projector in parallel. Similarly, the processing device 110 included in the information processing device 10 may simultaneously perform the first correction and the second correction in multiple gradations of the non-reference projectors in parallel.

[0100] Furthermore, the processing device 110 included in the information processing device 10 may simultaneously execute the first and second corrections at any gradation of the reference projector and the first and second corrections at any gradation of the non-reference projectors in parallel.

[0101] 2-3: Variation 3 In the above embodiment, the processing device 110 included in the information processing device 10 corrected the RGB values ​​indicating the chromaticity at multiple gradations of the reference projector and the non-reference projectors. However, the processing device 110 may correct the brightness instead of the chromaticity. Alternatively, the processing device 110 may correct both the chromaticity and the brightness at the same time. Here, the brightness is an example of a gradation value.

[0102] In addition, when correcting the brightness, unlike the above embodiment, the processing device 110 sets the shift amounts for R, G, and B at the same gradation to the same value. R =d G =d B In addition, the processing device 110 uses the captured pixel value G camera Then, the unit image UP whose brightness is closest to the target value is searched for.

[0103] 2-4: Variation 4 In the above embodiment, d R , d G , and d B was set to a value in increments of 8 or 20. However, the change in the gradation value with respect to the change in gradation is not linear. For example, the change in the gradation value with respect to the change in one gradation is larger in a low gradation than in a high gradation. Therefore, in order to display gradation values ​​at equal intervals for each unit image UP, the information processing device 10 estimates the display gradation value based on the display characteristics of the projector, thereby R , d G , and d B may be determined.

[0104] 2-5: Variation 5 In the above embodiment, the information processing device 10, the first projector 20-1, and the imaging device 30 are separate from each other. However, two or more of these devices may be realized as a single device stored in the same housing. The same applies to the information processing device 10, the second projector 20-2, and the imaging device 30.

[0105] 3: Summary of this disclosure The following is a summary of this disclosure. (Note 1) A first unit image is located in a first region and has a first gradation value, a second unit image is located in a second region and has the first gradation value, a third unit image is located in a third region and has the first gradation value, a fourth unit image is located in a fourth region and has a second gradation value different from the first gradation value, and a fifth unit image is located in a fifth region and has a third gradation value different from the first gradation value and the second gradation value, and a distance from the second region to the fourth region is a first display device displays a first entire image, in which the distance from the second region to the fourth region is equal to or less than the distance from the second region to the fourth region, the distance from the third region to the fifth region is equal to or less than the distance from the first region to the fifth region, and the distance from the third region to the fifth region is equal to or less than the distance from the third region to the fourth region; and an image is captured of a range including the first entire image and a target image that is a target of gradation value correction. acquiring a first captured image; acquiring a fourth gradation value obtained by correcting a gradation value of a fourth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the second unit image in the first captured image; acquiring a fifth gradation value obtained by correcting a gradation value of a fifth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the third unit image in the first captured image; calculating a first gradation value difference which is a difference between the gradation value of the target image and the fourth gradation value; calculating a second gradation value difference which is a difference between the gradation value of the target image and the fifth gradation value in the first captured image; and correcting a display image displayed by the first display device using a first correction value when the first gradation value difference is equal to or greater than the second gradation value difference, and correcting a display image displayed by the first display device using a second correction value when the first gradation value difference is less than the second gradation value difference; A method for adjusting a displayed image, including:

[0106] The above-described display image adjustment method can shorten the adjustment time and improve user convenience compared to conventional techniques when correcting the screen color tone using an image captured of the projection screen in order to eliminate individual differences between projectors.

[0107] (Appendix 2) The method for adjusting a displayed image according to Appendix 1, characterized in that the target image is superimposed on the first overall image.

[0108] The above-described display image adjustment method allows a user to perform correction based on the display color of any position in the display image by using a target image within the entire image.

[0109] (Appendix 3) The method for adjusting a display image of Appendix 2, characterized in that the target image is located in a sixth area of ​​the first overall image, a distance from a center position of the first overall image to the sixth area is shorter than a distance from the center position to the first area, a distance from the center position of the first overall image to the sixth area is shorter than a distance from the center position to the second area, a distance from the center position of the first overall image to the sixth area is shorter than a distance from the center position to the third area, a distance from the center position of the first overall image to the sixth area is shorter than a distance from the center position to the fourth area, and a distance from the center position of the first overall image to the sixth area is shorter than a distance from the center position to the fifth area.

[0110] In an image displayed by a display device, the closer to the center of the screen, the less the color degradation of the displayed image tends to be. By using the above-described display image adjustment method to position the target image closer to the center than each area, the user can perform correction with higher accuracy.

[0111] (Appendix 4) The method for adjusting a displayed image according to Appendix 1, characterized in that a second display device displays a second whole image including the target image.

[0112] By using the above-described display image adjustment method and using a target image included in the image displayed by the second display device, the user can perform correction to match the image displayed by the second display device.

[0113] (Appendix 5) The method of adjusting a display image of Appendix 4, further comprising: acquiring a second captured image capturing an area displayed by the first display device, the second captured image capturing an area including a judgment image used to judge quality regarding the gradation value of the displayed image; and acquiring a third captured image capturing an area displayed by the second display device, the judgment image being included, wherein a third gradation value difference, which is the difference between a reference gradation value serving as a standard for the quality and the gradation value of the judgment image in the third captured image, is smaller than a fourth gradation value difference, which is the difference between the reference gradation value and the gradation value of the judgment image in the second captured image.

[0114] By using the above-described display image adjustment method, the user can achieve highly accurate correction by correcting the image to be displayed based on a target image displayed by a display device, which is an image close to the ideal value.

[0115] (Note 6) Acquiring a second captured image of an area including a judgment image used to judge quality related to a gradation value of a display image displayed by the first display device, acquiring a third captured image of an area including the judgment image displayed by the second display device, acquiring a fourth captured image of an area including the judgment image displayed by a third display device, and obtaining a gradation value of the judgment image in the second captured image, a gradation value of the judgment image in the third captured image, and a fourth captured image. a sixth unit image located in a sixth region and having a sixth gradation value, a seventh unit image located in a seventh region and having a sixth gradation value, and a seventh unit image located in a seventh region and having a sixth gradation value, wherein a third gradation value difference which is a difference between the average value and the gradation value of the determination image in the third captured image is smaller than a fourth gradation value difference which is a difference between the average value and the gradation value of the determination image in the second captured image, and the third gradation value difference is smaller than a fifth gradation value difference which is a difference between the average value and the gradation value of the determination image in the fourth captured image. a seventh unit image having the sixth gradation value, an eighth unit image located in an eighth region and having the sixth gradation value, a ninth unit image located in a ninth region and having a seventh gradation value different from the sixth gradation value, and a tenth unit image located in a tenth region and having an eighth gradation value different from each of the sixth gradation value and the seventh gradation value, and a tenth unit image located in a tenth region and having an eighth gradation value different from each of the sixth gradation value and the seventh gradation value, a third display device displays a third overall image, in which a distance from the eighth area to the tenth area is equal to or less than a distance from the sixth area to the tenth area, a distance from the eighth area to the tenth area is equal to or less than a distance from the eighth area to the ninth area, a distance from the eighth area to the tenth area is equal to or less than a distance from the eighth area to the ninth area, a fifth captured image is obtained by capturing an image of a range including the third overall image and the target image, and based on the gradation value of the sixth unit image and the gradation value of the seventh unit image in the fifth captured image,acquiring a ninth gradation value obtained by correcting the gradation value of the ninth unit image in the fifth captured image; acquiring a tenth gradation value obtained by correcting the gradation value of the tenth unit image in the fifth captured image based on the gradation value of the sixth unit image and the gradation value of the eighth unit image in the fifth captured image; calculating a third gradation value difference which is a difference between the gradation value of the target image and the ninth gradation value in the fifth captured image; 5. The display image adjustment method of claim 4, further comprising: calculating a fourth gradation value difference which is a difference between the gradation value of the target image and the tenth gradation value in the captured image of claim 5; and if the third gradation value difference is equal to or greater than the fourth gradation value difference, correcting the display image displayed by the third display device using the third correction value, and if the third gradation value difference is less than the fourth gradation value difference, correcting the display image displayed by the third display device using the fourth correction value.

[0116] By using the above-described display image adjustment method, the target image is displayed from the display device having the gradation value closest to the average among three or more display devices, allowing the user to set a target value that is easier for the other display devices to correct.

[0117] (Supplementary Note 7) The display image displayed by the second display device is located between the display image displayed by the first display device and the display image displayed by the third display device in the first direction, and includes a sixth unit image located in a sixth region and having a sixth gradation value, a seventh unit image located in a seventh region and having the sixth gradation value, an eighth unit image located in an eighth region and having the sixth gradation value, a ninth unit image located in a ninth region and having a seventh gradation value different from the sixth gradation value, and a tenth unit image located in a tenth region and having a seventh gradation value different from the sixth gradation value. a third whole image including a tenth unit image having an eighth gradation value different from each other, the distance from the seventh region to the ninth region being equal to or less than the distance from the sixth region to the ninth region, the distance from the seventh region to the ninth region being equal to or less than the distance from the seventh region to the tenth region, the distance from the eighth region to the tenth region being equal to or less than the distance from the sixth region to the tenth region, and the distance from the eighth region to the tenth region being equal to or less than the distance from the eighth region to the ninth region, acquiring a ninth gradation value obtained by correcting a gradation value of the ninth unit image in the fifth captured image based on a gradation value of the sixth unit image and a gradation value of the seventh unit image in the fifth captured image; and acquiring a tenth gradation value obtained by correcting a gradation value of the tenth unit image in the fifth captured image based on a gradation value of the sixth unit image and a gradation value of the eighth unit image in the fifth captured image. calculating a third gradation value difference which is a difference between the gradation value of the target image and the ninth gradation value in the fifth captured image; calculating a fourth gradation value difference which is a difference between the gradation value of the target image and the tenth gradation value in the fifth captured image; and correcting a display image displayed by the third display device using the third correction value if the third gradation value difference is equal to or greater than the fourth gradation value difference, and correcting a display image displayed by the third display device using the fourth correction value if the third gradation value difference is less than the fourth gradation value difference.The display image adjustment method of claim 4, further comprising:

[0118] By using the above-described display image adjustment method, the display image located at the center among three or more display images becomes the most noticeable, and the user can correct the surrounding images based on the most noticeable display image.

[0119] (Appendix 8) The display image adjustment method of any one of Appendices 1 to 7, further comprising: correcting the first overall image using the first correction value when the first gradation value difference is equal to or greater than the second gradation value difference; and correcting the first overall image using the second correction value when the first gradation value difference is less than the second gradation value difference.

[0120] By using the above-mentioned display image adjustment method, the user can determine the correction value to be used for actual correction from among any of the correction values ​​obtained based on the result of capturing one image. Therefore, the user can reduce the time required for shooting compared to the conventional technology that captures a large number of images. Furthermore, the user's convenience is improved.

[0121] (Note 9) A first unit image is located in a first region and has a first gradation value, a second unit image is located in a second region and has the first gradation value, a third unit image is located in a third region and has the first gradation value, a fourth unit image is located in a fourth region and has a second gradation value different from the first gradation value, and a fifth unit image is located in a fifth region and has a third gradation value different from each of the first gradation value and the second gradation value, and a distance from the second region to the fourth region is a first display device that displays a first entire image, the distance from the second region to the fourth region being equal to or less than a distance from the second region to the fifth region, the distance from the third region to the fifth region being equal to or less than a distance from the first region to the fifth region, and the distance from the third region to the fifth region being equal to or less than a distance from the third region to the fourth region; an imaging device that generates a first captured image capturing an area including the first entire image and a target image that is a target for gradation value correction; acquiring a fourth gradation value obtained by correcting the gradation value of the fourth unit image in the first captured image based on the gradation value of the first unit image and the gradation value of the second unit image in the first captured image; acquiring a fifth gradation value obtained by correcting the gradation value of the fifth unit image in the first captured image based on the gradation value of the first unit image and the gradation value of the third unit image in the first captured image; acquiring a fifth gradation value obtained by correcting the gradation value of the fifth unit image in the first captured image based on the gradation value of the first unit image and the gradation value of the third unit image in the first captured image; and an information processing device that executes the following operations: calculates a first gradation value difference which is a difference between the gradation value of the target image and the fifth gradation value in the first captured image; calculates a second gradation value difference which is a difference between the gradation value of the target image and the fifth gradation value in the first captured image; and corrects a display image displayed by the first display device using a first correction value if the first gradation value difference is equal to or greater than the second gradation value difference, and corrects the display image displayed by the first display device using the second correction value if the first gradation value difference is less than the second gradation value difference.

[0122] With the above-described display system, when correcting the color tone of the screen using an image captured of the projection screen in order to eliminate individual differences between projectors, the adjustment time can be shortened compared to conventional techniques, improving user convenience.

[0123] (Note 10) A first unit image located in a first region and having a first gradation value, a second unit image located in a second region and having the first gradation value, a third unit image located in a third region and having the first gradation value, a fourth unit image located in a fourth region and having a second gradation value different from the first gradation value, and a fifth unit image located in a fifth region and having a third gradation value different from each of the first gradation value and the second gradation value, wherein a distance from the second region to the fourth region is equal to or less than a distance from the first region to the fourth region. a first display device that displays a first entire image, in which a distance from the second region to the fourth region is equal to or less than a distance from the second region to the fifth region, a distance from the third region to the fifth region is equal to or less than a distance from the first region to the fifth region, and a distance from the third region to the fifth region is equal to or less than a distance from the third region to the fourth region; a second display device that displays a target image that is a target for correction of gradation values; and an imaging device that generates a first captured image by capturing an image of a range including the first entire image and the target image. acquiring the first captured image; acquiring a fourth gradation value obtained by correcting a gradation value of the fourth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the second unit image in the first captured image; acquiring a fifth gradation value obtained by correcting a gradation value of the fifth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the third unit image in the first captured image; acquiring a fifth gradation value obtained by correcting a gradation value of the fifth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the third unit image in the first captured image; and an information processing device that executes the following operations: calculates a first gradation value difference which is a difference between the gradation value of the target image and the fifth gradation value in the first captured image; calculates a second gradation value difference which is a difference between the gradation value of the target image and the fifth gradation value in the first captured image; and corrects a display image displayed by the first display device using a first correction value if the first gradation value difference is equal to or greater than the second gradation value difference, and corrects the display image displayed by the first display device using the second correction value if the first gradation value difference is less than the second gradation value difference.

[0124] With the above-described display system, when correcting the color tone of the screen using an image captured of the projection screen in order to eliminate individual differences between projectors, the adjustment time can be shortened compared to conventional techniques, improving user convenience.

[0125] (Note 11) A first unit image located in a first region and having a first gradation value, a second unit image located in a second region and having the first gradation value, a third unit image located in a third region and having the first gradation value, a fourth unit image located in a fourth region and having a second gradation value different from the first gradation value, and a fifth unit image located in a fifth region and having a third gradation value different from each of the first gradation value and the second gradation value, and a distance from the second region to the fourth region is greater than or equal to 100 mm from the first region to the fourth region. a first overall image, the second area being below the fourth area, the distance from the second area to the fourth area being equal to or less than that from the second area to the fifth area, the distance from the third area to the fifth area being equal to or less than that from the first area to the fifth area, and the distance from the third area to the fifth area being equal to or less than that from the third area to the fifth area; acquiring a first captured image captured by an imaging device of a range including the first overall image and a target image that is a target for correction of gradation values; and acquiring the first captured image. acquiring a fourth gradation value obtained by correcting a gradation value of the fourth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the second unit image in the first captured image; acquiring a fifth gradation value obtained by correcting a gradation value of the fifth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the third unit image in the first captured image; acquiring a fifth gradation value obtained by correcting a gradation value of the fifth unit image in the first captured image based on a gradation value of the first unit image and a gradation value of the third unit image in the first captured image; calculating a first gradation value difference which is a difference between the gradation value of the target image and the fifth gradation value in the first captured image; calculating a second gradation value difference which is a difference between the gradation value of the target image and the fifth gradation value in the first captured image; and correcting a display image displayed by the first display device using a first correction value if the first gradation value difference is equal to or greater than the second gradation value difference, and correcting the display image displayed by the first display device using the second correction value if the first gradation value difference is less than the second gradation value difference.

[0126] By using the above-mentioned information processing program, when correcting the color tone of a screen using an image captured of the projection screen in order to eliminate individual differences between projectors, the adjustment time can be shortened compared to conventional techniques, improving user convenience. [Explanation of symbols]

[0127] 1...display system, 10...information processing device, 20...projector, 30...imaging device, 110...processing device, 111...detection unit, 112...generation unit, 113...output unit, 114...first acquisition unit, 115...second acquisition unit, 116...third acquisition unit, 117...first calculation unit, 118...second calculation unit, 119...correction unit, 120...storage device, 130...display device, 140...communication device, 210...projection device, 220...processing device, 221...acquisition unit, 222...projection control unit, 230...storage device, 240...communication device, AP1, AP2, AP3...whole image, PR1, PR2...control program

Claims

1. a first unit image located in a first region and having a first gradation value; a second unit image located in a second region and having the first gradation value; a third unit image located in a third region and having the first gradation value; a fourth unit image located in a fourth region and having a second gradation value different from the first gradation value; and a fifth unit image located in a fifth region and having a third gray scale value different from the first gray scale value and the second gray scale value; a distance from the second region to the fourth region is equal to or less than a distance from the first region to the fourth region; a distance from the second region to the fourth region is equal to or less than a distance from the second region to the fifth region; a distance from the third region to the fifth region is equal to or less than a distance from the first region to the fifth region; The distance from the third region to the fifth region is equal to or less than the distance from the third region to the fourth region. displaying the first overall image on a first display device; acquiring a first captured image obtained by capturing an area including the first overall image and a target image that is a target for gradation value correction; acquiring a fourth gradation value obtained by correcting the gradation value of the fourth unit image in the first captured image based on the gradation value of the first unit image and the gradation value of the second unit image in the first captured image; acquiring a fifth gradation value obtained by correcting the gradation value of the fifth unit image in the first captured image based on the gradation value of the first unit image and the gradation value of the third unit image in the first captured image; calculating a first gradation value difference that is a difference between the gradation value of the target image and the fourth gradation value in the first captured image; calculating a second gradation value difference, which is a difference between the gradation value of the target image and the fifth gradation value in the first captured image; correcting a display image displayed by the first display device using a first correction value when the first gradation value difference is equal to or greater than the second gradation value difference, and correcting a display image displayed by the first display device using a second correction value when the first gradation value difference is less than the second gradation value difference; A method for adjusting a displayed image, including:

2. The target image is superimposed on the first overall image.

2. The display image adjusting method according to claim 1, wherein:

3. the target image is located in a sixth region of the first overall image; a distance from a center position of the first entire image to the sixth region is shorter than a distance from the center position to the first region; a distance from a center position of the first entire image to the sixth region is shorter than a distance from the center position to the second region; a distance from a center position of the first entire image to the sixth region is shorter than a distance from the center position to the third region; a distance from a center position of the first entire image to the sixth region is shorter than a distance from the center position to the fourth region; The distance from the center position of the first whole image to the sixth region is shorter than the distance from the center position to the fifth region.

3. The display image adjusting method according to claim 2, wherein:

4. A second display device displays a second overall image including the target image.

2. The display image adjusting method according to claim 1, wherein:

5. acquiring a second captured image of an area including a determination image used to determine the quality of the gradation value of the display image, which is displayed by the first display device; acquiring a third captured image of an area including the determination image displayed by the second display device, A third gradation value difference, which is the difference between a reference gradation value serving as a quality standard and a gradation value of the determination image in the third captured image, is smaller than a fourth gradation value difference, which is the difference between the reference gradation value and a gradation value of the determination image in the second captured image.

5. The display image adjusting method according to claim 4.

6. acquiring a second captured image of an area including a determination image used to determine the quality of the gradation value of the display image, which is displayed by the first display device; acquiring a third captured image of an area including the determination image displayed by the second display device; acquiring a fourth captured image of an area including the determination image displayed by a third display device; obtaining an average value of a gradation value of the determination image in the second captured image, a gradation value of the determination image in the third captured image, and a gradation value of the determination image in the fourth captured image, a third gradation value difference, which is a difference between the average value and the gradation value of the determination image in the third captured image, is smaller than a fourth gradation value difference, which is a difference between the average value and the gradation value of the determination image in the second captured image; the third gradation value difference is smaller than a fifth gradation value difference which is a difference between the average value and the gradation value of the determination image in the fourth captured image, a sixth unit image located in a sixth region and having a sixth gradation value; a seventh unit image located in a seventh region and having the sixth gradation value; an eighth unit image located in an eighth region and having the sixth gradation value; a ninth unit image located in a ninth region and having a seventh gradation value different from the sixth gradation value; and a tenth unit image located in a tenth region and having an eighth gray scale value different from each of the sixth gray scale value and the seventh gray scale value; a distance from the seventh region to the ninth region is equal to or less than a distance from the sixth region to the ninth region; a distance from the seventh region to the ninth region is equal to or less than a distance from the seventh region to the tenth region; a distance from the eighth region to the tenth region is equal to or less than a distance from the sixth region to the tenth region; The distance from the eighth region to the tenth region is equal to or less than the distance from the eighth region to the ninth region. displaying a third overall image on the third display device; acquiring a fifth captured image capturing an area including the third overall image and the target image; acquiring a ninth gradation value obtained by correcting the gradation value of the ninth unit image in the fifth captured image based on the gradation value of the sixth unit image and the gradation value of the seventh unit image in the fifth captured image; acquiring a tenth gradation value obtained by correcting the gradation value of the tenth unit image in the fifth captured image based on the gradation value of the sixth unit image and the gradation value of the eighth unit image in the fifth captured image; calculating a third gradation value difference, which is a difference between the gradation value of the target image and the ninth gradation value in the fifth captured image; Calculating a fourth gradation value difference, which is a difference between the gradation value of the target image and the tenth gradation value in the fifth captured image; correcting a display image displayed by the third display device using a third correction value when the third gradation value difference is equal to or greater than the fourth gradation value difference, and correcting a display image displayed by the third display device using a fourth correction value when the third gradation value difference is less than the fourth gradation value difference.

5. The display image adjusting method according to claim 4.

7. A sixth unit image located in a sixth region and having a sixth gradation value; a seventh unit image located in a seventh region and having the sixth gradation value; an eighth unit image located in an eighth region and having the sixth gradation value; a ninth unit image located in a ninth region and having a seventh gradation value different from the sixth gradation value; and a tenth unit image located in a tenth region and having an eighth gray scale value different from each of the sixth gray scale value and the seventh gray scale value; a distance from the seventh region to the ninth region is equal to or less than a distance from the sixth region to the ninth region; a distance from the seventh region to the ninth region is equal to or less than a distance from the seventh region to the tenth region; a distance from the eighth region to the tenth region is equal to or less than a distance from the sixth region to the tenth region; The distance from the eighth region to the tenth region is equal to or less than the distance from the eighth region to the ninth region. displaying a third overall image on the third display device; acquiring a fifth captured image capturing an area including the third overall image and the target image; acquiring a ninth gradation value obtained by correcting the gradation value of the ninth unit image in the fifth captured image based on the gradation value of the sixth unit image and the gradation value of the seventh unit image in the fifth captured image; acquiring a tenth gradation value obtained by correcting the gradation value of the tenth unit image in the fifth captured image based on the gradation value of the sixth unit image and the gradation value of the eighth unit image in the fifth captured image; calculating a third gradation value difference, which is a difference between the gradation value of the target image and the ninth gradation value in the fifth captured image; Calculating a fourth gradation value difference, which is a difference between the gradation value of the target image and the tenth gradation value in the fifth captured image; If the third gradation value difference is equal to or greater than the fourth gradation value difference, correcting a display image displayed by the third display device using a third correction value, and if the third gradation value difference is less than the fourth gradation value difference, correcting a display image displayed by the third display device using a fourth correction value, a display image displayed by the second display device is located between a display image displayed by the first display device and a display image displayed by a third display device in a first direction; 5. The display image adjusting method according to claim 4.

8. correcting the first overall image using the first correction value when the first gradation value difference is equal to or greater than the second gradation value difference; correcting the first overall image using the second correction value when the first gradation value difference is less than the second gradation value difference; The method of adjusting a displayed image according to claim 1 , further comprising:

9. a first unit image located in a first region and having a first gradation value; a second unit image located in a second region and having the first gradation value; a third unit image located in a third region and having the first gradation value; a fourth unit image located in a fourth region and having a second gradation value different from the first gradation value; and a fifth unit image located in a fifth region and having a third gradation value different from each of the first gradation value and the second gradation value; a distance from the second region to the fourth region is equal to or less than a distance from the first region to the fourth region; a distance from the second region to the fourth region is equal to or less than a distance from the second region to the fifth region; a distance from the third region to the fifth region is equal to or less than a distance from the first region to the fifth region; The distance from the third region to the fifth region is equal to or less than the distance from the third region to the fourth region. a first display device that displays a first overall image; an imaging device that generates a first captured image by capturing an area including the first overall image and a target image that is a target for gradation value correction; acquiring the first captured image; acquiring a fourth gradation value obtained by correcting the gradation value of the fourth unit image in the first captured image based on the gradation value of the first unit image and the gradation value of the second unit image in the first captured image; acquiring a fifth gradation value obtained by correcting the gradation value of the fifth unit image in the first captured image based on the gradation value of the first unit image and the gradation value of the third unit image in the first captured image; calculating a first gradation value difference that is a difference between the gradation value of the target image and the fourth gradation value in the first captured image; calculating a second gradation value difference, which is a difference between the gradation value of the target image and the fifth gradation value in the first captured image; an information processing device that corrects a display image displayed by the first display device using a first correction value when the first gradation value difference is equal to or greater than the second gradation value difference, and corrects a display image displayed by the first display device using a second correction value when the first gradation value difference is less than the second gradation value difference; A display system comprising:

10. a first unit image located in a first region and having a first gradation value; a second unit image located in a second region and having the first gradation value; a third unit image located in a third region and having the first gradation value; a fourth unit image located in a fourth region and having a second gradation value different from the first gradation value; a fifth unit image located in a fifth region and having a third gradation value different from each of the first gradation value and the second gradation value; a distance from the second region to the fourth region is equal to or less than a distance from the first region to the fourth region; a distance from the second region to the fourth region is equal to or less than a distance from the second region to the fifth region; a distance from the third region to the fifth region is equal to or less than a distance from the first region to the fifth region; The distance from the third region to the fifth region is equal to or less than the distance from the third region to the fourth region. a first display device that displays a first overall image; a second display device that displays a target image that is a target for correction of gradation values; an imaging device that generates a first captured image by capturing an area including the first overall image and the target image; acquiring the first captured image; acquiring a fourth gradation value obtained by correcting the gradation value of the fourth unit image in the first captured image based on the gradation value of the first unit image and the gradation value of the second unit image in the first captured image; acquiring a fifth gradation value obtained by correcting the gradation value of the fifth unit image in the first captured image based on the gradation value of the first unit image and the gradation value of the third unit image in the first captured image; calculating a first gradation value difference that is a difference between the gradation value of the target image and the fourth gradation value in the first captured image; calculating a second gradation value difference, which is a difference between the gradation value of the target image and the fifth gradation value in the first captured image; an information processing device that corrects a display image displayed by the first display device using a first correction value when the first gradation value difference is equal to or greater than the second gradation value difference, and corrects a display image displayed by the first display device using a second correction value when the first gradation value difference is less than the second gradation value difference; A display system comprising:

11. a first unit image located in a first region and having a first gradation value; a second unit image located in a second region and having the first gradation value; a third unit image located in a third region and having the first gradation value; a fourth unit image located in a fourth region and having a second gradation value different from the first gradation value; and a fifth unit image located in a fifth region and having a third gradation value different from each of the first gradation value and the second gradation value; a distance from the second region to the fourth region is equal to or less than a distance from the first region to the fourth region; a distance from the second region to the fourth region is equal to or less than a distance from the second region to the fifth region; a distance from the third region to the fifth region is equal to or less than a distance from the first region to the fifth region; The distance from the third region to the fifth region is equal to or less than the distance from the third region to the fourth region. Displaying the first overall image on a first display device; acquiring a first captured image obtained by capturing an image of a range including the first overall image and a target image that is a target for gradation value correction by an imaging device; acquiring the first captured image; acquiring a fourth gradation value obtained by correcting the gradation value of the fourth unit image in the first captured image based on the gradation value of the first unit image and the gradation value of the second unit image in the first captured image; acquiring a fifth gradation value obtained by correcting the gradation value of the fifth unit image in the first captured image based on the gradation value of the first unit image and the gradation value of the third unit image in the first captured image; calculating a first gradation value difference that is a difference between the gradation value of the target image and the fourth gradation value in the first captured image; calculating a second gradation value difference, which is a difference between the gradation value of the target image and the fifth gradation value in the first captured image; correcting a display image displayed by the first display device using a first correction value when the first gradation value difference is equal to or greater than the second gradation value difference, and correcting a display image displayed by the first display device using a second correction value when the first gradation value difference is less than the second gradation value difference; An information processing program that causes a computer to execute the following.

Images