Information processing system, adjustment method, and program

Abstract

The present disclosure pertains to an information processing system, an adjustment method, and a program that make it possible to display an image having a higher resolution. A contrast measurement unit: measures the brightness of a bonding area including boundaries between mutually adjacent LED modules and the brightness of a background area outside the bonding area in an LED display device based on an image obtained by imaging the LED display device including a plurality of LED modules arranged in a tiled form; and measuring the contrast of the bonding region with respect to the background region. A joint correction value calculation unit calculates a joint correction value for adjusting the brightness at the boundary between the LED modules based on the contrast measurement result. The present technology can be applied, for example, to large-scale direct-view and flat-paving displays using LEDs.

Description

Technical Field

[0001] The present disclosure relates to an information processing system, an adjustment method, and a program, and more particularly to an information processing system, an adjustment method, and a program capable of displaying higher quality images. Background Art

[0002] In recent years, the market for direct-view type and tiled type large displays using light-emitting diodes (LEDs) has expanded, and installation of large LED displays has progressed for the purpose of more faithful image representation. For example, in the movie industry, etc., large LED displays in which a plurality of LED modules are arranged in a tiled form are increasingly used as backgrounds in virtual studios.

[0003] For example, Patent Document 1 discloses a driving device capable of suppressing the occurrence of band-like brightness unevenness in an image obtained by imaging in the case where an LED display is imaged by a camera.

[0004] Reference List

[0005] Patent Literature

[0006] Patent document 1: WO 2018 / 164105 A Summary of the invention

[0007] Problems to be solved by the present invention

[0008] By the way, in the tiled large-scale LED display as described above, by performing adjustment work for making the joints between the LED modules inconspicuous and adjustment work for achieving uniformity of the entire image, it is possible to display a high-quality image. However, in the past, since the adjustment work was performed by the operator visually or manually while changing the brightness one by one between the LED modules, not only the operation time becomes longer, but also the final work varies depending on the proficiency of the operator. Therefore, by automating these adjustment operations, it is necessary to be able to display a high-quality image in a shorter time while avoiding variations in completion between workers.

[0009] The present disclosure has been made in view of such circumstances, and an object thereof is to display higher quality images.

[0010] Solution to the problem

[0011] According to one aspect of the present disclosure, an information processing system includes: a contrast measurement unit that measures the brightness of a joint area in an LED display device and a background area outside the joint area based on an image obtained by imaging an LED display device in which a plurality of LED modules are arranged in a tiled form, wherein the joint area includes a boundary between mutually adjacent LED modules, and measures the contrast of the joint area relative to the background area; and a joint correction value calculation unit that calculates a joint correction value for adjusting the brightness of the boundary of the LED module based on the above-mentioned contrast measurement result.

[0012] In an adjustment method according to one aspect of the present disclosure, an information processing system performs processing, which includes: measuring, based on an image obtained by imaging an LED display device in which a plurality of LED modules are arranged in a tiled form; the brightness of a joining area in the LED display device and a background area outside the joining area, wherein the joining area includes a boundary between LED modules adjacent to each other, and measuring the contrast of the joining area relative to the background area; and calculating a joining correction value for adjusting the brightness at the boundary between the LED modules based on the measurement result of the contrast.

[0013] A program according to one aspect of the present disclosure allows a computer of an information processing system to perform processing, including: measuring the brightness of a joining area in an LED display device and a background area outside the joining area based on an image obtained by imaging an LED display device configured with a plurality of LED modules arranged in a tiled form, the joining area including a boundary between mutually adjacent LED modules, and measuring the contrast of the joining area relative to the background area; and calculating a joining correction value for adjusting the brightness at the boundary between the LED modules based on the contrast measurement result.

[0014] In one aspect of the present disclosure, based on an image obtained by imaging an LED display device in which a plurality of LED modules are arranged in a tiled form, the brightness of a joining area including boundaries between adjacent LED modules in the LED display device and a background area outside the joining area is measured, and the contrast of the joining area relative to the background area is measured, and a joining correction value for adjusting the brightness at the boundaries between the LED modules is calculated based on the contrast measurement result. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a diagram showing a configuration example of one embodiment of a display system to which the present technology is applied.

[0016] Figure 2 is a block diagram showing a configuration example of an LED display adjustment processing unit.

[0017] Figure 3 is a diagram showing an adjustment target range and measurement marks.

[0018] Figure 4 The figure shows a display example of the camera positioning processing screen.

[0019] Figure 5 is a diagram showing an external light removal process.

[0020] Figure 6 This is a diagram showing the fact that a joint is obvious in an LED display device.

[0021] Figure 7 It is a diagram showing detection of joining coordinates.

[0022] Figure 8 is a diagram showing detection of a measurement area.

[0023] Fig. 9 : is a figure which shows the joint area and the background area in a measurement area.

[0024] Fig.10 is a graph showing a signal level at which the contrast is zero.

[0025] Fig.11 The figure shows an example of the display of the joint adjustment processing screen in the NG state.

[0026] Fig.12 It is a diagram showing a display example of the bonding adjustment processing screen in the OK state.

[0027] Fig.13 is a flow chart showing the engagement adjustment process.

[0028] Fig.14 is a diagram showing the arrangement of measurement marks.

[0029] Fig.15 It is a diagram showing a first display example of the uniformity adjustment processing screen in an NG state.

[0030] Fig.16 : is a diagram showing a first display example of the uniformity adjustment processing screen in the OK state.

[0031] Fig.17 It is a diagram showing a second display example of the uniformity adjustment processing screen in the NG state.

[0032] Fig.18 2 is a diagram showing a second display example of the uniformity adjustment processing screen in the OK state.

[0033] Fig.19 is a flowchart showing the uniformity adjustment process.

[0034] Fig. 20 A diagram showing a posture estimation method for estimating the posture of a camera.

[0035] Fig.21 2 is a diagram showing an external light reflection removal process.

[0036] Fig. 22 is a diagram showing changes in the illuminance of external light reflected in the LED display device.

[0037] Fig.23 is a diagram showing overlapping imaging.

[0038] Fig.24 The figure shows the brightness step difference occurring at the boundary with the cabinet.

[0039] Fig.25 1 is a diagram showing a uniformity adjustment process for an adjusted adjustment target range that is executed with the adjusted adjustment target range as a reference.

[0040] Fig.26 is a diagram showing an LED calibration table.

[0041] Fig. 27 This is a diagram showing curve information of a circular LED display device.

[0042] Fig.28 is a diagram showing the positioning of the camera relative to the circular shape.

[0043] Fig.29 It is a diagram showing the uniformity adjustment process of a circle.

[0044] Fig.30 is a diagram showing viewpoint modes.

[0045] Fig.31 is a block diagram showing a configuration example of one embodiment of a computer to which the present technology is applied. DETAILED DESCRIPTION

[0046] Hereinafter, specific embodiments to which the present technology is applied will be described in detail with reference to the accompanying drawings.

[0047] <Display system configuration example>

[0048] Figure 1 is a diagram showing a configuration example of one embodiment of a display system to which the present technology is applied.

[0049] like Figure 1 As shown, the display system 11 includes an LED display device 12 , a camera 13 , an information processing device 14 and a display controller 15 .

[0050] The LED display device 12 is configured by arranging a plurality of LED modules 21 in a tiled form, and the LED modules 21 can display images up to the edge of the surface. Therefore, the LED display device 12 can display images without physical junctions at the boundaries between the LED modules 21 on the entire LED display device 12 by installing adjacent LED modules 21 without gaps therebetween.

[0051] Here, in the display system 11, as will be described later with reference to Figure 6 As described above, the joint is sometimes noticeable due to high brightness or low brightness at the boundary between the LED modules 21. Therefore, in the display system 11, a process of adjusting the brightness (hereinafter, referred to as a joint adjustment process) is performed to avoid noticeable joints of the LED display device 12. In addition, in the display system 11, a process of adjusting the brightness (hereinafter, referred to as a uniformity adjustment process) is performed so that an image with uniformity is displayed as the entire LED display device 12.

[0052] The camera 13 is installed in front of the LED display device 12 , and images the LED display device 12 under the control of the information processing device 14 when performing the joint adjustment process and the uniformity adjustment process.

[0053] For example, the information processing device 14 may use a personal computer and execute adjustment software for performing a joint adjustment process and a uniformity adjustment process on the LED display device 12 using an image of the LED display device 12 imaged by the camera 13. Then, the information processing device 14 outputs various instructions, commands, setting values, etc. to the display controller 15. Note that the information processing device 14 may also serve a personal computer that executes control software for controlling the display controller 15, or a personal computer for executing the control software may be prepared in addition to the information processing device 14.

[0054] For example, the display controller 15 divides the video signal in units of frames provided from a video server not shown according to the positions of the plurality of LED modules 21 included in the LED display device 12, and performs light emission control for each LED module 21. In addition, for example, the display controller 15 performs the measurement area 26 ( Figure 8 )、Mark 29( Fig.14 ) and the like, and provides the setting value and the like to the LED display device 12. Note that the display controller 15 may be incorporated into (integrated with) the LED display device 12 to form the display system 11.

[0055] The display system 11 is configured as described above, and workers who perform these tasks can perform joint adjustment processing and uniformity adjustment processing when installing the LED display device 12 or maintaining and replacing the LED module 21. Therefore, the display system 11 can display higher quality images on the LED display device 12.

[0056] Figure 2 2 is a block diagram showing a configuration example of the information processing device 14 .

[0057] like Figure 2 As shown, the information processing device 14 includes a display control unit 31 , a camera control unit 32 , a screen display control unit 33 , and an LED display adjustment processing unit 34 .

[0058] The display control unit 31 may perform control related to the display of the LED display device 12 according to an instruction from the LED display adjustment processing unit 34 .

[0059] The camera control unit 32 controls imaging of the camera 13 according to an instruction from the LED display adjustment processing unit 34 , acquires an image of the LED display device 12 imaged by the camera 13 , and supplies it to the LED display adjustment processing unit 34 .

[0060] The screen display control unit 33 controls the screen display on the display unit of the information processing device 14 according to the instruction from the LED display adjustment processing unit 34. For example, the screen display control unit 33 controls the screen display described later. Figure 4 The camera positioning processing screen 71 shown in FIG. Fig.11 and Fig.12 The joining adjustment processing screen 81 shown in FIG. Figures 15 to 18 The uniformity adjustment processing screen 91 shown in FIG.

[0061] The LED display adjustment processing unit 34 includes a camera positioning processing unit 41 , an external light removal processing unit 42 , a joint adjustment processing unit 43 , and a uniformity adjustment processing unit 44 .

[0062] The camera positioning processing unit 41 performs camera positioning processing so as to accurately install the camera 13 in a position in front of the LED display device 12 and at the center of the adjustment target range 22 ( Figure 3 ).

[0063] The external light removal processing unit 42 performs external light removal processing for removing the influence of external light when the LED display device 12 is imaged by the camera 13 .

[0064] The joint adjustment processing unit 43 performs joint adjustment processing based on an image obtained by imaging the LED display device 12 , and includes a joint coordinate detection unit 51 , a measurement area detection unit 52 , a contrast measurement unit 53 , a joint correction value calculation unit 54 , and a joint correction value setting unit 55 .

[0065] In the joining adjustment process, the joining coordinate detection unit 51 detects the joining coordinates on an image obtained by imaging the LED display device 12 by the camera 13 .

[0066] In the joint adjustment process, the measurement area detection unit 52 detects the measurement area 26 ( Figure 8 ).

[0067] In the joint adjustment process, the contrast measurement unit 53 measures the joint area 27 ( Fig. 9 ) and background area 28( Fig. 9 ) and measure the contrast between the joining area 27 and the background area 28.

[0068] In the joint adjustment process, the joint correction value calculation unit 54 calculates the joint correction value based on the measurement result of the contrast of the measurement area 26 by the contrast measurement unit 53 .

[0069] In the joint adjustment process, the joint correction value setting unit 55 writes the joint correction value appropriately obtained by the joint correction value calculation unit 54 into a storage unit of the LED display device 12, for example, a register or a rewritable nonvolatile memory, and sets the joint correction value.

[0070] The uniformity adjustment processing unit 44 performs uniformity adjustment processing based on an image obtained by imaging the LED display device 12 , and includes a mark display unit 61 , a monochrome display unit 62 , a brightness data calculation unit 63 , a uniformity correction value calculation unit 64 , and a uniformity correction value setting unit 65 .

[0071] In the uniformity adjustment process, the mark display unit 61 detects the mark 29 ( Fig.14 ).

[0072] In the uniformity adjustment process, the monochrome display unit 62 allows the LED display device 12 to display a red monochrome image, a green monochrome image, and a blue monochrome image, acquires three images obtained by imaging the LED display device 12 displaying the monochrome image, and provides the three images to the brightness data calculation unit 63. Each LED element included in the LED display device 12 can express various colors by adjusting the brightness of a plurality of luminous colors (for example, the three primary colors of red, green, and blue), and the monochrome display unit 62 allows the LED display device 12 to display a monochrome image corresponding to the luminous color.

[0073] In the uniformity adjustment process, the brightness data calculation unit 63 calculates brightness data of the region of the mark 29 in three images obtained by imaging the LED display device 12 displaying a red monochrome image, a green monochrome image, and a blue monochrome image.

[0074] In the uniformity adjustment process, the uniformity correction value calculation unit 64 calculates a uniformity correction value for each color by comparing the reference luminance data for each color with the luminance data for each color calculated by the luminance data calculation unit 63 .

[0075] In the uniformity adjustment process, the uniformity correction value setting unit 65 writes the uniformity correction value of each color appropriately obtained by the uniformity correction value calculation unit 64 into a register or a rewritable nonvolatile memory of the LED display device 12 and sets the uniformity correction value of each color.

[0076] <Processing Example of Camera Positioning Processing>

[0077] Will refer to Figure 3 and Figure 4 An example of camera positioning processing is described.

[0078] In the display system 11, when the joint adjustment process and the uniformity adjustment process are performed using the image captured by the camera 13, the camera 13 needs to be accurately installed at the center of the LED module 21 as the adjustment target range of the LED display device 12. For example, in the display system 11, the entire LED display device 12 (that is, all LED modules 21) can be set as the adjustment target range, and a selectable number of arbitrary LED modules 21 can be set as the adjustment target range.

[0079] exist Figure 3 In the example shown, the LED display device 12 includes LED modules 21 (1, 1) to 21 (6, 12) arranged in a 6×12 (height×width) tile form, and the range surrounded by the dotted line is set as the adjustment target range 22. That is, Figure 3In the illustrated example, 3×6 array LED modules 21 ( 3 , 2 ) to 21 ( 3 , 7 ), LED modules 21 ( 4 , 2 ) to 21 ( 4 , 7 ), and LED modules 21 ( 5 , 2 ) to 21 ( 5 , 7 ) are set as the adjustment target range 22 .

[0080] For example, the worker temporarily installs the camera 13 in a position in front of the LED display device 12 and at the center of the adjustment target range 22. Then, when the worker operates the information processing device 14 to designate the adjustment target range 22, the camera positioning processing unit 41 accepts the designation of the adjustment target range 22 and performs the camera positioning processing based on the designated adjustment target range 22.

[0081] First, the camera positioning processing unit 41 instructs the display control unit 31 to display the marks 23-1 to 23-4 for positioning at the four corners of the adjustment target range 22. Therefore, the display control unit 31 controls the LED display device 12 to display the mark 23-1 for positioning at the lower left corner of the LED module 21 (3, 2), the mark 23-2 for positioning at the lower right corner of the LED module 21 (3, 7), the mark 23-3 for positioning at the upper left corner of the LED module 21 (5, 2), and the mark 23-4 for positioning at the upper right corner of the LED module 21 (5, 7).

[0082] Then, the camera positioning processing unit 41 instructs the camera control unit 32 to allow the camera 13 to image the LED display device 12, and the camera control unit 32 controls the camera 13. When the camera 13 acquires an image obtained by imaging the LED display device 12 in response thereto, the camera control unit 32 acquires the image and supplies it to the camera positioning processing unit 41. Therefore, the camera positioning processing unit 41 can acquire the position coordinate data of the markers 23-1 to 23-4 for positioning on the image captured by the camera 13.

[0083] In addition, if Figure 4 As shown, the camera positioning processing unit 41 instructs the screen display control unit 33 to display the camera positioning processing screen 71 , and the screen display control unit 33 controls the display of the display unit of the information processing device 14 .

[0084] like Figure 4 As shown, the camera positioning processing screen 71 is provided with an image display area 72 , an angle adjustment display area 73 and a position adjustment display area 74 .

[0085] An image obtained by imaging the LED display device 12 by the camera 13 (ie, an image of the LED display device 12 showing the marks 23-1 to 23-4 positioned at the four corners of the adjustment target range 22) is displayed in the image display area 72. Figure 4In the illustrated example, the positions of the markers 23 - 1 to 23 - 4 positioned on the image imaged by the camera 13 are indicated in the image display area 72 .

[0086] The angle adjustment amount for adjusting the angle (pan, tilt, roll) of the camera 13 so that the marks 23-1 to 23-4 for positioning on the image match the reference position coordinate data of the target mark is indicated in the angle adjustment display area 73. In addition, after each angle adjustment amount, an icon for allowing the worker to easily grasp the direction in which the camera 13 is moved according to the angle adjustment amount is displayed.

[0087] The position adjustment amount for adjusting the position (X direction, Y direction, Z direction) of the camera 13 so that the marks 23-1 to 23-4 for positioning on the image match the reference position coordinate data of the target mark is displayed in the position adjustment display area 74. In addition, after each position adjustment amount, an icon for allowing the worker to easily grasp the direction in which the camera 13 is moved according to the position adjustment amount is displayed.

[0088] Here, since the image actually captured by the camera 13 is barrel distorted due to lens distortion (lens distortion aberration), it is difficult to obtain the target mark position on the image by calculation. Therefore, in the display system 11, the four corners of each LED module 21 are set as the target mark position, and it is simulated in which position its reference position coordinate data appears on the image actually imaged by the camera 13. That is, in a state where the four corners of each LED module 21 are turned on, imaging is actually performed by the camera 13. Therefore, the camera positioning processing unit 41 can pre-acquire the reference position coordinate data of the target mark on the image imaged in a state where the four corners of each LED module 21 are turned on as reference information.

[0089] Therefore, the camera positioning processing unit 41 is able to obtain the angle adjustment amount and the position adjustment amount by comparing the reference position coordinate data corresponding to the markers 23-1 to 23-4 for positioning in the reference information with the position coordinate data of the markers 23-1 to 23-4 for positioning in the image acquired by the camera positioning processing and calculating the deviation between them.

[0090] Therefore, the staff can adjust the angle and position of the camera 13 according to the angle adjustment amount displayed in the angle adjustment display area 73 and the position adjustment amount displayed in the position adjustment display area 74, so as to accurately install the camera 13 at the position in front of the LED display device 12 and at the center of the adjustment target range 22.

[0091] <Processing Example of External Light Removal Processing>

[0092] Will refer to Figure 5 An example of the external light removal process is described.

[0093] For example, Figure 5 As shown in A of FIG. 1 , in a case where the lighting device 16 is provided in a room in which the LED display device 12 is arranged, the illumination light of the lighting device 16 and the reflected light of the illumination light reflected by the floor or the like sometimes appear as unnecessary external light in the image imaged by the camera 13. Therefore, in the display system 11, the external light removal processing of the external light removal processing unit 42 is required to avoid such external light from adversely affecting the joint adjustment processing and the uniformity adjustment processing.

[0094] First, if Figure 5 As shown in FIG. 1B , the external light removal processing unit 42 instructs the camera control unit 32 to allow the camera 13 to image the LED display device 12 in a state where lighting other than the lighting device 16 is turned off and a white image is displayed in the adjustment target range 22 of the LED display device 12. It should be noted that Figure 5 B shows a state where a white image is displayed on the entire surface of the LED display device 12 .

[0095] Next, if Figure 5 As shown in FIG. 4C, the external light removal processing unit 42 instructs the camera control unit 32 to allow the camera 13 to image the LED display device 12 in a state where a black image is displayed on the entire surface of the LED display device 12 while keeping the lighting other than the lighting device 16 turned off. When the camera control unit 32 performs control on the camera 13 in response to this, the camera 13 images the LED display device 12 displaying a white image in the adjustment target range 22, and images the LED display device 12 displaying a black image on the entire surface. Then, the camera control unit 32 acquires these two images and supplies them to the external light removal processing unit 42.

[0096] Therefore, the external light removal processing unit 42 may perform an arithmetic operation of subtracting an image captured in a state where a black image is displayed from an image captured in a state where a white image is displayed, thereby obtaining a Figure 5 The image shown in D retains only the white image of the LED display device 12 .

[0097] Then, when performing the joint adjustment process and the uniformity adjustment process, the external light removal processing unit 42 limits the area corresponding to the white image of the LED display device 12 on the image as the processing target range. Therefore, even in the case where the lighting device 16 is arranged in the imaging range imaged by the camera 13, the influence of the lighting device 16 can be eliminated and the joint adjustment process and the uniformity adjustment process can be performed.

[0098] In addition, in addition to displaying a white image in the adjustment target range 22, the external light removal process can also be performed by displaying an image of a specified color other than black. In addition, in the external light removal process, in addition to displaying a black image on the entire surface of the LED display device 12, the entire surface of the LED display device 12 can also be turned off.

[0099] <Processing Example of Joint Adjustment Processing>

[0100] Will refer to Figures 6 to 13 An example of the engagement adjustment process is described.

[0101] First, refer to Figure 6 , the fact that the joint portion is prominent in the LED display device 12 will be described.

[0102] Figure 6 The settings shown are as reference Figure 3 The described adjustment target range 22 is a 3×6 array LED module 21. In addition, Figure 6 In FIG. 1 , the boundary portion between the four LED modules 21 a to 21 d arranged in 2×2 (height×width) is shown in an enlarged manner. Figure 6 , the boundaries between the LED modules 21 arranged adjacent to each other are indicated by dotted lines.

[0103] For example, in the LED module 21, a plurality of LED pixels 24 are arranged in a matrix at regular intervals D in the X direction and the Y direction. Then, the outer shape of the LED module 21 is formed in such a manner that the boundary interval Dx between the LED pixels 24 arranged along the boundary of the LED module 21 arranged adjacent to each other in the lateral direction and the boundary interval Dy between the LED pixels 24 arranged along the boundary of the LED module 21 arranged adjacent to each other in the longitudinal direction coincide with the interval D. However, in reality, there are cases where the boundary interval Dx or the boundary interval Dy does not match the interval D when installing the LED display device 12 or maintaining and replacing the LED module 21 due to various errors or the like.

[0104] For example, in the case where the boundary interval Dx is narrower than the interval D, the area along the boundary between the LED modules 21 arranged adjacent to each other in the lateral direction has a higher brightness than other areas, and therefore, the joining is noticeable in the area along the boundary. On the contrary, in the case where the boundary interval Dx is wider than the interval D, the area along the boundary between the LED modules 21 arranged adjacent to each other in the lateral direction has a lower brightness than other areas, and therefore, the joining is noticeable in the area along the boundary. Similarly, in the case where the boundary interval Dy is narrower than the interval D, and in the case where the boundary interval Dy is wider than the interval D, the joining portion is noticeable in the area along the boundary between the LED modules 21 arranged adjacent to each other in the longitudinal direction.

[0105] Therefore, in the display system 11 , the joint adjustment processing unit 43 can perform the joint adjustment processing, thereby adjusting the brightness to prevent the joint from being noticeable at the boundary between the LED modules 21 arranged adjacent to each other.

[0106] First, in the joint adjustment process, the joint coordinate detection unit 51 detects the joint coordinates in the LED display device 12 on the image captured by the camera 13 .

[0107] and Figure 6 resemblance, Figure 7 The 3×6 array LED modules 21 set as the adjustment target range 22 are shown, and the boundary portion between the four LED modules 21 a to 21 d arranged in 2×2 (height×width) is shown in an enlarged manner.

[0108] For example, Figure 7 As shown, the joint coordinate detection unit 51 instructs the display control unit 31 to allow the LED pixels 24 of two rows and two columns arranged across the boundary between the LED modules 21 among the plurality of LED pixels 24 arranged in a matrix to be turned on in white, and the other LED pixels 24 to be turned off. Here, the area where the LED pixels 24 of two rows and two columns arranged across the boundary between the LED modules 21 are set is hereinafter referred to as a shadow area 25. When the display control unit 31 performs control on the LED display device 12 in response to this, the LED display device 12 turns on the LED pixels 24 in the shadow area 25, and turns off the other LED pixels 24.

[0109] Then, the joint coordinate detection unit 51 instructs the camera control unit 32 to allow the camera 13 to image the LED display device 12. When the camera control unit 32 performs control on the camera 13 in response thereto, the camera 13 images the LED display device 12 in a state where the LED pixels 24 in the shadow area 25 are turned on in white. Thus, the camera control unit 32 acquires an image and supplies it to the joint coordinate detection unit 51.

[0110] Therefore, the joint coordinate detection unit 51 can detect the joint coordinates in the LED display device 12 based on the image obtained by imaging the LED display device 12 in a state where the LED pixels 24 in the shadow area 25 are turned on in white. Then, the joint coordinate detection unit 51 notifies the contrast measurement unit 53 of the joint coordinates in the LED display device 12 on the image taken by the camera 13.

[0111] Next, in the joint adjustment process, the measurement area detection unit 52 detects the measurement area in the LED display device 12 on the image captured by the camera 13 .

[0112] Similar to Figure 6 , Figure 8 3×6 array LED modules 21 are shown arranged to adjust the target range 22. Figure 8 , with LED module 21a as the center, a portion of LED module 21b arranged on the lower side, a portion of LED module 21c arranged on the left side, a portion of LED module 21d arranged on the right side, and a portion of LED module 21e arranged on the upper side are shown in an enlarged manner.

[0113] For example, Figure 8 As shown, the measurement area detection unit 52 instructs the display control unit 31 to allow the LED pixels 24 in the measurement area 26 to be turned on in white and to allow the LED pixels 24 other than the measurement area 26 to be turned off, and the measurement area 26 is provided near both ends of the boundary between the LED modules 21 arranged adjacent to each other. When the display control unit 31 controls the LED display device 12 in response to this, the LED display device 12 turns on the LED pixels 24 in the measurement area 26 in white and turns off the LED pixels 24 other than the measurement area 26.

[0114] Then, the measurement area detection unit 52 instructs the camera control unit 32 to allow the camera 13 to image the LED display device 12. When the camera control unit 32 performs control on the camera 13 in response thereto, the camera 13 images the LED display device 12 in a state where the LED pixels 24 in the measurement area 26 are turned on in white. Thus, the camera control unit 32 acquires an image and provides it to the measurement area detection unit 52.

[0115] Therefore, the measurement area detection unit 52 can detect the measurement area 26 in the LED display device 12 based on the image obtained by imaging the LED display device 12 in a state where the LED pixels 24 in the measurement area 26 are turned on in white. Then, the measurement area detection unit 52 notifies the contrast measurement unit 53 of the measurement area 26 in the LED display device 12 on the image imaged by the camera 13.

[0116] exist Figure 8In the example shown, the measurement area 26-1 is set near the left end of the boundary between the LED module 21a and the LED module 21b, and the measurement area 26-2 is set near the right end of the boundary between the LED module 21a and the LED module 21b. Therefore, in the measurement area 26-1 and the measurement area 26-2, the contrast for obtaining the joint correction value at the boundary between the LED module 21a and the LED module 21b is measured. In addition, the measurement area 26-3 is set near the lower end of the boundary between the LED module 21a and the LED module 21c, and the measurement area 26-4 is set near the upper end of the boundary between the LED module 21a and the LED module 21c. Therefore, in the measurement area 26-3 and the measurement area 26-4, the contrast for obtaining the joint correction value at the boundary between the LED module 21a and the LED module 21c is measured.

[0117] Similarly, the measurement area 26-5 is set near the lower end of the boundary between the LED module 21a and the LED module 21d, and the measurement area 26-6 is set near the upper end of the boundary between the LED module 21a and the LED module 21d. Therefore, in the measurement area 26-5 and the measurement area 26-6, the contrast for obtaining the joint correction value at the boundary between the LED module 21a and the LED module 21d is measured. In addition, the measurement area 26-7 is set near the left end of the boundary between the LED module 21a and the LED module 21e, and the measurement area 26-8 is set near the right end of the boundary between the LED module 21a and the LED module 21e. Therefore, in the measurement area 26-7 and the measurement area 26-8, the contrast for obtaining the joint correction value at the boundary between the LED module 21a and the LED module 21e is measured.

[0118] Fig. 9 An example is shown in which a 30×30 array LED pixel 24 arranged in a matrix is ​​set as the measurement area 26, and the boundary between the LED modules 21 arranged adjacent to each other is indicated by a dotted line. Fig. 9 In the description, the measurement of the contrast in the measurement area 26 where the boundary between the LED modules 21 is oriented in the transverse direction will be described, but the contrast may be similarly measured in the measurement area 26 where the boundary between the LED modules 21 is oriented in the longitudinal direction.

[0119] Furthermore, in the measurement area 26, an area where two rows of LED pixels 24 arranged across the boundary between the LED modules 21 are provided is set as a junction area 27, and an area other than the junction area 27 is set as a background area 28. That is, the background area 28 is an area where 30×14 array LED pixels 24 located on the upper side of the junction area 27 and 30×14 array LED pixels 24 located on the lower side of the junction area 27 are provided.

[0120] For example, the contrast measurement unit 53 instructs the display control unit 31 to display a green monochrome screen in the adjustment target range 22 of the LED display device 12. When the display control unit 31 controls the LED display device 12 in response thereto, the LED display device 12 displays the green monochrome screen in the adjustment target range 22. Note that a monochrome screen other than green, such as a white monochrome screen, may be used.

[0121] Then, the contrast measurement unit 53 instructs the camera control unit 32 to cause the camera 13 to image the LED display device 12. When the camera control unit 32 performs control on the camera 13 in response thereto, the camera 13 images the LED display device 12 in a state where a green monochrome screen is displayed in the adjustment target range 22. Thus, the camera control unit 32 acquires an image and supplies it to the contrast measurement unit 53.

[0122] As described above, the joint coordinate detection unit 51 notifies the contrast measurement unit 53 of the joint coordinates in the LED display device 12 on the image captured by the camera 13. Furthermore, the measurement area detection unit 52 notifies the contrast measurement unit 53 of the measurement area 26 in the LED display device 12 on the image imaged by the camera 13. Therefore, the contrast measurement unit 53 can measure the brightness of each of the joint area 27 and the background area 28 of the measurement area 26 on the image of the LED display device 12 in a state where the green monochrome screen is displayed in the adjustment target range 22.

[0123] For example, the joint area 27 is an area corresponding to the measurement area 26 and an area corresponding to the joint coordinates, and the contrast measurement unit 53 measures the brightness component of green in the area as the brightness of the joint area 27. In addition, the background area 28 is an area corresponding to the measurement area 26 and an area corresponding to an area other than the joint coordinates, and the contrast measurement unit 53 measures the brightness component of green in the area as the brightness of the background area 28.

[0124] Then, the contrast measurement unit 53 may calculate the contrast of the measurement area 26 by dividing the brightness of the joint area 27 by the brightness of the background area 28 (=brightness of the joint area 27 / brightness of the background area 28 ).

[0125] Furthermore, the contrast measurement unit 53 instructs the display control unit 31 to change the brightness of the shadow area 25 to +10%, +5%, 0%, -5%, and -10% while displaying a green monochrome screen in the adjustment target range 22 of the LED display device 12. In response to this, the display control unit 31 controls the LED display device 12.

[0126] Meanwhile, each time the brightness of the shadow area 25 changes, the contrast measurement unit 53 instructs the camera control unit 32 to allow the camera 13 to image the LED display device 12. In response thereto, the camera control unit 32 controls the camera 13.

[0127] Therefore, the contrast measurement unit 53 can acquire five images in which the brightness of the shadow area 25 is +10%, +5%, 0%, -5%, and -10% while displaying a green monochrome screen in the adjustment target range 22 of the LED display device 12. Then, based on these five images, the contrast measurement unit 53 measures the contrast of the measurement area 26 as described above, and supplies the measurement result to the joint correction value calculation unit 54.

[0128] Fig.10 An example of a measurement result of the contrast of the measurement area 26 with respect to the brightness of the shadow area 25 is shown.

[0129] When the brightness of the shadow area 25 is +10%, the joint correction value calculation unit 54 performs linear interpolation on the measurement result of the contrast of the measurement area 26. The measurement result of the contrast of the measurement area 26 when the brightness of the shadow area 25 is +5%, the measurement result of the contrast of the measurement area 26 when the brightness of the shadow area 25 is 0%, the measurement result of the contrast of the measurement area 26 when the brightness of the shadow area 25 is -5%, and the measurement result of the contrast of the measurement area 26 when the brightness of the shadow area 25 is -10%, and the brightness of the hatched area 25 with a contrast of zero is obtained. That is, in Fig.10 At the brightness of the shaded area 25 indicated by the white arrow in FIG. 2 , the contrast of the measurement area 26 is zero.

[0130] Therefore, the joint correction value calculation unit 54 can calculate the signal level corresponding to the brightness of the shadow area 25 with a contrast of zero as the joint correction value. That is, by correcting the brightness of the LED pixels 24 in two rows or two columns arranged across the boundary between the LED modules 21 according to the joint correction value, it is possible to prevent the joint at this part from being noticeable. Then, the joint correction value calculation unit 54 similarly calculates the joint correction value of the boundary between all the LED modules 21 within the adjustment target range 22.

[0131] Then, the joint correction value calculation unit 54 provides the calculated joint correction value to the joint correction value setting unit 55, and the joint correction value setting unit 55 writes and sets the joint correction value in the register of the LED display device 12. Therefore, when the joint correction value calculation unit 54 displays the green monochrome screen in the adjustment target range 22 of the LED display device 12, the correction according to the joint correction value is applied to the brightness of the LED pixels 24 in the two rows or two columns arranged across the boundary between the LED modules 21. That is, the green monochrome screen is displayed in the adjustment target range 22 of the LED display device 12 in a state where the brightness of the LED pixels 24 in the two rows or two columns arranged across the boundary between the LED modules 21 is corrected according to the joint correction value.

[0132] At this time, if the stitching correction value is obtained appropriately, the measurement results of the contrast of all the measurement area detection units 52 are zero. That is, similar to the above description, when the contrast of the measurement area 26 is measured from five images in the state where the brightness of the shadow area 25 is +10%, +5%, 0%, -5%, and -10%, respectively, and linear interpolation of the measurement results is performed, when the brightness of the shadow area 25 is 0%, the contrast of the measurement area 26 is zero. In this way, it can be confirmed that the stitching adjustment process has been appropriately performed.

[0133] Then, the joint correction value calculation unit 54 supplies the appropriately obtained joint correction value to the joint correction value setting unit 55. The joint correction value setting unit 55 writes the joint correction value supplied from the joint correction value calculation unit 54 into the rewritable nonvolatile memory of the LED display device 12 so that the brightness of the boundary between the LED modules 21 is corrected so that the joint is not noticeable when the LED display device 12 is used.

[0134] Note that, instead of changing the brightness of the hatched area 25, the joint correction value calculation unit 54 may change the brightness of an area other than the hatched area 25 (e.g., the background area 28) to obtain a joint correction value. Further, the hatched area 25 may be an area including predetermined LED pixels 24 in two rows or two columns of the LED pixels 24 arranged on the boundary between the LED modules 21, and, for example, an area of ​​LED pixels 24 in four rows or four columns may be the hatched area 25. Further, the measurement area 26 is not limited to the area of Fig. 9 The rectangular shape shown in FIG. 21 and may have any shape as long as it includes the boundaries between the LED modules 21 .

[0135] Will refer to Fig.11 and Fig.12 Describes the joint adjustment processing screen.

[0136] Fig.11The joining adjustment processing screen 81 is shown in an NG state in which the joining adjustment processing is not properly performed, and a joining state display area 82 is provided on the joining adjustment processing screen 81. Fig.11 In the example shown, in the joining status display area 82, the boundaries between the LED modules 21 in the LED display device 12 are represented by thin lines, and thick lines (guide display) representing boundaries where joining is obvious (i.e., boundaries where the contrast of the measurement area 26 is not zero) are displayed.

[0137] Fig.12 The bonding adjustment processing screen 81 is shown in the OK state where the bonding adjustment processing is properly performed. Fig.12 In the example shown in , all the boundaries between the LED modules 21 in the LED display device 12 displayed in the joint state display area 82 are represented by thin lines, indicating that there are no boundaries where the joint is obvious.

[0138] Will refer to Fig.13 The flowchart shown in describes the joint adjustment process.

[0139] In step S11, the camera positioning processing unit 41 performs the above-mentioned Figure 3 and Figure 4 The camera positioning process described above is performed to display the camera positioning process screen 71, display the angle adjustment amount in the angle adjustment display area 73, and display the position adjustment amount in the position adjustment display area 74. Therefore, the staff adjusts the angle and position of the camera 13 according to the angle adjustment amount and the position adjustment amount, thereby accurately installing the camera 13 in the position in front of the LED display device 12 and at the center of the adjustment target range 22.

[0140] In step S12, the external light removal processing unit 42 performs the above-mentioned Figure 5 The external light removal process is described to remove the influence of external light, and to limit the process target range when performing the joint adjustment process and the uniformity adjustment process.

[0141] In step S13, pre-correction imaging is performed. Here, in pre-correction imaging, imaging is performed in which the LED pixels 24 in the shadow area 25 are turned on in white, as described above with reference to Figure 7 As described above, imaging is performed, wherein the LED pixels 24 in the measurement area 26 are as described above with reference to Figure 8 The LED display device 12 is turned on in white, and imaging is performed, wherein the brightness of the shadow area 25 is changed, while a green monochrome picture is displayed in the adjustment target range 22 of the LED display device 12, as described above with reference to Fig.10Therefore, by performing pre-correction imaging, the joint correction value calculation unit 54 acquires the measurement result of the contrast of the measurement area 26 when the brightness of the shadow area 25 is respectively +10%, +5%, 0%, -5%, and -10%.

[0142] In step S14, as mentioned above Fig.10 As described, the stitching correction value calculation unit 54 performs linear interpolation on the measurement result of the contrast obtained in the pre-correction imaging in step S13, and obtains the brightness of the hatched area 25 with a contrast of zero. Then, the stitching correction value calculation unit 54 calculates the signal level corresponding to the brightness of the hatched area 25 with a contrast of zero as the stitching correction value.

[0143] In step S15 , the joint correction value setting unit 55 writes and sets the joint correction value calculated by the joint correction value calculation unit 54 in step S14 in the rewritable nonvolatile memory of the LED display device 12 .

[0144] In step S16, corrected imaging is performed. Here, a green monochrome screen is displayed in the adjustment target range 22 of the LED display device 12 while the brightness of the LED pixels 24 in two rows or two columns arranged across the boundary between the LED modules 21 is corrected based on the joint correction value. Then, as described above with reference to FIG. Fig.10 As described, imaging is performed in which the brightness of the hatched area 25 is changed while displaying a green monochrome screen in the adjustment target range 22 of the LED display device 12. Therefore, by performing the corrected imaging, the joint correction value calculation unit 54 acquires the measurement result of the contrast of the measurement area 26 when the brightness of the hatched area 25 is respectively +10%, +5%, 0%, -5%, and -10% in a state where the correction by the joint correction value is applied. In addition, the joint adjustment processing screen 81 is displayed based on the measurement result of the contrast.

[0145] In step S17, it is determined whether readjustment by manual adjustment is required. For example, the worker visually confirms the state of correction of the applied joint correction value, and determines whether manual adjustment is required based on the thick line (i.e., the obvious boundary of the joint) displayed in the joint state display area 82 of the joint adjustment processing screen 81.

[0146] In the case where it is determined in step S17 that readjustment by manual adjustment is necessary, the process proceeds to step S18, and the joint adjustment is performed by a manual adjustment method similar to the conventional method. In this case, the joint correction value according to the manual adjustment is provided to the joint correction value setting unit 55. Note that instead of performing manual adjustment, the adjustment process of steps S13 to S16 may be performed again. For example, a graphical user interface (GUI) for instructing execution of the readjustment process may be displayed on the joint adjustment process screen 81 to allow the worker to select the manual adjustment or the readjustment process.

[0147] In step S19 , the joint correction value setting unit 55 writes the joint correction value subjected to the manual adjustment or readjustment process in step S18 into the rewritable nonvolatile memory of the LED display device 12 , and the process ends.

[0148] In contrast, in the case where it is determined in step S17 that readjustment by manual adjustment is not required, the joint correction value has already been written in step S15 , and the process ends.

[0149] By performing the joining adjustment processing as described above, the camera 13 can be easily installed, the joining coordinates and the measurement area 26 can be automatically detected to calculate the contrast, and the appropriate joining correction value can be calculated by performing image processing on the jointly imaged image, so that joining adjustment without changes can be achieved in a short time.

[0150] <Processing Example of Uniformity Adjustment Processing>

[0151] Will refer to Figures 14 to 19 An example of uniformity adjustment processing is described.

[0152] Fig.14 A 2×4 array LED module 21 is shown. Hereinafter, a group of the 2×4 array LED modules 21 shown is referred to as a cabinet. The cabinet can be operated as a separate display device, and LED modules 21 in arrays other than the 2×4 array can form a cabinet. In addition, the LED display device 12 is configured as a display device with a selectable size and resolution by arranging a plurality of cabinets. In addition, in Fig.14 In FIG. 1 , marks 29 used as adjustment points when the uniformity adjustment process is performed are shown.

[0153] exist Fig.14In A, the mark 29 is displayed at four positions which are the center of the upper side, lower side, right side and left side of the cabinet including the 2×4 array LED module 21. That is, the mark 29-1 is displayed at the center of the lower side of the cabinet, the mark 29-2 is displayed at the center of the left side of the cabinet, the mark 29-3 is displayed at the center of the right side of the cabinet, and the mark 29-4 is displayed at the center of the upper side of the cabinet. In this way, the uniformity adjustment process can be performed in units of cabinets by displaying the mark 29, and this display of the mark 29 is called a cabinet mode.

[0154] exist Fig.14 In B, the marks 29 are displayed at eight positions which are the center of each of the 2×4 array LED modules 21. By displaying the marks 29 in this way, the uniformity adjustment process can be performed in units of the LED modules 21, and the display of the marks 29 is called a module mode.

[0155] exist Fig.14 In C, the cabinet including the 2×4 array LED module 21 is divided into the right and left parts, and the mark 29 is displayed at eight positions which are the center of the upper side, lower side, right side and left side of each of the left 2×2 array LED module 21 and the right 2×2 array LED module 21. That is, the mark 29-1 is displayed at the lower center of the left 2×2 array LED module 21, the mark 29-2 is displayed at the left center of the 2×2 array LED module 21, the mark 29-3 is displayed at the right center of the 2×2 array LED module 21, and the mark 29-4 is displayed at the upper center of the 2×2 array LED module 21 on the left. Moreover, the mark 29-5 is displayed at the lower center of the right 2×2 array LED module 21, the mark 29-6 is displayed at the left center of the 2×2 array LED module 21 on the left, the mark 29-7 is displayed at the right center of the 2×2 array LED module 21 on the right, and the mark 29-8 is displayed at the upper center of the 2×2 array LED module 21 on the right. In this manner, the uniformity adjustment process can be performed in units of the 2×2 array LED modules 21 by displaying the mark 29 , and such display of the mark 29 is referred to as a radiator mode.

[0156] First, in the uniformity adjustment process, the mark display unit 61 instructs the display control unit 31 to Fig.14 Therefore, the display control unit 31 controls the LED display device 12 so that the mark 29 is displayed in any mode shown in FIG. Fig.14 The mark 29 is displayed in any mode shown in , that is, in such a manner that the LED pixels 24 of the mark 29 are turned on in white, and the LED pixels 24 other than the mark 29 are turned off.

[0157] Then, the mark display unit 61 instructs the camera control unit 32 to cause the camera 13 to photograph the LED display device 12. When the camera control unit 32 controls the camera 13 in response thereto, the camera 13 images the LED display device 12 in a state where the LED pixels 24 of the mark 29 are turned on in white. Thus, the camera control unit 32 acquires an image and provides it to the mark display unit 61.

[0158] Therefore, based on the image obtained by photographing the LED display device 12 in a state where the LED pixels 24 of the mark 29 are turned on in white, the mark display unit 61 can detect the mark 29 in the LED display device 12 based on the image. Then, the mark display unit 61 notifies the brightness data calculation unit 63 of the mark 29 in the LED display device 12 on the image photographed by the camera 13.

[0159] Next, in the uniformity adjustment process, the monochrome display unit 62 instructs the display control unit 31 to display a red monochrome image, a green monochrome image, and a blue monochrome image corresponding to the emission colors of the LED elements included in the LED pixels 24. Therefore, the display control unit 31 controls the LED display device 12 to sequentially display the red monochrome image, the green monochrome image, and the blue monochrome image. At the same time, whenever the color of the display control unit 31 is changed, the monochrome display unit 62 instructs the camera control unit 32 to allow the camera 13 to image the LED display device 12. In response, the camera control unit 32 controls the camera 13.

[0160] Therefore, the monochrome display unit 62 can obtain three images obtained by imaging the LED display device 12 displaying a red monochrome image, a green monochrome image, and a blue monochrome image, and provide these images to the brightness data calculation unit 63. Here, the image obtained by imaging the LED display device 12 displaying a red monochrome image is referred to as a red monochrome imaging image. Similarly, the image obtained by imaging the LED display device 12 displaying a green monochrome image is referred to as a green monochrome imaging image, and the image obtained by imaging the LED display device 12 displaying a blue monochrome image is referred to as a blue monochrome imaging image.

[0161] Here, since a shadow in which the brightness of the peripheral portion decreases appears in the image imaged by the camera 13, the brightness data calculation unit 63 corrects the lens shadow of the red monochrome imaging image, the green monochrome imaging image, and the blue monochrome imaging image based on the lens calibration table according to the lens used by the camera 13. In addition, since the LED pixels 24 of the LED display device 12 have viewing angle characteristics, the brightness data calculation unit 63 corrects the viewing angle characteristics of the red monochrome imaging image, the green monochrome imaging image, and the blue monochrome imaging image based on the LED calibration table so as to obtain the brightness when the LED pixels 24 are viewed from the front.

[0162] In this way, the brightness data calculation unit 63 corrects the lens shading and viewing angle characteristics of the red monochrome imaging image, the green monochrome imaging image, and the blue monochrome imaging image, and calculates the brightness data of the area of ​​the mark 29 in each corrected image. That is, the brightness data calculation unit 63 calculates the brightness data of red from the area of ​​the mark 29 in the red monochrome imaging image, in which the lens shading and viewing angle characteristics are corrected. Similarly, the brightness data calculation unit 63 calculates the brightness data of green from the area of ​​the mark 29 in the green monochrome imaging image in which the lens shading and viewing angle characteristics are corrected, and calculates the brightness data of blue from the area of ​​the mark 29 in the blue monochrome imaging image in which the lens shading and viewing angle characteristics are corrected. Then, the brightness data calculation unit 63 provides the brightness data of red, the brightness data of green, and the brightness data of blue to the uniformity correction value calculation unit 64.

[0163] The uniformity correction value calculation unit 64 holds reference brightness data used as each of the red monochrome captured image, the green monochrome captured image, and the blue monochrome captured image. For example, the uniformity correction value calculation unit 64 may acquire the reference brightness data by imaging the reference cabinet in advance. Alternatively, the uniformity correction value calculation unit 64 may acquire the reference brightness data by imaging the LED module 21 as a reference, an area designated by a worker, etc. in advance, or may acquire an external input value as the reference brightness data.

[0164] Then, the uniformity correction value calculation unit 64 compares the reference brightness data of the red monochrome imaging image with the brightness data of the red color supplied from the brightness data calculation unit 63 to convert the relative brightness ratio, thereby generating brightness comparison data of the red color for each mark 29. Similarly, the uniformity correction value calculation unit 64 creates brightness comparison data of green color and brightness comparison data of blue color for each mark 29 of the green monochrome imaging image and the blue monochrome imaging image.

[0165] Next, the uniformity correction value calculation unit 64 calculates the uniformity correction value of red from the brightness comparison data of red for each mark 29, calculates the uniformity correction value of green from the brightness comparison data of green for each mark 29, and calculates the uniformity correction value of blue from the brightness comparison data of blue for each mark 29.

[0166] For example, when the uniformity correction value calculation unit 64 is in the Fig.14 In the case of the cabinet mode of the display mark 29 shown in A of FIG. 1 , this calculates the uniformity correction value in units of cabinets by performing linear interpolation between the marks 29. In addition, when the uniformity correction value calculation unit 64 is in the state as shown in FIG. Fig.14 In the case of the module mode of displaying the mark 29 shown in B of FIG. 1 , the uniformity correction value is calculated in units of the LED modules 21 displaying each mark 29. In addition, when the uniformity correction value calculation unit 64 is in the state as shown in FIG. Fig.14 In the case of the radiator pattern showing the marks 29 shown in C, the uniformity correction value is calculated in units of 2×2 array LED modules 21 by performing linear interpolation between the marks 29 .

[0167] Then, the uniformity correction value calculation unit 64 supplies the uniformity correction value of red, the uniformity correction value of green, and the uniformity correction value of blue to the uniformity correction value setting unit 65. The uniformity correction value setting unit 65 writes and sets the uniformity correction value of red, the uniformity correction value of green, and the uniformity correction value of blue in the register of the LED display device 12. Therefore, for example, when the monochrome display unit 62 allows the LED display device 12 to display each of the red monochrome image, the green monochrome image, and the blue monochrome image, the red monochrome image, the green monochrome image, and the blue monochrome image are displayed to be uniform as a whole.

[0168] At this time, if the uniformity correction value is appropriately obtained, the brightness data of all the marks 29 are uniform values, and it can be confirmed that the uniformity adjustment process is appropriately performed.

[0169] Then, the uniformity correction value calculation unit 64 supplies the uniformity correction value obtained appropriately to the uniformity correction value setting unit 65. The uniformity correction value setting unit 65 writes the uniformity correction value supplied from the uniformity correction value calculation unit 64 into the rewritable nonvolatile memory of the LED display device 12 so that the brightness is corrected so that an image having uniformity as a whole is displayed when the LED display device 12 is used. Thus, the brightness difference between cabinets and between LED modules 21 caused by individual differences during manufacturing and deterioration over time can be corrected.

[0170] It should be noted that in the uniformity adjustment process, in addition to the use of the red monochrome image, the green monochrome image, and the blue monochrome image, a white monochrome image, an invisible light monochrome image (in the case of using the LED pixels 24 capable of outputting invisible light), and the like may be used according to the configuration of the LED pixels 24. Furthermore, these monochrome images are not necessarily displayed on the entire surface of the LED display device 12, and the uniformity adjustment process may be performed as long as they are displayed in at least the mark 29, for example.

[0171] Will refer to Figures 15 to 18 Describes the uniformity adjustment processing screen.

[0172] Fig.15 A uniformity adjustment processing screen 91 in an NG state in which the uniformity adjustment processing is not properly performed is shown, and a uniformity state display area 92 is provided on the uniformity adjustment processing screen 91. In addition, Fig.15 An example is shown in which a cabinet including 2×4 array LED modules 21 is arranged in a range of 3×2 (height×width) as the adjustment target range. Fig.15 In the illustrated example, in the uniformity state display area 92 , the LED modules 21 that do not have uniformity with respect to the entire adjustment target range are indicated in black (guide display).

[0173] Fig.16 The uniformity adjustment processing screen 91 is shown in the OK state where the uniformity adjustment processing is properly performed. Fig.16 An example is shown in which a cabinet including 2×4 array LED modules 21 is arranged in a range of 2×2 (height×width) as the adjustment target range. Fig.16 In the illustrated example, it is shown that in the uniformity state display area 92 , there is no LED module 21 that does not have uniformity in the entire adjustment target range, that is, all the LED modules 21 have uniformity.

[0174] Fig.17 The uniformity adjustment processing screen 91 in the NG state in which the uniformity adjustment processing is not properly performed is shown, and a uniformity state display area 92 is provided on the uniformity adjustment processing screen 91. In addition, Fig.17 The entire range of the LED display device 12 is shown as an example of the adjustment target range. Fig.17 In the illustrated example, in the uniformity state display area 92 , the LED modules 21 that do not have uniformity with respect to the entire adjustment target range are indicated in black (guide display).

[0175] Fig.18 The uniformity adjustment processing screen 91 is shown in the OK state in which the uniformity adjustment processing is properly performed. Fig.18The entire range of the LED display device 12 is shown as an example of the adjustment target range. Fig.18 In the illustrated example, it is shown that in the uniformity state display area 92 , there is no LED module 21 that does not have uniformity for the entire adjustment target range, that is, all the LED modules 21 have uniformity.

[0176] Will refer to Fig.19 The flowchart shown in describes the uniformity adjustment process.

[0177] In steps S21 and S22, the Fig.13 Steps S11 and S12 are processed similarly.

[0178] In step S23, the pre-correction imaging is performed. Here, in the pre-correction imaging, as described above with reference to Fig.14 As described above, imaging is performed in which the LED pixels 24 of the marker 29 are turned on in white, and imaging is performed in a state where the display control unit 31 displays a red monochrome image, a green monochrome image, and a blue monochrome image. Then, when pre-correction imaging is performed, the brightness data calculation unit 63 acquires brightness data of red, brightness data of green, and brightness data of blue for each marker 29.

[0179] In step S24, the uniformity correction value calculation unit 64 creates the brightness comparison data of red for each mark 29, and calculates the uniformity correction value of red based on the brightness comparison data. Similarly, the uniformity correction value calculation unit 64 generates the brightness comparison data of green for each mark 29 to calculate the uniformity correction value of green, and generates the brightness comparison data of blue for each mark 29 to calculate the uniformity correction value of blue.

[0180] In step S25 , the uniformity correction value setting unit 65 writes and sets the uniformity correction value calculated by the uniformity correction value calculation unit 64 in step S24 in the rewritable nonvolatile memory of the LED display device 12 .

[0181] In step S26, post-correction imaging is performed. Here, in the post-correction imaging, a red monochrome image, a green monochrome image, and a blue monochrome image are displayed on the LED display device 12 in a state where correction based on the uniformity correction value set for the LED display device 12 is applied. Then, similarly to the pre-correction imaging in step S23, the brightness data calculation unit 63 acquires the brightness data of red, the brightness data of green, and the brightness data of blue for each mark 29. In addition, a uniformity adjustment processing screen 91 is displayed based on the brightness data of red, the brightness data of green, and the brightness data of blue.

[0182] In step S27, it is determined whether readjustment by manual adjustment is required. For example, the operator visually confirms the state of application of correction based on the uniformity correction value, and determines whether manual adjustment is required based on the black paint (i.e., LED module 21 without uniformity) displayed in the uniformity state display area 92 of the uniformity adjustment processing screen 91.

[0183] In the case where it is determined in step S27 that readjustment by manual adjustment is necessary, the process proceeds to step S28, and uniformity adjustment is performed by a manual adjustment method similar to the conventional method. In this case, the uniformity correction value according to the manual adjustment is provided to the uniformity correction value setting unit 65. Note that instead of performing manual adjustment, the adjustment process of steps S23 to S26 may be performed again. For example, a GUI for instructing execution of readjustment processing may be displayed on the uniformity adjustment processing screen 91 to allow the worker to select manual adjustment or readjustment processing.

[0184] In step S29 , the uniformity correction value setting unit 65 writes the uniformity correction value subjected to the manual adjustment or readjustment process in step S28 into the rewritable nonvolatile memory of the LED display device 12 , and the process ends.

[0185] In contrast, in the case where it is determined in step S27 that readjustment by manual adjustment is not required, the uniformity correction value has already been written in step S25 , and the process ends.

[0186] By performing the uniformity adjustment processing as described above, the camera 13 can be easily installed, the mark 29 can be automatically detected to calculate the brightness data of red, green and blue, and the appropriate uniformity correction value can be calculated by performing image processing on the commonly imaged image, so that uniformity adjustment without variation can be achieved in a short time.

[0187] <Camera pose estimation method>

[0188] Will refer to Fig. 20 A method for estimating the pose of the camera 13 is described.

[0189] As described above, in the display system 11, it is necessary to install the camera 13 in a position in front of the LED display device 12 and at the center of the adjustment target range 22 to perform the joint adjustment process and the uniformity adjustment process. On the contrary, even in the case where the camera 13 is installed at a position far from the front of the LED display device 12 or the center of the adjustment target range 22, by estimating the posture of the camera 13, the joint adjustment process and the uniformity adjustment process can be performed as if the camera 13 is installed at a position in front of the LED display device 12 and at the center of the adjustment target range 22.

[0190] For example, in order to estimate the posture of the camera 13, it is necessary to obtain in advance the shape information representing the LED display device 12 and the height information representing the installation of the camera 13. Based on the shape information of the LED display device 12, a world coordinate system is provided in such a way that the XY plane of the world coordinate system is parallel to the display surface of the LED display device 12. The camera coordinate system is set to be parallel to the imaging element with the center of the imaging element of the camera 13 as the origin, and the origin of the camera coordinate system in the Y direction is set according to the height information of the camera 13.

[0191] Then, as mentioned above Figure 3 As shown, marks 23-1 to 23-4 for positioning are displayed at four corners of the adjustment target range 22 and imaged by the camera 13. The coordinates (Xw, Yw, Zw) of the marks 23-1 to 23-4 on the display surface of the LED display device 12 are expressed in a three-dimensional world coordinate system.

[0192] The coordinates (Xi, Yi) of the points where the markers 23-1 to 23-4 are imaged in the image captured by the camera 13 are expressed in the two-dimensional image coordinate system. The coordinates (Xi, Yi) can be converted into coordinates (Xc, Yc, Zc) according to the three-dimensional camera coordinate system using internal parameters expressed in the following expression (1).

[0193] [Mathematical expression 1]

[0194]

[0195] The coordinates (Xc, Yc, Zc) representing the coordinates (Xi, Yi) of the points where markers 23-1 to 23-4 are imaged on the image in the camera coordinate system can be converted into the coordinates (Xw, Yw, Zw) of markers 23-1 to 23-4 on the display surface of the LED display device 12 using external parameters as expressed in the following expression (2).

[0196] [Mathematical expression 2]

[0197]

[0198] Therefore, by calculating the external parameters shown in the equation (2) using the least square method, it is possible to estimate the posture of the camera 13. In addition, by displaying more markers 23, it is possible to improve the estimation accuracy of the posture of the camera 13.

[0199] <Handling of Reflection of External Light>

[0200] Will refer to Fig.21 and Fig. 22 Describe countermeasures against reflected external light.

[0201] In the display system 11, an external light reflection removal process ( Fig.13 Step S13 and Fig.19 . , step S23 in the process.

[0202] In the external light reflection removal process, such as Fig.21 As shown on the left side of FIG. 1 , a monochrome picture of a specific color is displayed on the entire surface of the LED display device 12 and is imaged by the camera 13, and as shown in FIG. Fig.21 As shown in the center of FIG. 1 , a black image is displayed on the entire surface of the LED display device 12 (or, the entire surface of the LED display device 12 is turned off) and is imaged by the camera 13. At this time, if the environment in which the LED display device 12 is installed does not change, the external light reflected in the LED display device 12 is imaged in two images.

[0203] Then, by obtaining the difference between an image obtained by displaying a monochrome screen of a specific color on the LED display device 12 and imaging it and an image obtained by displaying a black image on the entire surface of the LED display device 12 and imaging it, external light reflected in the LED display device 12 can be removed. Fig.21 As shown on the right side of , image data of only a monochrome screen displayed on the LED display device 12 can be acquired. Therefore, by performing the joint adjustment process and the uniformity adjustment process using the image data of only a monochrome screen displayed on the LED display device 12, the adjustment can be performed more accurately.

[0204] In addition, in the display system 11, by checking the external light reflected in the LED display device 12 before and after each imaging performed in the bonding adjustment process and the uniformity adjustment process, erroneous adjustment due to changes in the illumination of the external light reflected in the LED display device 12 can be prevented.

[0205] For example, Fig. 22As shown, before and after displaying the red monochrome picture, the green monochrome picture, and the blue monochrome picture on the entire surface of the LED display device 12, a black image is displayed on the entire surface of the LED display device 12. Then, by checking the difference in the area where the LED display device 12 is imaged before and after displaying the red monochrome picture, the change in the illumination of the external light can be confirmed. Similarly, by checking the difference in the area imaged by the LED display device 12 before and after displaying the green monochrome picture and before and after displaying the blue monochrome picture, the change in the illumination of the external light can be confirmed. For example, in the joint adjustment process, the change in the illumination of the external light is confirmed by subtracting in units of pixels of the imaging element of the camera 13, and in the uniformity adjustment process, the change in the illumination of the external light is confirmed for each cabinet used as a measurement unit.

[0206] Then, in the display system 11, when the illumination of the external light changes greatly, the joint adjustment process or the uniformity adjustment process can be interrupted. That is, when the dynamic influence of the external light is large, the adjustment cannot be performed accurately, so it is necessary to interrupt the process and eliminate the influence of the external light.

[0207] <Uniformity Adjustment Processing>

[0208] Will refer to Figure 23 to Figure 26 Describes the uniformity adjustment process.

[0209] As described above, in the display system 11, the uniformity adjustment process can be performed in units of a cabinet, which is a group of a plurality of LED modules 21. At this time, when the uniformity adjustment process is performed while a certain cabinet is set as the adjustment target range 22, the cabinet adjacent to the cabinet to which the uniformity adjustment process is applied can be used as a reference.

[0210] For example, Fig.23 As shown, an example of performing uniformity adjustment processing while setting a cabinet including a 3×3 array LED module 21 as an adjustment target range 22 will be described. Fig.23 In the example shown, the 3×3 array LED modules 21 arranged at the lower left of the LED display device 12 serve as the adjustment target range 22 for adjustment, and the 3×3 array LED modules 21 arranged at the lower right of the LED display device 12 serve as the adjustment target range 22 for adjustment.

[0211] Then, when the uniformity adjustment process of the adjusted adjustment target range 22 is performed, among the LED display devices 12 forming the adjusted adjustment target range 22, the LED display device 12 adjacent to the adjusted adjustment target range 22 is set as an imaging area to be imaged by the camera 13. In this way, by imaging by the camera 13 so that a part of the adjusted adjustment target range 22 overlaps, the uniformity adjustment process can be performed so that no brightness step difference is generated at the boundary of the adjustment target range 22 based on the adjusted adjustment target range 22.

[0212] For example, Fig.24 As shown in A of FIG. 1 , in a case where imaging is performed by the camera 13 on each adjustment target range 22 without overlapping, the uniformity adjustment process is performed with reference points set in each adjustment target range 22 as references. For example, in a case where the brightness of the LED display device 12 used as a reference point in the adjustment target range 22 on the right is different from the brightness of the LED display device 12 used as a reference point in the adjustment target range 22 on the left, after the uniformity adjustment process is performed, the overall brightness of the adjustment target range 22 on the right is different from the overall brightness of the adjustment target range 22 on the left. Therefore, a brightness step appears at the boundary between the cabinet used as the adjustment target range 22 on the right and the cabinet used as the adjustment target range 22 on the left.

[0213] On the contrary, Fig.24 As shown in FIG. 1B , in a case where imaging is performed by the camera 13 so as to overlap with a portion of the adjusted adjustment target range 22, a reference point can be provided in the adjusted adjustment target range 22, and the uniformity adjustment process of the adjusted adjustment target range 22 is performed with the reference point as a reference. Therefore, the brightness of the adjusted adjustment target range 22 can be matched with the brightness of the adjusted adjustment target range 22. Therefore, the occurrence of a brightness step at the boundary of the housing serving as the adjustment target range 22 can be avoided, and the display system 11 can support an LED display device 12 having a larger size.

[0214] like Fig.25 As shown in A, when the adjusted adjustment target range 22 is set to be adjacent to the adjusted adjustment target range 22 on the left, in each same row, taking the brightness of the LED module 21 as a reference, in the adjusted adjustment target range 22, uniformity adjustment processing is performed on the adjusted adjustment target range 22.

[0215] like Fig.25 As shown in B, when the adjusted adjustment target range 22 is set to be adjacent to the adjusted adjustment target range 22 on the lower side, for each identical column, uniformity adjustment processing is performed on the adjusted adjustment target range 22 with the brightness of the LED module 21 used as a reference in the adjusted adjustment target range 22 as a target.

[0216] like Fig.25 As shown in C, in the case where the adjusted adjustment target range 22 is arranged to be adjacent to the adjusted adjustment target range 22 on the left and lower sides, uniformity adjustment processing is performed on the adjusted adjustment target range 22, wherein the brightness weighted and synthesized according to the distance in the row direction and the column direction is used as the target for each point. That is, the brightness is synthesized and set as the target by weighted average obtained by weighting the brightness of the LED module 21 as the reference in the adjusted adjustment target range 22 in the row direction according to the distance in the row direction and by weighting the brightness of the LED module 21 as the reference in the adjusted adjustment target range 22 in the column direction.

[0217] Will refer to Fig.26 Describes the LED calibration table used in the uniformity adjustment process.

[0218] For example, in the case described later Fig.30 In the case where the LED display device 12 installed at a high place is seen while searching, color deviation occurs due to the viewing angle of the LEDs of each color forming the LED pixels 24 of the LED display device 12. Therefore, a position where the LED display device 12 is viewed is assumed, and the LED calibration table is used when the uniformity adjustment process is performed so that color deviation does not occur in the position.

[0219] like Fig.26 As shown in , the LED calibration table is acquired within a range of ±45° in each of the horizontal rotation direction and the pitch direction, with the installation position of the camera 13 when the uniformity adjustment process is performed as a reference. For example, in the lens calibration table, a correction coefficient for correcting color deviation according to the viewing angle of the LED is recorded for each of the horizontal angle H, the vertical angle V, and the distance D to the LED display device 12.

[0220] <Circular LED Display Device>

[0221] Will refer to Figure 27 to Figure 29 A circular-shaped LED display device 12 is described.

[0222] In the display system 11, the LED display device 12 can be installed in a circular shape by adjusting the angle difference between adjacent cabinets 17 for each cabinet 17 including a plurality of LED modules 21. Then, by preparing in advance the curve information representing the shape of the LED display device 12 installed in a circular shape, this can be used as the shape information of the LED display device 12 when positioning the camera 13, or can be used to obtain an LED calibration table for the adjustment target range 22 in the uniformity adjustment process.

[0223] Will refer to Fig. 27The graph information of the LED display device 12 installed in a circular shape is described.

[0224] Fig. 27 A plan view of an LED display device 12 installed in a circular manner by arranging 33 cabinets 17 at a predetermined angle between adjacent cabinets 17 is shown. Then, a numerical value indicating the angle difference between adjacent cabinets 17 is recorded in the curve information. In the example shown, the angle difference between cabinets 17-1 and 17-2 is registered as 0° in the curve information, and the angle difference between cabinets 17-2 and 17-3 is registered as 2° in the curve information. From cabinet 17-3 to cabinet 17-6, the angle difference is registered as 5° in the curve information, and from cabinet 17-6 to cabinet 17-9, the angle difference is registered as 10° in the curve information. In the following, the numerical value indicating the angle difference between adjacent cabinets 17 is similarly recorded in the curve information.

[0225] Fig.28 1 is a diagram showing the positioning of the camera 13 installed with respect to the LED display device 12 installed in a circular shape.

[0226] For example, the posture (horizontal rotation / vertical rotation / lateral roll, X / Y / Z position) of the camera 13 can be estimated based on the image captured by the camera 13 and the curve information as the shape information of the LED display device 12, and the angle θ toward the front of the adjustment target range and the distance D from the center of the adjustment target range can be obtained. Then, by adjusting the installation position of the camera 13 so that the angle θ and the distance D become 0, the camera 13 can be installed at a position in front of and in the center of the adjustment target range.

[0227] Furthermore, in the display system 11, since the LED calibration table according to the viewing angle of the LED pixel 24 and the calibration table according to the lens used by the camera 13 are separated, the LED calibration table can be accurately applied to the LED display device 12 installed in a circular shape. Therefore, for example, a distorted image obtained when the LED display device 12 installed in a circular shape is imaged by the camera 13 when looking upward can be supported.

[0228] Fig.29 FIG. 1 is a diagram showing a uniformity adjustment process in the LED display device 12 installed in a circle.

[0229] For example, in the display system 11, the viewing angle α of the LED pixel 24 to be measured can be calculated based on the curve information indicating the shape of the LED display device 12 and the camera positioning information indicating the installation position of the camera 13 relative to the LED display device 12. The viewing angle α of the LED pixel 24 to be measured is the angle between a straight line (single-dotted dash line) passing through the LED pixel 24 to be measured and extending in a direction perpendicular to the cabinet 17 and a straight line (double-dotted dash line) from the LED pixel 24 to be measured to the focus of the camera 13.

[0230] Then, after calculating the viewing angle α of all LED pixels 24 , the display system 11 may acquire brightness data obtained by multiplying the brightness data by the correction coefficient registered in the LED calibration table.

[0231] <Viewpoint Mode for Uniformity Adjustment Processing>

[0232] Will refer to Fig.30 Describes the viewpoint mode of the uniformity adjustment process.

[0233] In the display system 11 , a viewpoint mode for adjusting the uniformity of the position of the camera 13 as a viewpoint to be uniform is set, and the viewpoint can be optionally selected according to the installation situation of the display system 11 .

[0234] For example, Fig.30 As shown in A of FIG. 1 , the LED display device 12 will be described as being installed at a height of 3 m to 5 m. Fig. 20 As described above, even if the camera 13 is installed at a position far from the front of the LED display device 12 or the center of the adjustment target range 22, the uniformity adjustment process can be performed by estimating the posture of the camera 13. That is, for example, the uniformity adjustment process of the LED display device 12 installed at a height of 3m to 5m can be performed by the camera 13 installed at a height of 1.7m.

[0235] Fig.30 B shows an example in which the uniformity adjustment process of the LED display device 12 is performed in the front view mode in which the camera 13 is installed in a position in front of the LED display device 12 and at the center of the adjustment target range 22 .

[0236] In the case of uniformity adjustment processing in the front viewing mode, if the viewing height of the LED display device 12 is the front of the LED display device 12 (for example, viewing height: 5.1m), an image in which color deviation does not occur can be viewed without affecting the viewing angle of the LED. On the contrary, in this case, for example, when the LED display device 12 installed at a height of 3m to 5m is viewed from a height of 1.7m, an image in which color deviation occurs due to the influence of the viewing angle of the LED is viewed on the upper part of the LED display device 12.

[0237] In addition, in the front-view mode, the viewpoint adjustment limited to the vertical direction is performed, thereby supporting the direction in which the LED display device 12 is looked at. For example, in a private theater, etc., it is possible to support viewing in one place applied in the horizontal and vertical directions. In addition, the gain can be adjusted by the angle in the horizontal and vertical directions to be fixed.

[0238] Fig.30C shows an example of performing the uniformity adjustment process of the LED display device 12 in the viewpoint mode in which the camera 13 is installed, while setting a height of 1.7 m as the viewpoint with respect to the LED display device 12 set at a height of 3 to 5 m.

[0239] In the case of uniformity adjustment processing in the viewpoint mode, if the viewing height of the LED display device 12 is 1.7m, an image without color deviation can be viewed without being affected by the viewing angle of the LED. On the contrary, in this case, when the LED display device 12 installed at a height of 3m to 5m is viewed from the front, for example, from a height of 5.1m, an image with color deviation due to the influence of the viewing angle of the LED is viewed on the lower part of the LED display device 12.

[0240] In this manner, by setting the viewpoint mode of the uniformity adjustment process, the display system 11 can support viewing in which color deviation does not occur in an image at a viewpoint assumed according to the installation situation of the LED display device 12 .

[0241] Note that when acquiring the LED calibration table, it is necessary to measure the shadow data of each viewing angle of the LED pixel 24. At this time, one of the LED module 21 and the camera 13 is fixed, the other is attached to the robot, and the robot is moved to change the relative angle, whereby the data can be measured. Therefore, for example, wavelength swing can be supported, and a planar light source is not required.

[0242] <Computer Configuration Example>

[0243] Next, the above-described series of processing may be executed by hardware or also by software. In the case where the series of processing is executed by software, a program configuring the software is installed on a general-purpose computer or the like.

[0244] Fig.31 : is a block diagram showing a configuration example of one embodiment of a computer in which a program for executing the above-described series of processes is installed.

[0245] The program may be recorded in advance on the hard disk 105 or the ROM 103 as a recording medium included in the computer.

[0246] Alternatively, the program may also be stored (recorded) in a removable recording medium 111 driven by the drive 109. Such a removable recording medium 111 may be provided as so-called packaged software. Here, examples of the removable recording medium 111 include, for example, a floppy disk, a compact disk read-only memory (CD-ROM), a magneto-optical (MO) disk, a digital versatile disk (DVD), a magnetic disk, a semiconductor memory, and the like.

[0247] It should be noted that, in addition to being installed on the computer from the removable recording medium 111 as described above, the program may be downloaded to the computer via a communication network or a broadcasting network and installed on the incorporated hard disk 105. That is, for example, the program may be wirelessly transmitted to the computer from a download site via an artificial satellite for digital satellite broadcasting, or may be transmitted to the computer by wire via a network such as a local area network (LAN) and the Internet.

[0248] The computer includes a central processing unit (CPU) 102 , and an input / output interface 110 is connected to the CPU 102 through a bus 101 .

[0249] When receiving a command input by a user by operating input unit 107 or the like via input / output interface 110, CPU 102 accordingly executes a program stored in read only memory (ROM) 103. Alternatively, CPU 102 loads a program stored in hard disk 105 into random access memory (RAM) 104 for execution.

[0250] Therefore, the CPU 102 performs processing according to the above flowchart, or performs processing by the configuration in the above block diagram. Then, as needed, the CPU 102 outputs the processing result from the output unit 106 through the input / output interface 110, or transmits the processing result from the communication unit 108, and further records it on the hard disk 105, etc.

[0251] Note that the input unit 107 includes a keyboard, a mouse, a microphone, etc. Furthermore, the output unit 106 includes a liquid crystal display (LCD), a speaker, and the like.

[0252] Here, in this specification, the processing executed by the computer according to the program is not necessarily executed in time series according to the order described in the flowchart. That is, the processing executed by the computer according to the program includes processing executed in parallel or independently (for example, parallel processing or object-based processing).

[0253] In addition, the program may be processed by one computer (one processor), or by a plurality of computers in a distributed manner. In addition, the program may be transmitted to a remote computer to be executed.

[0254] In addition, in this specification, a system means a group of multiple components (devices, modules (components), etc.), and it does not matter whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected to each other via a network and a device in which multiple modules are housed in one housing are both systems.

[0255] In addition, for example, a configuration described as one device (or one processing unit) may be divided and configured as a plurality of devices (or processing units). Conversely, the configuration described above as a plurality of devices (or processing units) may be collectively configured as one device (or processing unit). Furthermore, needless to say, a configuration other than the above configuration may be added to the configuration of each device (or each processing unit). In addition, when the configuration and operation as the entire system are substantially the same, a part of the configuration of a certain device (or processing unit) may be included in the configuration of another device (or another processing unit).

[0256] Furthermore, for example, the present technology may be configured as cloud computing in which one function is shared and jointly processed by a plurality of devices through a network.

[0257] In addition, for example, the above-mentioned program can be executed by an optional device. In this case, the device only needs to have necessary functions (functional blocks, etc.) and obtain necessary information.

[0258] In addition, for example, each step described in the above flowchart may be performed by one device, or may be performed by multiple devices in a shared manner. In addition, in the case where multiple processes are included in one step, the multiple processes included in one step may be performed by one device or may be performed by multiple devices in a shared manner. In other words, the multiple processes included in one step may also be performed as processes of multiple steps. Conversely, a process described as multiple steps may also be performed collectively as one step.

[0259] It should be noted that in the program executed by the computer, the processing of the steps describing the program may be performed in time series in the order described in this specification, or may be performed in parallel, or may be performed independently at necessary timing such as when calling. That is, unless there is a contradiction, the processing of each step may be performed in an order different from the above order. In addition, the processing of the steps describing the program may be performed in parallel with the processing of another program, or may be performed in conjunction with the processing of another program.

[0260] It should be noted that, unless there is a contradiction, the various present technologies described in this specification can be independently implemented as a single unit. It goes without saying that the optional various present technologies can be implemented in combination. For example, part or all of the present technologies described in any embodiment can be implemented in combination with part or all of the present technologies described in other embodiments. In addition, part or all of the optional present technologies described above can be implemented together with another technology not described above.

[0261] <Configuration combination example>

[0262] It should be noted that the present technology can also have the following configurations. (1)

[0264] An information processing system, comprising:

[0265] a contrast measurement unit that measures brightness of a junction area in the LED display device and a background area outside the junction area based on an image obtained by imaging the LED display device configured by arranging a plurality of light emitting diode (LED) modules in a tiled manner, the junction area including a boundary between LED modules adjacent to each other, and the contrast measurement unit measures contrast of the junction area relative to the background area, the LED display device being configured by; and

[0266] A joint correction value calculation unit calculates a joint correction value for adjusting brightness at a boundary between LED modules based on a measurement result of the contrast. (2)

[0268] The information processing system according to (1) above, wherein:

[0269] The contrast measurement unit measures a plurality of contrasts by changing the brightness of the joint area or the background area at a predetermined ratio, and

[0270] The seam correction value calculation unit calculates the seam correction value based on the measurement results of the plurality of contrasts. (3)

[0272] The information processing system according to (2) above, wherein:

[0273] The seam correction value calculation unit performs linear interpolation on the plurality of contrasts and calculates a signal level corresponding to the brightness of the seam area where the contrast becomes zero as the seam correction value. (4)

[0275] The information processing system according to any one of (1) to (3) above, further comprising:

[0276] The joining coordinate detection unit detects positions of regions corresponding to predetermined LED pixels on an image obtained by imaging the LED display device as joining coordinates, the predetermined LED pixels including two rows or two columns of LED pixels arranged across a boundary between adjacent LED modules. (5)

[0278] The information processing system according to (4) above, wherein:

[0279] The bonding coordinate detection unit detects bonding coordinates based on an image obtained by imaging the LED display device in a state where predetermined LED pixels including two rows or columns of LED pixels arranged across a boundary between adjacent LED modules are turned on and LED pixels other than the predetermined LED pixels are turned off. (6)

[0281] The information processing system according to (4) above further comprises:

[0282] The measurement region detection unit detects a region corresponding to a measurement region of a predetermined shape including a boundary between LED modules adjacent to each other on an image obtained by imaging the LED display device. (7)

[0284] The information processing system according to (6) above, wherein:

[0285] The measurement region detection unit detects a region corresponding to the measurement region based on an image obtained by imaging the LED display device in a state in which LED pixels of the measurement region are turned on and LED pixels other than the measurement region are turned off. (8)

[0287] The information processing system according to (6) above, wherein:

[0288] The measurement area is provided near both ends of the boundary between the LED modules adjacent to each other. (9)

[0290] The information processing system according to (6) above, wherein:

[0291] Contrast measurement unit

[0292] On an image obtained by imaging an LED display device displaying a monochrome screen of a predetermined color,

[0293] detecting a brightness component of a predetermined color in an area corresponding to the measurement area and corresponding to the joint coordinates as the brightness of the joint area, and

[0294] A luminance component of a predetermined color in an area corresponding to the measurement area and corresponding to an area other than the joint coordinates is detected as the luminance of the background area. (10)

[0296] The information processing system according to (9) above, wherein:

[0297] The contrast measurement unit measures the contrast using an image obtained by imaging the LED display device displaying a monochrome screen in a state where correction is applied based on the joint correction value, and displays a joint adjustment processing screen indicating the measurement result. (11)

[0299] The information processing system according to (10) above, wherein:

[0300] A guide display indicating a boundary where the contrast in the measurement area is not zero is performed on the joint adjustment processing screen. (12)

[0302] The information processing system according to (10) above, wherein:

[0303] Based on the contrast measurement result, it is determined whether the brightness at the boundary between the LED modules needs to be readjusted. (13)

[0305] The information processing system according to any one of (1) to (12) above, further comprising:

[0306] The joint correction value setting unit writes and sets the joint correction value obtained by the joint correction value calculation unit in the storage unit of the LED display device. (14)

[0308] The information processing system according to any one of (1) to (13) above, further comprising:

[0309] A camera positioning processing unit performs camera positioning processing for accurately installing a camera for imaging the LED display device in front of the LED display device and at a position at the center of a target range for calculating a joint correction value. (15)

[0311] The information processing system according to (14) above, wherein:

[0312] The camera positioning processing unit accepts designation of a target range and performs camera positioning processing based on the designated target range. (16)

[0314] The information processing system according to (14) above, wherein:

[0315] The camera positioning processing unit detects four areas on the image corresponding to the positioning marks based on an image obtained by imaging the LED display device in a state where positioning marks are displayed at the four corners of the target range, and calculates the adjustment amount for adjusting the angle and position of the camera to match the reference position coordinate data of the four target marks acquired in advance. (17)

[0317] The information processing system according to (16) above, wherein:

[0318] The camera positioning processing unit displays a camera positioning processing screen provided with a display area for displaying an adjustment amount for adjusting the angle and position of the camera. (18)

[0320] The information processing system according to any one of (1) to (17) above, further comprising:

[0321] An external light removal processing unit performs an arithmetic operation of subtracting an image obtained by imaging the LED display device in a state where a black image is displayed on the entire surface or in a state where the entire surface is turned off from an image obtained by imaging the LED display device in a state where an image of a predetermined color other than black is displayed within a processing target range, thereby acquiring an image in which only the image of the predetermined color of the LED display device is retained, and limiting the area on the image corresponding to the image of the predetermined color as the processing target range. (19)

[0323] A method for adjusting an information processing system for performing processing, comprising:

[0324] Based on an image obtained by imaging an LED display device configured by arranging a plurality of light emitting diode (LED) modules in a tiled manner, measuring the brightness of a junction area in the LED display device and a background area outside the junction area, the junction area including a boundary between LED modules adjacent to each other, and measuring the contrast of the junction area relative to the background area; and

[0325] A joint correction value for adjusting brightness at a boundary between LED modules is calculated based on the measurement result of the contrast. (20)

[0327] A program for causing a computer of an information processing system to execute a process, the process comprising:

[0328] Based on an image obtained by imaging an LED display device configured by arranging a plurality of light emitting diode (LED) modules in a tiled manner, measuring the brightness of a junction area in the LED display device and a background area outside the junction area, the junction area including a boundary between LED modules adjacent to each other, and measuring the contrast of the junction area relative to the background area; and

[0329] A joint correction value for adjusting brightness at a boundary between LED modules is calculated based on the measurement result of the contrast.

[0330] It should be noted that the present embodiment is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present disclosure. In addition, the effects described in this specification are merely examples and are not limited, and other effects can be provided.

[0331] Reference Symbols List

[0332] 11 Display System

[0333] 12 LED display device

[0334] 13 Camera

[0335] 14 Information processing device

[0336] 15 Display Controller

[0337] 16 lighting fixtures

[0338] 21 LED Module

[0339] 22 Adjust target range

[0340] 23 Markers for positioning

[0341] 24 LED pixels

[0342] 25 Shadow Area

[0343] 26 Measurement area

[0344] 27 Junction area

[0345] 28 Background area

[0346] 29 Marks

[0347] 31 Display control unit

[0348] 32 Camera control unit

[0349] 33 Screen display control unit

[0350] 34 LED display adjustment processing unit

[0351] 41 Camera positioning processing unit

[0352] 42 External light removal processing unit

[0353] 43 Joint adjustment processing unit

[0354] 44 Uniformity Adjustment Processing Unit

[0355] 51 Joint coordinate detection unit

[0356] 52 Measurement area detection unit

[0357] 53 Contrast measurement unit

[0358] 54 Joint correction value calculation unit

[0359] 55 Joint correction value setting unit

[0360] 61 Marking display unit

[0361] 62 monochrome display units

[0362] 63 brightness data calculation unit

[0363] 64 Uniformity correction value calculation unit

[0364] 65 Uniformity correction value setting unit.

Claims

1. An information processing system, comprising: a contrast measurement unit that measures brightness of a junction area in the LED display device and a background area outside the junction area based on an image obtained by imaging a LED display device configured by arranging a plurality of light emitting diode (LED) modules in a tiled manner, wherein the junction area includes a boundary between LED modules adjacent to each other, and the contrast measurement unit measures a contrast of the junction area relative to the background area; as well as A joint correction value calculation unit calculates a joint correction value for adjusting the brightness at the boundary between the LED modules based on the measurement result of the contrast.

2. The information processing system according to claim 1, wherein: The contrast measurement unit measures a plurality of contrasts by changing the brightness of the joint region or the background region at a predetermined ratio, and The seam correction value calculation unit calculates the seam correction value based on the measurement results of the plurality of contrasts.

3. The information processing system according to claim 2, wherein The seam correction value calculation unit performs linear interpolation on the plurality of contrasts, and calculates a signal level corresponding to brightness of a seam area where the contrast is zero as the seam correction value.

4. The information processing system according to claim 1, further comprising: A joining coordinate detection unit detects the position of an area corresponding to predetermined LED pixels on the image obtained by imaging the LED display device as a joining coordinate, wherein the predetermined LED pixels include two rows or two columns of LED pixels arranged across the boundary between the LED modules adjacent to each other.

5. The information processing system according to claim 4, wherein: The joining coordinate detection unit detects the joining coordinates based on an image obtained by imaging the LED display device in a state where the predetermined LED pixels including two rows or two columns of LED pixels arranged across the boundary between the LED modules adjacent to each other are turned on and the LED pixels other than the predetermined LED pixels are turned off.

6. The information processing system according to claim 4, further comprising: A measurement region detection unit detects a region corresponding to a measurement region of a predetermined shape including the boundary between the LED modules adjacent to each other on the image obtained by imaging the LED display device.

7. The information processing system according to claim 6, wherein: The measurement region detection unit detects a region corresponding to the measurement region based on an image obtained by imaging the LED display device in a state in which the LED pixels of the measurement region are turned on and the LED pixels other than the measurement region are turned off.

8. The information processing system according to claim 6, wherein: The measurement area is provided near both ends of the boundary between the LED modules adjacent to each other.

9. The information processing system according to claim 6, wherein: The contrast measurement unit On an image obtained by imaging the LED display device displaying a monochrome screen of a predetermined color, detecting a brightness component of the predetermined color in a region corresponding to the measurement region and corresponding to the joint coordinates as brightness of the joint region, and A luminance component of the predetermined color in a region corresponding to the measurement region and corresponding to a region other than the joint coordinates is detected as luminance of the background region.

10. The information processing system according to claim 9, wherein: The contrast measurement unit measures the contrast using an image obtained by imaging the LED display device displaying the monochrome screen in a state where correction is applied based on the joint correction value, and displays a joint adjustment processing screen indicating a measurement result.

11. The information processing system according to claim 10, wherein: On the joint adjustment processing screen, a guide display indicating a boundary where the contrast in the measurement area is not zero is performed.

12. The information processing system according to claim 10, wherein: According to the measurement result of the contrast, it is determined whether the brightness at the boundary between the LED modules needs to be readjusted.

13. The information processing system according to claim 1, further comprising: The joint correction value setting unit writes and sets the joint correction value obtained by the joint correction value calculation unit in a storage unit of the LED display device.

14. The information processing system according to claim 1, further comprising: A camera positioning processing unit performs camera positioning processing for accurately installing a camera for imaging the LED display device in front of the LED display device and at a position at a center of a target range for calculating the joint correction value.

15. The information processing system according to claim 14, wherein: The camera positioning processing unit accepts designation of the target range and executes the camera positioning processing based on the designated target range.

16. The information processing system according to claim 14, wherein: The camera positioning processing unit detects four areas corresponding to the positioning marks on the image based on the image obtained by imaging the LED display device in a state where positioning marks are displayed at the four corners of the target range, and calculates the adjustment amount for adjusting the angle and position of the camera for matching with the reference position coordinate data of the four target marks acquired in advance.

17. The information processing system according to claim 16, wherein: The camera positioning processing unit displays a camera positioning processing screen provided with a display area for displaying the adjustment amount for adjusting the angle and position of the camera.

18. The information processing system according to claim 1, further comprising: An external light removal processing unit performs an arithmetic operation of subtracting an image obtained by imaging the LED display device in a state where a black image is displayed on the entire surface or in a state where the entire surface is turned off from an image obtained by imaging the LED display device in a state where an image of a predetermined color other than black is displayed within a processing target range, thereby acquiring an image in which only the image of the predetermined color of the LED display device is retained, and limiting an area on the image corresponding to the image of the predetermined color as the processing target range.

19. A method for adjusting an information processing system for performing processing, comprising: Based on an image obtained by imaging an LED display device configured by arranging a plurality of light emitting diode (LED) modules in a tiled manner, measuring the brightness of a junction area in the LED display device and a background area outside the junction area, wherein the junction area includes a boundary between adjacent LED modules, and measuring the contrast of the junction area relative to the background area; and A joint correction value for adjusting brightness at the boundary between the LED modules is calculated based on the measurement result of the contrast.

20. A program for causing a computer of an information processing system to execute a process, the process comprising: Based on an image obtained by imaging an LED display device configured by arranging a plurality of light emitting diode (LED) modules in a tiled manner, measuring the brightness of a junction area in the LED display device and a background area outside the junction area, wherein the junction area includes a boundary between adjacent LED modules, and measuring the contrast of the junction area relative to the background area; and A joint correction value for adjusting brightness at the boundary between the LED modules is calculated based on the measurement result of the contrast.

Images