Display system and information processing method

Abstract

The present technology relates to a display system and an information processing method that enables suppression of unevenness in video appearance due to the viewing angle characteristics of an LED. A display system according to the present technology includes: a divided display unit that constitutes one display unit by being arranged in a tiled form; an acquisition unit that acquires viewing position information indicating a viewing position of a display video displayed on the display unit; and a luminance control unit that controls the luminance of the divided display unit based on the viewing position information. The present technology can be applied, for example, to an imaging system used in virtual production.

Description

Technical Field

[0001] This technology relates to display systems and information processing methods, and particularly to display systems and information processing methods capable of suppressing the non-uniformity of image appearance caused by the viewing angle characteristics of LEDs. Background Technology

[0002] In recent years, the market for large, direct-view tiled display systems using light-emitting diodes (LEDs) has been expanding. For example, the use of cameras to capture backgrounds and subjects for virtual production is growing rapidly, with backgrounds such as landscapes being reproduced on large LED displays at the content production site.

[0003] PTL 1 describes a display system configured to perform the following: a process of adjusting brightness to avoid color shift on a large LED display, and a process of adjusting brightness to ensure uniformity of the image displayed as a whole large LED display.

[0004] Reference List

[0005] Patent documents

[0006] PTL 1: International Publication No. 2023 / 203985 Summary of the Invention

[0007] [Technical Issues]

[0008] In LED displays, due to the different viewing angle characteristics of each of the R, G, and B LEDs, the appearance of some areas of the image displayed on the LED display may differ from that of other areas, depending on the viewing angle relative to the LED display.

[0009] This technology was developed in view of such circumstances, and its purpose is to enable the suppression of image appearance non-uniformity caused by the viewing angle characteristics of LEDs.

[0010] [Solution to the problem]

[0011] The first aspect of this technology is a display system comprising: a segmented display unit configured to form a display unit by tiling; an acquisition unit configured to acquire viewing position information indicating a viewing position of a display image displayed on the display unit; and a brightness control unit configured to control the brightness of the segmented display unit based on the viewing position information.

[0012] The second aspect of this technology's information processing method includes: acquiring viewing position information, which indicates the viewing position of a display image displayed on the display unit, by providing a display system having segmented display units configured in a tiled manner to form a display unit, and controlling the brightness of the segmented display units based on the viewing position information.

[0013] In the first and second aspects of this technology, a display system is provided with segmented display units configured to form a display unit by tiling, viewing position information indicating the viewing position of a display image displayed on the display unit is acquired, and the brightness of the segmented display unit is controlled based on the viewing position information. Attached Figure Description

[0014] [ Figure 1 [Illustration] is a diagram used to illustrate an overview of an image capture system that applies this technology.

[0015] [ Figure 2 [Illustration 1] is an example of a captured image by a camera device.

[0016] [ Figure 3 [ ] is a diagram showing an example configuration of an image capture system.

[0017] [ Figure 4 [Image] is a diagram illustrating an example of the viewing angle characteristics of an LED in a display.

[0018] [ Figure 5 [This is the first diagram used to illustrate the color shift caused by the viewing angle characteristics of LEDs.]

[0019] [ Figure 6 [This is the second figure used to illustrate the color shift caused by the viewing angle characteristics of LEDs.]

[0020] [ Figure 7 [1] is the first diagram used to illustrate the compensation of the segmented image performed by the display cabinet.

[0021] [ Figure 8 [] is a diagram used to illustrate the movement of the camera device.

[0022] [ Figure 9 [Figure 3] is used to illustrate the color shift caused by the viewing angle characteristics of LEDs.

[0023] [ Figure 10 This is the fourth figure used to illustrate the color shift caused by the viewing angle characteristics of LEDs.

[0024] [ Figure 11 [This is the second figure used to illustrate the compensation of the segmented image performed by the display cabinet.]

[0025] [ Figure 12 [Figure 3] is used to illustrate the compensation of the segmented image performed by the display cabinet.

[0026] [ Figure 13 [ ] is a block diagram illustrating an example configuration of an image capture system.

[0027] [ Figure 14 [A diagram is used to illustrate panel location information, viewing location information, and viewing angle.]

[0028] [ Figure 15 [] is a diagram showing an example of a LUT.

[0029] [ Figure 16 [ ] is a flowchart illustrating the processes performed by the image capture system 1. Detailed Implementation

[0030] The following describes implementation methods for this technology. The descriptions will proceed in the following order.

[0031] 1. Overview of Image Capture Systems

[0032] 2. Configuration and operation of the image capture system

[0033] <1. Overview of Image Capture Systems>

[0034] Figure 1 This is a diagram illustrating an overview of the image capture system 1 that applies this technology.

[0035] Figure 1 The image capture system 1 is, for example, a system for capturing images using virtual production (in-camera VFX). The image capture system 1, for example, captures movies or dramas. The image capture system 1 includes a camera device 11, an image storage device (not shown) for storing captured images captured by the camera device 11, a wall display 12, and a display controller (not shown) for controlling the display 12.

[0036] The display 12 is, for example, an LED display and is set in a real space such as a photography studio. The display 12 displays, for example, an image of a three-dimensional space created by computer graphics (CG) as a display image. The cameraman P1 uses the camera device 11 to capture an image of the motorcycle M1 as the subject, with the CG image displayed on the display 12 as a background.

[0037] Figure 2 This is a diagram showing an example of a captured image captured by camera device 11.

[0038] like Figure 2The captured image shown by the camera device 11 is an image as if the motorcycle M1 exists in a three-dimensional space represented by the CG image. In this way, performing the capture using the image capture system 1 allows the cameraman P1 to take a captured image in the studio, in which the space projected onto the CG image expands in the background of the motorcycle M1.

[0039] Figure 3 This is a diagram showing an example configuration of image capture system 1.

[0040] like Figure 3 The image capture system 1 (display system) shown includes, in addition to the camera device 11 and the display 12, a video server 61, a personal computer (PC) 62 and a display controller 63.

[0041] The camera device 11, in response to an image capture start command from the cameraman P1, captures the subject against the background of the display image shown on the display 12.

[0042] Display 12 (display unit) is a large LED display composed of n (n is a positive integer) display cabinets (display units) 41-1 to 41-n arranged in a tiled pattern. Figure 3 In the example, display 12 consists of 6 It consists of 24 display cabinets. In the following text, when it is not necessary to distinguish between display cabinets 41-1 to 41-n, each of display cabinets 41-1 to 41-n will be referred to as display cabinet 41.

[0043] The display cabinet 41 consists of an array of m LEDs (m being a positive integer) arranged in a tiled manner, from 51-1 to 51-m, wherein the LEDs (not shown) corresponding to each pixel are arranged in a matrix shape (a two-dimensional array shape). Figure 3 In the example, it is shown that the box 41 is composed of 4 The LED array 51 consists of 3 LED arrays. In the following text, when it is not necessary to distinguish LED arrays 51-1 to 51-m separately, LED arrays 51-1 to 51-m are each referred to as LED array 51. The groups of LED arrays 51 constituting a display cabinet 41 are arranged in a tiled manner to serve as segmented display units constituting a display 12.

[0044] Each display cabinet 41 of the display 12 is connected to the display controller 63 via a cable such as a local area network (LAN) cable. The display 12 displays a display image indicated by image data provided from the display controller 63. The image data provided to each display cabinet 41 is image data of segmented images obtained by segmenting the display image to correspond to the position of the display cabinet 41 within the display 12. Each display cabinet 41 displays the segmented image carried on the image data, such that the entire display image is displayed on the display 12.

[0045] The display cabinets 41 of the monitor 12 can be daisy-chained. In this case, the display cabinets 41 are connected to each other via cables such as LAN cables. When the display controller 63 provides image data to the daisy-chained display cabinets 41, each display cabinet 41 displays an image based on the image data corresponding to itself in the provided image data. Note that daisy-chaining is also referred to as cascading connection, etc.

[0046] In the daisy-chained display cabinets 41, the first display cabinet 41 directly connected to the display controller 63 receives image data from the display controller 63 and provides the image data to the subsequent display cabinets 41 connected in the daisy chain. The subsequent display cabinets 41 connected in the daisy chain acquire image data from the previous display cabinet 41 and provide the image data to another subsequent display cabinet 41 connected in the daisy chain.

[0047] Video server 61, for example, is a server computer. Video server 61 stores image data such as video content and performs rendering of a three-dimensional space created by CG to generate image data. Video server 61 provides the image data to display controller 63.

[0048] The display controller 63 may be provided with image data from a recording medium such as a hard disk drive (HDD) or Blu-ray disc (BD) (registered trademark) instead of the video server 61.

[0049] PC 62 is a common general-purpose computer. PC 62 generates control commands for controlling display controller 63 and transmits the control commands to display controller 63, thereby controlling display controller 63.

[0050] The display controller 63 divides the image data provided by the video server 61 into n segments based on the position of the display cabinet 41, and transmits the n segments of image data to each display cabinet 41. The display controller 63 transmits information to each display cabinet 41 based on control commands provided by the PC 62.

[0051] Display cabinet 41 can be daisy-chained to display controller 63. Display controller 63 transmits information to the first display cabinet 41 in the display chain based on image data provided from video server 61 and control commands provided from PC 62. This display chain includes corresponding display cabinets 41. Furthermore, multiple display chains can be connected to display controller 63.

[0052] Note that the display controller 63 and the display 12 can be integrated as a single unit, and can also be integrated as a single display device. Note that the PC 62, display controller 63, and display 12 can be integrated as a single unit, and can also be integrated as a single display device.

[0053] Figure 4 This is a diagram illustrating an example of the viewing angle characteristics of the LEDs in display 12. Figure 4 In the diagram, the horizontal axis represents the angle (viewing angle) of the camera device 11 relative to each LED (each pixel) of the display 12, and the vertical axis represents the brightness of each LED when viewed from the camera device 11.

[0054] exist Figure 4 In the example, the viewing angle characteristics of the red LED are indicated by a solid line, the viewing angle characteristics of the blue LED are indicated by a dotted line, and the viewing angle characteristics of the green LED are indicated by a dashed line.

[0055] In display 12, such as Figure 4 As shown, due to the different viewing angle characteristics of the LEDs R, G and B, depending on the viewing angle of the camera device 11 relative to the display 12, the appearance of some areas of the displayed image in terms of brightness, color, etc., may differ from that of other areas.

[0056] For example, such as Figure 5 As shown in Figure A, when the camera device 11 is facing the center of the display 12, the viewing angle of the camera device 11 relative to the pixels at the center of the display 12 is 0 degrees. When viewed from the camera device 11, the viewing angle of the camera device 11 relative to the pixels at the left end is -60 degrees, and the viewing angle of the camera device 11 relative to the pixels at the right end is 60 degrees.

[0057] In this case, because the viewing angle characteristics of LEDs with R, G, and B are different, therefore, as Figure 5 As shown in Figure B, when viewed from the camera device 11, the color of the central portion of the display 12 appears different from the color of the surrounding portion.

[0058] In addition, for example, such as Figure 6As shown, when a semi-cylindrical display 12A is installed in the studio and a display 12B is installed on the ceiling of the studio, the viewing angle of the camera device 11 relative to each pixel in the display 12B is particularly large, and therefore a large color shift occurs in the display 12B.

[0059] Therefore, in the image capture system 1 of this technology, the brightness of the LED array 51 is controlled by each display cabinet 41 based on the viewing angle characteristics of the LEDs, and thus the color, brightness, etc. of the entire displayed image can be made uniform when viewed from the camera device 11. For example, the brightness of the LED array 51 is controlled by performing compensation on the segmented image based on the viewing angle characteristics of the LEDs.

[0060] Figure 7 This is a diagram used to illustrate the compensation of the segmented image performed by the display housing 41.

[0061] like Figure 7 As shown in the upper left part, in the image capture system 1, the angle (viewing angle) of light incident on the camera device 11 emitted from the LEDs at each corner (four corners) of the display cabinet 41 is calculated in real time based on the viewing position information indicating the viewing position of the camera device 11.

[0062] like Figure 7 As shown in the upper right part, the image capture system 1 pre-stores: viewing angle data D1R indicating the correspondence between the viewing angle and compensation value of the camera device 11 relative to the red LED, viewing angle data D1G indicating the correspondence between the viewing angle and compensation value of the camera device 11 relative to the green LED, and viewing angle data D1B indicating the correspondence between the viewing angle and compensation value of the camera device 11 relative to the blue LED.

[0063] like Figure 7 As shown in the middle, the display cabinet 41 calculates the gain of each pixel of the display cabinet 41 as a compensation value based on the viewing angle information of the camera device 11 relative to the pixel at each corner, as well as the viewing angle data D1R, D1G and D1B.

[0064] Specifically, the display cabinet 41 first calculates the gain of each pixel (each of pixels Pi1, Pi2, Pi3, and Pi4) at each corner as a reference gain based on the viewing angle information and viewing angle data D1R, D1G, and D1B. Next, the display cabinet 41 calculates the gain of all pixels except those at the corners based on the reference gain. The display cabinet 41 calculates the gain of all pixels except those at the corners by performing linear interpolation, for example, using the reference gain. Linear interpolation allows for obtaining a gain whose value varies smoothly across pixels.

[0065] Note that a uniform gain value can be calculated for all pixels of the display cabinet 41.

[0066] Display cabinet 41 performs gain compensation on the segmented image by multiplying the pixel values ​​of the R, G, and B channels of each pixel of the display image by a calculated gain for each pixel of display cabinet 41. When the compensated segmented image is displayed on display cabinet 41, camera device 11 can capture the overall appearance of the image, such as a uniform brightness and color, as shown in the display image. Figure 7 As shown in the lower part.

[0067] Figure 8 This is a diagram used to illustrate the movement of the camera device 11.

[0068] like Figure 8 As shown in A, when the camera device 11 moves from right to left while facing the display 12 during the time period from time t1 to time t2, the viewing angle of the pixels at each corner of the camera device 11 relative to the display cabinet 41 is calculated at each time point in time t1 and time t2.

[0069] Compensation is performed on the segmented image at time t1 based on the viewing angle of the camera device 11 at time t1, and compensation is also performed on the segmented image at time t2 based on the viewing angle of the camera device 11 at time t2. Therefore, compensation is performed on the segmented image following the movement of the camera device 11. Thus, as... Figure 8 As shown in B, even when the camera device 11 moves during the time period from time t1 to time t2, the camera device 11 can continue to capture the appearance of the entire image, such as the brightness or color, and display the image uniformly.

[0070] When performing image capture with virtual rendering using two camera devices 11, viewpoint information indicating the viewpoint of each of the two camera devices 11 can be input to the display cabinet 41. In this case, for each frame, a segmented image compensated according to the viewpoint of one camera device 11 and a segmented image compensated according to the viewpoint of the other camera device 11 are displayed alternately, so that both of the two camera devices 11 can capture the overall appearance of the image, such as uniform brightness and color.

[0071] The display system of this technology can be applied not only to display devices used for virtual creation, but also to display devices actually viewed by viewers. Even in the display 12 actually viewed by viewers, due to the different viewing angle characteristics of the R, G, and B LEDs, the appearance of some areas of the displayed image in terms of brightness, color, etc., may differ from that of other areas depending on the viewer's viewing angle relative to the display 12.

[0072] For example, such as Figure 9 As shown in Figure A, when viewer P11 is facing the center of display 12, the viewing angle of viewer P11 relative to the pixels in the center of display 12 is 0 degrees. When viewed from viewer P11, the viewing angle of viewer P11 relative to the pixels at the left end is -60 degrees, and the viewing angle of viewer P11 relative to the pixels at the right end is 60 degrees.

[0073] In this case, because the viewing angle characteristics of LEDs with R, G, and B are different, therefore, as Figure 9 As shown in Figure B, when viewed from viewer P11, the color of the central portion of display 12 appears different from the color of the surrounding portion.

[0074] In addition, for example, such as Figure 10 As shown, when the display 12 is mounted at a position higher than the viewer P11's line of sight, the viewer P11 has a large viewing angle relative to each pixel in the display 12, and therefore a large color shift occurs in the display 12.

[0075] As described above, in the display 12 of this technology, each display cabinet 41 in the display cabinet 41 controls the brightness of the LED array 51 based on the viewing angle characteristics of the LEDs, and thus makes the brightness, color, etc. of the entire display image uniform when viewed from the viewer P11. For example, the brightness of the LED array 51 is controlled by performing compensation on the segmented image based on the viewing angle characteristics of the LEDs.

[0076] Figure 11 and Figure 12 This is a diagram used to illustrate the compensation of the segmented image performed by the display housing 41.

[0077] In image capture system 1, the viewing position of viewer P11 is predetermined, and the viewing position information of viewer P11 is input. Next, as... Figure 11 The shown and Figure 12 As shown in the upper left, based on the viewing position information of viewer P11, the angle (viewing angle) of light incident on the eyes of viewer P11 is calculated from the LEDs at each corner (four corners) of the display cabinet 41.

[0078] like Figure 12 As shown in the upper right part, the image capture system 1 pre-stores: viewing angle data D11R, which indicates the correspondence between the viewing angle and compensation value of the viewer P11 relative to the red LED; viewing angle data D11G, which indicates the correspondence between the viewing angle and compensation value of the viewer P11 relative to the green LED; and viewing angle data D11B, which indicates the correspondence between the viewing angle and compensation value of the viewer P11 relative to the blue LED.

[0079] like Figure 12 As shown in the middle, the display cabinet 41 calculates the gain of each pixel of the display cabinet 41 as a compensation value based on the viewing angle information indicating the viewing angle of the viewer P11 relative to the pixels at each corner, as well as the viewing angle data D11R, D11G, and D11B.

[0080] Specifically, the display cabinet 41 first calculates the gain of the pixels at the corners (pixels Pi1, Pi2, Pi3, and Pi4) as a reference gain based on the viewing angle information and viewing angle data D11R, D11G, and D11B. Next, the display cabinet 41 calculates the gain of all pixels except the corner pixels by performing linear interpolation, for example, using the reference gain. Linear interpolation allows for obtaining a gain whose value varies smoothly across pixels.

[0081] Note that a uniform gain value can be calculated for all pixels of the display cabinet 41.

[0082] Display cabinet 41 performs gain compensation on the segmented image by multiplying the pixel values ​​of the R, G, and B channels of each pixel of the display image by a gain calculated for each pixel of display cabinet 41. When the compensated segmented image is displayed on display cabinet 41, the viewer P11 can capture the overall appearance of the segmented image, such as uniform brightness and color. Figure 12 As shown in the lower left part.

[0083] like Figure 12 As shown in the lower right part, when the viewer P11 moves during the time interval from time t11 to time t12, a certain degree of color shift occurs, but as long as the distance between the display 12 and the viewer P11 does not change, the appearance of the entire displayed image, such as brightness and color, remains uniform.

[0084] <2. Configuration and Operation of the Image Capture System>

[0085] Figure 13 This is a block diagram illustrating a configuration example of image capture system 1.

[0086] like Figure 13 As shown, the image capture system 1 includes multiple display cabinets 41, a video server 61, a PC 62, a display controller 63, and a tracker 64.

[0087] The video server 61 transmits image data to the display controller 63.

[0088] The film or theater producer operates the input unit (not shown) of PC 62 to input installation information about the installation position of the monitor 12. Based on the installation information, PC 62 calculates the positions of the corners of all the display cabinets 41 that make up the monitor 12 and transmits panel position information indicating the positions of the corners of the display cabinets 41 to the display controller 63.

[0089] The display controller 63 divides the image data transmitted from the video server 61 into n segments based on the position of the display cabinet 41, and transmits the n segments of image data to each display cabinet 41. In the panel position information transmitted from the PC 62, the display controller 63 transmits panel position information to each display cabinet 41 indicating the position of a corner of the display cabinet 41 that is the destination for transmission. Furthermore, the display controller 63 transmits the viewing position information of the camera device 11 transmitted (input) from the tracker 64 to each display cabinet 41.

[0090] When the display cabinet 41 is daisy-chained to the display controller 63, the display controller 63 provides image data, panel position information and viewing position information to the first display cabinet 41 in the display chain, which includes the corresponding display cabinet 41.

[0091] Tracker 64 acquires viewing position information of camera device 11. For example, tracker 64 is mounted on camera device 11 and acquires viewing position information of camera device 11 by tracking using markers set in a studio. Tracker 64 transmits the viewing position information of camera device 11 to display controller 63.

[0092] When no camera tracking system including tracker 64 is set up, for example, a film or theater producer or cinematographer operates PC 62 to input the viewing position of camera device 11, and PC 62 transmits the viewing position information to display controller 63 based on the operation.

[0093] When the display system of this technology is applied to a display device that a viewer actually watches, for example, the viewer operates a controller connected to PC 62 to input his / her own viewing position, and PC 62 transmits the viewing position information to the display controller based on the operation content.

[0094] The installer of monitor 12 can input the position of the intended viewer to view the displayed image at a high frequency into PC 62 as the viewer's viewing position.

[0095] The display enclosure 41 includes a control unit 101, a register 102, an LED driver 103, and an LED 104. Within the display enclosure 41, a lookup table (LUT) is stored as viewpoint data. This LUT is used to output gain for gain compensation, taking the viewpoint of the camera device 11 or the viewer as input.

[0096] The control unit 101 includes a CPU, etc. When the CPU, etc., executes a predetermined program, it implements the viewing angle calculation unit 121, the arithmetic operation unit 122, and the compensation unit 123. The control unit 101 serves as a brightness control unit for controlling the brightness of the segmented display units. The display 12, composed of multiple display cabinets 41, can be considered a display device comprising multiple segmented display units (groups of LED arrays 51) and multiple brightness control units corresponding to the multiple segmented display units.

[0097] The viewing angle calculation unit 121 serves as an acquisition unit, receiving and acquiring viewing position information and panel position information transmitted from the display controller 63. Based on the viewing position information and panel position information, the viewing angle calculation unit 121 calculates the viewing angle relative to a predetermined pixel of the display housing 41 itself. For example, it calculates the viewing angle of the camera device 11 relative to pixels at each corner of the pixels constituting the display housing 41.

[0098] When the display cabinets 41 are connected in a daisy chain, the viewing angle calculation unit 121 of the display cabinets 41 other than the first display cabinet 41 in the display chain obtains image data, panel position information, and viewing position information from the previous display cabinet. The supply unit (not shown) of the display cabinet 41 provides the image data, panel position information, and viewing position information to the subsequent display cabinets.

[0099] Figure 14 This is a diagram used to illustrate panel location information, viewing location information, and viewing angle. In Figure 14 In the example, display 12 consists of 4 The display cabinet 41 is composed of 4, and the viewer P21 views the displayed image.

[0100] In the panel position information and viewing position information, for example, the position of the pixel at each corner of the display cabinet 41 and the viewing position of the viewer P21 are indicated by coordinates on a three-dimensional coordinate system with the center point Po1 of the bottom portion of the display 12 as the origin. For example, the position of the pixel Pi11 at the upper left corner of the display cabinet 41-1-1 in the first column and the first level is indicated by coordinates (Xp, Yp, Zp), and the viewing position of the viewer P21 is indicated by coordinates (Xc, Yc, Zc). The x-axis represents the horizontal direction when viewed from the viewer P21, the y-axis represents the depth direction, and the z-axis represents the height direction.

[0101] Panel position information indicating the positions of pixel Pi11 at the top left, pixel Pi12 at the top right, pixel Pi13 at the bottom left, and pixel Pi14 at the bottom right is input to display cabinet 41-1-1. Display cabinet 41-1 calculates the viewing angle of viewer P21 relative to each of pixels Pi11 to Pi14.

[0102] The perspective used is a vertical perspective (zenith angle). And horizontal viewing angle (azimuth). To represent. For example, the vertical viewing angle of pixel Pi11 (the pixel viewed from below by viewer P21) at the top left corner of display box 41-1-1 in column 1 and level 1. Represented by negative values, and the vertical viewing angle of pixel Pi31 (the pixel viewed from above by viewer P21) at the bottom left corner of display box 41-1-4 in column 1 and level 4. Use positive values ​​to represent this. Furthermore, for example, the horizontal viewing angle of pixel Pi11 at the top left corner of display housing 41-1-1 in column 1 and level 1 (the pixel on the upper left when viewed from viewer P21). Represented by positive values, and the horizontal viewing angle of pixel Pi21 at the top right corner of display box 41-4-1 in column 4 and level 1 (the pixel on the right when viewed from viewer P21). Use negative values ​​to represent them.

[0103] Return to reference Figure 13 The viewpoint calculation unit 121 obtains the gain of each corner pixel based on the viewpoint relative to the pixel at each corner. Specifically, the viewpoint calculation unit 121 refers to the stored LUT and converts the viewpoint relative to the pixel at each corner into the gain of the pixel at each corner.

[0104] Figure 15 This is a diagram showing an example of a LUT.

[0105] exist Figure 15 In the diagram, the LUT for the red LED (R channel) is shown in the upper section, the LUT for the green LED (G channel) is shown in the middle section, and the LUT for the blue LED (B channel) is shown in the lower section. In each LUT, the horizontal viewing angle is (-60°). -40 -20 0 20 40 60 ) and vertical angle (-60) -40 -20 0 20 40 60 The combinations and gains are associated with each other and are registered.

[0106] The viewpoint calculation unit 121 provides the gain of the pixels at each corner to the register 102.

[0107] For example, the arithmetic operation unit 122 obtains the gain of the pixel at each corner from the register 102 and calculates the gain of the pixels other than the corner pixels by performing linear interpolation. The arithmetic operation unit 122 provides the gain of all pixels to the compensation unit 123.

[0108] The compensation unit 123 performs gain compensation on the image data by multiplying the pixel values ​​of the R, G, and B channels of each pixel of the image data transmitted from the display controller 63 by the gain of each pixel provided from the arithmetic operation unit 122. Based on the compensated image data, the compensation unit 123 generates luminous data indicating the luminous intensity of the LED 104 and provides the luminous data to the LED driver 103.

[0109] Register 102 stores the gain of the pixel at each corner provided by the view calculation unit 121.

[0110] LED driver 103 controls LED 104 based on light emission data provided from compensation unit 123, thereby causing LED 104 to emit light.

[0111] LED 104 is an LED disposed in each of the plurality of LED arrays 51 constituting the display housing 41.

[0112] Next, we will refer to Figure 16 The flowchart describes the processing performed by the image capture system 1 with the configuration described above.

[0113] In step S1, PC 62 calculates the position of the pixels at each corner of the display cabinet 41, and the display control unit 63 transmits panel position information indicating the position of each corner of the display cabinet 41 as the transmission destination to each display cabinet 41. Step S1 only needs to be performed once before the display image begins to be displayed by the display 12.

[0114] In step S2, the display controller 63 obtains viewing position information from the tracker 64 and the like.

[0115] In step S3, the display controller 63 transmits the viewing position information to each display cabinet 41.

[0116] In step S4, the viewing angle calculation unit 121 of the display cabinet 41 obtains the gain of the pixels at each corner. Specifically, the viewing angle calculation unit 121 calculates the viewing angle of the pixels at each corner of the display cabinet 41 relative to itself based on the viewing position information and panel position information transmitted from the display controller 63. The viewing angle calculation unit 121 refers to the LUT stored in the display cabinet 41 and converts the viewing angle relative to the pixels at each corner into the gain of the pixels at each corner.

[0117] In step S5, the arithmetic operation unit 122 calculates the gain of all pixels based on the gain of the pixels at the corners.

[0118] In step S6, the compensation unit 123 uses the gain of all pixels calculated by the arithmetic operation unit 122 to perform gain compensation on the image data.

[0119] In step S7, the display unit 41 displays the compensated segmented image. The segmented image is displayed on all display units 41, and thus the entire display image is displayed on the monitor 12.

[0120] As described above, in the image capture system 1 of this technology, viewing position information is obtained by the viewing angle calculation unit 121, which indicates the viewing position of the displayed image, and the control unit 101 controls the brightness of the segmented display unit (a group of LED arrays 51 constituting the display housing 41) based on the viewing position information. The segmented display unit is configured as a display unit by being arranged in a tiled manner.

[0121] This enables the suppression of image appearance non-uniformity due to the viewing angle characteristics of LEDs, such as the appearance of some areas of the displayed image on display 12 differing from that of other areas in terms of brightness, color, etc.

[0122] The series of processing steps described above can be executed by hardware or software. When software executes the series of processing operations, the program constituting the software is installed in a computer, general-purpose personal computer, or similar hardware embedded in dedicated hardware.

[0123] The program to be installed is recorded on the removable media to be provided, such as optical discs (CD-ROM, DVD, etc.) and semiconductor memory. The program can also be provided via wired or wireless transmission media such as local area networks, the Internet, or digital satellite broadcasting. The program can be pre-installed in ROM or a storage unit.

[0124] Note that a program executed by a computer may be a program that performs processing sequentially in the order described in this specification, or it may be a program that performs processing in parallel or at necessary time intervals (such as when a call is made).

[0125] In this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), and it is not important whether all components are housed in the same housing. Therefore, a system can refer to both multiple devices housed in a separate housing and connected via a network, and multiple modules housed in a single housing.

[0126] The effects described in this manual are merely examples, and the effects are not limited to these; other effects may also be produced.

[0127] The implementation of this technology is not limited to the implementation described above, and various modifications can be made without departing from the spirit of this technology.

[0128] Furthermore, each step described in the flowchart above can be performed by a single device, or can be shared and performed by multiple devices.

[0129] Furthermore, when a single step includes multiple processing operations, the multiple processing operations included in that single step can be performed by a single device, or can be shared and performed by multiple devices.

[0130] <Example of configuration combinations>

[0131] Note that this technology can also have the following configurations.

[0132] (1) A display system, comprising:

[0133] A segmented display unit, wherein the segmented display unit is configured to form a display unit by tiling the display units together;

[0134] An acquisition unit, configured to acquire viewing position information, the viewing position information indicating the viewing position of a display image displayed on a display unit; and

[0135] A brightness control unit is configured to control the brightness of the split display unit based on the viewing position information.

[0136] (2) The display system according to (1), wherein,

[0137] The brightness control unit controls the brightness by performing gain compensation on the segmented image displayed on the segmented display unit, the segmented image being obtained by segmenting the displayed image.

[0138] (3) The display system according to (2), wherein,

[0139] The acquisition unit calculates the viewing angle relative to predetermined pixels constituting the segmented display unit based on the viewing position information, and

[0140] The brightness control unit obtains the gain used for the gain compensation based on the viewing angle.

[0141] (4) The display system according to (3), wherein,

[0142] The brightness control unit calculates the gain compensation for pixels other than the predetermined pixel among the pixels constituting the segmented display unit by linear interpolation using the gain for the predetermined pixel.

[0143] (5) The display system according to (3), wherein,

[0144] The acquisition unit calculates the viewing angle relative to the pixels at the corners of the pixels constituting the segmented display unit based on the viewing position information.

[0145] (6) The display system according to (5), wherein,

[0146] The brightness control unit obtains a reference gain for gain compensation of the pixel at the corner based on the viewing angle relative to the pixel at the corner, and calculates a gain for gain compensation of the pixels other than the pixel at the corner among the pixels constituting the segmented display unit based on the reference gain.

[0147] (7) The display system according to (6), wherein,

[0148] The brightness control unit calculates the gain for gain compensation for pixels other than those at the corners by using linear interpolation of the reference gain.

[0149] (8) The display system according to any one of (3) to (7), wherein,

[0150] The brightness control unit references a LUT to obtain the gain for the gain compensation, and the LUT is used to output the gain for the gain compensation with the viewing angle as input.

[0151] (9) The display system according to any one of (2) to (8) further comprises:

[0152] A display controller is connected to a plurality of brightness control units corresponding to a plurality of segmented display units, and is configured to provide the segmented image to the plurality of brightness control units respectively.

[0153] (10) The display system according to (9), wherein,

[0154] The acquisition unit acquires the viewing position information via the display controller.

[0155] (11) The display system according to (10), wherein,

[0156] The acquisition unit acquires the following information as the viewing position information: the information indicates the position of the camera device used to capture an image of the subject against the background of the display unit.

[0157] (12) The display system according to (11), wherein,

[0158] The display controller provides the acquisition unit with viewing position information input from the tracker used to track the camera device.

[0159] (13) The display system according to (10), wherein,

[0160] The acquisition unit acquires the following information as the viewing position information: the information indicates the position of the viewer who is actually viewing the display unit.

[0161] (14) The display system according to any one of (1) to (13), comprising:

[0162] Multiple split display units; and

[0163] Multiple brightness control units, each corresponding to a multiple segmented display unit.

[0164] (15) The display system according to any one of (1) to (14), wherein,

[0165] The acquisition unit acquires the viewing position information from at least one other segmented display unit constituting the display unit.

[0166] (16) The display system according to any one of (1) to (15), comprising:

[0167] A providing unit, the providing unit being configured to provide the viewing position information to at least one other segmented display unit constituting the display unit.

[0168] (17) The display system according to any one of (1) to (16), wherein,

[0169] The split display unit is daisy-chained to at least one other split display unit constituting the display unit.

[0170] (18) An information processing method for a display system comprising segmented display units arranged in a tiled manner to form a display unit, the information processing method comprising:

[0171] Acquire viewing position information, which indicates the viewing position of the displayed image on the display unit; and

[0172] The brightness of the segmented display unit is controlled based on the viewing position information.

[0173] (19) According to the information processing method described in (18), wherein,

[0174] Brightness is controlled by performing gain compensation on the segmented image, which is obtained by segmenting the display image and displayed on the segmented display unit.

[0175] (20) The information processing method according to (19) further includes:

[0176] Calculate the viewing angle relative to the predetermined pixels constituting the segmented display unit based on the viewing position information; and

[0177] The gain used for the gain compensation is obtained based on the aforementioned perspective.

[0178] List of reference numerals

[0179] 1 Image capture system, 11 Camera device, 12 Display, 41 Display cabinet, 51 LED array, 61 Video server, 62 PC, 63 Display controller, 64 Tracker, 101 Control unit, 102 Register, 103 LED driver, 104 LED, 121 View angle calculation unit, 122 Arithmetic operation unit, 123 Compensation unit

Claims

1. A display system, comprising: A segmented display unit, wherein the segmented display unit is configured to form a display unit by tiling the display units together; An acquisition unit is configured to acquire viewing position information, the viewing position information indicating the viewing position of a display image displayed on a display unit; as well as A brightness control unit is configured to control the brightness of the split display unit based on the viewing position information.

2. The display system according to claim 1, wherein, The brightness control unit controls the brightness by performing gain compensation on the segmented image displayed on the segmented display unit, the segmented image being obtained by segmenting the displayed image.

3. The display system according to claim 2, wherein, The acquisition unit calculates the viewing angle relative to predetermined pixels constituting the segmented display unit based on the viewing position information, and The brightness control unit obtains the gain used for the gain compensation based on the viewing angle.

4. The display system according to claim 3, wherein, The brightness control unit calculates the gain compensation for pixels other than the predetermined pixel among the pixels constituting the segmented display unit by linear interpolation using the gain for the predetermined pixel.

5. The display system according to claim 3, wherein, The acquisition unit calculates the viewing angle relative to the pixels at the corners of the pixels constituting the segmented display unit based on the viewing position information.

6. The display system according to claim 5, wherein, The brightness control unit obtains a reference gain for gain compensation of the pixel at the corner based on the viewing angle relative to the pixel at the corner, and calculates a gain for gain compensation of the pixels other than the pixel at the corner among the pixels constituting the segmented display unit based on the reference gain.

7. The display system according to claim 6, wherein, The brightness control unit calculates the gain for gain compensation for pixels other than those at the corners by using linear interpolation of the reference gain.

8. The display system according to claim 3, wherein, The brightness control unit references a LUT to obtain the gain for the gain compensation, and the LUT is used to output the gain for the gain compensation with the viewing angle as input.

9. The display system according to claim 2, further comprising: A display controller is connected to a plurality of brightness control units corresponding to a plurality of segmented display units, and is configured to provide the segmented image to the plurality of brightness control units respectively.

10. The display system according to claim 9, wherein, The acquisition unit acquires the viewing position information via the display controller.

11. The display system according to claim 10, wherein, The acquisition unit acquires the following information as the viewing position information: the information indicates the position of the camera device used to capture an image of the subject against the background of the display unit.

12. The display system according to claim 11, wherein, The display controller provides the acquisition unit with viewing position information input from the tracker used to track the camera device.

13. The display system according to claim 10, wherein, The acquisition unit acquires the following information as the viewing position information: the information indicates the position of the viewer who is actually viewing the display unit.

14. The display system according to claim 1, comprising: Multiple segmented display units; as well as Multiple brightness control units, each corresponding to a multiple segmented display unit.

15. The display system according to claim 1, wherein, The acquisition unit acquires the viewing position information from at least one other segmented display unit constituting the display unit.

16. The display system according to claim 1, comprising: A providing unit, the providing unit being configured to provide the viewing position information to at least one other segmented display unit constituting the display unit.

17. The display system according to claim 1, wherein, The split display unit is daisy-chained to at least one other split display unit constituting the display unit.

18. An information processing method performed by a display system, the display system comprising segmented display units arranged in a tiled manner to form a display unit, the information processing method comprising: Acquire viewing position information, which indicates the viewing position of the displayed image on the display unit; as well as The brightness of the segmented display unit is controlled based on the viewing position information.

19. The information processing method according to claim 18, wherein, Brightness is controlled by performing gain compensation on the segmented image, which is obtained by segmenting the display image and displayed on the segmented display unit.

20. The information processing method according to claim 19, further comprising: The viewing position information is used to calculate the viewing angle relative to the predetermined pixels constituting the segmented display unit; as well as The gain used for the gain compensation is obtained based on the aforementioned perspective.

Images