Video processing method, program, and video processing system

Abstract

To provide a video processing method capable of facilitating adjustment of the color of video content output from a display device.SOLUTION: The video processing method includes the following steps: acquiring a first video content (S1); acquiring environmental information indicating the environment in which the display device that outputs the video to the display surface is installed (S2, S4); generating correction information for adjusting the color of the first video content and outputting the same as the second video content from the display device 2 based on the acquired environmental information (S6); and outputting the generated corrected information.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to a video processing method, a program, and a video processing system. [Background technology]

[0002] Patent Document 1 discloses a method for adjusting the image quality of an image display device that displays an image. This image quality adjustment method includes the steps of displaying a first image that is displayed with the least unevenness on the image display device, capturing the first image, generating first luminance distribution data from the captured image, displaying a second image on the image display device, capturing the second image, generating second luminance distribution data from the captured image, and adjusting the image quality of the image displayed on the image display device using the first luminance distribution data and the second luminance distribution data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-175615 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure provides a video processing method and the like that makes it easy to adjust the color of video content output from a display device. [Means for solving the problem]

[0005] In a video processing method according to one aspect of the present disclosure, a first video content is acquired. The video processing method acquires environmental information indicating an environment in which a display device that outputs an image to a display surface is installed. The video processing method generates correction information based on the acquired environmental information to adjust the color of the first video content and output it from the display device as a second video content. The video processing method outputs the generated correction information. [Effects of the Invention]

[0006] The present disclosure has an advantage in that it is easy to adjust the color of video content output from a display device. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic diagram showing an overall configuration including a video processing system according to an embodiment. [Figure 2] FIG. 2 is a flowchart showing an example of the basic operation of the video processing system according to the embodiment. [Figure 3] FIG. 3 is an explanatory diagram of an example of generation of correction information in the video processing system according to the embodiment. [Figure 4] FIG. 4 is a schematic diagram illustrating an example of a user interface used in the video processing system according to the embodiment. [Figure 5] FIG. 5 is a flowchart showing an example of a process for adjusting the color of video content according to the embodiment. [Figure 6] FIG. 6 is an explanatory diagram of an operation example in the color gamut adjustment mode. [Figure 7] FIG. 7 is an explanatory diagram of an example of operation in the color gamut adjustment mode when there are two display devices. DETAILED DESCRIPTION OF THE INVENTION

[0008] [1. Findings that formed the basis of this disclosure] First, the inventor's point of view will be explained below.

[0009] In order to achieve optimal visual expression, video content producers may create video content by adjusting the color (e.g., saturation, brightness, or hue) of the video for each scene. In such cases, producers generally do not create the video content at the location where the video is actually output (hereinafter referred to as the "site"), but at a location away from the site (hereinafter referred to as the "production site"). During the production of the video content, the producer adjusts the color of the video content while viewing the video content displayed on a display at the production site, for example.

[0010] However, since the production location and the on-site location are different, the environments where the video content is displayed are also different. For example, the video content is displayed on a monitor at the production location, while the video content is projected onto a screen using a display device such as a projector at the on-site location. This causes a problem that the video content that the producer adjusted the color of at the production location may not be displayed on the screen as intended by the producer at the on-site location due to environmental differences such as external light, making it difficult to adjust the color of the video content output from the display device.

[0011] In view of the above, the inventors have come up with the present disclosure.

[0012] Hereinafter, embodiments will be described with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component placement and connection forms, steps, step order, etc. shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components not described in independent claims will be described as optional components.

[0013] It should be noted that the drawings are schematic diagrams and are not necessarily strict illustrations. In addition, in the drawings, substantially the same components are denoted by the same reference numerals, and overlapping descriptions may be omitted or simplified.

[0014] (Embodiment) [2. Configuration] The overall configuration including a video processing system 1 according to an embodiment will be described below. FIG. 1 is a schematic diagram showing the overall configuration including a video processing system 1 according to an embodiment. The video processing system 1 is a system that adjusts the color of an image output by a display device 2, and includes a processor and a memory. In the embodiment, the video processing system 1 is realized by a server 4 and a media server 5. Therefore, in the embodiment, the processor of the video processing system 1 is a CPU 45 of the server 4, a CPU 56 of the media server 5, or a GPU 57 of the media server 5, which will be described later. Furthermore, the memory of the video processing system 1 is a memory 43 of the server 4 or a memory 53 of the media server 5. Furthermore, in the embodiment, the video processing system 1 (server 4 and media server 5) is used together with a display device 2 and a camera 3.

[0015] The display device 2 is installed on-site and outputs the video content output from the media server 5 onto a projection surface such as a screen. In other words, the display device 2 is a device that outputs video onto a display surface (projection surface). Hereinafter, video content created by the user will also be referred to as "first video content." Furthermore, video content that the media server 5 corrects the first video content and outputs to the display device 2 will also be referred to as "second video content." Note that when the correction process is performed on the display device 2, the correction information may be output from the media server 5 to the display device 2. In this case, the video content that is output as a result of the correction process performed on the display device 2 corresponds to the "second video content."

[0016] In this embodiment, the display device 2 is a projector. The display device 2 uses a magnifying projection optical system including a lens (not shown) to project image light formed by a light source and a spatial light modulation element onto a projection surface. The projection surface is not limited to a screen, and may be a surface of a structure other than a screen, such as a wall surface.

[0017] The camera 3 is installed on-site and has an image sensor. The camera 3 captures an image of the video output by the display device 2 or a screen as a projection surface onto which the video is projected, and generates captured data. The captured data is data in the form of an image. The captured data generated by the camera 3 is transmitted to the server 4. Here, the captured data is acquired as data indicative of the environment of the site (i.e., the environment in which the display device 2 is installed). In other words, external light such as indoor lighting or outdoor sunlight, which may vary depending on the environment in which the display device 2 is installed, may affect the appearance of the video output by the display device 2. The captured data corresponds to data indicative of the environment of the site, since it is data obtained by capturing an image affected by this external light. As will be described in detail later, the video processing system 1 controls the color of the video output by the display device 2 based on the captured data acquired by the camera 3 so that it is visually perceived as a color desired by the user.

[0018] The server 4 is installed at a location different from the site, and adjusts various parameters of the first video content in response to, for example, a user's operation. The various parameters include, for example, saturation, brightness, or hue. The server 4 includes a network interface 41, a storage 42, a memory 43, an input unit 44, and a CPU (Central Processing Unit) 45.

[0019] The network interface 41 is an interface for connecting to a network N1 such as a LAN (Local Area Network) or a WAN (Wide Area Network). The network interface 41 transmits, for example, the first video content to an external device via the network N1, and acquires captured data from the camera 3 via the network N1.

[0020] The storage 42 is a main storage device such as a hard disk, a solid state drive (SSD), or a flash memory, and has a function of storing data such as the first video content.

[0021] The memory 43 is configured by, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory), and temporarily stores data to be processed by the CPU 45, or stores programs to be executed by the CPU 45, etc.

[0022] The input unit 44 is a user interface that accepts inputs made by user operations. In the embodiment, the input unit 44 accepts information input by user operations in an external device 7, such as a personal computer used by the user, via the network N1. The external device 7 may be, for example, a portable information processing terminal, such as a smartphone or a tablet terminal.

[0023] The CPU 45 performs overall control of the server 4. The CPU 45 may be any processor capable of overall control of the server 4, such as an MPU (Micro Processing Unit) or an FPGA (Field-Programmable Gate Array).

[0024] The server 4 controls various operations of the server 4 in response to user operations received by the input unit 44, for example. For example, the server 4 acquires the first environmental information by generating the first environmental information based on the image capturing data acquired from the camera 3, and stores the first environmental information in the storage 42. Here, the first environmental information is information indicating the environment in which the display device 2 that outputs an image to a projection surface (display surface) is installed. The same applies to the second environmental information described below. Note that the first environmental information and the second environmental information will be simply referred to as "environmental information" when there is no particular need to distinguish between them.

[0025] The first environmental information is generated using a set of, for example, ambient light image data obtained by capturing with the camera 3 a projection surface on which no image is projected in order to acquire ambient light information, and test image data obtained by capturing with the camera 3 a test pattern that is output by the display device 2 and displayed on the projection surface. Note that the server 4 may acquire the first environmental information by reading out the first environmental information stored in the storage 42 in advance, instead of the captured data acquired from the camera 3.

[0026] Here, when the display device 2 is a projector, the external light information is information generated from an image captured of a projection surface such as a screen when no image is being projected. Specifically, the external light information may indicate at least one of the luminance distribution of a screen area in an image captured of the screen or the distribution of RGB (Red, Green, Blue) pixel values. Note that when the display device 2 is a flat panel display, the external light information is information generated from an image captured of a display surface when no image is being displayed.

[0027] The first environment information generated by the server 4 is used by the media server 5 to generate correction information for adjusting the colors of the video content output by the display device 2. Here, the correction information is, for example, a 3D-LUT (Lookup Table). A 3D-LUT is color conversion table data that, when three input values ​​of RGB of a video are input as a set, can obtain three converted output values ​​of RGB according to a predetermined array conversion and correction formula. Note that the correction information is not limited to a 3D-LUT, and may be, for example, 1D-LUT data in which each RGB table is independent. Furthermore, the correction information may be image data.

[0028] Furthermore, the server 4 transmits the first video content, the first environmental information, and color adjustment information for the first video content (described later) stored in the storage 42 to the media server 5 via the network N1 as content to be output by the display device 2. Note that communication between the server 4 and the media server 5 is not limited to via the network N1, and may be wired communication such as a USB (Universal Serial Bus) cable, or wireless communication such as Wi-Fi (registered trademark).

[0029] The media server 5 is installed on-site and stores the first video content, first environment information, color adjustment information, etc. acquired from the server 4 in order to output the second video content to the display device 2. The media server 5 includes a network interface 51, a storage 52, a memory 53, an input unit 54, an output unit 55, a CPU 56, and a GPU (Graphics Processing Unit) 57.

[0030] The network interface 51 is an interface for connecting to a network N1 such as a LAN or a WAN, etc. The network interface 51 acquires data transmitted from the server 4 via the network N1, for example.

[0031] The storage 52 is a main storage device such as a hard disk, SSD, or flash memory, and has a function of storing the first video content, first environmental information, color adjustment information, etc. acquired from the server 4. The storage 52 also has a function of storing the second video content.

[0032] The memory 53 is configured by, for example, a RAM or a ROM, and temporarily stores data to be processed by the CPU 56 or the GPU 57, and stores programs to be executed by the CPU 56 or the GPU 57.

[0033] The input unit 54 is an interface for connecting to the camera 3. The input unit 54 acquires photographic data from the camera 3. Note that communication between the input unit 54 and the camera 3 may be wired communication or wireless communication.

[0034] The output unit 55 is an interface for connecting to the display device 2. The output unit 55 outputs the second video content to the display device 2. Note that communication between the output unit 55 and the display device 2 may be wired communication or wireless communication.

[0035] The CPU 56 performs overall control of the media server 5. The CPU 56 may be any processor capable of performing overall control of the media server 5, and may be an MPU, an FPGA, or the like.

[0036] The GPU 57 is a computing device that executes image processing related to the first video content or the second video content stored in the storage 52.

[0037] The media server 5 stores the shooting data acquired by the camera 3 as environmental information (here, second environmental information) in the storage 52. The media server 5 also generates correction information based on the environmental information acquired from the camera 3 and the color adjustment information acquired from the server 4. The correction information is information for correcting the first video content acquired from the server 4 into the second video content to be output from the display device 2, and as already mentioned, is, for example, a 3D-LUT. The correction information generated by the media server 5 is stored in the storage 52. The second video content corrected using the correction information is output to the display device 2.

[0038] The correction information may be generated by the server 4. In this case, there is an advantage that if there is no significant difference between the first environmental information and the second environmental information when the first environmental information and the second environmental information are compared in the media server 5, which will be described later, the process of generating the correction information by the media server 5 can be omitted.

[0039] [3. Operation] The operation of the video processing system 1 according to the embodiment will be described below.

[0040] [3-1. Basic operation example] First, an example of a basic operation of the video processing system 1 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a flowchart showing an example of a basic operation of the video processing system 1 according to the embodiment. In the following description, it is assumed that the first video content has already been created by the user.

[0041] Each of the server 4 and the media server 5 acquires the first video content by storing the first video content in a storage (S1). Specifically, the server 4 stores the first video content in storage 42. Furthermore, the media server 5 stores the first video content transmitted from the server 4 via the network N1 in storage 52.

[0042] Next, the media server 5 acquires the first environmental information from the server 4 via the network N1 (S2). The first environmental information may be data generated from photographed data acquired by photographing the environment in which the display device 2 is installed with the camera 3 in advance, or may be data prepared in advance. Note that the media server 5 may acquire the first environmental information directly from the camera 3.

[0043] Next, the server 4 receives an input for adjusting the color of the first video content, and acquires color adjustment information based on the input (S3). The color of the first video content is adjusted by the user operating the external device 7 to select a color gamut adjustment mode or adjust the RGB values ​​of the selected color. Details of the color adjustment of the first video content will be described later. The acquired color adjustment information is transmitted to the media server 5. The color adjustment information is used to adjust the RGB of the input side of the 3D-LUT as correction information. Step S3 may be executed after steps S4 and S5.

[0044] Next, the media server 5 acquires, as second environmental information, a set of ambient light image data obtained by capturing an image of a projection surface on which no image is projected, and test image data obtained by capturing a test pattern output by the display device 2 and displayed on the projection surface from the camera 3 (S4). Here, the test pattern uses a black image in which all pixels are black, and a white image in which all pixels are white. Therefore, the test image data includes black image data obtained by capturing a black image, and white image data obtained by capturing a white image. Note that, in order to acquire more detailed second environmental information, at least one or more images selected from the RGB monochrome images and halftone images may be added to the test pattern.

[0045] Next, the media server 5 determines the environmental information by comparing the acquired second environmental information with the first environmental information (S5). This comparison between the second environmental information and the first environmental information includes a comparison between ambient light image data and a comparison between test image data. Specifically, this comparison is realized by extracting the difference in RGB values ​​of each pixel of the image data.

[0046] In step S5, if there is no significant difference between the first environmental information and the second environmental information, the media server 5 determines the first environmental information as the environmental information. On the other hand, if there is a significant difference between the first environmental information and the second environmental information, the media server 5 determines data obtained by adding information indicating the difference between the first environmental information and the second environmental information obtained by the comparison to the first environmental information as the environmental information. Here, an example of a case where there is no significant difference between the first environmental information and the second environmental information is when the difference in brightness distribution between the ambient light image data and the test image data falls within a predetermined brightness distribution range.

[0047] Next, the media server 5 generates a 3D-LUT as correction information based on the color adjustment information generated in step S3 and the environmental information determined in step S5 (S6). Then, the media server 5 uses the generated correction information to generate second video content to be output by the display device 2 (S7). In step S7, the media server 5 generates the second video content by converting the video signal of the first video content acquired in step S1 into the video signal of the second video content using the correction information.

[0048] Note that in step S6, the media server 5 may generate a 3D-LUT as correction information without using color adjustment information, and generate video content using the generated correction information. In this case, the generated video content may be displayed in a second display area 62 of the user interface screen 6, which will be described later. After step S3 is executed, the media server 5 may then execute step S6.

[0049] Here, the generation of correction information will be described in more detail with reference to FIG. 3. FIG. 3 is an explanatory diagram of an example of generation of correction information in the video processing system 1 according to the embodiment. (a) of FIG. 3 is an explanatory diagram when video content is output, and (b) of FIG. 3 is an explanatory diagram when correction information is generated. As shown in (a) of FIG. 3, the 3D-LUT generated by the media server 5 receives an input image (first video content) and outputs a corrected output image (second video content). In generating the correction information used to correct this video content, ambient light image data and test image data as environmental information are used as follows.

[0050] First, the media server 5 acquires the distribution of pixel values ​​of the ambient light image data, the distribution of pixel values ​​of the black image data in the test image data, and the distribution of pixel values ​​of the white image data.

[0051] Next, the media server 5 calculates the correlation between the pixel values ​​of the input image and the captured image for each pixel using the pixel values ​​of the acquired ambient light image data, the pixel values ​​of the white image data, and the pixel values ​​of the black image data. As shown in FIG. 3(b), the input image is an image that the media server 5 inputs to the 3D-LUT. However, since no correction using the 3D-LUT is performed at the stage of generating the correction information, the input image is the same as the output image output by the display device 2 (in other words, the image input from the media server 5 to the display device 2). The captured image is an image of the projection surface captured by the camera 3. To calculate the correlation, for example, a simple difference between the input image and the captured image can be used. Alternatively, if the input image is a monochromatic image of each of RGB, a known calculation method such as a color conversion matrix (color correction matrix) can be used.

[0052] Then, the media server 5 can use the calculated correlation information and the pixel values ​​of the ambient light image data to calculate, for each pixel, the pixel values ​​of the output image required to obtain a captured image with uniform pixel values.

[0053] By converting the relationship between the pixel value of the input image and the pixel value of the output image calculated above into data for each RGB, it is possible to generate a 3D-LUT as correction information. Note that the reference pixel value for uniform pixel values ​​can be, for example, the average brightness value or the darkest brightness value.

[0054] Then, the media server 5 transmits (outputs) the generated second video content to the display device 2, thereby causing the display device 2 to output the second video content (S8).

[0055] The media server 5 may determine the first environmental information acquired from the server 4 as the environmental information without executing step S4, and execute step S6 using the determined environmental information. In this case, the media server 5 does not need to execute step S5. This process is executed when the first environmental information is selected in a first adjustment area 64 of the user interface screen 6, which will be described later.

[0056] [3-2. User Interface] Next, a user interface used in the video processing system 1 according to the embodiment will be described. Fig. 4 is a schematic diagram showing an example of a user interface used in the video processing system 1 according to the embodiment. More specifically, Fig. 4 shows a user interface screen 6 displayed on a display provided in the external device 7, which is used by the user to adjust the color of the video content (first video content) stored in the server 4 or the media server 5.

[0057] A first adjustment area 64, a second adjustment area 65, and a third adjustment area 66 are displayed at the top of the user interface screen 6. The first adjustment area 64 is an area for selecting environmental information. The second adjustment area 65 is an area for adjusting the colors of the video content. The third adjustment area 66 is an area for adjusting the RGB values ​​of the video content. The data adjusted in the second adjustment area 65 and the third adjustment area 66 is reflected in the color adjustment information.

[0058] In addition, at the bottom of the user interface screen 6, a first display area 61, a second display area 62, and a third display area 63 are displayed.

[0059] The first display area 61 is an area for displaying the first video content. The first display area 61 accepts the selection of the first video content by the user. Then, the first display area 61 displays the first video content selected by the user.

[0060] The second display area 62 is an area that displays video content that is generated based on the first video content and environmental information and has not undergone color adjustment.

[0061] The third display area 63 is an area for displaying the video content displayed in the second display area 62 after the color of the video content has been adjusted.

[0062] The first adjustment area 64 accepts the user's selection of environmental information. Selectable environmental information includes first environmental information and second environmental information. In selecting environmental information, both the first environmental information and the second environmental information may be selectable if the site can be photographed by the camera 3, and only the first environmental information may be selectable if the site cannot be photographed by the camera 3. The video processing system 1 (media server 5) generates a 3D-LUT as correction information based on the environmental information selected in the first adjustment area 64, and generates the second video content using the generated correction information.

[0063] The second adjustment area 65 accepts the user's selection of a color gamut adjustment mode when the color gamut that the external device 7 can output differs from the color gamut that the display device 2 can output. Information regarding the color gamuts of the external device 7 and the display device 2 may be stored in advance in the storage 42 of the server 4, or may be obtained from an external source via the network N1. In this embodiment, the color gamut adjustment modes include a color gamut balance mode and a color gamut priority mode. Details of the color gamut balance mode and the color gamut priority mode will be described later.

[0064] The third adjustment area 66 accepts the user's selection of the color to be adjusted. Specifically, in the third adjustment area 66, the user selects the desired color to be adjusted, and adjusts the RGB values ​​of the selected color to adjust the hue of the video content.

[0065] As described above, the user can adjust the color of the video content by operating the external device 7 while looking at the user interface screen 6, and can confirm the results of the correction by looking at the second display area 62 and the third display area 63.

[0066] [3-3. Adjusting the color of video content] Next, color adjustment of video content will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of processing for adjusting the color of video content according to the embodiment.

[0067] First, the user selects the color gamut adjustment mode by selecting either the radio button corresponding to the color gamut priority mode or the radio button corresponding to the color balance priority mode in the second adjustment area 65 of the user interface screen 6 (S31).

[0068] Fig. 6 is an explanatory diagram of an operation example of the color gamut adjustment mode. Specifically, Fig. 6 shows an xy chromaticity diagram of video content. Fig. 6 also shows an example in which the color gamut A1 of the external device 7 (see the triangle drawn by the solid line in Fig. 6) is larger than the color gamut A2 of the display device 2 (see the triangle drawn by the dashed line in Fig. 6).

[0069] When the color gamut balance mode is selected by the user, the colors of the video content are adjusted by compressing the entire color gamut based on the color gamut A2 of the display device 2 so that the overall balance is achieved when the video content is displayed in the color gamut A2 of the display device 2.

[0070] When the color gamut priority mode is selected by the user, the colors of the video content are adjusted so that the hues of the overlapping portions of the color gamut A1 of the external device 7 and the color gamut A2 of the display device 2 are maintained when displayed in the color gamut A2 of the display device 2. On the other hand, the colors of the video content that can be displayed in the color gamut A1 of the external device 7 but cannot be displayed in the color gamut A2 of the display device 2 are converted into hues that can be reproduced within the range of the color gamut A2 of the display device 2, thereby adjusting the colors of the video content.

[0071] Returning to FIG. 5, after selecting the color gamut adjustment mode (S31), the user then selects a color to be adjusted while viewing the video content displayed in the third display area 63 (S32). Here, the user selects one of the multiple colors (here, 16 colors) shown in FIG. 4 as the color to be adjusted. In the example shown in FIG. 4, each of the multiple colors displayed in the third adjustment area 66 is represented by hatching. The 16 colors may be, for example, the 16 colors defined in HTML3.2 or HTML4.01 in the Web technology field, but are not limited to this. Furthermore, the multiple colors are not limited to 16 colors, and may be less than 16 colors or more than 16 colors.

[0072] 5, when the user selects a color to be adjusted (S32: Yes), the user adjusts the RGB values ​​of the color to be adjusted (S33). The R value, G value, and B value are all represented by signal values ​​ranging from 0 to 255. Note that if the processor included in the video processing system 1 has relatively high performance and can perform color adjustment calculations over a wider range of RGB values, the R value, G value, and B value may be represented by signal values ​​ranging from 0 to 255.

[0073] Specifically, when the user selects a color to be adjusted, the current RGB values ​​of the color to be adjusted are displayed in the third adjustment area 66. The user then determines the RGB values ​​of the color to be adjusted while viewing the video content displayed in the third display area 63. Note that if there are multiple colors to be adjusted, the above process is repeated for each of the multiple colors to be adjusted.

[0074] If the user does not select a color to be adjusted, that is, if there is no color to be adjusted to begin with, or if the user has adjusted all the colors to be adjusted (S32: No), the color adjustment of the video content ends.

[0075] [4. Advantages, etc.] The advantages of the video processing system 1 (video processing method) according to the embodiment will be described below. As described above, the video processing system 1 according to the embodiment generates and outputs correction information for adjusting the color of the first video content and outputting it as the second video content from the display device 2 based on environmental information indicating the environment of the site where the display device 2 is installed. Therefore, the video processing system 1 according to the embodiment has the advantage that it is easy to adjust the color of the video content to be output from the display device 2, for example, by adjusting the color of the first video content produced by a producer at the production site using the correction information, so that the second video content can be output as the video content intended by the producer even at the site where the display device 2 is installed.

[0076] [5. Other embodiments] Although the embodiments have been described above, the present disclosure is not limited to the above-described embodiments.

[0077] In the above embodiment, the image processing system 1 targets one display device 2 and one camera 3, but this is not limited to this. For example, the image processing system 1 may target multiple display devices 2 and multiple cameras 3. Below, the processing when there are multiple display devices 2 and multiple cameras 3 will be described, focusing on only the differences from the processing when there is one display device 2 and one camera 3.

[0078] When there are multiple display devices 2 and cameras 3, each camera 3 captures an image of the projection surface on which the corresponding display device 2 is not projecting any image, and also captures a test pattern that is output and displayed on the projection surface by the corresponding display device 2. Here, while any display device 2 is displaying a test pattern on the projection surface, the other display devices 2 do not display a test pattern on the projection surface.

[0079] Next, the image processing system 1 performs a process of matching the brightness of common parts in the image data of each camera 3. Specifically, the image processing system 1 acquires multiple pieces of image data from multiple cameras 3 and determines a common image area in the multiple pieces of image data. Next, the image processing system 1 adjusts the brightness of each piece of image data so that the brightness in the image area matches, and saves the adjusted multiple pieces of image data as environmental information (first environmental information or second environmental information). Note that this process is not necessary when there is only one camera 3.

[0080] Furthermore, when there are multiple display devices 2, the user selects the color gamut to be used in addition to selecting either the color gamut priority mode or the color balance priority mode in the second adjustment area 65 of the user interface screen 6. Details of this will be explained below with reference to FIG.

[0081] FIG. 7 is an explanatory diagram of an example of operation of the color gamut adjustment mode when two display devices are used. When there are multiple display devices 2 (two in this example), an xy chromaticity diagram such as that shown in FIG. 7 is displayed in the second adjustment area 65 of the user interface screen 6. This xy chromaticity diagram displays the color gamut A1 of the external device 7 (see the solid triangle in FIG. 7), the color gamut A21 of one of the two display devices 2 (see the dashed triangle in FIG. 7), and the color gamut A22 of the other display device 2 (see the dashed triangle in FIG. 7). The xy chromaticity diagram also displays the color gamut A3 to be used (see the thick solid triangle in FIG. 7), and the user can select the color gamut to be used when adjusting the colors of the video content by manipulating the color gamut A3. Note that if the color gamut A1 of the external device 7 and the color gamuts A21 and A22 of each display device 2 cannot be obtained, the above operation does not need to be performed.

[0082] Furthermore, in the above embodiment, the video processing system 1 is realized by a plurality of devices (the server 4 and the media server 5), but this is not limiting. For example, the video processing system 1 may be realized by a single device. In other words, the video processing system 1 may be realized by a single server that has the functions of both the server 4 and the media server 5.

[0083] In the above-described embodiment, the processing performed by a specific processing unit may be performed by another processing unit. The order of multiple processing operations may be changed, or multiple processing operations may be performed in parallel.

[0084] In the above-described embodiments, each component may be realized by executing a software program suitable for that component, or by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0085] Furthermore, each component may be realized by hardware. Each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0086] Furthermore, the general or specific aspects of the present disclosure may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0087] The present disclosure may also be realized as a video processing method executed by a computer such as the video processing system of the above-described embodiments. The present disclosure may also be realized as a program (computer program product) for causing a computer to execute such a video processing method, or as a computer-readable non-transitory recording medium on which such a program is recorded.

[0088] In addition, this disclosure also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art would think of, or forms realized by arbitrarily combining the components and functions of each embodiment within the scope that does not deviate from the intent of this disclosure.

[0089] (summary) As described above, in the video processing method according to the first aspect, first video content is acquired (S1). This video processing method also acquires environmental information indicating the environment in which the display device 2 that outputs the video to the display surface is installed (S2, S4). This video processing method also generates correction information based on the acquired environmental information to adjust the color of the first video content and output it from the display device 2 as second video content (S6). This video processing method also outputs the generated correction information.

[0090] In such a video processing method, for example, by adjusting the color of the first video content produced by the producer at the production location using correction information, the second video content can be output as the video content intended by the producer even at the site where the display device 2 is installed, which has the advantage of making it easy to adjust the color of the video content output from the display device 2.

[0091] In addition, for example, in the video processing method according to the second aspect, the first video content is corrected based on the correction information in the first aspect to generate the second video content (S7), and the generated second video content is output from the display device 2 (S8).

[0092] In such a video processing method, for example, by adjusting the color of the first video content produced by the producer at the production location using correction information, the second video content can be output as the video content intended by the producer even at the site where the display device 2 is installed, which has the advantage of making it easy to adjust the color of the video content output from the display device 2.

[0093] Furthermore, for example, in a video processing method according to a third aspect, the first video content, the color of which has been adjusted based on environmental information in the first or second aspect, is output from the display device 2. This video processing method also receives an input for adjusting the color of the first video content, and further acquires color adjustment information based on the input (S3). This video processing method also generates correction information based on the acquired color adjustment information and environmental information (S6).

[0094] In such a video processing method, the color of the first video content is adjusted taking into account not only environmental information but also color adjustment information based on input from the producer for adjusting the color, for example, which has the advantage that it is easier to make more detailed adjustments to the color of the video content output from the display device 2.

[0095] Also, for example, in the video processing method according to the fourth aspect, in the process of acquiring color adjustment information in the third aspect, the color adjustment information is acquired based on an input for adjusting the RGB values ​​of one or more colors to be adjusted (S3).

[0096] In such a video processing method, for example, adjustments made by the producer to the RGB values ​​of one or more colors to be adjusted are reflected in the color adjustment information, which has the advantage of making it easier to make more detailed adjustments to the colors of the video content output from the display device 2.

[0097] Also, for example, in the video processing method according to the fifth aspect, in the third or fourth aspect, the process of acquiring color adjustment information acquires the color adjustment information based on an input that selects a color gamut based on the color gamut A1 that can be output by the external device 7 that produced the first video content and the color gamut A2 that can be output by the display device 2 (S3).

[0098] In such a video processing method, the color adjustment information reflects a color gamut that takes into account, for example, the color gamut A1 of the external device 7 used by the producer and the color gamut A2 of the display device 2, which has the advantage of making it easier to make more detailed adjustments to the colors of the video content output from the display device 2.

[0099] Also, for example, in the video processing method according to the sixth aspect, in any one of the first to fifth aspects, the process of acquiring environmental information involves generating and acquiring environmental information from data captured by a camera 3 of a display surface on which no image is displayed and data captured by a camera 3 of a test pattern output by the display device 2 and displayed on the display surface (S2, S4).

[0100] This type of video processing method has the advantage that the impact of external light on the display surface in the environment in which the display device 2 is installed is reflected in the environmental information, making it easier to make more detailed adjustments to the color of the video content output from the display device 2.

[0101] Furthermore, for example, in a video processing method according to a seventh aspect, in any one of the first to sixth aspects, environmental information is further acquired as second environmental information (S4). Furthermore, in this video processing method, environmental information to be used when generating correction information is determined based on a comparison between the first environmental information, which is existing environmental information, and the acquired second environmental information (S5).

[0102] With such an image processing method, even if the environment of the site where the display device 2 is installed may change, correction information can be generated using environmental information that reflects the environmental change, which has the advantage that it is easy to adjust the color of the image content output from the display device 2 in accordance with changes in the site environment.

[0103] Furthermore, for example, a program according to an eighth aspect causes one or more processors to execute the video processing method according to any one of the first to seventh aspects.

[0104] Such a program has the advantage that, for example, by adjusting the color of the first video content produced by the producer at the production location using correction information, the second video content can be output as the video content intended by the producer even at the site where the display device 2 is installed, making it easy to adjust the color of the video content output from the display device 2.

[0105] Furthermore, for example, a video processing system 1 according to a ninth aspect includes a processor (CPU 45, CPU 56, or GPU 57) and a memory (memory 43 or memory 53). The processor acquires a first video content (S1). The processor also acquires environmental information indicating an environment in which a display device 2 that outputs a video to a display surface is installed (S2, S4). The processor also generates correction information based on the acquired environmental information to adjust the color of the first video content and output it from the display device 2 as a second video content (S6). The processor also outputs the generated correction information.

[0106] In such a video processing system 1, for example, by adjusting the color of the first video content produced by a producer at the production location using correction information, the second video content can be output as the video content intended by the producer even at the location where the display device 2 is installed, which has the advantage of making it easy to adjust the color of the video content output from the display device 2. [Industrial Applicability]

[0107] The image processing method and the like of the present disclosure can be used in a system and the like that processes images output from a display device such as a projector. [Explanation of symbols]

[0108] 1. Video processing system 2 Display device 3 Camera 4 Server 41 Network Interface 42 Storage 43 Memory 44 Input section 45 CPU 5 Media Server 51 Network Interface 52 Storage 53 Memory 54 Input section 55 Output section 56 CPU 57 GPU 6 User Interface Screen 61 First display area 62 Second display area 63 Third display area 64 First Adjustment Area 65 Second Adjustment Area 66 Third Adjustment Area 7 External device A1, A2, A21, A22, A3 color gamut N1 Network

Claims

1. obtaining a first video content; acquires environmental information indicating an environment in which a display device that outputs an image to a display surface is installed; generating correction information for adjusting a color of the first video content and outputting the second video content from the display device based on the acquired environmental information; outputting the generated correction information; Image processing method.

2. correcting the first video content based on the correction information to generate the second video content; outputting the generated second video content from the display device; The video processing method according to claim 1 .

3. outputting the first video content, the color of which has been adjusted based on the environmental information, from the display device; receiving an input for adjusting a color of the first video content, and further acquiring color adjustment information based on the input; generating the correction information based on the acquired color adjustment information and environmental information; The video processing method according to claim 1 .

4. In the process of acquiring the color adjustment information, the color adjustment information is acquired based on an input for adjusting RGB values ​​of one or more colors to be adjusted. The video processing method according to claim 3 .

5. and acquiring the color adjustment information based on an input for selecting a color gamut based on a color gamut that can be output by an external device that produced the first video content and a color gamut that can be output by the display device. The video processing method according to claim 3 .

6. In the process of acquiring the environmental information, the environmental information is generated and acquired from data obtained by capturing an image of the display surface with no image displayed thereon using a camera and data obtained by capturing an image of a test pattern output by the display device and displayed on the display surface using the camera. The video processing method according to any one of claims 1 to 5.

7. The environmental information is further acquired as second environmental information; determining the environmental information to be used when generating the correction information based on a comparison between first environmental information, which is the existing environmental information, and the acquired second environmental information; The video processing method according to any one of claims 1 to 5.

8. one or more processors, Executing the video processing method according to any one of claims 1 to 5, program.

9. a processor and a memory, The processor: obtaining a first video content; acquires environmental information indicating an environment in which a display device that outputs an image to a display surface is installed; generating correction information for adjusting a color of the first video content and outputting the second video content from the display device based on the acquired environmental information; outputting the generated correction information; Video processing system.

Images