Information processing device, lighting system, information processing method, and lighting system control method
The information processing device synchronizes lighting devices with display content to expand the visible area by determining and controlling lighting based on acquired color and position information, addressing the limitations of existing ambient lighting systems.
Patent Information
- Application Number
- JP2021203836
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-12-16
- Publication Date
- 2025-11-19
- Estimated Expiration
- 2041-12-16
AI Technical Summary
Existing ambient lighting systems for display devices are limited in expanding the display area, as the light source is confined to the back surface, restricting the ambient lighting effect.
An information processing device and method that acquires color and position information from a display unit, determining lighting color information for multiple lighting devices positioned around the display area, and transmitting this information to control the lighting devices to illuminate the surrounding environment based on the displayed image content.
Enables a wider range of ambient lighting that enhances the immersive experience by synchronizing the lighting with the displayed image, effectively expanding the visible display area beyond the device's boundaries.
Smart Images

Figure 0007773360000001 
Figure 0007773360000002 
Figure 0007773360000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing device, a lighting system, an information processing method, and a method for controlling a lighting system. [Background technology]
[0002] Patent Document 1 describes an ambient lighting system for a display device. More specifically, a light source is provided on the back of the display device, and light is emitted from the light source onto an ambient surface surrounding the display area of the display device. As a result, the ambient surface serves to expand the display area. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Special Publication No. 2010-511988 Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the configuration disclosed in Patent Document 1, the light source is provided on the back surface of the display, so the ambience surface is also limited to the periphery of the back surface of the display. In other words, the effect of expanding the display area by the light source is limited.
[0005] One aspect of the present invention provides an information processing device, a lighting system, an information processing method, and a lighting system control method that are capable of irradiating a wider range with light based on color information displayed on a display. [Means for solving the problem]
[0006] An information processing device according to one embodiment of the present invention includes a color information acquisition unit that acquires color information relating to an image displayed on a display unit, a position information acquisition unit that acquires relative position information between the display unit and a lighting device installed at a distance from the display unit, a determination unit that determines lighting color information to be turned on by the lighting device based on the color information and the position information, and a transmission unit that transmits the lighting color information to the lighting device.
[0007] Furthermore, a lighting system according to one embodiment of the present invention includes the information processing device and the lighting device, and the lighting device includes a receiving unit that receives lighting color information and a lighting control unit that turns on a lighting unit that is capable of emitting light based on the lighting color information received by the receiving unit.
[0008] Furthermore, an information processing method according to one embodiment of the present invention includes acquiring color information relating to an image displayed on a display unit, acquiring relative position information between the display unit and a lighting device installed at a distance from the display unit, determining lighting color information to be turned on by the lighting device based on the color information and the position information, and transmitting the lighting color information to the lighting device.
[0009] Furthermore, a method for controlling a lighting system according to one embodiment of the present invention includes acquiring color information relating to an image displayed on a display unit, acquiring relative position information between the display unit and a lighting device installed at a distance from the display unit, determining lighting color information to be turned on by the lighting device based on the color information and the position information, transmitting the lighting color information to the lighting device, and having received the lighting color information, turning on a lighting unit capable of turning on light based on the lighting color information. [Brief explanation of the drawings]
[0010] [Figure 1] FIG. 1 is a conceptual diagram of a lighting system according to a first embodiment. [Figure 2] FIG. 1 is a block diagram of a television receiver and an audio device according to a first embodiment. [Figure 3A] FIG. 2 is a conceptual diagram of a high-resolution image according to the first embodiment. [Figure 3B] FIG. 2 is a conceptual diagram of a low-resolution image according to the first embodiment. [Figure 3C] FIG. 3 is a conceptual diagram of color information according to the first embodiment. [Figure 4A] FIG. 2 is a conceptual diagram of location information according to the first embodiment. [Figure 4B] FIG. 2 is a conceptual diagram of location information according to the first embodiment. [Figure 5A] FIG. 2 is a conceptual diagram of an audio signal according to the first embodiment. [Figure 5B] FIG. 2 is a conceptual diagram of an audio signal according to the first embodiment. [Figure 6A] 1 is an external view of a lighting device according to a first embodiment. [Figure 6B] FIG. 1 is a conceptual diagram showing the internal configuration of a lighting device according to a first embodiment. [Figure 7] 4 is a flowchart showing the operation of the lighting system according to the first embodiment. [Figure 8A] 4 is a diagram showing the relationship between each area of a low-resolution image and a lighting device according to the first embodiment. [Figure 8B] FIG. 1 is a conceptual diagram showing the internal configuration of a lighting device according to a first embodiment. [Figure 8C] FIG. 1 is a conceptual diagram showing how the lighting device according to the first embodiment illuminates the inside of a room. [Figure 9A] FIG. 10 is an external view of a lighting device according to a second embodiment. [Figure 9B] FIG. 10 is an external view of a lighting device according to a second embodiment. [Figure 10] FIG. 10 is a conceptual diagram showing how the lighting device according to the second embodiment illuminates the inside of a room. [Figure 11] 10 is a diagram showing the relationship between each area of a low-resolution image and a lighting device according to the second embodiment. [Figure 12] FIG. 10 is an external view of a lighting device according to a third embodiment. [Figure 13] FIG. 10 is a conceptual diagram showing how an illumination device according to a third embodiment illuminates the inside of a room. [Figure 14] 11 is a diagram showing the relationship between each area of a low-resolution image and a lighting device according to the third embodiment. [Figure 15A] FIG. 10 is a conceptual diagram of a subframe according to the fourth embodiment. [Figure 15B]FIG. 10 is a conceptual diagram of a subframe according to the fourth embodiment. [Figure 16A] FIG. 11 is a block diagram of a television receiver and an audio device according to a fifth embodiment. [Figure 16B] FIG. 13 is a conceptual diagram of an audio signal according to the fifth embodiment. [Figure 16C] 10 is a flowchart showing the operation of a lighting system according to a fifth embodiment. [Figure 17] FIG. 13 is a conceptual diagram showing how an illumination device according to a sixth embodiment illuminates the inside of a room. [Figure 18A] 13 is a diagram showing the relationship between each area of a low-resolution image and a lighting device according to the sixth embodiment. [Figure 18B] 13 is a diagram showing the relationship between each area of a low-resolution image and a lighting device according to the sixth embodiment. [Figure 19] 10A to 10C are conceptual diagrams of video signals and audio signals according to modifications of the first to sixth embodiments. DETAILED DESCRIPTION OF THE INVENTION
[0011] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same or equivalent elements are designated by the same reference numerals, and redundant description will be omitted.
[0012] (First embodiment) An information processing device, a lighting system, an information processing method, and a lighting system control method according to a first embodiment of the present invention will be described. This embodiment relates to a lighting device including, for example, a television set installed in a user's room and, for example, multiple lighting devices. The lighting devices are turned on based on their relative position relative to the television set and color information of the areas associated with the lighting devices within the television set's display area, thereby illuminating the walls of the room. As an example, lighting devices located on the left and right sides of the television set are associated with the respective left and right areas of the television set's display area and emit light of the same or similar color as the associated areas. This allows the entire room to be illuminated with a color similar to the image displayed on the television set, enhancing the sense of immersion when, for example, watching live music video.
[0013] <Lighting system configuration> Fig. 1 is a conceptual diagram of a lighting system according to this embodiment, showing the three-dimensional space of a room to which the lighting system is applied as viewed from the front of a television receiver. In the example of Fig. 1, for convenience of explanation, the horizontal direction of the room is defined as the X direction and the Y direction, and the vertical direction is defined as the Z direction. Therefore, the floor and ceiling of the room are the XY plane, and the walls are the XZ plane or the YZ plane.
[0014] As shown in the figure, the lighting system 1 according to this embodiment includes a television set 100, an audio device 200, a plurality of lighting devices 300-1 to 300-11, and a plurality of speakers 400-1 to 400-3. The speakers 400-1 to 400-3 are arranged on a floor 500-4 along three wall surfaces 500-1 to 500-3, respectively. The speakers 400-1 to 400-3 receive audio signals from the television set 100 via the audio device 200 and output audio. Note that when the lighting devices 300-1 to 300-11 are not distinguished from one another, they will simply be referred to as lighting devices 300, and similarly, when the speakers 400-1 to 400-3 are not distinguished from one another, they will simply be referred to as speakers 400. The same applies to the wall surfaces 500-1 to 500-3. The number of lighting devices 300 and speakers 400 is arbitrary, and may be one or more, and there is no limit to the number.
[0015] The television set 100 is placed on a speaker 400-1. The television set 100 receives video via broadcast waves or internet communication and displays it on a display unit (display). In the example of FIG. 1, the television set 100 is placed so that the display unit faces the center of the room. In the three-dimensional space of the room shown in FIG. 1, the surface along the display unit of the television set 100, in other words, the surface opposite the back surface of the television set 100 (in this example, the XZ plane including the wall surface 500-1), is defined as the "front" of the room. Note that the television set 100 does not necessarily need to be capable of receiving and displaying television broadcasts, and is not limited to any display device capable of displaying video.
[0016] Audio device 200 is placed on speaker 400-1. Audio device 200 receives an audio signal and lighting information from television set 100. Audio device 200 then outputs the audio signal to speaker 400 and controls lighting device 300 in accordance with the lighting information. The placement location of audio device 200 is not limited to the example in FIG. 1 , and is not limited to any location as long as it can output an audio signal to speaker 400 and control each of lighting devices 300, and may be outside the room shown in FIG. 1 . Details regarding the functions of television set 100 and audio device 200 will be described later using FIG. 2.
[0017] The lighting devices 300 are arranged, for example, above the speakers 400-1 to 400-3. More specifically, the lighting devices 300-1 to 300-5 are arranged above the speaker 400-1 provided at the front side of the room. The lighting devices 300-1 to 300-5 are arranged in order from the left toward the front of the room, i.e., as viewed from the television 100, and are spaced apart from one another toward the right, i.e., along the X direction. Therefore, above the speaker 400-1, the lighting device 300-1 is located at the left end, the lighting device 300-5 is located at the right end, and the lighting device 300-3 is located in the center. The lighting device 300-3 located in the center is located behind the television 100, in other words, between the television 100 and the wall 500-1. The lighting devices 300-1 to 300-5 irradiate light of various colors toward the wall 500-1 in accordance with commands from the audio device 200.
[0018] Lighting devices 300-6 to 300-8 are arranged on speaker 400-2, which is provided on the left side as one faces the front of the room. Lighting devices 300-6 to 300-8 are lined up in order from the front to the back of the room, spaced apart from one another, that is, along the Y direction. Therefore, above speaker 400-2, lighting device 300-8 is closest to television set 100, lighting device 300-6 is the farthest, and lighting device 300-7 is located between lighting devices 300-6 and 300-8. Lighting devices 300-6 to 300-8 irradiate light of various colors toward wall surface 500-2 in accordance with commands from audio device 200.
[0019] Lighting devices 300-9 to 300-11 are arranged on speaker 400-3, which is provided on the right side as one faces the front of the room. Lighting devices 300-9 to 300-11 are arranged in order from the back to the front of the room, spaced apart from one another, toward the front, i.e., along the Y direction. Therefore, on speaker 400-3, lighting device 300-9 is closest to television 100, lighting device 300-11 is furthest, and lighting device 300-10 is located between lighting devices 300-9 and 300-11. Lighting devices 300-9 to 300-11 irradiate light of various colors toward wall surface 500-2 in accordance with commands from audio device 200. The arrangement of lighting devices 300 is merely an example and is not limited to the arrangement shown in FIG. 1 . Lighting device 300 may be integrated with speaker 400.
[0020] 1, hatched circles indicate light irradiated onto the wall surface 500 by the lighting device 300. For example, light 600-1a, 600-1b, and 600-1c illuminating the wall surface 500-1 are irradiated by the lighting device 300-1. That is, the lighting device 300-1 includes, for example, three illumination light-emitting units aligned in the Z direction, which irradiate the wall surface 500-1 with light 600-1a, 600-1b, and 600-1c. This also applies to the other lighting devices 300-2 to 300-11, and the light irradiated by the lighting device 300-i (i is a natural number from 1 to 11) is referred to as light 600-ia, 600-ib, and 600-ic. When these lights are not distinguished, they are simply referred to as light 600. The relationship between the lighting devices 300 and the light 600 will be described later.
[0021] Next, the configuration of the television receiver 100 and the audio device 200 will be described with reference to Fig. 2. Fig. 2 is a block diagram of the television receiver 100 and the audio device 200. First, the configuration of the television receiver 100 will be described.
[0022] As shown in FIG. 2, the television receiver 100 includes a display unit 101, a receiving unit 102, a color information acquisition unit 103, a determination unit 104, a position information acquisition unit 105, an integration unit 106, a user information reception unit 107, a memory 108, and a transmission unit 109.
[0023] The receiving unit 102 receives video and audio signals from a broadcast station or a network server. The receiving unit 102 then transfers the video signal of the video and audio signals to the display unit 101 and the color information acquisition unit 103, and transfers the audio signal to the integration unit 106. The display unit 101 is, for example, a liquid crystal display or an EL display. The display unit 101 displays an image based on the video signal received from the receiving unit 102. The user information accepting unit 107 accepts information regarding the relative positional relationship between the television set 100 and the lighting device 300 from a user, such as a viewer of the television set 100. The accepted information is then stored in the memory 108. The positional relationship between the television set and the lighting device 300 may be input directly to the television set or may be input using a server, a mobile device, or the like; the method for doing so will be described in detail below.
[0024] The color information acquisition unit 103 acquires color information related to the video displayed on the display unit 101. More specifically, the color information acquisition unit 103 receives a video signal from the receiving unit 102 (or may receive the video signal from the display unit 101). The color information acquisition unit 103 then acquires color information output from each pixel from a plurality of pixels held by the display unit 101 for displaying the video. The position information acquisition unit 105 reads, from the memory 108, position information related to the relative positional relationship between the television set 100 and the lighting devices 300. The determination unit 104 determines illumination color information to be used to light up the plurality of lighting devices 300, based on the color information acquired by the color information acquisition unit 103 and the position information acquired by the position information acquisition unit 105. At this time, the determination unit 104 compresses the color information acquired by the color information acquisition unit 103. Furthermore, the determination unit 104 associates each lighting device 300 with one of the areas when the display unit 101 is divided into multiple areas, depending on the position of each lighting device 300, and determines the lighting color based on this association. The integration unit 106 receives the audio signal from the receiving unit 102. The audio signal is, for example, a signal that complies with the SPDIF (IEC-60958) standard. The integration unit 106 also receives the lighting color information determined by the determination unit 104. The integration unit 106 then embeds the lighting color information in the audio signal and transfers it to the transmission unit 109.
[0025] The transmitting unit 109 transmits the audio signal, in which the illumination color information is embedded and received from the integrating unit 106, to the audio device 200 via wired or wireless communication.
[0026] In the above configuration, for example, the color information acquisition unit 103, the determination unit 104, the position information acquisition unit 105, and the integration unit 106 may be a processor such as a CPU. That is, for example, the processor may function as these functional blocks 103 to 106 by executing a program stored in the memory 108.
[0027] 3A is a conceptual diagram of a video signal input to the receiving unit 102, which corresponds to a set of pixels included in the display unit 101. As shown in the figure, the video signal corresponds to a high-resolution video of, for example, 1920 pixels horizontally and 1080 pixels vertically. This high-resolution video of (1920 x 1080) pixels is then displayed on the display unit 101.
[0028] As described above, the determination unit 104 compresses the high-resolution video received by the receiving unit 102. In other words, the color information of the high-resolution video shown in FIG. 3A is acquired by the color information acquisition unit 103, and the determination unit 104 compresses this color information. This is shown in FIG. 3B. FIG. 3B is a conceptual diagram of the color information compressed by the determination unit 104, illustrating the concept of a set of pixels used to determine the color to be illuminated by the lighting device 300, i.e., the above-mentioned illumination color information. As shown in the figure, the illumination color information corresponds to a low-resolution video having, for example, 9 pixels vertically and 16 pixels horizontally. This low-resolution video is obtained by compressing the high-resolution video shown in FIG. 3A. More specifically, the high-resolution video is averaged every (120 × 120) pixels, thereby compressing the information of (1920 × 180) pixels into information of (16 × 9) pixels.
[0029] In the example of FIG. 3B, the 16 horizontal pixels are assigned symbols "A" through "P" in order, and the 9 vertical pixels are assigned numbers "1" through "9" in order, and each of these symbols represents a (16 x 9) pixel. For example, pixel A1 in FIG. 3B is, for example, the average value of the pixel values of the upper leftmost (120 x 120) pixel in FIG. 3A. Pixel A2 in FIG. 3B is the average value of the pixel values of the (120 x 120) pixel vertically adjacent to the (120 x 120) pixel in FIG. 3A corresponding to pixel A1. Similarly, pixel B1 in FIG. 3B is the average value of the pixel values of the (120 x 120) pixel horizontally adjacent to the (120 x 120) pixel in FIG. 3A corresponding to pixel A1. Pixel A9 in FIG. 3B is, for example, the average value of the pixel values of the bottom left (120×120) pixels in FIG. 3A, pixel P1 is, for example, the average value of the pixel values of the top right (120×120) pixels in FIG. 3A, and pixel P9 is, for example, the average value of the pixel values of the bottom right (120×120) pixels in FIG. 3A.
[0030] That is, in Fig. 3B, pixels closer to column A contain information about the left side area when viewed from the front of the high-resolution image shown in Fig. 3A, pixels in columns H and I contain central information, and pixels closer to column P contain information about the right side area. Also, pixels closer to the first row in Fig. 3B contain information about the upper area when viewed from the front of the high-resolution image shown in Fig. 3A, pixels in the fifth column contain central information, and pixels closer to the ninth column contain information about the lower area.
[0031] 3C is a conceptual diagram of the illumination color information of pixels A1 to P1 and A1 to P9. As shown in the figure, the illumination color information of each pixel has information on red, green, and blue components, with each color being 3-bit information. Hereinafter, the red component of Aj (j is a natural number from 1 to 9) will be represented as Aj-Red, each bit will be represented as Aj-R0 to Aj-R3, the green component will be represented as Aj-Green, each bit will be represented as Aj-G0 to Aj-G3, and the blue component will be represented as Aj-Blue, each bit will be represented as Aj-B0 to Aj-B3. These are embedded in the audio signal as illumination color information.
[0032] 4A and 4B are conceptual diagrams of position information acquired by position information acquisition unit 105. Fig. 4A shows the arrangement of television set 100 and lighting devices 300 when Fig. 1 is viewed from the ceiling of a room. As an example, Fig. 4B shows the X and Y coordinates of each lighting device 300 when the horizontal center of display unit 101 of television set 100 is set as the origin, the relative position of each lighting device 300 with respect to television set 100, and pixel columns A to P shown in Fig. 3B that correspond to each lighting device 300.
[0033] For example, assume that lighting devices 300-1 to 300-11 are arranged as shown in FIG. 4A. Also, assume that IDs "1" to "11" are assigned to lighting devices 300-1 to 300-11 by, for example, position information acquisition unit 105. In this case, assume that the X and Y coordinates of lighting devices 300-1 to 300-11 are as shown in FIG. 4B. As shown in FIG. 4B, lighting devices 300-1 to 300-5 have negative Y coordinates, which indicate that they are located behind television set 100. Furthermore, the X coordinate values indicate whether they are located on the left or right side of television set 100. The same applies to the other lighting devices 300-6 to 300-11. Furthermore, for example, determination unit 104 associates each lighting device 300 with pixel columns A to P described with reference to FIG. 3B. In this case, the determination unit 104 associates the positions of the lighting devices 300 with the regions of the low-resolution video shown in Fig. 3B so that they correspond to each other. For example, pixel rows N to P in the compressed image are associated with lighting devices 300-9 to 300-11 located on the right side of the television set 100, pixel rows A to C in the compressed image are associated with lighting devices 300-6 to 300-8 located on the left side of the television set 100, and pixel rows D to M are associated in groups of two with lighting devices 300-1 to 300-5 located near the center. Information relating to the relationship between each lighting device 300 and these positions is stored in, for example, memory 108.
[0034] The position information of the lighting device 300 shown in FIG. 4A can be obtained by, for example, receiving an input from a user by the position information acquisition unit 105. As an example, the position information of the lighting device 300 can be registered by the following method. That is, (1) The user places the lighting device 300 in a room and connects it to the audio device 200 by wire or wirelessly. (2) Audio device 200 acquires from lighting device 300 the device ID of the connected lighting device 300 (for example, information unique to the lighting device, such as a MAC address) and information indicating that the lighting device is a lighting device. (3) The audio device 200 notifies the television 100 that a new lighting device 300 has been connected, and transmits to the television 100 the device ID of the lighting device 300 and information indicating that it is a lighting device. (4) When a new lighting device 300 is connected, the television receiver 100 launches a registration screen for inputting location information of the lighting device and prompts the user to input the location information. An example of this registration screen is shown in FIG. 4A, and the screen shown in FIG. 4A is displayed on the display unit 101. The user then specifies the location of the new lighting device 300 on the display unit 101, for example, using a remote control. (5) The television receiver 100 associates the input location information with the device ID of the lighting device 300 and stores the information in, for example, the memory 108. The information stored at this time is, for example, the information shown in FIG. 4B. (6) When the above process has been performed for all lighting devices 300, the display of the registration screen displayed on the display unit 101 in (4) above is terminated.
[0035] The registration operation may be performed by, for example, television 100 as described above, or may be performed by a home server that controls multiple home appliances in a house. That is, the user may input location information of the lighting device using a monitor on the home server, and this information may be provided to television 100 and audio device 200. The registration operation may also be performed by a mobile device such as a smartphone. That is, the user may operate the smartphone to input the location of lighting device 300 into the smartphone, and the information may be transmitted from the smartphone to television 100, and the location information acquisition unit 105 may acquire the information. Furthermore, transmission and reception of signals between television 100 and audio device 200 may be performed via a dedicated line, wirelessly, or via the home server described above.
[0036] 5A and 5B are conceptual diagrams of an audio signal in which illumination color information has been embedded by the integration unit 106. As shown in FIG. 5A, an audio signal conforming to the SPDIF standard includes multiple frames 0 to 191, with 192 frames forming a unit called a block. Each frame includes two subframes. A subframe includes a channel CH1 (L (left) channel) and a channel CH2 (R (right) channel). Each subframe is 32 bits long, with bits 0 to 3 forming a preamble. The preamble is a section for detecting synchronization (SYNC) between subframes, frames, and blocks. There are three types of preamble patterns: B, W, and M. The preamble for the first subframe of a block is B, and the preamble for the remaining channel CH1 is M. The preamble for the subframe of channel CH2 is W.
[0037] Bits 4 to 7 of the subframe are used for extension. The 20-bit section from bits 8 to 27 is used for storing voice data. Bit 28 is used for reliability flag V, bit 29 is used for user data U, bit 30 is used for channel status information C, and bit 31 is used for parity bit P.
[0038] In the subframes configured as described above, integration unit 106 incorporates the pixel value (illumination color information: 1 bit) of the low-resolution video data described with reference to FIG. 3B into the section for user data U of bit 28 of the subframe. This is shown in FIG. 5B. FIG. 5B shows, as an example, six consecutive subframes. As shown in the figure, the first bit A1-R1 of the three-bit red component of pixel A1 is incorporated into the first subframe, the second bit A1-R2 is incorporated into the next subframe, and the third bit A1-R3 is incorporated into the next subframe. In this way, the red, green, and blue components of one pixel of the low-resolution video are transmitted to audio device 200 as illumination color information using the sections for user data U of the three subframes.
[0039] 2, the configuration of audio device 200 will be described. As shown in the figure, audio device 200 includes a separation unit 201, an amplification unit 202, an illumination control unit 203, and a reception unit 204.
[0040] The receiving unit 204 receives the audio signal transmitted by the transmitting unit 109 of the television receiver 100. This audio signal is a signal incorporating color information (illumination color information) as described with reference to Figures 5A and 5B. The receiving unit 204 then transmits the received audio signal to the separating unit 201.
[0041] The separator 201 extracts color information (illumination color information) from the audio signal received from the receiver 204. The separator 201 then separates the audio information from the illumination color information. The separator 201 then transmits the audio information to the amplifier 202 and transmits the illumination color information to the lighting control unit 203.
[0042] Amplification unit 202 amplifies the audio information received from separation unit 201 and transmits it to speaker 400. Then, lighting control unit 203 controls lighting device 300 based on the illumination color information received from separation unit 201. The method of controlling lighting device 300 will be described in detail later.
[0043] Next, a description will be given of the configuration of the lighting device 300. Fig. 6A is an external view of the lighting device 300, and Fig. 6B shows the lighting device 300, particularly the elements that output light.
[0044] As shown in the figure, the lighting device 300 according to this embodiment includes three full-color LED (Light Emitting Diode) lamps 310-a to 310-c. When the LED lamps 310-a to 310-c are not distinguished from one another, they are simply referred to as LED lamps 310. The LED lamps 310-a to 310-c are arranged substantially along the Z-axis direction, with the LED lamp 310-a located at the bottom (the floor side of the room), the LED lamp 310-c located at the top (the ceiling side of the room), and the LED lamp 310-b located between them. The LED lamps 310-a to 310-c illuminate the lower, central, and upper portions of the corresponding wall surfaces, respectively. The areas indicated by dashed lines in FIGS. 6A and 6B represent the light emitted by the LED lamps 310.
[0045] As shown in Fig. 6B, each LED lamp 310 includes three LEDs 320, 321, and 322, and a lens 330 associated with each LED. Each of the LEDs 320-322 outputs red light, green light, and blue light, respectively, based on pixel values (illumination color information) of low-resolution video data separated from an audio signal conforming to the SPDIF standard described with reference to Figs. 5A and 5B. The lens 330 then mixes the light output by the three associated LEDs 320-322 and outputs the mixed light to the outside.
[0046] <Lighting system operation> Next, the operation of the lighting system 1 having the above configuration will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the flow of the operation of the lighting system 1.
[0047] As shown in the figure, first, the receiving unit 102 of the television receiver 100 receives a video and audio signal via broadcast waves or internet communication (step S10). Then, a separating unit (not shown) separates the video signal from the audio signal and transmits the video signal to the display unit 101 and the color information acquiring unit 103. The audio signal is also transferred to the integrating unit 106.
[0048] The display unit 101 displays an image based on the received image signal (step S11). The display unit 101 displays a high-resolution image of (1920 × 1080) pixels as described in FIG. 3A. The color information acquisition unit 103 also acquires color information from the (1920 × 1080) pixels used to display the image on the display unit 101 (step S12). That is, the color information acquisition unit 103 obtains RGB pixel values for each pixel of the high-resolution image and transmits them to the determination unit 104.
[0049] Based on the pixel values received from the color information acquisition unit 103, the determination unit 104 compresses the high-resolution image into a low-resolution image of, for example, (16×9) as described in FIG. 3B (step S13). As described above, for example, pixel A1 of the low-resolution image in FIG. 3 corresponds to a (120×120) pixel of the high-resolution image. Therefore, the determination unit 104 obtains the low-resolution image by calculating the average value of each RGB color of (120×120) pixels corresponding to each of the (16×9) pixels described in FIG. 3B. As described above, each RGB pixel value of each pixel of the low-resolution image is expressed by, for example, 3 bits. This is as described using FIG. 3C.
[0050] Furthermore, the determination unit 104 receives the position information read from the memory 108 from the position information acquisition unit 105. Then, as described with reference to FIGS. 4A and 4B, the position of the lighting device 300 in the room is confirmed (step S14). Next, the determination unit 104 associates the color information obtained in step S13 with the position in the display unit 101 (or the position in the low-resolution image) and the position information of the lighting device 300 obtained in step S14 (step S15). That is, as shown in FIG. 4B, the determination unit 104 associates the lighting device 300 with a pixel row corresponding to the color information to be output by each lighting device according to the position of the lighting device 300. This information is transmitted from the determination unit 104 to the transmission unit 109, for example, and the transmission unit 109 and the illumination color control unit 203 use this information when transmitting audio information including color information to each lighting device 300.
[0051] Next, integration unit 106 incorporates the color information (illumination color information) compressed by determination unit 104 in step S13 and associated with any of illumination devices 300, bit by bit, into each subframe of the audio signal received from reception unit 102, as shown in Fig. 5B (step S16). Then, transmission unit 109 transmits the audio signal with the incorporated color information to audio device 200 (step S17).
[0052] The receiving unit 204 of the audio device 200 receives the audio signal transmitted from the transmitting unit 109 of the television receiver 100 (step S18). The receiving unit 204 transmits the received audio signal to the separating unit 201. The separating unit 201 then extracts color information (illumination color information) from the audio signal. Specifically, contrary to the process of step S15, the separating unit 201 extracts one bit of color information from each of the user bits U described in FIGS. 5A and 5B and transmits this to the lighting control unit 203 (step S19). The lighting control unit 203 then controls the lighting devices 300 based on the color information obtained in step S19 (step S20). That is, the lighting control unit 203 transmits corresponding color information to the lighting devices 300 based on the position information of each lighting device 300. The separating unit 201 also transmits the audio signal to the amplifying unit 202, and the audio signal amplified by the amplifying unit 202 is transmitted to the speaker 400 (step S21).
[0053] 8A and 8B show a specific example of the method for controlling the lighting device 300 in step S20. As described with reference to FIGS. 4A and 4B, the lighting device 300-1 corresponds to pixel rows D and E of the low-resolution video. Therefore, the lighting control unit 203 generates a control signal for the lighting device 300-1 based on color information for pixel rows D and E, i.e., pixels D1 to D9 and pixels E1 to E9, and transmits the control signal to the lighting device 300-1. The lighting device 300-2 corresponds to pixel rows F and G of the low-resolution video. Therefore, the lighting control unit 203 generates a control signal for the lighting device 300-2 based on color information for pixel rows F and G, i.e., pixels F1 to F9 and pixels G1 to G9, and transmits the control signal to the lighting device 300-2.
[0054] The same applies to the other lighting devices 300. The lighting device 300-6 located at the rear left of the television set 100 corresponds to pixel row A (A1 to A9) at the left edge of the low-resolution video. Therefore, the lighting control unit 203 generates a control signal for the lighting device 300-6 based on color information for pixel row A, i.e., pixels A1 to A9, and transmits it to the lighting device 300-6. The lighting device 300-11 located at the rear right of the television set 100 corresponds to pixel row P (P1 to P9) at the right edge of the low-resolution video. Therefore, the lighting control unit 203 generates a control signal for the lighting device 300-11 based on color information for pixel row P, i.e., pixels P1 to P9, and transmits it to the lighting device 300-11. The same applies to the other lighting devices 300.
[0055] The lighting control unit 203 transmits the configuration of the lighting device 300 (specifically, the name of the lighting device manufacturer, model, etc.) along with, for example, the position information of the lighting device 300 to the audio device 300. Therefore, in this example, for example, it is recognized that the lighting device 300 has three LED lamps 310 arranged in the Z direction as shown in Fig. 8B. Therefore, the lighting control unit 203 generates three control signals by averaging color information corresponding to each lighting device 300 and the position of the LED lamps 310 in each lighting device 300, as shown in Fig. 8A.
[0056] For example, in the case of lighting device 300-6, the pixel values of the top three pixels A1 to A3 in the low-resolution image are averaged (average value A123), and the top LED lamp 310-c of lighting device 300-6 is controlled based on the result. Similarly, the pixel values of the center three pixels A4 to A6 in the low-resolution image are averaged (average value A456), and the center LED lamp 310-b of lighting device 300-6 is controlled based on the result. Finally, the pixel values of the bottom three pixels A7 to A9 in the low-resolution image are averaged (average value A789), and the bottom LED lamp 310-a of lighting device 300-6 is controlled based on the result.
[0057] This is shown in Figure 8B. Figure 8B shows, as an example, the color information provided to each LED lamp 310 of lighting device 300-6. As shown in the figure, LED 320 of LED lamp 310-c in lighting device 300-6 is provided with a 3-bit red component with an average value A123, LED 321 is provided with a 3-bit green component with an average value A123, and LED 322 is provided with a 3-bit blue component with an average value A123.
[0058] Furthermore, LED320 of LED lamp 310-b is given a 3-bit red component with an average value of A456, LED321 is given a 3-bit green component with an average value of A456, and LED322 is given a 3-bit blue component with an average value of A456. LED320 of LED lamp 310-a is given a 3-bit red component with an average value of A789, LED321 is given a 3-bit green component with an average value of A789, and LED322 is given a 3-bit blue component with an average value of A789.
[0059] Fig. 8C shows a room illuminated by the lighting device 300 as described above. Similar to Fig. 1, Fig. 8C shows a three-dimensional space of a room to which the lighting system 1 is applied, as viewed from the front of the television set 100. Note that in Fig. 1, the television set 100 and the audio device 200 are not shown in order to clearly show how the wall surface 500 is illuminated by the lighting device 300.
[0060] As shown in the figure, as explained in Fig. 1, three wall surfaces 500-1 to 500-3 are illuminated by the lighting device 300. More specifically, this is as follows. Lighting device 300-1: Light 600-1a to 600-1c emitted from LED lamps 310-a to 310-c is irradiated onto the wall surface 500-1 on the rear side of the television set 100, and the colors of the light 600-1a to 600-1c are based on the average pixel values DE789, DE456, and DE123 in the low-resolution image, respectively. Lighting device 300-2: Light 600-2a to 600-2c emitted from LED lamps 310-a to 310-c is irradiated onto wall surface 500-1, and the colors of light 600-2a to 600-2c are based on average values FG789, FG456, and FG123, respectively. Illumination device 300-3: Light 600-3a to 600-3c emitted from LED lamps 310-a to 310-c is irradiated onto wall surface 500-1, and the colors of light 600-3a to 600-3c are based on average values HI789, HI456, and HI123, respectively. Lighting device 300-4: Light 600-4a to 600-4c emitted from LED lamps 310-a to 310-c is irradiated onto wall surface 500-1, and the colors of light 600-4a to 600-4c are based on average values JK789, JK456, and JK123, respectively. Lighting device 300-5: Light 600-5a to 600-5c emitted from LED lamps 310-a to 310-c is irradiated onto wall surface 500-1, and the colors of light 600-5a to 600-5c are based on average values LM789, LM456, and LM123, respectively. Lighting device 300-6: Light 600-6a to 600-6c emitted from LED lamps 310-a to 310-c is projected onto the wall surface 500-2 on the left side of the television set 100, and the colors of the light 600-6a to 600-6c are based on the average pixel values A789, A456, and A123 in the low-resolution image, respectively. Lighting device 300-7: Light 600-7a to 600-7c emitted from LED lamps 310-a to 310-c is irradiated onto wall surface 500-2, and the colors of light 600-7a to 600-7c are based on average values B789, B456, and B123, respectively. Lighting device 300-8: Light 600-8a to 600-8c emitted from LED lamps 310-a to 310-c is irradiated onto wall surface 500-2, and the colors of light 600-8a to 600-8c are based on average values C789, C456, and C123, respectively. Lighting device 300-9: Light 600-9a to 600-9c emitted from LED lamps 310-a to 310-c is projected onto the wall surface 500-3 to the right of the television set 100, and the colors of the light 600-9a to 600-9c are based on the average pixel values N789, N456, and N123 in the low-resolution image, respectively. Lighting device 300-10: Light 600-10a to 600-10c emitted from LED lamps 310-a to 310-c is irradiated onto wall surface 500-3, and the colors of light 600-10a to 600-10c are based on average values of O789, O456, and O123, respectively. Lighting device 300-11: Light 600-11a to 600-11c emitted from LED lamps 310-a to 310-c is irradiated onto wall surface 500-3, and the colors of light 600-11a to 600-11c are based on average values P789, P456, and P123, respectively.
[0061] <Effects of this embodiment> According to the above configuration, the lighting device 300, which is a device separate from the television set 100, is associated with any region of the display unit 101 of the television set 100. More specifically, the lighting device 300 is associated with the television set 100 so that the relative position of the lighting device 300 with respect to the television set 100 and the position of the lighting device 300 in the left-right and up-down directions within the display unit 101 of the television set 100 substantially coincide with each other.
[0062] For example, the lighting device 300 located on the right side of the display unit 101 of the television set 100 is associated with the right-side area of the display unit 101 of the television set 100. The lighting device 300 located on the left side of the display unit 101 of the television set 100 is associated with the left-side area of the display unit 101 of the television set 100. The lighting device 300 located in the center of the display unit 101 of the television set 100 is associated with the center area of the display unit 101 of the television set 100.
[0063] The above applies not only to the horizontal direction but also to the vertical direction. That is, LED lamp 310-a, which illuminates the lower side of the wall surface, is associated with the lower area of display unit 101 of television set 100. LED lamp 310-c, which illuminates the upper side of the wall surface, is associated with the upper area of display unit 101 of television set 100. And LED lamp 310-b, which illuminates the center of the wall surface, is associated with the central area of display unit 101 of television set 100.
[0064] Then, color information based on pixel values corresponding to the associated regions in television set 100 is embedded in an audio signal and transmitted to audio device 200, and this color information is used as lighting color information to control each lighting device 300. Therefore, lighting device 300 lights the entire room in a color that is linked to the lighting in display unit 101 of television set 100. This can enhance the viewer's sense of immersion in the content displayed on television set 100. This is particularly effective for content with drastic changes in lighting, such as live music videos, games, and movies.
[0065] (Second embodiment) Next, an information processing device, a lighting system, an information processing method, and a lighting system control method according to a second embodiment of the present invention will be described. In this embodiment, the lighting device 300 illuminates not only the walls of a room but also the floor and ceiling in the first embodiment.
[0066] FIG. 9A is an external view of a lighting device 300H for illuminating the ceiling of a room. As shown in the figure, the lighting device 300H includes three full-color LED lamps 310-d to 310-f, similar to the configuration described in FIG. 6A of the first embodiment. When the LED lamps 310-d to 310-f are not to be distinguished from one another, they are simply referred to as LED lamps 310. The LED lamps 310 are arranged to emit light upward above the lighting device 300H. More specifically, the LED lamps 310-d to 310-f are arranged in a row on the top surface of the lighting device 300H, and each lamp is arranged to illuminate upward at a different angle. As described in FIG. 6B of the first embodiment, the LED lamps 310-d to 310-f each include LEDs 320 to 322 and a lens 330. Each of the LEDs 320 to 322 is controlled by color information (illumination color information) provided by the illumination control unit 203, as described in the first embodiment with reference to FIG. 8B.
[0067] FIG. 9B is an external view of a lighting device 300L for illuminating the floor of a room. As shown in the figure, the lighting device 300L includes three full-color LED lamps 310-g to 310-i, similar to the configuration described in FIG. 6A of the first embodiment. When the LED lamps 310-g to 310-i are not distinguished from one another, they are simply referred to as LED lamps 310. The LED lamps 310 are arranged to emit light downward from the lighting device 300L. More specifically, the LED lamps 310-g to 310-i are arranged in a row on the side of the lighting device 300L, and each LED is arranged to illuminate downward at a different angle. Each of these LEDs 320 to 322 is controlled by color information (illumination color information) provided by the lighting control unit 203.
[0068] The control method for the lighting device 300 is as shown in Fig. 7 described in the first embodiment. Fig. 10 shows the state of a room illuminated by the lighting device 300 according to this embodiment and the arrangement of the lighting devices 300, and corresponds to Fig. 8C described in the first embodiment. Fig. 11 shows the relationship between the lighting device 300 and the pixels of a low-resolution image, and corresponds to Fig. 8A described in the first embodiment.
[0069] As shown in FIG. 10, the arrangement of the lighting devices 300-1 to 300-11 is the same as in the first embodiment. Furthermore, in this embodiment, five lighting devices 300H (300H-1 to 300H-5) and 300L (300L-1 to 300L-5) are arranged above the speaker 400-1. Specifically, the lighting devices 300H-1 and 300L-1 are arranged to the left and right of the lighting device 300-1 when facing the television receiver 100 (not shown). Furthermore, the lighting devices 300H-2 and 300L-2 are arranged to the left and right of the lighting device 300-2. The lighting devices 300H-3 and 300L-3 are arranged to the left and right of the lighting device 300-3. The lighting devices 300H-4 and 300L-4 are arranged to the left and right of the lighting device 300-4. Furthermore, lighting devices 300H-5 and 300L-5 are disposed to the left and right of lighting device 300-5, respectively. Of course, the number and positions of lighting devices 300H and 300L are merely an example, and are not limited as long as they are disposed in a way that can illuminate ceiling 500-5 and floor 500-4 of the room.
[0070] The relationship between the lighting devices 300 and the low-resolution images is as shown in Fig. 11, and each lighting device 300 illuminates the walls, ceiling, and floor of the room as shown in Fig. 10. Lighting device 300-1: Light 600-1a to 600-1c emitted from LED lamps 310-a to 310-c is irradiated onto the wall surface 500-1 on the rear side of the television set 100, and the colors of the light 600-1a to 600-1c are based on the average pixel values DE6 (average pixel values of pixels D6 and E6), DE5, and DE4 in the low-resolution image, respectively. Lighting device 300H-1: Light 600-1d to 600-1f emitted from LED lamps 310-d to 310-f is irradiated onto ceiling 500-5, and the colors of light 600-1d to 600-1f are based on the average pixel values DE3, DE2, and DE1 in the low-resolution image, respectively. Lighting device 300L-1: Light 600-1g to 600-1i emitted from LED lamps 310-g to 310-i is irradiated onto floor surface 500-4, and the colors of light 600-1g to 600-1i are based on the average pixel values DE9, DE8, and DE7 in the low-resolution image, respectively.
[0071] Lighting device 300-2: Light 600-2a to 600-2c emitted from LED lamps 310-a to 310-c is irradiated onto the wall surface 500-1 on the rear side of the television set 100, and the colors of the light 600-2a to 600-2c are based on the average pixel values FG6, FG5, and FG4 in the low-resolution image, respectively. Lighting device 300H-2: Light 600-2d to 600-2f emitted from LED lamps 310-d to 310-f is irradiated onto the ceiling 500-5, and the colors of the light 600-2d to 600-2f are based on the average pixel values FG3, FG2, and FG1 in the low-resolution image, respectively. Lighting device 300L-2: Light 600-2g to 600-2i emitted from LED lamps 310-g to 310-i is irradiated onto the floor surface 500-4, and the colors of the light 600-2g to 600-2i are based on the average pixel values FG9, FG8, and FG7 in the low-resolution image, respectively.
[0072] Lighting device 300-3: Light 600-3a to 600-3c emitted from LED lamps 310-a to 310-c is irradiated onto the wall surface 500-1 on the rear side of the television set 100, and the colors of the light 600-3a to 600-3c are based on the average pixel values HI6, HI5, and HI4 in the low-resolution image, respectively. Lighting device 300H-3: Light 600-3d to 600-3f emitted from LED lamps 310-d to 310-f is irradiated onto ceiling 500-5, and the colors of light 600-3d to 600-3f are based on the average pixel values HI3, HI2, and HI1 in the low-resolution image, respectively. Lighting device 300L-3: Light 600-3g to 600-3i emitted from LED lamps 310-g to 310-i is irradiated onto the floor surface 500-4, and the colors of the light 600-3g to 600-3i are based on the average pixel values HI9, HI8, and HI7 in the low-resolution image, respectively.
[0073] Lighting device 300-4: Light 600-4a to 600-4c emitted from LED lamps 310-a to 310-c is irradiated onto the wall surface 500-1 on the rear side of the television set 100, and the colors of the light 600-4a to 600-4c are based on the average pixel values JK6, JK5, and JK4 in the low-resolution image, respectively. Lighting device 300H-4: Light 600-4d to 600-4f emitted from LED lamps 310-d to 310-f is emitted onto the ceiling 500-5, and the colors of the light 600-4d to 600-4f are based on the average pixel values JK3, JK2, and JK1 in the low-resolution image, respectively. Lighting device 300L-4: Light 600-4g to 600-4i emitted from LED lamps 310-g to 310-i is irradiated onto floor 500-4, and the colors of light 600-4g to 600-4i are based on the average pixel values JK9, JK8, and JK7 in the low-resolution image, respectively.
[0074] Lighting device 300-5: Light 600-5a to 600-5c emitted from LED lamps 310-a to 310-c is irradiated onto the wall surface 500-1 on the rear side of the television set 100, and the colors of the light 600-5a to 600-5c are based on the average pixel values LM6, LM5, and LM4 in the low-resolution image, respectively. Lighting device 300H-5: Light 600-5d to 600-5f emitted from LED lamps 310-d to 310-f is irradiated onto the ceiling 500-5, and the colors of the light 600-5d to 600-5f are based on the average pixel values LM3, LM2, and LM1 in the low-resolution image, respectively. Lighting device 300L-5: Light 600-5g to 600-5i emitted from LED lamps 310-g to 310-i is irradiated onto floor 500-4, and the colors of light 600-5g to 600-5i are based on the average pixel values LM9, LM8, and LM7 in the low-resolution image, respectively.
[0075] The other lighting devices 300 are as described in the first embodiment. As described above, by allocating pixels in the low-resolution image to the floor 500-4 and the ceiling 500-5 as well, the entire room can be illuminated in accordance with the color displayed on the display unit 101 of the television set 100. Note that the correspondence between the lighting devices 300H and 300L and the lighting color information (average pixel values of the low-resolution image) is not limited to the cases in FIGS. 10 and 11, and the correspondence can be freely set. In addition, the position information of the lighting devices 300H and 300L can also be registered in the same manner as the position information of the lighting device 300 described in the first embodiment.
[0076] (Third embodiment) Next, an information processing device, a lighting system, an information processing method, and a lighting system control method according to a third embodiment of the present invention will be described. This embodiment expresses the strobe light displayed on the display unit 101 of the television receiver 100 in the first embodiment.
[0077] Fig. 12 is an external view of an illumination device 300W for expressing strobe light. As shown in the figure, the illumination device 300W is configured such that, in the configuration described in Fig. 6A of the first embodiment, the three full-color LED lamps 310 are replaced with one high-intensity white LED lamp 310-j. The LED lamp 310-j replaces the three LEDs 320 to 322 in the configuration described in Fig. 6B with, for example, one high-intensity white LED, and furthermore, a lens 330 illuminates the wall surface of the room from approximately the top to the bottom. The white LED is controlled by color information (illumination color information) provided by the illumination control unit 203.
[0078] The control method for the lighting device 300 is as shown in Fig. 7 described in the first embodiment. Fig. 13 shows the state of a room lit by the lighting device 300 according to this embodiment and the arrangement of the lighting devices 300 and 300W, and corresponds to Fig. 9 described in the first embodiment. Fig. 14 shows the relationship between the lighting device 300W and the pixels of the low-resolution video. The relationship between the lighting device 300 and the pixels of the low-resolution video is as shown in Fig. 8A described in the first embodiment.
[0079] 13, the arrangement of the lighting devices 300-1 to 300-11 is the same as in the first embodiment. Furthermore, in this embodiment, four lighting devices 300W (300W-1 to 300W-4) are arranged above speaker 400-1, and two lighting devices 300W (300W-5 to 300W-8) are arranged above each of speakers 400-2 and 400-3. Specifically, lighting device 300W-1 is arranged between lighting devices 300-1 and 300-2, lighting device 300W-2 is arranged between lighting devices 300-2 and 300-3, lighting device 300W-3 is arranged between lighting devices 300-3 and 300-4, and lighting device 300W-4 is arranged between lighting devices 300-4 and 300-5. Furthermore, lighting device 300W-5 is disposed between lighting devices 300-6 and 300-7, and lighting device 300W-6 is disposed between lighting devices 300-7 and 300-8. Lighting device 300W-7 is disposed between lighting devices 300-9 and 300-10, and lighting device 300W-8 is disposed between lighting devices 300-10 and 300-11. Of course, the number and positions of lighting devices 300W are merely examples and are not limited as long as the necessary strobe light can be provided.
[0080] The relationship between the lighting devices 300W and the low-resolution images is as shown in FIG. 14, and each lighting device 300W illuminates the wall surface of the room as shown in FIG. 13. Lighting device 300W-1: Light 600W-1 emitted from LED lamp 310-j is irradiated onto wall surface 500-1 on the rear side of television receiver 100 (not shown). The luminance of light 600W-1 is based on the average pixel value DEF123456789 (average pixel value of pixels D1 to D9, E1 to E9, and F1 to F9) in the low-resolution image. Light 600W-1 also illuminates the area between the area illuminated by lights 600-1a to 600-1c and the area illuminated by lights 600-2a to 600-2c. Lighting device 300W-2: Light 600W-2 emitted from LED lamp 310-j is irradiated onto wall surface 500-1 on the rear side of television receiver 100. The luminance of light 600W-2 is based on the average pixel value FGH123456789 in the low-resolution image. Light 600W-2 also illuminates an area between the area illuminated by lights 600-2a to 600-2c and the area illuminated by lights 600-3a to 600-3c. Lighting device 300W-3: Light 600W-3 emitted from LED lamp 310-j is irradiated onto wall surface 500-1 on the rear side of television receiver 100. The luminance of light 600W-3 is based on the average pixel value IJK123456789 in the low-resolution image. Light 600W-3 also illuminates an area between the area illuminated by lights 600-3a to 600-3c and the area illuminated by lights 600-4a to 600-4c. Lighting device 300W-4: Light 600W-4 emitted from LED lamp 310-j is irradiated onto wall surface 500-1 on the rear side of television receiver 100. The luminance of light 600W-4 is based on the average pixel value KLM123456789 in the low-resolution image. Light 600W-4 also illuminates the area between the area illuminated by lights 600-4a to 600-4c and the area illuminated by lights 600-5a to 600-5c.
[0081] Lighting device 300W-5: Light 600W-5 emitted from LED lamp 310-j is irradiated onto wall surface 500-2 on the left side as viewed from the television set 100. The luminance of light 600W-5 is based on the average pixel value AB123456789 in the low-resolution image. Light 600W-5 also illuminates an area between the area illuminated by lights 600-6a to 600-6c and the area illuminated by lights 600-7a to 600-7c. Lighting device 300W-6: Light 600W-6 emitted from LED lamp 310-j is irradiated onto wall surface 500-2 on the left side as one faces the television set 100. The luminance of light 600W-6 is based on the average pixel value BC123456789 in the low-resolution image. Light 600W-6 also illuminates an area between the area illuminated by lights 600-7a to 600-7c and the area illuminated by lights 600-8a to 600-8c.
[0082] Lighting device 300W-7: Light 600W-7 emitted from LED lamp 310-j is irradiated onto wall surface 500-3 on the right side of the television set 100. The luminance of light 600W-7 is based on the average pixel value NO123456789 in the low-resolution image. Light 600W-7 also illuminates the area between the area illuminated by lights 600-9a to 600-9c and the area illuminated by lights 600-10a to 600-10c. Lighting device 300W-8: Light 600W-8 emitted from LED lamp 310-j is irradiated onto wall surface 500-3 on the right side of the television set 100. The luminance of light 600W-8 is based on the average pixel value OP123456789 in the low-resolution image. Light 600W-8 also illuminates the area between the area illuminated by lights 600-10a to 600-10c and the area illuminated by lights 600-11a to 600-11c.
[0083] Whether the LED lamp 310-j emits light is determined based on, for example, the pixel values of multiple corresponding pixels in a low-resolution image. For example, the LED lamp 310-j of the lighting device 300W-5 corresponds to pixels A1 to A9 and pixels B1 to B9 as described above. The luminance of the LED lamp 310-j when emitting light is based on the average pixel value of these pixels, AB123456789. In contrast, whether the LED lamp 310-j emits light can be determined based on, for example, whether all of the pixel values of the corresponding 18 pixels exceed a certain reference value. For example, the RGB pixel values of each of the pixels A1 to A9 and pixels B1 to B9 are expressed in 3 bits as described in FIG. 3C of the first embodiment. That is, they are expressed as values from "0" to "7" in decimal notation. The LED lamp 310-j emits light when all of the RGB pixel values of the 18 pixels, pixels A1 to A9 and pixels B1 to B9, are "6" or "7." The LED lamp 310-j is turned off when even one of the 18 pixels has a pixel value of RGB between “0” and “5.” This control is performed by the illumination control unit 203.
[0084] As described above, the strobe light displayed on the display unit 101 of the television receiver 100 can be reproduced in a room by the illumination device 300W using a white LED. In this example, the correspondence between the illumination device 300W and the illumination color information (average pixel value of the low-resolution image) is not limited to that shown in FIGS. 13 and 14, and the correspondence can be freely set. In addition, the position information of the illumination device 300W can be registered in the same manner as the position information of the illumination device 300 described in the first embodiment. In addition, although this embodiment has been described as being applied to the first embodiment, it can also be implemented in combination with the second embodiment.
[0085] (Fourth embodiment) Next, an information processing device, a lighting system, an information processing method, and a lighting system control method according to a fourth embodiment of the present invention will be described. In the first embodiment, a case where color information (lighting color information) is assigned to user bits U of an audio signal (IEC-60958) has been described, but in this embodiment, a different assignment method is used. Only differences from the first to third embodiments will be described below.
[0086] <CASE I> First, the first case will be described with reference to Fig. 15A. Fig. 15A is a conceptual diagram of one subframe of an audio signal conforming to the SPDIF (IEC-60958) standard described with reference to Figs. 5A and 5B in the first embodiment.
[0087] In the first case (CASE I), pixel values (illumination color information) of the low-resolution video data described in FIG. 3B are assigned to the extension bits (AUX: auxiliary) of bits 4 to 7. The television receiver 100 notifies the audio device 200 in advance that illumination color information will be assigned to the extension bits. This notification is made by, for example, the determination unit 104 or the integration unit 106 of the television receiver 100 using user bits of the SPIDF, allowing the audio device 200 to recognize that the extension bits of subframes transmitted after the current subframe will be assigned to illumination color information. The bit length of audio data transmitted by SPDIF is specified by bits 32 to 35 of the status channel bits, and a bit length of 16 to 24 bits can be selected. When the bit length of the audio data is set to 20 bits or less, illumination color information can be assigned to the extension bits. This case enables illumination color information to be transmitted four times faster than when the user bits U are used, thereby increasing the amount of data required for the resolution or color depth of the lighting device 300.
[0088] <CASE II> Next, the second case will be described with reference to FIG. 15A. As shown in the figure, in the second case (CASE II), in addition to the extension bits of bits 4 to 7, the area of bits 8 to 11 is allocated as a field for storing illumination color information. In this example, the television receiver 100 notifies the audio device 200 in advance that illumination color information will be allocated to the field of bits 4 to 11. This notification is performed using, for example, the user bits of SPIDF, as in the first case. This example is also possible when the bit length of the audio data is set to 16 bits or less. This case makes it possible to transmit illumination color information at eight times the speed compared to when the user bits U are used. Note that even if the LSB (Least Significant Bit) side of the audio data is allocated to low-resolution data, the audio in this area has a very small amplitude that is almost indistinguishable to humans, so a significant impact on sound quality can be suppressed.
[0089] <CASE III> Next, the third case will be described with reference to FIG. 15A. As shown in the figure, in the third case (CASE III), when the audio data field is 24 bits long, i.e., when the extension bits 4 to 7 are used for audio data, the field of bits 4 to 6 is assigned to illumination color information. In this example, the television receiver 100 notifies the audio device 200 in advance that illumination color information will be assigned to the field of bits 4 to 6. This notification is performed using, for example, the user bits of SPIDF, as in the first case. This example is possible when the bit length of the audio data is set to 24 bits. This case allows illumination color information to be transmitted three times faster than when the user bits U are used. As in the second case, significant impacts on sound quality can be suppressed.
[0090] <CASE IV> Next, a fourth case will be described. In the fourth case (CASE IV), the audio signal is transmitted from the television receiver 100 to the audio device 200 in accordance with IEC-61937 instead of IEC-60958 in the first to third embodiments. Fig. 15B is a conceptual diagram of one subframe of an audio signal conforming to the IEC-61937 standard according to this example.
[0091] As shown in FIG. 15B, the format of the IEC-61937 subframe is the same as that of IEC-60958 shown in FIG. 15A, except that compressed audio data is stored in the field from bit 12 to bit 27, and the field from bit 8 to bit 11 is unused and filled with, for example, "0." As in the first case, pixel values (illumination color information) of the low-resolution video data described in FIG. 3B are assigned to the extension bits from bit 4 to 7. Note that the assignment of low-resolution video data to the extension bits is notified in advance from television receiver 100 to audio device 200. This notification is performed using user bits, as in the case of IEC-60958. According to this case, it is possible to transmit illumination color information four times faster than when user bit U is used, thereby enabling an increase in the amount of data for resolution or color depth for lighting device 300.
[0092] <CASE V> Next, the fifth case (CASE V) will be described with reference to FIG. 15B. In this example, as in the second case described above, illumination color information is assigned to the field of bits 4 to 11. In this example, the television receiver 100 notifies the audio device 200 in advance using a user bit or the like that illumination color information will be assigned to the field of bits 4 to 11. According to this case, illumination color information can be transmitted eight times faster than when the user bit U is used.
[0093] As described above, color information for controlling the lighting device 300 can be assigned to various fields, not just user bits. Using a field with a wider bit width allows for faster transmission of more data. The field in which the illumination color information is to be stored is determined, for example, by the determination unit 104 or the integration unit 106, and the integration unit 106 actually embeds the illumination color information in the audio signal.
[0094] (Fifth embodiment) Next, an information processing device, a lighting system, an information processing method, and a lighting system control method according to a fifth embodiment of the present invention will be described. In this embodiment, IEC-61937-10 is adopted for transmitting signals from television receiver 100 to audio device 200 in the above-described first to fourth embodiments, and an audio signal containing audio data and color information is compressed and transmitted from television receiver 100 to audio device 200. Only differences from the first to fourth embodiments will be described below.
[0095] Fig. 16A is a block diagram of the television receiver 100 and the audio device 200, and corresponds to Fig. 2 described in the first embodiment. First, the configuration of the television receiver 100 will be described.
[0096] As shown in the figure, the television receiver 100 according to this embodiment further includes a compression unit 110 in addition to the components shown in FIG. 2 described in the first embodiment. The compression unit 110 losslessly compresses the data string of the audio signal, into which the illumination color information is embedded, obtained by the integration unit 106. Then, for example, the transmission unit 109 (or the integration unit 106) stores the compressed data string in a payload field in the format described in FIG. 15B in accordance with the rules of IEC-91637. The transmission unit 109 then transmits the signal obtained by the integration unit 106 to the audio device 200.
[0097] The audio device 200 further includes a decoding unit 205 in the diagram described in the first embodiment. The decoding unit 205 extracts the data string compressed by the compression unit 110 from the payload of the signal received from the receiving unit 204 and decodes it. The separating unit 201 then separates the decoded data string into an audio signal and color information and transmits them to the amplifying unit 202 and the lighting control unit 203, respectively.
[0098] FIG. 16B schematically shows signals obtained in the determination unit 104, the integrating unit 106, the compression unit 110, and the transmission unit 109. As described in the first embodiment, the determination unit 104 obtains color information of the low-resolution video. The integrating unit 106 also receives an audio signal from the receiving unit 102. As shown in the figure, the audio signal alternates between the L channel and the R channel every 24 bits, for example. In FIG. 16B, the bits of the L channel signal are denoted as L0 to L23, and the bits of the R channel signal are denoted as R0 to R23. The integrating unit 106 then replaces the lowest 3 bits of the 24-bit audio signal with color information (illumination color information). In the example of FIG. 16B, of the first 24 bits, bit L2 is replaced with A1-R0, bit L1 is replaced with A1-R1, and bit L0 is replaced with A1-R2. Of the next 24 bits, bit R2 is replaced with A1-G0, bit R1 is replaced with A1-G1, bit R0 is replaced with A1-G2, and so on.
[0099] As described above, the audio signal incorporating color information is compressed by compression unit 110. That is, in this example, the 24-bit audio signal is compressed as a series of data strings by compression unit 110. Compression unit 110 divides the compressed series of data strings into 16-bit segments, and the individual bits are represented as b0 to b15, b16 to b31, b32 to b47, ... in FIG. 16B. Then, for example, transmission unit 109 stores the 16-bit signal in a payload field in the IEC-91637 format and transmits it to audio device 200.
[0100] In audio device 200, as described above, decoding unit 204 decodes the 16-bit signal extracted from the payload into a 24-bit signal. Separation unit 201 then separates the 24 bits into an audio signal and color information.
[0101] Fig. 16C is a flowchart showing the operation of the lighting system 1 according to this embodiment. As described above, this differs from Fig. 7 described in the first embodiment in that, after color information (illumination color information) is incorporated into the audio signal (step S16), the audio signal is losslessly compressed by the compression unit 110 (step S30), and the decoding unit 204 that has received the audio signal decodes the audio signal (step S31).
[0102] In carrying out this embodiment, the television receiver 100 notifies the audio device 200 in advance using the user bit U of IEC-61937 or the like that the lowest three bits of the decoded audio data of the data to be transmitted thereafter represent low-resolution video. This embodiment also makes it possible to transmit illumination color information at three times the speed compared to the first embodiment, in which the user bit U is used. Furthermore, because a 24-bit audio signal contains color information in the lowest three bits, it is possible to transmit the audio signal and color information together, provided that the audio data is not modified.
[0103] (Sixth embodiment) Next, an information processing device, a lighting system, an information processing method, and a lighting system control method according to a sixth embodiment of the present invention will be described. In this embodiment, the lighting device 300 illuminates the room in colors that are more faithful to the image displayed on the display unit 101 of the television receiver 100 in the second embodiment. Only the differences from the second embodiment will be described below.
[0104] Fig. 17 shows the state of a room lit by lighting devices 300 according to this embodiment and the arrangement of lighting devices 300, and corresponds to Fig. 10 described in the second embodiment. Fig. 18A shows the relationship between lighting devices 300 and pixels of a low-resolution image, and corresponds to Fig. 11 described in the second embodiment.
[0105] As shown in Fig. 17, the arrangement of the lighting devices 300, 300H, and 300L is the same as in the second embodiment. The relationship between the lighting devices 300 and the low-resolution video is as shown in Fig. 18A, and each lighting device 300 illuminates the walls, ceiling, and floor of the room as shown in Fig. 17. That is, Lighting device 300H-1: Light 600-1d to 600-1f emitted from LED lamps 310-d to 310-f is irradiated onto ceiling 500-5, and the colors of light 600-1d to 600-1f are based on the average pixel values DE3, CD2, and BCD1 in the low-resolution image, respectively. Lighting device 300L-1: Light 600-1g to 600-1i emitted from LED lamps 310-g to 310-i is irradiated onto floor 500-4, and the colors of light 600-1g to 600-1i are based on the average pixel values BCD9, CD8, and DE7 in the low-resolution image, respectively.
[0106] Lighting device 300H-2: Light 600-2d to 600-2f emitted from LED lamps 310-d to 310-f is irradiated onto the ceiling 500-5, and the colors of the light 600-2d to 600-2f are based on the average values FG3, EFG2, and EFG1 of the pixel values in the low-resolution image, respectively. Lighting device 300L-2: Light 600-2g to 600-2i emitted from LED lamps 310-g to 310-i is irradiated onto the floor surface 500-4, and the colors of the light 600-2g to 600-2i are based on the average values EFG9, EFG8, and FG7 of the pixel values in the low-resolution image, respectively.
[0107] Lighting device 300H-4: Light 600-4d to 600-4f emitted from LED lamps 310-d to 310-f is emitted onto the ceiling 500-5, and the colors of the light 600-4d to 600-4f are based on the average pixel values JK3, JKL2, and JKL1 in the low-resolution image, respectively. Lighting device 300L-4: Light 600-4g to 600-4i emitted from LED lamps 310-g to 310-i is irradiated onto floor 500-4, and the colors of light 600-4g to 600-4i are based on the average pixel values JKL9, JKL8, and JK7 in the low-resolution image, respectively.
[0108] Lighting device 300H-5: Light 600-5d to 600-5f emitted from LED lamps 310-d to 310-f is irradiated onto the ceiling 500-5, and the colors of the light 600-5d to 600-5f are based on the average pixel values LM3, MN2, and MNO1 in the low-resolution image, respectively. Lighting device 300L-5: Light 600-5g to 600-5i emitted from LED lamps 310-g to 310-i is irradiated onto floor 500-4, and the colors of light 600-5g to 600-5i are based on the average pixel values MNO9, MN8, and LM7 in the low-resolution image, respectively.
[0109] Lighting device 300-7: Light 600-7a to 600-7c emitted from LED lamps 310-a to 310-c is irradiated onto wall surface 500-2, and the colors of light 600-7a to 600-7c are based on average values B678, B456, and B234, respectively. Lighting device 300-8: Light 600-8a to 600-8c emitted from LED lamps 310-a to 310-c is irradiated onto wall surface 500-2, and the colors of light 600-8a to 600-8c are based on average values C567, C456, and C345, respectively.
[0110] Lighting device 300-9: Light 600-9a to 600-9c emitted from LED lamps 310-a to 310-c is irradiated onto the wall surface 500-3, and the colors of the light 600-9a to 600-9c are based on the average pixel values N567, N456, and N345 in the low-resolution image, respectively. Lighting device 300-10: Light 600-10a to 600-10c emitted from LED lamps 310-a to 310-c is irradiated onto wall surface 500-3, and the colors of light 600-10a to 600-10c are based on average values of O678, O456, and O234, respectively.
[0111] The rest of the lighting device 300 is as described in the first embodiment. According to this embodiment, the color of the lighting changes more naturally at the boundary between the ceiling 500-5 and the wall surfaces 500-2 and 500-3 and at the boundary between the floor ceiling 500-4 and the wall surfaces 500-2 and 500-3, and it is possible to express colors closer to those displayed on the display unit 101.
[0112] 17 and 18A, at the boundary between wall surface 500-2 and ceiling 500-5, the closer the light illuminating wall surface 500-2 is to the television set 100, the more it reflects the color of the display unit 101 nearer to the center. For example, light 600-6c is based on average value A123, while light 600-7c is based on average value B234 nearer to the center. In other words, it is not based on pixel B1. Light 600-8c is based on average value C345 nearer to the center. In other words, it is not based on pixels C1 and C2. Furthermore, the farther the light from ceiling 500-5 adjacent to wall surface 500-2 is from the television set 100, the more pixels its color is based on, and light closer to wall surface 500-2 is also influenced by the pixels that illuminate wall surface 500-2 in FIG. 10.
[0113] For example, light 600-1d is based on average value DE3, while light 600-1e is based on average value CD2 including pixel C2 for illuminating wall surface 500-2 in FIG. 10. Light 600-1f is based on average value BCD1. Furthermore, light 600-2d is based on average value FG3, while light 600-2e is based on average value EFG2 including pixel E2. Light 600-1f is based on average value EFG1.
[0114] Fig. 18B is a redrawing of Fig. 18A showing the relationship between each pixel of the (16x9) pixel low-resolution image and color information of the light illuminating wall surfaces 500-1 to 500-3, floor surface 500-4, and ceiling 500-5. Also in Fig. 18B, pixel groups corresponding to wall surfaces 500-1 to 500-3, floor surface 500-4, and ceiling 500-5 are indicated by areas AR1 to AR5 shown with thick solid lines. Furthermore, in areas AR1, AR4, and AR5, pixel groups corresponding to each lighting device 300, 300H, and 300L are indicated with thin solid lines.
[0115] 18B , in the region where wall surface 500-2 and floor surface 500-4 meet, unlike the first embodiment, pixels B9, C8, and C9 do not contribute to color information of light irradiated onto wall surface 500-2, but contribute to color information of lighting device 300L-1 irradiating floor surface 500-4. Furthermore, pixels E8 and E9 contribute to color information of lighting device 300L-2 adjacent to lighting device 300L-1 irradiating the same floor surface 500-4, rather than lighting device 300L-1 irradiating the same floor surface 500-4. This is also true in the region where wall surface 500-3 and floor surface 500-4 meet.
[0116] The above also applies to the area where wall surface 500-2 and ceiling 500-5 meet. That is, pixels B1, C1, and C2 do not contribute to color information of light irradiated onto wall surface 500-2, but contribute to color information of lighting device 300H-1 irradiating ceiling 500-5. Furthermore, pixels E1 and E2 contribute to color information of lighting device 300H-2 adjacent to lighting device 300H-1 irradiating the same ceiling 500-5, rather than lighting device 300H-1 irradiating the same ceiling 500-5. This also applies to the area where wall surface 500-3 and ceiling 500-5 meet.
[0117] In contrast, the relationship between the pixel group in area AR1 corresponding to the front and illumination device 300 is the same as in the first embodiment. That is, in this embodiment, the corresponding pixel columns in the vertical direction are different between area AR1 and areas AR4 and AR5. More specifically, in the area where floor 500-4 meets wall surface 500-2 or 500-3 and the area where ceiling 500-5 meets wall surface 500-2 or 500-3, pixels located outside the pixel group corresponding to the front (on the edge of display unit 101) are used as color information for light illuminating floor surface 500-4 or ceiling 500-5, rather than wall surface 500-2 or 500-3. In other words, light illuminating locations farther from television receiver 100 in the X and Y directions is generated based also on color information for light corresponding to wall surface 500-2 or 500-3. This makes it possible to improve the continuity of color changes between the floor surface 500-4 and the wall surfaces 500-2 and 500-3, and between the ceiling 500-5 and the wall surfaces 500-2 and 500-3.
[0118] As described above, according to this embodiment, the color of light at the boundary between the ceiling and the wall surface and the boundary between the floor and the wall surface can be made to be closer to that of the video. As a result, the entire room is illuminated in a more natural state, which further enhances the sense of immersion of the user watching the television receiver 100. Of course, the correspondence between each lighting device 300 and the illumination color information is not limited to the cases in FIGS. 17, 18A, and 18B, and can be modified in various ways depending on the genre of the video, etc. This embodiment can also be applied to cases where the floor 500-4 and the ceiling 500-5 are not illuminated as in the first embodiment.
[0119] (Variations, etc.) The embodiments are not limited to the above-described embodiments, and various modifications are possible. For example, in the above-described embodiments, the audio device 200 controls the lighting device 300. However, instead of the audio device 200, a recording device, for example, may have the same functions. In this case, an audio signal and a video signal including illumination color information are transmitted from the television 100 to the recording device, and the recording device controls the lighting device 300 according to the received illumination color information. Alternatively, the television 100 may directly control the lighting device 300 without using the audio device 200 or the like. In this case, an audio signal embedded with illumination color information may be transmitted to the lighting device 300, as in the above-described embodiments, or illumination color information may be transmitted to the lighting device 300 by various methods without using an audio signal.
[0120] Furthermore, when embedding illumination color information in an audio signal and transmitting it to audio device 200, 8b / 10b conversion may be performed and a symbol lock code such as K28.5 may be used at positions corresponding to video frame boundaries. This is shown in Figure 19. Figure 19 is a conceptual diagram showing how video frames are processed on the television receiver 100 side.
[0121] As shown in FIG. 19 , for example, the determination unit 104 or the integration unit 106 performs 8b / 10b conversion on the color information of a (16×9) pixel low-resolution image extracted from a video frame, in 8-bit increments. As a result, the 8-bit color information (illumination color information) is converted into 10-bit information (10b1 to 10b10). Then, for example, the determination unit 104 or the integration unit 106 inserts a symbol lock code, such as K28.5 (0011111010), as start information for the video frame at a position indicating the start of the video frame. This 10-bit symbol lock code is then embedded in the audio signal using the method described with reference to FIGS. 5B, 15A, and 15B. This allows the audio device 200 receiving the audio signal to recognize the start of the video frame based on the presence of the symbol lock code.
[0122] In the audio device 200, for example, the separator 201 removes the symbol lock code from the received audio signal. Then, the 8b / 10b converted color information (illumination color information) is subjected to 10b / 8b conversion. This makes it possible to generate 3-bit color information for each RGB color per pixel, as shown in FIG. 19. This method makes it possible to synchronize the video information and color information in a video frame.
[0123] The arrangement of the television 100, audio device 200, lighting device 300, and speaker 400 is not limited to the arrangement described in the above embodiment, but can be freely set by the user. The determination unit 104 then determines the correspondence between the lighting device and each area of the low-resolution video according to the information obtained by the position information acquisition unit 105. The configurations described in the embodiments are merely examples, and any configuration may be used as long as it is capable of executing the processes shown in each flowchart, and the order of the steps in the flowcharts can be changed as much as possible.
[0124] Although several embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments and can be modified as appropriate. The above configurations can be replaced with substantially similar configurations, configurations that achieve similar effects, or configurations that can achieve similar purposes. [Explanation of symbols]
[0125] 1...lighting system, 100...television receiver, 101...display unit, 102...receiving unit, 103...color information acquisition unit, 104...determination unit, 105...position information acquisition unit, 106...integration unit, 107...user information reception unit, 108...memory, 109...transmitting unit, 110...compression unit, 200...audio device, 201...separating unit, 202...amplifying unit, 203...lighting control unit, 204...receiving unit, 205...decoding unit, 300, 300H, 300L, 300W...lighting device, 310...LED lamp, 320-322...LED, 330...lens, 400...speaker, 500...wall surface, 600, 600W...light
Claims
1. An information processing device, a color information acquisition unit that acquires color information related to the image displayed on the display unit; a position information acquisition unit that acquires relative position information between the display unit and a lighting device installed at a distance from the display unit; a determination unit that determines illumination color information to be emitted by the illumination device based on the color information and the position information; a transmitter that transmits the illumination color information to the illumination device; Equipped with the determination unit obtains the illumination color information by compressing the color information; The transmitting unit is an information processing device that transmits the illumination color information to the illumination device in a state where the illumination color information is incorporated into an audio signal.
2. the display unit includes a plurality of regions each including a plurality of pixels; The information processing device according to claim 1 , wherein the determination unit acquires the illumination color information based on a plurality of pixels included in any one of the plurality of regions on the display unit, and associates a position of any one of the plurality of regions with a position of the illumination device.
3. the plurality of regions include a first region and a second region at a position different from the first region, the lighting device includes a first lighting device and a second lighting device provided at a position different from that of the first lighting device, The information processing device according to claim 2 , wherein the transmission unit transmits the illumination color information about the first area to the first illumination device and transmits the illumination color information about the second area to the second illumination device.
4. the plurality of regions include a first region and a second region at a position different from the first region, the lighting device includes a first lighting device and a second lighting device provided at a position different from that of the first lighting device, the transmitting unit transmits a signal including the illumination color information regarding the first area and the illumination color information regarding the second area to the first lighting device and the second lighting device; the first lighting device is turned on based on the illumination color information related to the first area; The information processing apparatus according to claim 2 , wherein the second illumination device is turned on based on the illumination color information relating to the second area.
5. The information processing device according to claim 3 , wherein the number of pixels included in the first region is different from the number of pixels included in the second region.
6. The information processing apparatus according to claim 1 , wherein the lighting device includes: a lighting unit that turns on light based on the lighting color information; and a speaker that outputs sound based on audio information included in the audio signal.
7. The information processing device according to claim 1 , wherein the information processing device is a display device including the display unit.
8. The information processing device according to claim 1; the lighting device; The lighting device comprises: a receiving unit that receives the illumination color information; a lighting control unit that turns on a lighting unit that can emit light based on the illumination color information received by the receiving unit; A lighting system comprising:
9. Obtaining color information related to an image displayed on a display unit; acquiring relative position information between the display unit and a lighting device installed at a distance from the display unit; determining illumination color information to be emitted by the illumination device based on the color information and the position information; transmitting the illumination color information to the illumination device; Equipped with The illumination color information is obtained by compressing the color information; An information processing method, wherein the illumination color information is transmitted to the illumination device in a state where it is incorporated into an audio signal.
10. Obtaining color information related to an image displayed on a display unit; acquiring relative position information between the display unit and a lighting device installed at a distance from the display unit; determining illumination color information to be emitted by the illumination device based on the color information and the position information; transmitting the illumination color information to the illumination device; The lighting device that has received the illumination color information lights up a lighting unit that can emit light based on the illumination color information. Equipped with The illumination color information is obtained by compressing the color information; A method for controlling a lighting system, wherein the lighting color information is transmitted to the lighting device in a state where it is incorporated into an audio signal.
Citation Information
Patent Citations
Viewing environment control device, system, and method
JP2009021847A
Additional data generating system
JP2010034687A
Ambient lighting system for display devices
JP2010511988A
Illumination control device, control system, and illumination control method
JP2013218153A
A method and system for creating a light script for a video
US20200234052A1