Lighting control device, lighting device, and lighting control program

Abstract

To make it possible to perform lighting control according to a characteristic area in input video information.SOLUTION: A lighting control device according to the present invention executes an identifying process of identifying a target area that is part of input video information, a color determining process of determining either color information of the target area identified in the identifying process or color information of an area other than the target area, and a transmitting process of generating lighting control information for a lighting device based on the color information determined in the color determining process and transmitting the lighting control information to the lighting device.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a lighting device that controls lighting based on video information, a lighting device that performs lighting based on video information, and a lighting control program executable by an information processing device.

Background Art

[0002] Due to the increasing size of various display devices such as liquid crystal display devices, the sense of immersion when enjoying various contents such as movies, concerts, and karaoke has been greatly improved. For the purpose of further improving the sense of immersion, efforts have also been made to enrich the audio equipment. Currently, attempts are being made to improve the sense of immersion and atmosphere during viewing by controlling not only the audio equipment but also the lighting provided in the viewing room.

[0003] Patent Document 1 discloses a display device that analyzes the color information of a video when viewing video content and controls lighting means in conjunction with changes in the color information of the video. By controlling such lighting means, it is possible to make the viewer feel a sense of spread in the video content displayed on the display device.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] For the analysis of pornographic information in Patent Document 1, (1) capturing the video into the buffer memory frame by frame, dividing the captured video into three primary color planes, obtaining the average value of each color component of the three primary colors for the entire screen in each plane, and performing illumination with a single color corresponding to the average value; (2) capturing the video into the buffer memory frame by frame, dividing the captured video into a plurality of regions, obtaining the average value of each color component of the three primary colors for each divided region, and performing illumination with a color corresponding to each divided region based on the average value are disclosed.

[0006] In the display device described in Patent Document 1, in the analysis method of (1), the entire video is analyzed, and illumination control based on the color of the entire video is performed. Regarding the analysis method of (2), since the pornographic information is analyzed for each region of the divided video, illumination control is performed with the pornographic information averaged for each region of the divided video.

[0007] Therefore, in the display device described in Patent Document 1, illumination control is performed with the pornographic information averaged for the entire screen or each divided region, so it is considered that the illumination control lacks sharpness.

Means for Solving the Problem

[0008] Therefore, the illumination control device according to the present invention adopts the following configuration. A specific process for specifying a target region that is a part of the input video information, The pornographic information of the target region specified by the specific process to A color determination process for determining, Based on the pornographic information determined by the color determination process, generating illumination control information for the illumination device and transmitting the illumination control information to the illumination device are executed and the video information is provided with division areas, the transmission process generates lighting control information for each division area and transmits the lighting control information to the lighting device corresponding to the division area, the specifying process specifies only the changing part of the video information as the target area, the color determination process determines the color information of the target area specified by the specifying process, the transmission process generates first lighting control information for a first lighting device associated with a division area including the target area based on the color information of the target area determined by the color determination process, and transmits the first lighting control information to the first lighting device. Furthermore, in the lighting control device according to the present invention, determines the color information of the entire division area that does not include the target area specified by the specifying process among the division areas, generates second lighting control information for a second lighting device associated with a division area that does not include the target area among the division areas based on the color information of the entire division area that does not include the target area determined by the color determination process, and transmits the second lighting control information to the second lighting device.

[0014] Furthermore, in the lighting control device according to the present invention, when the amount of change in the input video information is greater than a predetermined threshold, the color information of the target area specified by the specific process is determined, and when the amount of change in the input video information is less than or equal to the predetermined threshold, the color information of the entire input video information is determined.

[0017] Also, the lighting device according to the present invention a specific process for specifying a target area that is a part of the input video information, a color determination process for determining the color information of the target area specified by the specific process, performs a lighting process of generating lighting control information based on the color information determined by the color determination process and performing lighting based on the lighting control information, The video information is provided with a divided area, The lighting process generates lighting control information for each divided area and controls the lighting device corresponding to the divided area, Light The specific process specifies only the changing part of the video information as the target area, The color determination process determines the color information of the target area specified by the specific process, The lighting process generates first lighting control information for a first lighting device associated with a divided area including the target area based on the color information of the target area determined by the color determination process, and controls the first lighting device based on the first lighting control information 。

[0018] Also, the lighting control program according to the present invention a specific process for specifying a target area that is a part of the input video information, a color determination process for determining the color information of the target area specified by the specific process, Based on the color information determined by the color determination process, an information processing device is caused to execute a transmission process of generating lighting control information for a lighting device and transmitting the lighting control information to the lighting device. The video information is provided with divided areas. In the transmission process, lighting control information is generated for each divided area, and the lighting control information is transmitted to the lighting device corresponding to the divided area. In the specifying process, only the changing portion of the video information is specified as a target area. In the color determination process, the color information of the target area specified in the specifying process is determined. The transmission process is as follows. Based on the color information of the target area determined in the color determination process, first lighting control information for a first lighting device associated with the divided area including the target area is generated, and the first lighting control information is transmitted to the first lighting device. 。

Advantages of the Invention

[0019] According to the lighting control device, lighting device, and lighting control program according to the present invention, by using the color information of the specified target area or the color information other than the target area in the video information, it becomes possible to perform lighting control according to the color information. For example, it also becomes possible to perform distinct lighting control according to the video information.

Brief Description of the Drawings

[0020]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Mode for Carrying Out the Invention

[0021] FIG. 1 is a diagram showing the configuration of the karaoke system of this embodiment. The karaoke system in this embodiment includes a karaoke device 2 (which may also be called a commander) and a remote control device 1. The karaoke device 2 and the remote control device 1 are communicatively connected to form a network using the LAN 100 and the access point 130.

[0022] The karaoke device 2 installed in a store such as a karaoke box is provided with an audio control unit 25 as a performance unit for playing music. The karaoke device 2 is also provided with an operation unit 21 for receiving various inputs from the user. The karaoke device 2 is provided with an operation processing unit 22 that interprets the input from the operation unit 21 and transmits it to the CPU 30. The karaoke device 2 is also provided with a hard disk 32 as a storage unit for storing various information. The karaoke device 2 is provided with a LAN communication unit 24a as a communication means for connecting to the LAN 100 and joining the network. In addition, the karaoke device 2 of this embodiment is also provided with a wireless LAN communication unit 24b, and it is also possible to perform a wireless network connection using the wireless LAN communication unit 24b instead of the wired network connection using the LAN communication unit 24a.

[0023] In addition, the karaoke device 2 is provided with video playback means for causing the monitor 41 to display lyrics video and background video. This video playback means includes a video playback unit 29 that plays back video based on video information, a video RAM 28 that temporarily stores the video to be played back, and a video control unit 31 that performs superimposition of lyrics telops on the played-back video, application of video effects, and the like.

[0024] Furthermore, in this karaoke device 2, in addition to the monitor 41 connected externally, it is possible to display various information on the touch panel monitor 33. The touch panel monitor 33 is configured by superimposing a display unit 35 that displays video information input from the video control unit 31 and a touch panel 34 that outputs the position where a touch input is made to the operation processing unit 22. This touch panel monitor 33 is arranged on the front surface of the housing of the karaoke device 2 or the like, and functions as an input unit similar to the operation unit 21 of the karaoke device 2 or the touch panel monitor 11 of the remote control device 1. The user can perform various operations on the karaoke device 2, such as directly reserving a song on the karaoke device 2 by selecting a song on the touch panel monitor 33.

[0025] Furthermore, the karaoke device 2 is configured to include a control unit including a CPU 30 for overall control of each component and a memory 27 for temporarily storing information necessary for executing various programs.

[0026] With such a configuration, the karaoke device 2 executes various processes. As the main functions of the karaoke device 2, it is possible to execute a song reservation process, a song playback process, and the like. The song reservation process is a process for designating and reserving a song based on a designation from the user and is executed in cooperation with the remote control device 1. The reservation information formed in the song selection process of the remote control device 1 is transmitted to the karaoke device 2. The karaoke device 2 registers the received reservation information in the reservation table in the memory 27. The song playback process is a process for playing back the reserved song, and is a process in which the song performance process and the lyrics display process are executed synchronously.

[0027] The music performance process is a process of causing the acoustic control unit 25 to perform a performance based on the performance information included in the music information. The music performed by the acoustic control unit 25 is emitted from the speaker 42 together with the singing voice input from the microphones 43a and 43b. The lyric display process is a process of providing singing assistance by causing the monitor 41 to display the lyric information included in the music information. It is also possible to execute a background video display process in which a background video is superimposed on the lyrics displayed in this lyric display process and displayed.

[0028] On the other hand, the remote control device 1 is capable of executing a music selection process of searching for music based on an instruction from the user and transmitting reservation information to the karaoke device 2 for the music for which a reproduction instruction has been given. Further, the remote control device 1 can receive various information from the karaoke device 2 or the server device 5 connected to the Internet and execute various processes. In the present embodiment, an operation unit 17 and a touch panel monitor 11 are provided as a user interface for receiving various instructions from the user. The touch panel monitor 11 includes a display unit 11a and a touch panel 11b, and while displaying various interfaces on the display unit 11a, it is capable of receiving touch inputs from the user.

[0029] Furthermore, the remote control device 1 includes a memory 14 as a storage unit for storing the database, various programs, and various information generated during program execution, which are required for the music selection process, and a remote control side control unit for comprehensively controlling these configurations. The remote control side control unit includes a CPU 15, a video control unit 13 for forming the video to be displayed on the touch panel monitor 11, a video RAM 12 for temporarily storing the video information to be displayed, and an operation processing unit 18 for interpreting the input from the touch panel monitor 11 or the operation unit 17 and transmitting it to the CPU 15.

[0030] The remote control device 1 is wirelessly connected to the access point 130 by the wireless LAN communication unit 16, and thus is connected to the network constituted by the LAN 100. Each remote control device 1 is pre-associated with a specific karaoke device 2. Various commands output from the remote control device 1 will be received by the associated karaoke device 2.

[0031] With such a configuration of the remote control device 1, by receiving various inputs from the user through the touch panel monitor 11 or the operation unit 17, and providing various information through the display of the touch panel monitor 11, it is possible to perform various processes such as a music selection process for transmitting reservation information output to the karaoke device 2.

[0032] In addition, the karaoke system of the present embodiment has a lighting control device 44 connected to the karaoke device 2. The lighting control device 44 performs lighting control of the lighting devices 45a to 45e based on the video information output by the karaoke device 2. As the content of the lighting control, for each of the lighting devices 45a to 45e, it is possible to control the brightness and the lighting color. By controlling the lighting devices 45a to 45e based on the video information, it is possible to give an extended feeling to the viewer on the monitor 41 or to improve the atmosphere during viewing. In the present embodiment, a wired connection is made between the lighting control device 44 and the lighting devices 45a to 45e, but a wireless connection form may be adopted between the lighting control device 44 and the lighting devices 45a to 45e.

[0033] FIG. 2 is a diagram for explaining the lighting-related configuration of the present embodiment, showing the state inside the karaoke room 6 and the arrangement relationship between the monitor 41 and the lighting devices 45a to 45e. The lighting devices 45a to 45e are configured to include a base 451 and a light emitting portion 452. Inside the base 451, a plurality of light emitting elements such as LEDs are arranged to illuminate the light emitting portion 452 formed of a transparent member such as an acrylic pipe. Three colors of the three primary colors are used for the plurality of light emitting elements, and by changing the brightness of each light emitting element, it is possible to illuminate the light emitting portion 452 with various colors.

[0034] Figure 2 shows the relationship between the divided areas 41a to 41e of the monitor 41 and the arrangement of the lighting devices 45a to 45e in the karaoke room 6. In this embodiment, the monitor 41 is divided into five parts in the vertical direction, and each part is assigned to the divided areas 41a to 41e. The lighting devices 45a to 45e are arranged according to the positions of these divided areas 41a to 41e. For example, the lighting device 45a corresponding to the leftmost divided area 41a is arranged in front of the left hand of the monitor 41. Also, the lighting device 45b corresponding to the divided area 41b is arranged in the back left of the monitor 41.

[0035] In this way, by arranging the lighting devices 45a to 45e corresponding to the positions of the divided areas 41a to 41e of the monitor 41, it becomes possible to illuminate the lighting devices 45a to 45e corresponding to the video displayed on the monitor 41.

[0036] By the way, in the karaoke device 2, it is also possible to play non-karaoke contents such as video distribution and games. The lighting control device 44 of this embodiment can control the lighting devices 45a to 45e according to the type of content or the type of video displayed on the monitor 41.

[0037] [Main Process] Figure 3 is a flowchart showing the main process of the lighting control device 44 of this embodiment. The lighting control device 44 executes control of the lighting devices 45a to 45e based on the video information output by the karaoke device 2. The lighting control device 44 of this embodiment can perform first to fourth lighting control processes, and has an automatic mode in which the first to fourth lighting control processes are automatically switched based on the type of the input video information, and a manual mode in which the first to fourth lighting control processes are manually switched by the user's operation. The karaoke device 2 of this embodiment can output the type of the video information (for example, karaoke, video distribution, game, etc.) to the lighting control device 44 along with the output video information.

[0038] In the main process, it is determined whether it is set to the automatic mode or the manual mode (S101). In the manual mode, it is possible to select the first to fourth settings using the operation unit provided in the lighting control device 44 or the operation unit 21 of the karaoke device 2. When the manual mode is set (S101: manual mode), based on the setting state of the operation unit, values from 1 to 4 are assigned to the variable I (S104).

[0039] On the other hand, when the automatic mode is set (S101: automatic mode), the lighting control device 44 monitors the type of video information input from the karaoke device 2 (S102) and determines whether it is any of the first to third types of video. For example, the first type of video is assigned to games, the second type of video is assigned to concert, distributed videos such as movies, and the third type of video is assigned to karaoke. As a result of the determination, when it is the first type of video, the value 1 is assigned to the variable I, when it is the second type of video, the value 2 is assigned to the variable I, and when it is the third type of video, the numerical value 3 is assigned to the variable I. Note that the type of video information is not limited to the above-described form and can be set as appropriate.

[0040] In either the manual mode or the automatic mode, when the variable I = 1, the first lighting control process (S210) is executed, when the variable I = 2, the second lighting control process (S220) is executed, when the variable I = 3, the third lighting control process (S230) is executed, and in other cases (including the variable I = 4), the fourth lighting control process (S240) is executed.

[0041] Thus, in the automatic mode of this embodiment, based on the type of input video information, the first to fourth lighting control processes are executed. Therefore, the first to fourth lighting control processes provided for each type of video information are automatically selected, and it is possible to perform lighting control according to the video information. Also, in the manual mode, by the user's selection, it is possible to execute the first to fourth lighting control processes that match the user's preference.

[0042] Next, the first to fourth lighting control processes that can be used in this embodiment will be described. FIG. 4 is a flowchart showing the first lighting control process (S210) of this embodiment. The first lighting control process (S210) can reflect a changing part of the input video information in lighting.

[0043] [First Lighting Process] In the first lighting control process (S211), binarization (grayscale conversion) of the input video information is performed (S211). Then, the binarized video information is stored in the video buffer (S212), and it is compared with the video information of the previous frame that was binarized last time, and difference extraction is performed (S213). Then, the position (xy value of the screen) of the change point is marked from the extracted difference (S214). For the marking of the change point, for example, a position where the difference is equal to or greater than the threshold value is marked. Note that a plurality of change points can be marked, and depending on the situation of the screen, there may be no change point.

[0044] Next, a specific area having the extracted change point as a reference position is specified as a target area (S215). For example, it is conceivable that the target area is a square (area a) having the change point as the center position. Note that in this embodiment, the target area is not the entire video information but a part of the video information. Then, for the video information before binarization, color information analysis of the target area is performed (S216). As an analysis method, various methods such as calculating the average color within the target area can be adopted. Then, lighting control information is generated based on the analyzed color information (S217).

[0045] FIG. 8 is a diagram for explaining the first lighting control process (S210) of the present embodiment. FIG. 8 shows a state where the moving body A is moving from the left to the right of the screen as time passes. Time is passing in the order of FIGS. 8(a), 8(b), 8(c), and 8(d). For example, at the time of FIG. 8(b), the area of the moving body A is specified as the target area, and the color of the moving body A is analyzed as color information. In this case, as the lighting control information, the color of the moving body A is set for the divided area 41b, and is transmitted to the lighting device 45b corresponding to the divided area 41b including the target area, and the lighting device 45b is illuminated with the color of the moving body A. Note that since the other divided areas 41a, 41c, and 41d do not include the target area, the lighting devices 45a, 45c, and 45d corresponding thereto do not perform lighting.

[0046] The same applies to the case of FIG. 8(c), where the lighting device 45c corresponding to the divided area 41c is illuminated with the color of the moving body A. Also, in the case of FIG. 8(d), the lighting device 45d corresponding to the divided area 41d is illuminated with the color of the moving body A. In this way, when the moving body A moves from the left to the right of the screen of the monitor 41, following the movement of the moving body A, the lighting devices 45a to 45e are sequentially illuminated with the color of the moving body A. Therefore, the user listening to the monitor 41 in the karaoke room 6 can experience an extended feeling of the screen or an improvement in the atmosphere.

[0047] As described above, in the first lighting control process (S210) of the present embodiment, the lighting of the lighting devices 45a to 45e corresponding to the divided areas 41a to 41e where the target area is located is controlled. When the divided areas 41a to 41e do not include the target area, the lighting devices 45a to 45e are in a state where lighting control is not performed (turned off state). Not only in such a form, but lighting control may also be performed on the divided areas 41a to 41e that do not include the target area.

[0048] As such a form, for example, (1) for the divided regions 41a to 41e that do not include the target region, analyze the color information of the entire divided regions 41a to 41e, and based on the analyzed color information, control the corresponding lighting devices 45a to 45e, or (2) analyze the color information for the region obtained by removing the target region from the entire video information, and based on the analyzed color information, control the lighting of the divided regions 41a to 41e that do not include the target region, etc. Various forms can be adopted.

[0049] [Second Lighting Process] FIG. 5 is a flowchart showing the second lighting control process (S220) of the present embodiment. In the second lighting control process (S220), a person region is detected as the target region in the video information (S221). In the video information, the region occupied by a person will be occupied by the colors of clothes and skin. When the colors of such a person region are reflected in the lighting devices 45a to 45e, it is considered that the lighting will not necessarily match the atmosphere of the screen.

[0050] Therefore, in the second lighting control process (S220), a person region is detected as the target region, and by reflecting the colors of the person removal region, which is the part other than the target region at times, in the lighting devices 45a to 45e, lighting that matches the atmosphere of the screen is performed.

[0051] FIG. 9 is a diagram for explaining the second lighting control process (S220) of the present embodiment. As shown in FIG. 9(a), video information in which a person 71a is displayed is projected on the monitor 41. In the present embodiment, when detecting a person region from the video information, as shown in FIG. 9(b), a skeleton model 71b is detected from the video information, a skeleton corresponding region 71c associated with the skeleton model 71b is specified, and as shown in FIG. 9(c), the region obtained by overlapping the skeleton corresponding region 71c is detected as the person region 71d (S221).

[0052] Note that the detection of the person region is not limited to the form using such a skeleton model, and various forms such as using face recognition or using face recognition and a skeleton model in combination can be adopted.

[0053] By removing the human area 71d, which is the target area, from the video information, it is possible to obtain the human-removed area 71e. By analyzing the color information of this human-removed area 71e (S222), the lighting control information for the lighting devices 45a to 45e is generated (S223). In this embodiment, the average color of the human-removed area 71e is used to generate the lighting control information assigned to each of the lighting devices 45a to 45e. Therefore, the lighting devices 45a to 45e that have received the lighting control information illuminate the surroundings with the average color based on the human-removed area 71e.

[0054] Note that in the second lighting control process (S220), it is also possible to detect the color information for each of the divided areas 41a to 41e for the human-removed area 71e, and use the color information of each of the divided areas 41a to 41e to illuminate the lighting devices 45a to 45e.

[0055] [Third Lighting Process] FIG. 6 is a flowchart showing the third lighting control process (S230) of this embodiment. In the third lighting control process (S230), a telop area is detected as the target area in the video information (S232). In videos used for karaoke, movies, etc., a telop (subtitle) may be displayed. Especially in karaoke, in order to assist singing, the area occupied by the telop in the screen is taken large, and the color of the telop changes to indicate the singing part. When controlling the lighting devices 45a to 45e using such video information, since the lighting is controlled including the color of the telop, it is considered that the lighting may not necessarily match the atmosphere of the screen.

[0056] Therefore, in the third lighting control process (S230), a telop area is detected as the target area, and by reflecting the color of the telop-removed area, which is the part other than the target area, on the lighting devices 45a to 45e, lighting that matches the atmosphere of the screen is performed.

[0057] FIG. 10 is a diagram for explaining the third lighting control process (S230) of the present embodiment. In the third lighting control process (S230), in the video information, a telop region 81a is detected as a target region (S231). As for the detection of the telop region 81a, it is conceivable to perform character recognition processing on the video information, or to set a predetermined region in the screen as the telop region 81a. Further, as shown in FIG. 10, the telop region 81a may be specified not only in a form with sufficient margins around the telop, but also with only the telop (character) part as the telop region 81a.

[0058] By removing the telop region 81a, which is the target region, from the video information, it is possible to obtain a telop removal region 81b. By analyzing the color information of this telop removal region (S232), lighting control information for the lighting devices 45a to 45e is generated (S233). In the present embodiment, the average color of the telop removal region is used to generate lighting control information assigned to each of the lighting devices 45a to 45e. Therefore, the lighting devices 45a to 45e that have received the lighting control information illuminate the surroundings with the average color based on the telop removal region 81b.

[0059] Note that in the second lighting control process (S220), color information may also be detected for each of the divided regions 41a to 41e in the person removal region, and the lighting devices 45a to 45e may be illuminated using the color information of each of the divided regions 41a to 41e.

[0060] Note that in the third lighting control process (S230), color information may also be detected for each of the divided regions 41a to 41e in the telop removal region 81b, and the lighting devices 45a to 45e may be illuminated using the color information of each of the divided regions 41a to 41e.

[0061] [Fourth Lighting Process] FIG. 7 is a flowchart showing the fourth lighting control process (S240) of the present embodiment. Different from the first to third lighting control processes (S210, S220, S230), the fourth lighting control process (S240) does not detect a target area in the image information, but analyzes color information for each of the divided areas 41a to 41e (S241). Then, using the color information analyzed for each of the divided areas 41a to 41e, lighting control information for the lighting devices 45a to 45e corresponding to each of the divided areas 41a to 41e is generated (S242).

[0062] The generated lighting control information is transmitted to each of the lighting devices 45a to 45e (S243). Each of the lighting devices 45a to 45e is illuminated with the color information of the corresponding divided area 41a to 41e based on the received lighting control information.

[0063] As described above, the various lighting control processes (the first to fourth lighting control processes) of the present embodiment have been described. By executing the lighting control process based on the image information, the lighting devices 45a to 45e are controlled in accordance with the display screen, and it becomes possible to give an extended feeling to the screen or to improve the atmosphere.

[0064] In particular, in the first to third lighting control processes of the present embodiment, a target area is detected from the image information, and the lighting color of the lighting devices 45a to 45e is controlled with the color information of the target area (the first lighting control process) or the color information other than the target area (the second and third lighting control processes), so that it becomes possible to perform lighting with the color of the characteristic part of the display screen or the color excluding the unnecessary parts.

[0065] [First Modification Example] FIG. 11 is a flowchart showing the lighting control process of another embodiment (first modification example). The first lighting control process (S210) described above identifies the changing portion in the image information as the target area, and controls the lighting devices 45a to 45e using the color information of the target area. Therefore, when there is no changing portion or there are few changing portions on the display screen, it is conceivable that the lighting devices 45a to 45e do not perform lighting. Regarding the divided areas 45a to 45e corresponding to the changing portion, even if lighting is performed by the corresponding lighting devices 45a to 45e, the lighting devices 45a to 45e corresponding to the divided areas 45a to 45e that are not the changing portion do not perform lighting.

[0066] In the first modification example, considering such a situation, for the divided areas 41a to 41e in which no changing portion has occurred, the lighting devices 45a to 45e are controlled based on the colors of the divided areas 41a to 41e. In the flowchart of the lighting control process shown in FIG. 11, the variable J indicating the divided areas 41a to 41e is reset (J = 1). In the present embodiment, the variable J indicates the order of the divided areas 41a to 41e from the left side of the screen.

[0067] In S302 to 303, similar to the first lighting control process described with reference to FIG. 4, binarization of the video information (S302) and storage in the video buffer (S303) are executed. Then, the processes of S304 to S305 are executed for the divided areas 41a to 41e specified by the variable J.

[0068] In the process for each divided area 41a to 41e, first, the J-th divided area 41a to 41e is set as the processing target (S304). Then, the difference from the previous frame is extracted for the divided area 41a to 41e (S305).

[0069] Then, the difference extraction result with the previous frame is compared with a threshold value. If the difference is greater than the threshold value (S306: Yes), for the target divided areas 41a to 41e, the same processing as the first lighting control processing (S214 to S218) is executed, and currently, lighting control information for the divided areas 41a to 41e specified by the variable J is generated (S310) and transmitted to the corresponding lighting devices 45a to 45e.

[0070] On the other hand, if the difference is equal to or less than the threshold value (S306: No), the color information of the entire screen of the target divided areas 41a to 41e is analyzed (S312), and based on the analyzed color information, lighting control information for the divided areas 41a to 41e currently specified by the variable J is generated (S314).

[0071] When the processing (S304 to S314) for one divided area 41a to 41e is completed, the variable J is incremented by one (S316), and the processing for the next divided area 41a to 41e is executed. When the processing for all the divided areas 41a to 41e in one screen is completed (S317: Yes), the process returns to S301 to reset the variable J, and the processing for the next input video information is executed.

[0072] Also, when the input of video information ends (S315: Yes), the lighting control processing ends. Thus, in the first modification example, the lighting control method is switched based on the magnitude of the change in the image information. Therefore, for each divided area 41a to 41e, it is possible to perform lighting control suitable for the magnitude of the change in the image information.

[0073] [Second Modification Example] In the above-described embodiment, in the main processing described with reference to FIG. 2, the switching between the first to fourth lighting control processes (S210 to S240) was performed in the automatic mode or the manual mode. In particular, in the automatic mode, the switching was performed based on the type of video information output from the karaoke device 2. In the automatic mode, instead of receiving the type of video information from the karaoke device 2 in this way, it may be possible to determine the type of video information by analyzing the video information.

[0074] [Third Modification Example] In the above-described embodiment, as can be seen from the main process described with reference to FIG. 3, the lighting control device 44 always executes a process and performs any one of the first to fourth lighting control processes (S210 to S240). Instead of such a form, lighting control may be performed only during reproduction of specific content. For example, a form in which it is activated when video distribution such as a concert or a movie is performed and executes the first lighting control process (S210), or a form in which the third lighting control process (S230) is executed during reproduction of a karaoke song is conceivable.

[0075] [Fourth Modification Example] In the above-described embodiment, the lighting control device 44 and the lighting devices 45a to 45e have different configurations. Instead of such a configuration, the lighting control device 44 may be incorporated into the lighting devices 45a to 45e. Further, the lighting control device 44 may be incorporated into a device (video playback device) that outputs video information, such as the karaoke device 2.

[0076] [Fifth Modification Example] In the above-described embodiment, the lighting control device 44 is provided in the form of a device. Instead of such a configuration, the function of the lighting control device 44 may be provided by a program executed by various information processing devices.

[0077] [Sixth Modification Example] In the above-described embodiment, as described with reference to FIG. 2, the divided areas 41a to 41e for video information are divided into five in the vertical direction. The divided areas 41a to 41e can be appropriately changed not only in such a five-fold division in the vertical direction but also in at least one of the division form or the number of divisions. For example, the divided areas may be in the form of an m×n matrix divided into n in the vertical direction and m in the horizontal direction. In that case, the lighting devices 45a to 45e are arranged at appropriate positions corresponding to the divided areas. Note that the number of the lighting devices 45a to 45e can also be appropriately set, and a plurality of the lighting devices 45a to 45e may be assigned to one divided area 41a to 41e.

[0078] Also, the divided area does not necessarily have to be provided, and the control of the lighting devices 45a to 45e may be performed based on the analysis result of the entire screen. For example, when the first lighting control process is performed on the video information described in FIG. 8, at each timing of FIGS. 8(a) to 8(d), all of the lighting devices 45a to 45e will be illuminated in the color of the moving body A.

Explanation of Signs

[0079] 1: Remote control device 31: Video control unit 2: Karaoke device 32: Hard disk 5: Server device 33: Touch panel monitor 6: Karaoke room 34: Touch panel 11: Touch panel monitor 35: Display unit 11a: Display unit 41: Monitor 11b: Touch panel 41a to 41e: Divided areas 12: Video RAM 42: Speaker 13: Video control unit 43a: Microphone 14: Memory 43b: Microphone 15: CPU 44: Lighting control device 16: Wireless LAN communication unit 45a to 45e: Lighting devices 17: Operation unit 451: Base 18: Operation processing unit 452: Light emitting unit 21: Operation unit 71a: Person 22: Operation processing unit 71b: Skeleton model 24a: LAN communication unit 71c: Skeleton corresponding area 24b: Wireless LAN communication unit 71d: Person area 25: Audio control unit 71e: Person removal area 27: Memory 81a: Telop area 28: Video RAM 81b: Telop removal area 29: Video playback unit 130: Access point 30: CPU

Claims

1. A specifying process for specifying a target area that is a part of the input video information, a color determination process for determining the color information of the target area specified by the specifying process, a transmission process for generating lighting control information for a lighting device based on the color information determined by the color determination process and transmitting the lighting control information to the lighting device, and executing the processes, the video information is provided with divided areas, the transmission process generates lighting control information for each divided area and transmits the lighting control information to the lighting device corresponding to the divided area, the specifying process specifies only the changing part of the video information as the target area, the color determination process determines the color information of the target area specified by the specifying process, the transmission process generates first lighting control information for a first lighting device associated with a divided area including the target area based on the color information of the target area determined by the color determination process, and transmits the first lighting control information to the first lighting device A lighting control device.

2. Determine the color information of the entire divided area that does not include the target area specified by the specifying process among the divided areas, Generate second lighting control information for a second lighting device associated with a divided area that does not include the target area based on the color information of the entire divided area that does not include the target area determined by the color determination process, and transmit the second lighting control information to the second lighting device The lighting control device according to claim 1.

3. When the amount of change in the input video information is greater than a predetermined threshold, the color determination process determines the color information of the target area specified by the specifying process; when the amount of change in the input video information is less than or equal to the predetermined threshold, the color determination process determines the color information of the entire input video information The lighting control device according to claim 1.

4. A specifying process for specifying a target area that is a part of the input video information, a color determination process for determining the color information of the target area specified by the specifying process, a lighting process for generating lighting control information based on the color information determined by the color determination process and performing lighting based on the lighting control information, and executing the processes, the video information is provided with divided areas, the lighting process generates lighting control information for each divided area and controls the lighting device corresponding to the divided area, the specifying process specifies only the changing part of the video information as the target area, the color determination process determines the color information of the target area specified by the specifying process, the lighting process Generate first lighting control information for a first lighting device associated with a divided area including the target area based on the color information of the target area determined in the color determination process, and control the first lighting device based on the first lighting control information. Lighting device. **Claim 5** A specifying process for specifying a target area that is a part of the input video information, A color determination process for determining the color information of the target area specified in the specifying process, Causing an information processing device to execute a transmission process of generating lighting control information for a lighting device based on the color information determined in the color determination process and transmitting the lighting control information to the lighting device. The video information is provided with divided areas. The transmission process generates lighting control information for each divided area and transmits the lighting control information to the lighting device corresponding to the divided area. The specifying process specifies only the changing part of the video information as the target area. The color determination process determines the color information of the target area specified in the specifying process. The transmission process Generate first lighting control information for a first lighting device associated with a divided area including the target area based on the color information of the target area determined in the color determination process, and transmit the first lighting control information to the first lighting device. Program for lighting control.

Images