Light color control system, video player, smart home system and medium

Abstract

The application relates to a light color control system, a video player, a smart home system and a computer equipment storage medium; the control system comprises: an embedded graphic display system used for collecting a video signal from a video source and acquiring an image picture; a light color processing unit used for performing color analysis on the image picture to obtain color data; a light address coding unit used for performing address coding on a light device according to the color data to generate a light control parameter, and outputting the light control parameter to a light driver to drive the light device to emit light, so that the light color of the light device changes along with the image picture output to a display screen by the video player; the technical scheme reduces the equipment cost in light color control and improves the light color control effect.

Description

Technical Field

[0001] This application relates to the field of lighting technology, and in particular to a lighting color control system, a video player, a smart home system, and a computer equipment storage medium. Background Technology

[0002] Light following shadow is a popular smart home technology. When watching TV or movies, the smart home system can automatically adjust the brightness and color of the light. It can automatically adjust the color and brightness of the background lights and ambient light strips according to the color changes of the video screen, thereby bringing users the ultimate viewing experience and lighting color effects.

[0003] Currently, commonly used light-following motion systems on the market, such as Figure 1 As shown, Figure 1 This is a schematic diagram of a sample light-following motion system. The video signal output from the graphics card of a video player is connected to a capture box via an HDMI video signal cable. The capture box's capture card acquires the video signal, a color analysis and processing unit performs color analysis, and light address encoding is performed. Control is then achieved using a remote control, etc. The capture box outputs a video signal to the display screen for playback. The capture box also outputs light control parameters to the light driver circuit, which then drives the lighting equipment for color control.

[0004] However, the aforementioned lighting color control system requires an external capture box, which results in high engineering costs. Since the capture box is connected to the video player via an HDMI video signal cable, the process of controlling the capture box cannot be controlled through the video player's UI interface, leading to poor controllability. Furthermore, the capture box acquires video signals after the graphics card, resulting in poor tracking between the lighting and the video image. Summary of the Invention

[0005] To address one of the aforementioned shortcomings, this application provides a lighting color control system, a video player, a smart home system, and a computer device storage medium to reduce equipment costs and improve lighting color control performance.

[0006] A lighting color control system, applied to a video player, includes:

[0007] An embedded graphics display system is used to acquire video signals from a video source and obtain image frames;

[0008] The light color processing unit is used to perform color analysis on the image to obtain color data;

[0009] The lighting address encoding unit is used to encode the address of the lighting device according to the color data to generate lighting control parameters, and output the lighting control parameters to the lighting driver to drive the lighting device to emit light, so that the light color of the lighting device changes with the image output to the display screen by the video player.

[0010] In one embodiment, the light address encoding unit is further configured to adjust the light mode and light control parameters output by the light color control system based on the configuration information input by the user in the UI interface of the video player.

[0011] In one embodiment, the lighting color control system further includes: an audio processing unit, configured to acquire input audio data, perform FFT processing on each channel of the audio data to obtain spectrum data; extract key frequency points from the spectrum data to obtain sound intensity information; and superimpose the sound intensity information onto the control parameters to control the lighting color effect of the light strip.

[0012] In one embodiment, the embedded graphics display system, the lighting color processing unit, and the lighting address encoding unit are integrated into the operating system of the video player.

[0013] In one embodiment, the light color processing unit is configured to adjust the resolution of the image to obtain a reduced image; perform Gaussian blur processing on the reduced image according to a set Gaussian blur parameter to obtain a blurred image; and perform color sampling processing on the blurred image according to the matching range of the light strip to obtain color data.

[0014] In one embodiment, the light color processing unit is configured to perform Gaussian blur processing on the reduced image according to a set first Gaussian blur parameter to obtain a first blurred image; wherein the first blurred image is used for motion mode control; and to perform Gaussian blur processing on the first blurred image according to the set first Gaussian blur parameter to obtain a second blurred image; wherein the second blurred image is used for ambient mode control.

[0015] In one embodiment, the light color processing unit is configured to perform a horizontal parallel scan of the image; perform a vertical scan using multiple scan lines on the image, and calculate the length of the black border of the image; and calculate the image within the black border range based on the length of the black border.

[0016] In one embodiment, the light color processing unit is configured to perform a horizontal parallel scan of the image from left to right, and determine that there is no black border in the horizontal direction when there is no black border in the scan; to set multiple distributed vertical lines in the vertical direction of the image, and to scan along the vertical lines from the top and bottom of the image towards the center to obtain the length value of the black border; to calculate the average length of the black border based on the length value of the black border, and to calculate the length of the black border of the image based on multiple black border length values ​​with similar values.

[0017] In one embodiment, the light color processing unit is configured to determine the sampling radius based on the size of the edge range of the light strip matching the image; calculate the sampling coordinate range of the four sides to be sampled in the blurred image based on the sampling radius; and perform pixel sampling processing from the sampling coordinate range of the blurred image in a set order to obtain color data.

[0018] In one embodiment, the light color processing unit is configured to sample pixels from the sampling coordinate range of the blurred image according to a set order to obtain a color array; and to perform linear interpolation sampling on the pixels of the color array to obtain color data that is the same as that of the light strip.

[0019] In one embodiment, the light color processing unit is further configured to perform unified post-processing on the color data; wherein the post-processing includes one or more of the following: brightness processing, saturation, gamma correction, highlight attenuation, palette adjustment, and fixed coloring in test mode.

[0020] In one embodiment, the light color processing unit is further configured to trim the sequence of color data; wherein the trimming includes one or more of the following: selection of the direction of the LED beads in the light strip, selection of the starting corner, adjustment of the starting point, ignoring the starting point, and removal of dirty data.

[0021] In one embodiment, the light color processing unit is further configured to extract color regions from the blurred image using a region image; perform Gaussian averaging on the color regions to obtain the region average color; and control the ambient lighting based on the average color.

[0022] A video player, characterized in that it comprises: a host and a graphics card; wherein, the host runs an operating system, and the operating system integrates the lighting and color control system;

[0023] The graphics card is used to render and output the video footage played by the host.

[0024] The host computer is used to play video footage and output lighting control parameters.

[0025] In one embodiment, the host computer is connected to a host computer; wherein the host computer is also used to control the lighting mode and parameter configuration of the lighting equipment.

[0026] A smart home system includes: a video player, a display screen, a light driver, and lighting equipment;

[0027] The graphics card output of the video player is connected to the display screen;

[0028] The main unit of the video player is connected to the light driver, and the light driver is connected to the lighting equipment;

[0029] The video player receives a video signal, renders the video signal through the graphics card, and outputs it to the display screen for playback. It also outputs lighting control parameters based on the video signal and outputs them to the lighting driver through an input / output device to drive the lighting device to emit light.

[0030] In one embodiment, the light driver includes a network driver or a wired driver; the light device includes a DMX512 light and a WS2812 light.

[0031] A computer-readable storage medium storing at least one instruction, at least one program, a code set, or an instruction set, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded by the processor and executes the functions of the lighting color control system.

[0032] The technical solution of the above embodiment integrates a lighting color control system on the video player. An embedded graphics display system acquires video signals and images from a video source. A lighting color processing unit performs color analysis on the images to obtain color data. A lighting address encoding unit encodes the lighting devices according to the color data to generate lighting control parameters, and outputs these parameters to a lighting driver to drive the lighting devices to emit light. This allows the lighting color of the devices to change in accordance with the image displayed on the screen. This technical solution integrates lighting color control functionality on the video player, reducing equipment costs in lighting color control. It extracts the image and generates lighting control parameters before video signal playback, resulting in good synchronization and following between the lighting color and the video image, thus improving the lighting color control effect.

[0033] Furthermore, the UI interface of the video player is also used to configure and adjust the lighting modes and lighting control parameters output by the lighting color control system according to the parameters input by the user, so as to facilitate the configuration of various lighting modes and custom lighting control parameters.

[0034] Furthermore, before control, the video signal and acquired image are automatically detected for black borders. The image within the black border area is used for lighting color control, which can avoid the defect that the lighting color cannot follow the image changes due to the presence of black borders at the top and bottom of the video screen.

[0035] Furthermore, a first blurred image and a second blurred image are obtained through Gaussian blurring, which are used for motion mode control and ambient mode control, respectively, to achieve the effect of freely controlling the lighting mode.

[0036] Furthermore, it quickly generates an array of colors of arbitrary shapes from video footage and audio, which is then sent to the light strip to achieve a lighting color effect that is related to the video footage, applied outside the screen.

[0037] Additional aspects and advantages of this application will be set forth in part in the description which follows, and will become apparent from the description or may be learned by practice of this application. Attached Figure Description

[0038] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0039] Figure 1 This is a schematic diagram of an example light-following motion system.

[0040] Figure 2 This is a schematic diagram of the structure of a lighting color control system according to one embodiment;

[0041] Figure 3 This is a system block diagram of an example video player;

[0042] Figure 4 This is a flowchart of a lighting color control method according to one embodiment;

[0043] Figure 5 This is a sample image with the image scaled down.

[0044] Figure 6 This is a sample color sampling diagram;

[0045] Figure 7 This is a sample color sampling diagram;

[0046] Figure 8 This is a schematic diagram of the structure of a video player according to one embodiment;

[0047] Figure 9 This is a schematic diagram of an example smart home system structure;

[0048] Figure 10This is a schematic diagram of an example light driver and lighting device. Detailed Implementation

[0049] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain this application, and should not be construed as limiting this application.

[0050] Those skilled in the art will understand that, unless otherwise stated, the singular forms “a,” “an,” “the,” and “the” used herein may also include the plural forms. It should be further understood that the word “comprising” as used in this application’s specification means the presence of the stated feature, integer, step, or operation, but does not preclude the presence or addition of one or more other features, integers, steps, or operations.

[0051] refer to Figure 2 As shown, Figure 2 This is a schematic diagram of a lighting color control system structure, applied to a video player. It can be integrated into the operating system of the video player and includes: an embedded graphics display system, a lighting color processing unit, and a lighting address encoding unit.

[0052] The embedded graphics display system is used to acquire video signals from the video source and obtain image images; the light color processing unit is used to perform color analysis on the image images to obtain color data; the light address encoding unit is used to encode the address of the light device according to the color data to generate light control parameters, and output the light control parameters to the light driver to drive the light device to emit light, so that the light color of the light device changes with the image images output to the display screen by the video player.

[0053] Compared to conventional post-acquisition box solutions, this application integrates a lighting color control system onto the video player, reducing equipment and engineering costs in lighting color control. By acquiring video signals from the video source through an embedded graphics display system, the color data of the image is obtained before video signal playback and rendering, generating lighting control parameters. This results in good synchronization and following between the lighting color and the video image, improving the lighting color control effect. Since the color data obtained by the lighting color processing unit can be adjusted according to different needs, different lighting mode settings and lighting control parameters can be implemented, allowing for free configuration of different lighting effects in lighting color control.

[0054] In one embodiment, the lighting address encoding unit of the lighting color control system is also used to adjust the lighting mode and lighting control parameters output by the lighting color control system according to the configuration information input by the user in the UI (User Interface Designer) interface of the video player.

[0055] Specifically, the lighting and color control system is integrated into the video player. Configuration information can be input through the UI interface of the video player's host computer to customize the lighting and color control system, including the output lighting modes and lighting control parameters; thus eliminating the need for additional control modules.

[0056] For example, by using the host computer of the video player, such as a computer or mobile terminal, configuration programs and interfaces can be added to the host computer's UI to realize the configuration function of the lighting and color control system.

[0057] In one embodiment, the lighting color control system further includes: an audio processing unit, configured to acquire input audio data, perform FFT processing on each channel of the audio data to obtain spectrum data; extract key frequency points from the spectrum data to obtain sound intensity information; and superimpose the sound intensity information onto the control parameters to control the lighting color effect of the light strip.

[0058] refer to Figure 3 As shown, Figure 3 This is a system block diagram of an example video player. The hardware layer mainly includes input / output devices, the host computer, and a graphics card. The input / output devices are primarily used for human-computer interaction, inputting configuration information, and displaying the UI. The host computer mainly includes the CPU, memory, and other motherboard circuitry. The graphics card renders video signals, typically using a GPU as its core for image rendering calculations, and outputs via an HDMI interface. The system software layer mainly consists of the video player's operating system, such as Android. The application software layer mainly consists of various application software. The lighting and color control system provided in this application is pre-installed on the operating system. The player can play video signals and render them using the graphics card. The configuration program can utilize the input / output devices to implement host computer configuration functions. Users input configuration information, which is then set into the lighting and color control system through the configuration program to change lighting control parameters, etc.

[0059] In one embodiment, the lighting color control system of this application includes a lighting color processing unit configured to: adjust the resolution of an image to obtain a reduced image; perform Gaussian blur processing on the reduced image according to a set first Gaussian blur parameter to obtain a first blurred image; perform Gaussian blur processing on the first blurred image according to the set first Gaussian blur parameter to obtain a second blurred image; and perform color sampling processing on the blurred image according to the matching range of the light strip to obtain color data; wherein the first blurred image is used for motion mode control, and the second blurred image is used for ambient mode control.

[0060] In the above embodiment, by using the first blurred image and the second blurred image as the base image for light following shadow, the effect of freely controlling the lighting mode can be achieved.

[0061] In one embodiment, the lighting color control system of this application further includes a lighting color processing unit configured to perform horizontal parallel scanning of the image; perform vertical scanning using multiple scan lines on the image and calculate the length of the black border of the image; and calculate the image within the black border range based on the length of the black border.

[0062] As in the above embodiment, by first performing automated black border detection on the video signal, the defect that the light color cannot follow the changes in the image due to the presence of black borders at the top and bottom of the video screen can be avoided.

[0063] Based on the lighting color control system of this application, a lighting color control method for implementing the functions of the lighting color control system is provided below; Reference Figure 4 As shown, Figure 4 This is a flowchart of a lighting color control method according to one embodiment, including:

[0064] Step S10: Acquire video signal and image frame, and adjust the resolution of the image frame to obtain a reduced image.

[0065] In this step, the video signal on the TV screen can be acquired and the image can be obtained, or the video signal can be accessed externally and the image can be obtained. Then, the resolution of each frame of the image can be adjusted to make the image smaller and smaller, thus realizing the native control scheme within the image system.

[0066] In one embodiment, addressing the defect in conventional technology where the top and bottom lights fail to illuminate when the video image has black bars at the top and bottom, the lighting color control system of this application further includes, before adjusting the resolution of the image in step S10 to obtain a smaller image:

[0067] S101, Perform a horizontal parallel scan on the image.

[0068] Specifically, each frame of the image is extracted from the input video, and then automatic black border detection is performed. First, a horizontal parallel scan is performed. For example, the image can be scanned horizontally from left to right. When no black border is found in the scan, it is determined that there is no black border in the horizontal direction. For example, the scan can be performed from left to right at a position between 2% and 98%. Once a non-black border is found, the detection ends and it is determined that there is no black border in the current image.

[0069] S102, perform vertical scanning using multiple scan lines on the image screen, and calculate the length of the black border of the image screen.

[0070] For example, the method for calculating the length of the black border in step S102 may include the following:

[0071] a) Set multiple vertical lines in the vertical direction of the image, and scan along the vertical lines from the top and bottom of the image towards the center to obtain the length value of the black screen.

[0072] Specifically, vertical line scanning can be performed on the image screen. There are multiple scan lines, evenly distributed on the image screen. For example, during scanning, the scan is performed from the top and bottom directions towards the center line, and then the length of black is calculated. Assuming there are 5 scan lines, 10 numbers are obtained from the scan, representing the length of black in 10 vertical directions.

[0073] b) Calculate the average black border length based on the black screen length value, and calculate the black border length of the image based on multiple black screen length values ​​with similar values.

[0074] Specifically, scan data that is significantly larger than the mean can be removed to avoid the black in the image interfering with the actual black border. In the remaining scan data, the variance is less than a threshold, meaning that the length of the black border is basically the same in each place. The mean of this value is then calculated as the length of the black border.

[0075] Preferably, in order to prevent the average length of the obtained black border from changing abruptly, the average of historical values ​​can be calculated. For example, multiple (e.g., 8) latest historical data can be recorded in a queue as a transition. Once the image is detected to have no black border, the queue is cleared.

[0076] S103, calculate the image within the black border area based on the black border length.

[0077] Specifically, based on the calculated length of the black border, the image within the black border area can be obtained as the original image for subsequent control of the light color.

[0078] As in the above embodiments, such as Figure 5 As shown, Figure 5This is an example of a scaled-down image. First, the video signal and the acquired image are subjected to automatic black border detection and removal. The scaled-down image within the black border area is then used for lighting color control. This avoids the defect that the lighting color cannot follow the image changes due to the presence of black borders at the top and bottom of the video screen, and enables fast color sampling processing.

[0079] Step S20: Perform Gaussian blur processing on the reduced image according to the set Gaussian blur parameters to obtain a blurred image.

[0080] In this step, the Gaussian blur parameter is set based on the lighting color control effect, and then the reduced image is processed by Gaussian blur using the Gaussian blur parameter to obtain a blurred image, which serves as the base image for lighting color control.

[0081] In one embodiment, to achieve free control of lighting modes, richer color lighting control parameters are provided; accordingly, the lighting color control system of this application, such as... Figure 6 As shown, Figure 6 This is an example of a Gaussian blur diagram. Step S20, which involves performing Gaussian blur processing on the reduced image according to set Gaussian blur parameters to obtain a blurred image, may include:

[0082] S201, the reduced image is subjected to Gaussian blur processing according to the set first Gaussian blur parameter to obtain a first blurred image; wherein, the first blurred image is used for motion mode control.

[0083] For example, the image within the black border area of ​​the original image is reduced to a smaller size, and then subjected to a first Gaussian blur to obtain a first blurred image.

[0084] S202, the first blurred image is subjected to Gaussian blur processing according to the set first Gaussian blur parameters to obtain a second blurred image; wherein, the second blurred image is used for ambient mode control.

[0085] For example, the second blurred image is obtained by reducing the size to half based on the first blurred image and then performing a second Gaussian blur.

[0086] In the above embodiment, a first blurred image is obtained by performing a first Gaussian blur on a scaled-down image of the original video frame. This image is used for motion mode control and leverages its high resolution and preservation of more details to achieve a high dynamic range effect. Then, a second blurred image is obtained by performing a Gaussian blur on the first blurred image. This image is used for ambient mode control and leverages the high degree of color mixing in the second blur to control the ambient light strip. These two blurred images serve as the base images for subsequent light-following-shadow animation, thereby achieving the effect of freely controlling the lighting mode.

[0087] Step S30: Perform color sampling processing on the blurred image according to the matching range of the light strip to obtain color data.

[0088] In this step, based on the matching of the light strip and the range of the image, color data for controlling the color is obtained by using a blurred image for color sampling, so as to realize the scheme of controlling the ambient color of the video image.

[0089] In one embodiment, step S30, which involves color sampling the blurred image based on the matching range of the light strip to obtain color data, may include:

[0090] S301, determine the sampling radius based on the size of the edge range of the light strip matching the image frame.

[0091] Specifically, such as Figure 7 As shown, Figure 7 This is a schematic diagram of a color sampling screen. The diagram shows the sampling radius r, which is determined based on the size of the edge range of the light strip matching the image screen. Thus, the radius of the sampling position can be customized, and the style can be controlled, whether it is precise sampling or blurred sampling.

[0092] S302, calculate the sampling coordinate range of the four sides to be sampled in the blurred image according to the sampling radius.

[0093] Specifically, based on the determined sampling radius r, the sampling coordinate range of the four sides to be sampled in the blurred image can be calculated; thus, the color sampling position can be adjusted, and the sampling band from the center of the image to the edge of the image can also be adjusted.

[0094] like Figure 7 Taking the first blurred image as an example, if the radius is r and the size of the first blurred image is 240×160, the sampling area size is 180×120. Taking the upper left corner as the origin, the sampling coordinate range of the upper left corner can be obtained as x∈[0,30], y∈[0,20], and the sampling coordinate range as x∈[180,240], y∈[120,160].

[0095] S303: Perform pixel sampling processing from the sampling coordinate range of the blurred image according to the set order to obtain color data.

[0096] In one embodiment, the sampling process in step S303 may include the following:

[0097] (1) Obtain a color array by sampling pixels from the sampling coordinate range of the blurred image according to the set order.

[0098] Specifically, based on the determined sampling coordinate range, the pixel color values ​​of the four sides are sampled from the blurred image in a clockwise direction to obtain the basic color array.

[0099] (2) Perform linear interpolation sampling on the pixels of the color array to obtain color data that is the same as that of the light strip;

[0100] Specifically, since the number of light-emitting units in a lighting device is not strictly equal to the size of the color array, the pixels are linearly interpolated and sampled to be enlarged or reduced, thereby obtaining the same color array as the light strip.

[0101] As in the above embodiment, different radii are set based on the data of the blurred image, and the pixel color values ​​are extracted to obtain color data for controlling the color of the light, thereby enabling accurate sampling of color data of the video image.

[0102] In one embodiment, during the sampling process of this embodiment, the color data can also be uniformly post-processed, such as the clockwise or counterclockwise rotation of the light strip, the starting corner of the installation, and the need to skip additional head light-emitting units during installation.

[0103] For example, after obtaining color data through sampling, subsequent color unification post-processing includes:

[0104] 1) Brightness;

[0105] 2) Saturation;

[0106] 3) Gamma correction;

[0107] 4) Brightness attenuation (compressing overly bright white light to avoid interfering with the viewing of video images);

[0108] 5) Optional color palette for color matching;

[0109] 6) Perform fixed dyeing in test mode (fix the dyeing four-sided light strip during installation and testing).

[0110] In one embodiment, during the sampling process, the color data required by all light-emitting units (LED beads) has been obtained. However, this data is a perfect clockwise sequence starting from the top left corner, which may not necessarily match the actual installation of the LED strip. Therefore, in this embodiment, a sequence adjustment process can be performed, including:

[0111] 1) LED bead direction selection (if the LED strip is installed counterclockwise, the order needs to be reversed);

[0112] 2) Starting corner selection (offset the color sequence according to the starting point of the LED strip installation);

[0113] 3) Starting point adjustment (move forward or backward if the installation point is not perfectly in a corner);

[0114] 4) Ignore starting point (if there is still a section of unused LEDs before the installation point, additional offset is required);

[0115] 5) Dirty data removal (used in settings mode to remove tail residue).

[0116] In one embodiment, if a first blurred image and a second blurred image are generated in step S20, then in step S30, after the first blurred image is sampled to obtain the corresponding color, since it has only undergone one blurring and has a high resolution, more details can be retained, and it can be used as a high dynamic range effect; after the second blurred image is sampled to obtain the corresponding color, because it is small in size and has undergone two blurring, the color mixing degree is higher, and it can be used as an ambient light strip.

[0117] Step S40: Generate lighting control parameters based on the color data to control the light color of the light strip.

[0118] In this step, based on the obtained color data, lighting control parameters can be generated to control the color of the light strip. Specifically, by adjusting the color data to make the color sequence consistent with the actual installation of the light strip, lighting control parameters can be generated and sent to the lighting control device for display, so as to control the ambient color.

[0119] For example, the lighting equipment can use pixel lights such as WS2812, which can better match the changes in the picture and achieve the effect of the light and the picture changing synchronously with the video picture.

[0120] As described in the above embodiment, the resolution of the acquired video signal and image is adjusted to obtain a reduced image. The reduced image is then subjected to Gaussian blurring to obtain a blurred image. Color sampling is performed on the blurred image to obtain color data, and lighting control parameters are generated to control the color of the light strip. This technical solution can enhance the lighting color control effect by blurring synchronous light colors related to the video image outside the video image.

[0121] In one embodiment, the technical solution of this application can also be applied to point light sources such as DMX512. Accordingly, the lighting color control system of this embodiment may further include: extracting color regions from the blurred image using a region image; performing Gaussian averaging on the color regions to obtain the region average color; and controlling ambient lighting according to the average color.

[0122] Specifically, the average color of the region is obtained by extracting the region image and then performing Gaussian averaging, which is then used as ambient lighting.

[0123] In one embodiment, the technical solution of this application can also be combined with audio to control the color change of the light. Accordingly, the light color control system of this application further includes:

[0124] The input audio data is acquired, and FFT (fast Fourier transform) processing is performed on each channel of the audio data to obtain spectrum data; key frequency points are extracted from the spectrum data to obtain sound intensity information; the sound intensity information is superimposed on the control parameters to control the light color effect of the light strip.

[0125] For example, the input audio data is received, and FFT processing is performed on the left channel, right channel, and mixed mono channel to obtain a spectrum data. Several key frequency points are taken to obtain their decibel information. These are then combined with the RGB values ​​of the sampled four sides and referenced in the script environment. In the script, the colors of the four sides are superimposed using the audio spectrum information to achieve the effect of the light colors following the music.

[0126] As described in the above embodiments, a rectangular or arbitrary color array can be quickly generated from video footage and audio. This color array is then sent to the light strip for control, thereby achieving a lighting color effect related to the video footage outside the screen.

[0127] The solutions described in the above embodiments have the following characteristics: high real-time performance, smooth color transitions, simple algorithm flow, high real-time performance, and customizable sampling radius (from neutral to edge); controllable style based on precise or fuzzy sampling; automatic calculation and removal of black borders to avoid the defect of lights not lighting up when there are black borders; color correction through post-processing; ability to sample areas as point lights for use as ambient light; and the ability to superimpose audio rhythm onto changing light colors through FFT calculation of audio. Lighting products using the technical solutions of this application, after actual testing, can effectively match ambient lighting around the screen, ceiling lights, and other ambient lighting.

[0128] The following describes an embodiment of the video player.

[0129] refer to Figure 8 As shown, Figure 8 This is a schematic diagram of a video player according to one embodiment, including: a host and a graphics card; additionally, it may include input / output devices and a power module; wherein the host runs an operating system, and the operating system integrates the lighting and color control system of any of the above embodiments; the graphics card is used to render and output the video image played by the host; the host is used to play the video image and output lighting control parameters, the input / output devices can realize user input functions and various display functions; the power module can provide power to the video player.

[0130] As mentioned above, a video player can output lighting control parameters. These parameters enter an I / O layer, which is an abstraction of a hardware device to accommodate different types of light drivers. These light drivers have an automatic discovery mechanism to facilitate the search, binding, and configuration of the light SDK.

[0131] The video player in this embodiment also includes a communication module, which communicates with the outside world via wireless or wired communication. The wireless communication methods include WiFi, Bluetooth, data networks, etc., and the wired communication methods include USB connection, Ethernet connection, etc.

[0132] Accordingly, the video player can receive video signals, either through a TV or audio-visual equipment, or by inputting video signals from external sources via interfaces such as HDMI; finally, it outputs lighting control parameters to the lighting driver to drive the lighting equipment to emit light; since the output function can be implemented using the hardware of the video player, compared to the conventional method of using a capture box, it can reduce equipment costs and simplify the solution.

[0133] The following describes an example of a smart home system.

[0134] The smart home system in this embodiment can be used to achieve a light-following-shadow effect; see reference Figure 9 As shown, Figure 9 This is a schematic diagram of an example smart home system structure, which mainly includes a video player, a display screen, a light driver, and lighting devices as described in any of the above embodiments; wherein, the graphics card output of the video player is connected to the display screen; the host of the video player is connected to the light driver, and the light driver is connected to the lighting devices; the host of the video player receives a video signal, renders the video signal through the graphics card, outputs it to the display screen for playback, and outputs lighting control parameters according to the video signal, which are then output to the light driver through an input / output device to drive the lighting devices to emit light.

[0135] For example, the video player can connect to multiple light drivers 1 to k, each light driver can use a different protocol, and each light device can be used to drive multiple light devices 1 to m, thereby meeting different light device usage needs.

[0136] like Figure 10 As shown, Figure 10 This is a schematic diagram of an example light driver and lighting device. The light driver in the diagram includes network drivers or wired drivers, such as network LED drivers, USB LED drivers, etc., and the lighting device includes DMX512 lights and WS2812 lights, etc.

[0137] The smart home system described in this application is based on the functionality of a video player. The color sampling position is adjustable, with the sampling circle from the center to the edge of the screen adjustable to remove black borders and prevent inconsistent brightness. Through color post-processing, rich color adjustments are available after color sampling, unlike most products on the market which only offer brightness adjustments. The light diffusion level is adjustable; audio and video simultaneously affect the lighting; multiple driver connection methods are available, including wired and wireless connections, with automatic discovery; multiple light type drivers are supported, including WS2812 and DMX512; and the effects are dynamically updated via scripts, facilitating the implementation of various effects.

[0138] The following describes an embodiment of a computer-readable storage medium.

[0139] This application provides a computer-readable storage medium storing at least one instruction, at least one program, a code set, or an instruction set, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded by the processor and executes the functions of the lighting color control system of any of the above embodiments.

[0140] In an exemplary embodiment, the computer-readable storage medium can be a non-transitory computer-readable storage medium that includes instructions, such as a memory that includes instructions. For example, a non-transitory computer-readable storage medium can be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0141] The above description is only a partial embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A video player, characterized in that, include: The host computer and the graphics card; wherein, the host computer runs an operating system, and the operating system integrates a lighting and color control system; The graphics card is used to render and output the video footage played by the host. The host computer is used to play video footage and output lighting control parameters; The lighting color control system includes: An embedded graphics display system is used to acquire video signals from a video source and obtain image frames; A lighting color processing unit is used to perform color analysis on the image before video signal playback and rendering to obtain color data. This includes: adjusting the resolution of the image to obtain a reduced image; performing Gaussian blur processing on the reduced image according to a set first Gaussian blur parameter to obtain a first blurred image; wherein the first blurred image is used for motion mode control; performing Gaussian blur processing on the first blurred image according to the set first Gaussian blur parameter to obtain a second blurred image; wherein the second blurred image is used for ambient mode control; scanning the image and calculating the length of the black border of the image, and calculating the image within the black border range based on the black border length; determining the sampling radius based on the size of the edge range of the light strip matching the image; calculating the sampling coordinate range of the four edges to be sampled in the blurred image according to the sampling radius; performing pixel sampling processing from the sampling coordinate range of the blurred image according to a set order to obtain a color array; performing linear interpolation sampling on the pixels of the color array to obtain color data with the same number of light strips; the blurred image includes a first blurred image and a second blurred image. The lighting address encoding unit is used to encode the address of the lighting device according to the color data to generate lighting control parameters, and output the lighting control parameters to the lighting driver to drive the lighting device to emit light, so that the light color of the lighting device changes with the image output to the display screen by the video player.

2. The video player according to claim 1, characterized in that, The light address encoding unit is also used to adjust the light mode and light control parameters output by the light color control system according to the configuration information entered by the user in the UI interface of the video player.

3. The video player according to claim 1, characterized in that, Also includes: The audio processing unit is used to acquire the input audio data and perform FFT processing on each channel of the audio data to obtain the spectrum data. Sound intensity information is obtained by extracting key frequency points from the spectrum data; the sound intensity information is superimposed on the control parameters to control the light color effect of the light strip.

4. The video player according to claim 3, characterized in that, The embedded graphics display system, the lighting color processing unit, and the lighting address encoding unit are integrated into the operating system of the video player.

5. The video player according to claim 1, characterized in that, The light color processing unit is configured to perform horizontal parallel scanning of the image; perform vertical scanning using multiple scan lines on the image and calculate the length of the black border of the image; and calculate the image within the black border range based on the length of the black border.

6. A smart home system, characterized in that, include: The video player, display screen, light driver, and lighting device according to any one of claims 1 to 5; The graphics card output of the video player is connected to the display screen; The main unit of the video player is connected to the light driver, and the light driver is connected to the lighting equipment; The video player receives a video signal, renders the video signal through the graphics card, and outputs it to the display screen for playback. It also outputs lighting control parameters based on the video signal and outputs them to the lighting driver through an input / output device to drive the lighting device to emit light.

7. The smart home system according to claim 6, characterized in that, The light driver includes a network driver or a wired driver; the light device includes DMX512 lights and WS2812 lights.

Images