Control device and method, storage medium and electronic equipment

Abstract

The invention provides a control device and method, a storage medium and electronic equipment. The control device comprises an SOC processing unit and a set of light emitting units. The SOC processing unit is connected with a group of light emitting units; the SOC processing unit is used for acquiring first image data corresponding to the first audio and video data, determining sampling image data corresponding to each light-emitting unit in the first image data according to the arrangement sequence of the group of light-emitting units, and determining color information corresponding to each light-emitting unit according to the first image data and the sampling image data; sending the color information to a light emitting unit; each light emitting unit is used for emitting light according to the corresponding color information; the light-emitting unit can be accurately controlled, and the display effect is improved.

Description

Technical Field

[0001] The present application relates to the field of electronic control technology, and in particular to a control device, method, storage medium and electronic equipment. Background Art

[0002] In the related art, a microcontroller unit (MCU) controller controls a TV background light and an ambient atmosphere light by acquiring audio and video data, which results in poor display effects of the TV background light and the ambient atmosphere light. Summary of the invention

[0003] The embodiments of the present application provide a control device, method, storage medium and electronic device, which can accurately control the light-emitting unit and improve the display effect.

[0004] To achieve the above purpose, the technical solution of the embodiment of the present application is implemented as follows:

[0005] In a first aspect, the present application provides a control device, the control device comprising at least a system-on-a-Chip (SOC) processing unit and a group of light-emitting units; the SOC processing unit and the group of light-emitting units are connected;

[0006] The SOC processing unit is used to obtain the first image data corresponding to the first audio and video data, determine the sampled image data corresponding to each of the light-emitting units in the first image data according to the arrangement order of the group of light-emitting units, and determine the color information corresponding to each of the light-emitting units according to the first image data and the sampled image data, and send the color information to the light-emitting unit;

[0007] Each of the light-emitting units is used to emit light according to corresponding color information.

[0008] In the above scheme, the SOC processing unit is further used to obtain audio data corresponding to the first audio and video data, analyze the audio data, and obtain rhythm information corresponding to the audio data; determine the brightness change information of each of the light-emitting units based on the rhythm information; and send the brightness change information to the light-emitting units;

[0009] Each of the light-emitting units is further used to emit light according to corresponding brightness change information and color information.

[0010] In the above scheme, the SOC processing unit is also used to respectively determine the first brightness information and the first color center of gravity information of the first image data, and the second brightness information and the second color center of gravity information of the sampled image data; and determine the color information corresponding to each of the light-emitting units according to the first brightness information, the first color center of gravity information, the second brightness information and the second color center of gravity information.

[0011] In the above scheme, the SOC processing unit is further used to obtain first quantity information of the first pixel and first pixel value information of the first pixel included in the first image data; determine third color center of gravity information of the first pixel in the first direction and fourth color center of gravity information of the first pixel in the second direction according to the first pixel value information; and determine the first color center of gravity information based on the third color center of gravity information and the fourth color center of gravity information; determine the first brightness information according to the first quantity information and the first pixel value information;

[0012] The SOC processing unit is also used to obtain the second quantity information of the second pixel of the sampled image data and the second pixel value information of the second pixel; determine the fifth color center of gravity information of the second pixel in the first direction and the sixth color center of gravity information of the second pixel in the second direction according to the second pixel value information; and determine the second color center of gravity information based on the fifth color center of gravity information and the sixth color center of gravity information; determine the second brightness information according to the second quantity information and the second pixel value information.

[0013] In the above scheme, the SOC processing unit is also used to determine the distance information between the first color center of gravity information and the second color center of gravity; and determine the color information corresponding to each of the light-emitting units based on the first preset weight information corresponding to the first image data, the second preset weight information corresponding to the sampled image data, the first brightness information, the second brightness information and the distance information.

[0014] In the above scheme, the control device further includes a button control unit; the button control unit is connected to the SOC processing unit via a general purpose input output port (GPIO); the SOC processing unit is connected to the group of light-emitting units via a serial peripheral interface (SPI);

[0015] The button control unit is used to send the first control information to the SOC processing unit;

[0016] The SOC processing unit is used to send the color information to the light emitting unit based on the first control information.

[0017] In the above solution, the control device further includes an application (APP) control unit; the APP control unit is connected to the SOC processing unit via a wireless controller; the wireless controller is connected to the group of light-emitting units;

[0018] The APP control unit is used to send second control information to the SOC processing unit;

[0019] The SOC processing unit is used to send the color information to the light emitting unit based on the second control information.

[0020] In the above solution, the control device further includes a data processing unit; the data processing unit is connected to the SOC processing unit;

[0021] The data processing unit is used to obtain the first audio and video data; process the video data in the first audio and video data to obtain the first image data.

[0022] In the above scheme, the data processing unit includes a split screen processing unit and a conversion unit; the conversion unit is connected to the split screen processing unit and the SOC processing unit respectively;

[0023] The split-screen processing unit is used to obtain the first audio and video data; perform data processing on the first audio and video data to obtain second audio and video data;

[0024] The conversion unit is used to perform frequency and / or resolution conversion processing on the video data in the second audio and video data to obtain the first image data.

[0025] In the above solution, the control device further includes an input unit and an output unit; the split screen processing unit is connected to the input unit and the output unit respectively;

[0026] The input unit is used to input the first audio and video data into the split-screen processing unit;

[0027] The split-screen processing unit is also used to input the second audio and video data into an external display device through the output unit.

[0028] In a second aspect, the present application provides an electronic device, comprising the control device described in any one of the above items.

[0029] In a third aspect, the present application provides a control method, the method comprising:

[0030] Acquire first image data corresponding to the first audio and video data, determine sampled image data corresponding to each light-emitting unit in the first image data according to the arrangement order of a group of light-emitting units, and determine color information corresponding to each light-emitting unit according to the first image data and the sampled image data, and send the color information to the light-emitting unit;

[0031] The lights are emitted according to the corresponding color information.

[0032] In the above scheme, audio data corresponding to the first audio and video data is obtained, the audio data is analyzed to obtain rhythm information corresponding to the audio data; brightness change information of each of the light-emitting units is determined based on the rhythm information; and the brightness change information is sent to the light-emitting unit;

[0033] The light is emitted according to the corresponding brightness change information and color information.

[0034] In the above scheme, the color information corresponding to each of the light-emitting units is determined respectively according to the first image data and the sampled image data; including:

[0035] Determine the first brightness information and the first color center of gravity information of the first image data, and the second brightness information and the second color center of gravity information of the sampled image data respectively; and determine the color information corresponding to each of the light-emitting units according to the first brightness information, the first color center of gravity information, the second brightness information and the second color center of gravity information.

[0036] In the above solution, the step of respectively determining the first brightness information and the first color center of gravity information of the first image data, and the second brightness information and the second color center of gravity information of the sampled image data includes:

[0037] Acquire first quantity information of first pixels and first pixel value information of the first pixels included in the first image data; determine third color center of gravity information of the first pixels in the first direction and fourth color center of gravity information of the first pixels in the second direction respectively according to the first pixel value information; and determine the first color center of gravity information based on the third color center of gravity information and the fourth color center of gravity information; determine the first brightness information according to the first quantity information and the first pixel value information;

[0038] Acquire the second quantity information of the second pixel of the sampled image data and the second pixel value information of the second pixel; determine the fifth color centroid information of the second pixel in the first direction and the sixth color centroid information of the second pixel in the second direction according to the second pixel value information; and determine the second color centroid information based on the fifth color centroid information and the sixth color centroid information; determine the second brightness information according to the second quantity information and the second pixel value information.

[0039] In the above solution, determining the color information corresponding to each of the light-emitting units according to the first brightness information, the first color center of gravity information, the second brightness information, and the second color center of gravity information includes:

[0040] Determine the distance information between the first color center of gravity information and the second color center of gravity; and determine the color information corresponding to each of the light-emitting units based on the first preset weight information corresponding to the first image data, the second preset weight information corresponding to the sampled image data, the first brightness information, the second brightness information and the distance information.

[0041] In the above scheme, the method further comprises:

[0042] Sending first control information to the SOC processing unit; and sending the color information to the light-emitting unit based on the first control information.

[0043] In the above scheme, the method further comprises:

[0044] Sending second control information to the SOC processing unit; and sending the color information to the light-emitting unit based on the second control information.

[0045] In the above scheme, the method further comprises:

[0046] Acquire the first audio and video data; process the video data in the first audio and video data to obtain the first image data.

[0047] In the above solution, obtaining the first image data includes:

[0048] Acquire the first audio and video data; perform data processing on the first audio and video data to obtain second audio and video data;

[0049] The video data in the second audio and video data is subjected to frequency and / or resolution conversion processing to obtain the first image data.

[0050] In a fourth aspect, the present application provides a storage medium having a computer program stored thereon, which implements the steps of any of the above methods when executed by a processor.

[0051] The present application provides a control device, method, storage medium and electronic device; the control device includes a SOC processing unit and a group of light-emitting units; the SOC processing unit is connected to the group of light-emitting units; the SOC processing unit is used to obtain the first image data corresponding to the first audio and video data, determine the sampled image data corresponding to each light-emitting unit in the first image data according to the arrangement order of the group of light-emitting units, and determine the color information corresponding to each light-emitting unit according to the first image data and the sampled image data, and send the color information to the light-emitting unit; each light-emitting unit is used to emit light according to the corresponding color information. The technical solution of the present application is adopted, the first audio and video data is processed by the SOC processing unit, and the sampled image data corresponding to each light-emitting unit in the first image data is determined according to the arrangement order of the group of light-emitting units, and the color information of each light-emitting unit is determined according to the first image data and the sampled image data, and then each light-emitting unit is controlled to emit light according to the corresponding color information, that is, after the SOC processing unit performs image processing on the acquired audio and video data, the light-emitting unit is controlled accordingly based on the acquired image data, thereby improving the display effect of the light-emitting unit. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 A schematic diagram of the structure of a control device provided in an embodiment of the present application;

[0053] Figure 2 A schematic diagram of the structure of another exemplary control device provided in an embodiment of the present application;

[0054] Figure 3 A schematic diagram of the structure of another exemplary control device provided in an embodiment of the present application;

[0055] Figure 4 A flow chart of a control method provided in an embodiment of the present application;

[0056] Figure 5 A schematic diagram of the structure of a control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] In order to enable a more detailed understanding of the features and technical contents of the embodiments of the present application, the implementation of the embodiments of the present application is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present application.

[0058] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0059] In the following description, reference is made to "some embodiments", which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict. It should also be noted that the terms "first\second" and the like involved in the embodiments of the present application are only used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first\second" and the like may be interchanged in a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0060] Figure 1 A schematic diagram of the structure of a control device provided in an embodiment of the present application; Figure 2 A schematic diagram of the structure of another exemplary control device provided in an embodiment of the present application; Figure 3 A schematic diagram of another exemplary control device provided in the embodiment of the present application; Figure 1 , Figure 2 and Figure 3 To illustrate, the control device 10 includes a SOC processing unit 101 and a group of light emitting units 102; the SOC processing unit 101 and the group of light emitting units 102 are connected;

[0061] The SOC processing unit 101 is used to obtain the first image data corresponding to the first audio and video data, determine the sampled image data corresponding to each light-emitting unit 102 in the first image data according to the arrangement order of a group of light-emitting units 102, and determine the color information corresponding to each light-emitting unit 102 according to the first image data and the sampled image data, and send the color information to the light-emitting unit 102;

[0062] Each light emitting unit 102 is used to emit light according to corresponding color information.

[0063] In the embodiment of the present application, the control device 10 can be understood as a device for controlling the atmosphere light in practical applications, specifically, a device for controlling the atmosphere light by analyzing a high definition multimedia interface (HDMI) audio and video stream.

[0064] The light-emitting unit 102 can be any object that can emit light, which is not limited here. As an example, the light-emitting unit 102 can be a lamp, specifically a TV background light and an ambient atmosphere lamp, etc.; the shape of the light-emitting unit 102 can be any shape, which is not limited here. As an example, the light-emitting unit 102 can be in the shape of a light strip; the number of the light-emitting units 102 can be one or more, and the specific number can be determined according to actual conditions.

[0065] In an embodiment of the present application, the number of first image data corresponding to the first audio and video data may be one or more, which needs to be specifically determined by the video data in the first audio and video data.

[0066] The arrangement order of a group of light emitting units 102 may be determined according to actual conditions. As an example, a group of light emitting units 102 may be arranged in a 4×4 rectangular arrangement or a circular arrangement.

[0067] It should be noted that the sampled image data can be understood as the image data mapped to the first image data for each light-emitting unit 102; determining the sampled image data corresponding to each light-emitting unit 102 in the first image data according to the arrangement order of a group of light-emitting units 102 can be understood as performing corresponding division processing on the first image data according to the arrangement order of a group of light-emitting units 102, and then determining the sampled image data of each light-emitting unit 102 in the first image data; it can be illustrated by an example that when the light-emitting units 102 are a 4×4 matrix, the first image data are divided into 4×4, and each light-emitting unit 102 determines the corresponding sampled image data in the first image data according to the arrangement order.

[0068] In the embodiment of the present application, color information can be understood as three primary color information, namely, red, green and blue information. The process of determining the color information corresponding to each light-emitting unit 102 according to the first image data and the sampled image data is specifically as follows: the SOC processing unit 101 is also used to determine the first brightness information and the first color center of gravity information of the first image data, and the second brightness information and the second color center of gravity information of the sampled image data; and determine the color information corresponding to each light-emitting unit 102 according to the first brightness information, the first color center of gravity information, the second brightness information and the second color center of gravity information.

[0069] It should be noted that the first brightness information of the first image data can be understood as the average brightness information of the three primary colors (Red Green Blue, RGB) of the first image data, that is, the first brightness information includes the average brightness of red, the average brightness of green, and the average brightness of red in the first image data; in practical applications, the average brightness of red in the first image data can be recorded as R(p), the average brightness of green can be recorded as G(p), and the average brightness of blue can be recorded as B(p). The first color center of gravity information of the first image data can be understood as the color center of gravity of RGB of the first image data, that is, the first color center of gravity includes the center of gravity of red, the center of gravity of green, and the center of gravity of blue in the first image data.

[0070] The second brightness information of the sampled image data can be understood as the average brightness information of the RGB of the sampled image, that is, the second brightness information includes the average brightness of red, the average brightness of green, and the average brightness of blue in the sampled image data; in practical applications, the average brightness of red in the sampled image data can be recorded as R(c), the average brightness of green can be recorded as G(c), and the average brightness of blue can be recorded as B(c). The second color center of gravity information of the sampled image data can be understood as the color center of gravity information of the RGB of the sampled image data, that is, the second color center of gravity information includes the center of gravity of red, the center of gravity of green, and the center of gravity of blue in the sampled image data.

[0071] In the embodiment of the present application, by respectively determining the sampled image data corresponding to the first image data for each light-emitting unit, and determining the color information corresponding to each light-emitting unit according to the corresponding sampled image data and the first image data (overall image data), the color information of each light-emitting unit can be accurately determined, thereby controlling the light-emitting unit to emit light accurately.

[0072] It should be noted that the process of determining the first brightness information and the first color center of gravity is specifically as follows: the SOC processing unit 101 is also used to obtain the first quantity information of the first pixel and the first pixel value information of the first pixel contained in the first image data; determine the third color center of gravity information of the first pixel in the first direction and the fourth color center of gravity information of the first pixel in the second direction according to the first pixel value information; and determine the first color center of gravity information based on the third color center of gravity information and the fourth color center of gravity information; determine the first brightness information according to the first quantity information and the first pixel value information.

[0073] In the embodiments of the present application, the first pixel can be understood as all the pixels included in the first image data. The first pixel value can be understood as the pixel value corresponding to each pixel, or can be understood as the color value of each pixel. The first direction can be understood as the pixel X axis, and the second direction can be understood as the pixel Y axis.

[0074] The third color center of gravity information can be understood as the center of gravity of the pixel point in the X-axis direction of the pixel, and the fourth color center of gravity can be understood as the center of gravity of the pixel point in the Y-axis direction of the pixel; determining the first color center of gravity information based on the third color center of gravity information and the fourth color center of gravity information can be understood as taking the intersection of the center of gravity of the pixel point in the X-axis direction and the center of gravity in the Y-axis direction as the first color center of gravity information.

[0075] It should be noted that the first color center of gravity includes the center of gravity of red, the center of gravity of green and the center of gravity of blue; when determining the center of gravity of red, the center of gravity of red in the pixel X-axis direction can be determined first, then the center of gravity of red in the pixel Y-axis direction can be determined, and finally the intersection of the center of gravity of red in the pixel X-axis direction and the center of gravity of the pixel Y-axis direction is used as the center of gravity of red. The center of gravity of green and the center of gravity of blue can be determined according to the above-mentioned method for determining the center of gravity of red, which will not be repeated here.

[0076] In the embodiment of the present application, the center of gravity of the red color in the first image data in the X-axis direction of the pixel can be calculated by formula (1), and the center of gravity of the red color in the Y-axis direction of the pixel can be calculated by formula (2). Formula (1) and formula (2) are as follows:

[0077] X(R)=X(0)*R(0)+X(1)*R(1)+…+X(n)*R(n) / (R(0)+R(1)+…+R(n)) (1)

[0078] Y(R)=Y(0)*R(0)+Y(1)*R(1)+…+Y(n)*R(n) / (R(0)+R(1)+…+R(n)) (2)

[0079] Wherein, n is the number of pixels in the first image data, X(R) is the centroid of red in the X-axis direction of the pixel, Y(R) is the centroid of red in the Y-axis direction of the pixel, and R(n) is the grayscale value of the pixel.

[0080] It should be noted that the centroid of the green and blue colors in the first image data can be obtained according to the above formula (1) and formula (2) respectively on the pixel X-axis and Y-axis. The intersection of the two is the centroid of the green or blue color, which will not be repeated here.

[0081] In an embodiment of the present application, the first brightness information includes the average brightness of red, the average brightness of green, and the average brightness of blue; determining the first brightness information based on the first quantity information and the first pixel value information can be understood as calculating the arithmetic mean of the color of each pixel in the first image data.

[0082] It should be noted that the process of determining the second brightness information and the second color center of gravity is specifically as follows: the SOC processing unit 101 is also used to obtain the second quantity information of the second pixel of the sampled image data and the second pixel value information of the second pixel; according to the second pixel value information, the fifth color center of gravity information of the second pixel in the first direction and the sixth color center of gravity information of the second pixel in the second direction are determined; and the second color center of gravity information is determined based on the fifth color center of gravity information and the sixth color center of gravity information; the second brightness information is determined according to the second quantity information and the second pixel value information.

[0083] In the embodiment of the present application, the second pixel can be understood as all the pixels included in the sampled image data. The second pixel value can be understood as the pixel value corresponding to each pixel, or can be understood as the color value of each pixel. The first direction can be understood as the pixel X axis, and the second direction can be understood as the pixel Y axis.

[0084] The fifth color center of gravity information can be understood as the center of gravity of the pixel point in the X-axis direction of the pixel, and the sixth color center of gravity can be understood as the center of gravity of the pixel point in the Y-axis direction of the pixel; determining the second color center of gravity information based on the fifth color center of gravity information and the sixth color center of gravity information can be understood as taking the intersection of the center of gravity of the pixel point in the X-axis direction and the center of gravity in the Y-axis direction as the second color center of gravity information of the sampled image data.

[0085] It should be noted that the second color center of gravity includes the center of gravity of red, the center of gravity of green and the center of gravity of blue; when determining the center of gravity of red, the center of gravity of red in the pixel X-axis direction can be determined first, then the center of gravity of red in the pixel Y-axis direction can be determined, and finally the intersection of the center of gravity of red in the pixel X-axis direction and the center of gravity of the pixel Y-axis direction is used as the center of gravity of red. The center of gravity of green and the center of gravity of blue can be determined according to the above-mentioned method for determining the center of gravity of red, which will not be repeated here.

[0086] In the embodiment of the present application, the center of gravity of the red color in the pixel X-axis direction in the sampled image data can be calculated by formula (3), and the center of gravity of the red color in the pixel Y-axis direction can be calculated by formula (4). Formula (3) and formula (4) are as follows:

[0087] x(R)=x(a)*R(a)+x(a+1)*R(a+1)+…+x(a+n)*R(a+n) / (R(a)+R(a+1)+…+R(a+n)) (3)

[0089] y(R)=y(b)*R(b)+y(b+1)*R(b+1)+…+y(b+n)*R(b+n) / (R(b)+R(b+1)+…+R(b+n)) (4)

[0091] Where n is the number of pixels in the sampled image data, a is the starting index of the pixel in the sampling area on the x-axis, b is the starting index of the pixel in the sampling area on the y-axis, X(R) is the center of gravity of the red color in the x-axis direction of the pixel, Y(R) is the center of gravity of the red color in the y-axis direction of the pixel, and R(n) is the grayscale value of the pixel.

[0092] It should be noted that the centroids of the green and blue colors in the sampled image data can be obtained on the pixel X-axis and Y-axis respectively according to the above formulas (3) and (4), and the intersection of the two is the centroid of the green or blue color, which will not be repeated here.

[0093] In an embodiment of the present application, the second brightness information includes the average brightness of red, the average brightness of green, and the average brightness of blue; determining the second brightness information based on the second quantity information and the second pixel value information can be understood as calculating the arithmetic mean of the color of each pixel in the sampled image data.

[0094] The method of the embodiment of the present application facilitates accurate calculation of the color information corresponding to each light-emitting unit by determining the second brightness information and the second color center of gravity information of each light-emitting unit in the sampled image data, and determining the first brightness information and the first color center of gravity information of the first image data.

[0095] In an embodiment of the present application, the process of determining the color information corresponding to each light-emitting unit according to the first brightness information, the first color center of gravity information, the second brightness information and the second color center of gravity information specifically includes: the SOC processing unit 101 is also used to determine the distance information between the first color center of gravity information and the second color center of gravity; and based on the first preset weight information corresponding to the first image data, the second preset weight information corresponding to the sampled image data, the first brightness information, the second brightness information and the distance information, the color information corresponding to each of the light-emitting units 102 is determined.

[0096] It should be noted that the first preset weight information can be understood as the weight system corresponding to the first image data; the second preset weight information can be understood as the weight system corresponding to the sampled image data; the specific values ​​of the first preset weight information and the second preset weight information can be determined according to actual conditions and are not limited here.

[0097] In an embodiment of the present application, the distance information includes the distance information between the red center of gravity in the first image data and the red center of gravity in the sampled image data, the distance information between the green center of gravity in the first image data and the green center of gravity in the sampled image data, and the distance information between the blue center of gravity in the first image data and the blue center of gravity in the sampled image data.

[0098] It should be noted that the color information includes red information, green information and blue information. Based on the first preset weight information corresponding to the first image data, the second preset weight information corresponding to the sampled image data, the first brightness information, the second brightness information and the distance information, the color information corresponding to each of the light-emitting units 102 is determined. It can be understood that the process of determining the red information is: determining the red information in the light-emitting unit 102 according to the first preset weight information, the second preset weight information, the average brightness of red in the first image data, the average brightness of red in the sampled image data, and the distance information between the red center of gravity in the first image data and the red center of gravity in the sampled image data; the process of determining the green information is: determining the green information in the light-emitting unit 102 according to the first preset weight information, the second preset weight information, the average brightness of green in the first image data, the average brightness of green in the sampled image data, and the distance information between the green center of gravity in the first image data and the green center of gravity in the sampled image data; the process of determining the blue information is: determining the blue information in the light-emitting unit 102 according to the first preset weight information, the second preset weight information, the average brightness of blue in the first image data, the average brightness of blue in the sampled image data, and the distance information between the blue center of gravity in the first image data and the blue center of gravity in the sampled image data.

[0099] It should be noted that the process of determining the color information corresponding to each of the light-emitting units 102 according to the first preset weight information corresponding to the first image data, the second preset weight information corresponding to the sampled image data, the first brightness information, the second brightness information and the distance information can be calculated by formulas (5), (6) and (7). Formulas (5), (6) and (7) are as follows:

[0100] R f =f(c)*R(c) / r(R c ) ∧2 +f(p)*R(p) / r(R p ) ∧2 (5)

[0101] B f =f(c)*B(c) / r(B c ) ∧2 +f(p)*B(p) / r(B p ) ∧2 (6)

[0102] G f =f(c)*G(c) / r(G c ) ∧2 +f(p)*G(p) / r(G p ) ∧2 (7)

[0103] In the formula, R f is the red information of the light emitting unit 102, B f is the green information of the light emitting unit 102, G f is the blue information of the light-emitting unit 102, f(c) and f(p) are the weight coefficients of the light-emitting unit sampling area and the target image respectively; r(R c ) and r(R p ) are the distances between the red center of gravity of the light-emitting unit and the sampling area and the red center of gravity of the target image; r(B c ) and r(B p ) are the distances between the blue center of gravity of the light-emitting unit and the sampling area and the blue center of gravity of the target image; r(G c ) and r(G p ) are the distances between the green center of the light-emitting unit and the sampling area and the green center of gravity of the target image.

[0104] The solution of the embodiment of the present application can accurately calculate the color information of the light-emitting unit by weighted calculation of the color information of the light-emitting unit through the brightness information and color center of gravity information of the first image data and the brightness information and color center of gravity information of the sampled image data, thereby facilitating more precise control of the light-emitting unit.

[0105] The solution of the embodiment of the present application processes the first audio and video data by adopting the SOC processing unit, and determines the sampled image data corresponding to each light-emitting unit in the first image data through the arrangement order of a group of light-emitting units, determines the color information of each light-emitting unit according to the first image data and the sampled image data, and then controls each light-emitting unit to emit light according to the corresponding color information. That is, after the SOC processing unit performs image processing on the acquired audio and video data, it controls the light-emitting unit accordingly based on the acquired image data, thereby improving the display effect of the light-emitting unit.

[0106] In an embodiment of the present application, the SOC processing unit 101 is also used to obtain audio data corresponding to the first audio and video data, analyze the audio data, and obtain rhythm information corresponding to the audio data; determine the brightness change information of each light-emitting unit 102 based on the rhythm information; send the brightness change information to the light-emitting unit 102; each light-emitting unit 102 is also used to emit light according to the corresponding brightness change information and color information.

[0107] It should be noted that audio data is time series data, which can also be understood as linear data. Rhythm information can be understood as amplitude information of vibration in audio data.

[0108] For ease of understanding, an example is given here to illustrate that the amplitude information of vibration at each moment in the audio data is different, and the changing brightness information is determined based on the changing amplitude information. The SOC processing unit 101 controls the light-emitting unit 102 to emit light according to the corresponding brightness change information and color information.

[0109] It should be noted that, in the process of analyzing the brightness change information obtained from the audio data and the light-emitting unit 102 emitting light respectively according to the brightness change information and the color information, the brightness change of each light-emitting unit 102 is the same. For example, it is bright at the first moment and dark at the second moment, then each light-emitting unit 102 is bright at the first moment and dark at the second moment, and the degree of brightness and darkness is the same.

[0110] The solution of the embodiment of the present application simplifies the system architecture by simultaneously processing audio data and video data in the SOC module, and the SOC module has a stronger data processing capability, thereby achieving fine control of the light-emitting unit.

[0111] In an embodiment of the present application, the control device 10 also includes a button control unit 103, which is connected to the SOC processing unit 101 via GPIO11; the SOC processing unit 101 is connected to a group of light-emitting units 102 via SPI12; the button control unit 103 is used to send first control information to the SOC processing unit 101; the SOC processing unit 101 is used to send color information to the light-emitting unit 102 based on the first control information.

[0112] It should be noted that the first control information is understood as information sent to the SOC processing unit 101 to control the light-emitting unit 102 to start emitting light. The button control unit 103 is used to send the first control information to the SOC processing unit 101, and the SOC processing unit 101 is used to send the color information to the light-emitting unit 102 based on the first control information; it can be understood that when the button control unit 103 receives a button pressed by the user, the first control information is sent to the SOC processing unit 101, and after receiving the first control information, the SOC processing unit 101 controls each light-emitting unit 102 to emit light according to the corresponding color information.

[0113] In an embodiment of the present application, the control device also includes an APP control unit 104, which is connected to the SOC processing unit 101 through a wireless controller 105; the wireless controller 105 is connected to a group of light-emitting units 102; the APP control unit 104 is used to send second control information to the SOC processing unit 101; the SOC processing unit 101 is used to send color information to the light-emitting unit based on the second control information.

[0114] It should be noted that the wireless controller 105 includes a wireless transmitting unit or wireless transmitting controller module 1051 and a wireless receiving controller 1052. The wireless transmitting unit or wireless transmitting controller module 1051 is connected to the APP control unit 104 and the SOC processing unit 101 respectively; the wireless receiving controller 1052 is connected to the wireless transmitting unit or wireless transmitting controller module 1051.

[0115] It should be noted that the second control information is understood as information sent to the SOC processing unit 101 to control the light-emitting unit 102 to start emitting light. The APP control unit 104 is used to send the second control information to the SOC processing unit 101; the SOC processing unit 101 is used to send the color information to the light-emitting unit based on the second control information; it can be understood that when the APP control unit 104 receives a user operation instruction, it sends an instruction to the wireless transmitting unit or the wireless transmitting controller module 1051, and the wireless transmitting unit or the wireless transmitting controller module 1051 sends the second control information to the SOC processing unit 101, and sends the second control information to the wireless receiving controller 1052, so as to control each light-emitting unit 102 to emit light according to the corresponding color information.

[0116] It should be noted that in the embodiment of the present application, the button control unit 103 and the APP control unit 105 can be used simultaneously to send control information, thereby instructing the SOC processing unit 101 to control the light-emitting unit 102 to emit light, or only the button control unit 103 can be used to send control information to instruct the SOC processing unit 101 to control the light-emitting unit 102 to emit light, or only the APP control unit 105 can be used to send control information to instruct the SOC processing unit 101 to control the light-emitting unit 102 to emit light.

[0117] The method of the embodiment of the present application sends control information through button control and APP control, which is more flexible to use and facilitates corresponding control according to user operations, thereby improving user experience.

[0118] In an embodiment of the present application, the control device 10 also includes a data processing unit 106, which is connected to the SOC processing unit 101; the data processing unit 106 is used to obtain first audio and video data, process the video data in the first audio and video data, and obtain first image data.

[0119] It should be noted that the data processing unit 106 includes a split-screen processing unit 1061 and a conversion unit 1062 , and the conversion unit 1062 is connected to the split-screen processing unit 1061 and the SOC processing unit 101 respectively.

[0120] The data processing unit 106 is used to obtain the first audio and video data, and process the video data in the first audio and video data to obtain the first image data; it can be understood that the split-screen processing unit 1061 is used to obtain the first audio and video data; process the first audio and video data to obtain the second audio and video data; the conversion unit 1062 is used to perform frequency and / or resolution conversion processing on the video data in the second audio and video data to obtain the first image data.

[0121] It should be noted that the screen splitting processing unit 1061 can be recorded as an HDMI splitter module in practical applications; the conversion unit 1062 can be recorded as an HDMI converter module in practical applications.

[0122] The split screen processing unit 1061 is used to obtain the first audio and video data; perform data processing on the first audio and video data to obtain the second audio and video data. It can be understood that the HDMI splitter module performs image processing on the first audio and video data to obtain the second audio and video data; the image processing includes HDR to SDR processing.

[0123] The conversion unit 1062 is used to perform frequency and / or resolution conversion processing on the video data in the second audio and video data to obtain the first image data. It can be understood that the HDMI converter module reduces the frequency and / or reduces the resolution of the video data in the second audio and video data to obtain the first image data. The resolution reduction processing can be understood as reducing the video data with a 4K resolution to the video data with a 1080P resolution.

[0124] It should be noted that the conversion unit 1062 can also perform format conversion processing on the second audio and video data.

[0125] According to the solution of the embodiment of the present application, image processing of the first audio and video data by the HDMI splitter module can prevent color distortion and make the image more accurate; the HDMI converter module can perform frequency reduction and / or resolution reduction processing, as well as format conversion processing, so that the format is easier to process, thereby reducing costs.

[0126] In the embodiment of the present application, the control device 10 also includes an input unit 107 and an output unit 108; the split-screen processing unit 1061 is respectively connected to the input unit 107 and the output unit 108; the input unit 107 is used to input the first audio and video data to the split-screen processing unit 1061; the split-screen processing unit 1061 is also used to input the second audio and video data into an external display device through the output unit 108.

[0127] It should be noted that the input unit 107 can be recorded as an HDMIIN module in practical applications; the output unit 108 can be recorded as an HDMIOUT module in practical applications. The input unit 107 is used to input the first audio and video data to the split screen processing unit 1061; the split screen processing unit 1061 is also used to input the second audio and video data to the external display device through the output unit 108; it can be understood that the HDMIIN module inputs the first audio and video data to the HDMI splitter module, and the HDMI splitter module performs image processing on the first audio and video data and outputs it to the external display device through the HDMIOUT module.

[0128] It should be noted that the external display device can be any display device, such as a television, a computer, a mobile phone, a display screen, etc.

[0129] For ease of understanding, an application scenario of connecting the audio and video of a computer to a TV is illustrated here. The HDMIsplitter module processes the first audio and video data from the computer, outputs one channel to the TV for display through the HDMIOUT module, and analyzes the other channel through the SOC module, thereby controlling the light-emitting unit to emit light.

[0130] In the embodiment of the present application, by performing image processing on the audio and video input by the HDMIIN module through the HDMI splitter module and then outputting it to the original external display device, the image on the display device can be made clearer, thereby improving the user experience.

[0131] An embodiment of the present application provides an electronic device, which is provided with a control device 10 as described in the above embodiment.

[0132] The present application provides a control method. Figure 4 A flow chart of a control method provided in an embodiment of the present application; Figure 4 As shown, the method includes:

[0133] S401. Obtain first image data corresponding to first audio and video data, determine the sampled image data corresponding to each light-emitting unit in the first image data according to the arrangement order of a group of light-emitting units, and determine the color information corresponding to each light-emitting unit according to the first image data and the sampled image data, and send the color information to the light-emitting unit.

[0134] It should be noted that the control method can be applied to the above-mentioned control device. In practical applications, the control method can be understood as a method for controlling the atmosphere light by analyzing the HDMI audio and video stream.

[0135] In an embodiment of the present application, the SOC processing unit of the control device obtains the first image data corresponding to the first audio and video data, determines the sampled image data corresponding to each light-emitting unit in the first image data according to the arrangement order of a group of light-emitting units, and determines the color information corresponding to each light-emitting unit according to the first image data and the sampled image data, and sends the color information to the light-emitting unit.

[0136] It should be noted that the light-emitting unit can be any object that can emit light, which is not limited here. As an example, the light-emitting unit can be a lamp, specifically a TV background light and an ambient atmosphere lamp, etc.; the shape of the light-emitting unit can be any shape, which is not limited here. As an example, the light-emitting unit can be in the shape of a light strip; the number of light-emitting units can be one or more, and the specific number can be determined based on actual conditions.

[0137] In an embodiment of the present application, the number of first image data corresponding to the first audio and video data may be one or more, which needs to be specifically determined by the video data in the first audio and video data.

[0138] The arrangement order of a group of light-emitting units may be determined according to actual conditions. As an example, a group of light-emitting units may be arranged in a 4×4 rectangular arrangement or a circular arrangement.

[0139] It should be noted that the sampled image data can be understood as the image data mapped to the first image data for each light-emitting unit; determining the sampled image data corresponding to each light-emitting unit in the first image data according to the arrangement order of a group of light-emitting units can be understood as performing corresponding division processing on the first image data according to the arrangement order of a group of light-emitting units, and then determining the sampled image data of each light-emitting unit in the first image data; it can be illustrated by an example that when the light-emitting units are a 4×4 matrix, the first image data is divided into 4×4, and each light-emitting unit determines the corresponding sampled image data in the first image data according to the arrangement order.

[0140] In the embodiment of the present application, color information can be understood as three primary color information, namely, red, green and blue information. The process of determining the color information corresponding to each light-emitting unit according to the first image data and the sampled image data specifically includes: determining the first brightness information and the first color center of gravity information of the first image data, and the second brightness information and the second color center of gravity information of the sampled image data respectively; and determining the color information corresponding to each light-emitting unit according to the first brightness information, the first color center of gravity information, the second brightness information and the second color center of gravity information.

[0141] It should be noted that the first brightness information of the first image data can be understood as the average brightness information of RGB of the first image data, that is, the first brightness information includes the average brightness of red, the average brightness of green, and the average brightness of red in the first image data; in practical applications, the average brightness of red in the first image data can be recorded as R(p), the average brightness of green can be recorded as G(p), and the average brightness of blue can be recorded as B(p). The first color center of gravity information of the first image data can be understood as the color center of gravity of RGB of the first image data, that is, the first color center of gravity includes the center of gravity of red, the center of gravity of green, and the center of gravity of blue in the first image data.

[0142] The second brightness information of the sampled image data can be understood as the average brightness information of the RGB of the sampled image, that is, the second brightness information includes the average brightness of red, the average brightness of green, and the average brightness of blue in the sampled image data; in practical applications, the average brightness of red in the sampled image data can be recorded as R(c), the average brightness of green can be recorded as G(c), and the average brightness of blue can be recorded as B(c). The second color center of gravity information of the sampled image data can be understood as the color center of gravity information of the RGB of the sampled image data, that is, the second color center of gravity information includes the center of gravity of red, the center of gravity of green, and the center of gravity of blue in the sampled image data.

[0143] In the embodiment of the present application, by respectively determining the sampled image data corresponding to the first image data for each light-emitting unit, and determining the color information corresponding to each light-emitting unit according to the corresponding sampled image data and the first image data (overall image data), the color information of each light-emitting unit can be accurately determined, thereby controlling the light-emitting unit to emit light accurately.

[0144] In an embodiment of the present application, the process of respectively determining the first brightness information and the first color center of gravity information of the first image data, and the second brightness information and the second color center of gravity information of the sampled image data specifically includes: obtaining the first quantity information of the first pixel and the first pixel value information of the first pixel contained in the first image data; determining the third color center of gravity information of the first pixel in the first direction and the fourth color center of gravity information of the first pixel in the second direction according to the first pixel value information; and determining the first color center of gravity information based on the third color center of gravity information and the fourth color center of gravity information; determining the first brightness information based on the first quantity information and the first pixel value information; obtaining the second quantity information of the second pixel and the second pixel value information of the second pixel of the sampled image data; determining the fifth color center of gravity information of the second pixel in the first direction and the sixth color center of gravity information of the second pixel in the second direction according to the second pixel value information; and determining the second color center of gravity information based on the fifth color center of gravity information and the sixth color center of gravity information; determining the second brightness information based on the second quantity information and the second pixel value information.

[0145] In the embodiments of the present application, the first pixel can be understood as all the pixels included in the first image data. The first pixel value can be understood as the pixel value corresponding to each pixel, or can be understood as the color value of each pixel. The first direction can be understood as the pixel X axis, and the second direction can be understood as the pixel Y axis.

[0146] The third color center of gravity information can be understood as the center of gravity of the pixel point in the X-axis direction of the pixel, and the fourth color center of gravity can be understood as the center of gravity of the pixel point in the Y-axis direction of the pixel; determining the first color center of gravity information based on the third color center of gravity information and the fourth color center of gravity information can be understood as taking the intersection of the center of gravity of the pixel point in the X-axis direction and the center of gravity in the Y-axis direction as the first color center of gravity information.

[0147] It should be noted that the first color center of gravity includes the center of gravity of red, the center of gravity of green and the center of gravity of blue; when determining the center of gravity of red, the center of gravity of red in the pixel X-axis direction can be determined first, then the center of gravity of red in the pixel Y-axis direction can be determined, and finally the intersection of the center of gravity of red in the pixel X-axis direction and the center of gravity of the pixel Y-axis direction is used as the center of gravity of red. The center of gravity of green and the center of gravity of blue can be determined according to the above-mentioned method for determining the center of gravity of red, which will not be repeated here.

[0148] In an embodiment of the present application, the center of gravity of the red color in the first image data in the pixel X-axis direction can be calculated by the above formula (1), and the center of gravity of the red color in the pixel Y-axis direction can be calculated by the above formula (2).

[0149] It should be noted that the centroid of the green and blue colors in the first image data can be obtained according to the above formula (1) and formula (2) respectively on the pixel X-axis and Y-axis. The intersection of the two is the centroid of the green or blue color, which will not be repeated here.

[0150] In an embodiment of the present application, the first brightness information includes the average brightness of red, the average brightness of green, and the average brightness of blue; determining the first brightness information based on the first quantity information and the first pixel value information can be understood as calculating the arithmetic mean of the color of each pixel in the first image data.

[0151] In the embodiment of the present application, the second pixel can be understood as all the pixels included in the sampled image data. The second pixel value can be understood as the pixel value corresponding to each pixel, or can be understood as the color value of each pixel. The first direction can be understood as the pixel X axis, and the second direction can be understood as the pixel Y axis.

[0152] The fifth color center of gravity information can be understood as the center of gravity of the pixel point in the X-axis direction of the pixel, and the sixth color center of gravity can be understood as the center of gravity of the pixel point in the Y-axis direction of the pixel; determining the second color center of gravity information based on the fifth color center of gravity information and the sixth color center of gravity information can be understood as taking the intersection of the center of gravity of the pixel point in the X-axis direction and the center of gravity in the Y-axis direction as the second color center of gravity information of the sampled image data.

[0153] It should be noted that the second color center of gravity includes the center of gravity of red, the center of gravity of green and the center of gravity of blue; when determining the center of gravity of red, the center of gravity of red in the pixel X-axis direction can be determined first, then the center of gravity of red in the pixel Y-axis direction can be determined, and finally the intersection of the center of gravity of red in the pixel X-axis direction and the center of gravity of the pixel Y-axis direction is used as the center of gravity of red. The center of gravity of green and the center of gravity of blue can be determined according to the above-mentioned method for determining the center of gravity of red, which will not be repeated here.

[0154] In the embodiment of the present application, the center of gravity of the red color in the sampled image data in the direction of the pixel X-axis can be calculated by the above formula (3), and the center of gravity of the red color in the direction of the pixel Y-axis can be calculated by the above formula (4). It should be noted that the center of gravity of the green and blue colors in the sampled image data can be obtained according to the above formula (3) and formula (4) respectively in the direction of the pixel X-axis and Y-axis, and the intersection of the two is the center of gravity of the green or blue color, which will not be repeated here.

[0155] In an embodiment of the present application, the second brightness information includes the average brightness of red, the average brightness of green, and the average brightness of blue; determining the second brightness information based on the second quantity information and the second pixel value information can be understood as calculating the arithmetic mean of the color of each pixel in the sampled image data.

[0156] The method of the embodiment of the present application facilitates accurate calculation of the color information corresponding to each light-emitting unit by determining the second brightness information and the second color center of gravity information of each light-emitting unit in the sampled image data, and determining the first brightness information and the first color center of gravity information of the first image data.

[0157] In an embodiment of the present application, the process of determining the color information corresponding to each light-emitting unit according to the first brightness information, the first color center of gravity information, the second brightness information and the second color center of gravity information specifically includes: determining the distance information between the first color center of gravity information and the second color center of gravity; and determining the color information corresponding to each of the light-emitting units based on the first preset weight information corresponding to the first image data, the second preset weight information corresponding to the sampled image data, the first brightness information, the second brightness information and the distance information.

[0158] It should be noted that the first preset weight information can be understood as the weight system corresponding to the first image data; the second preset weight information can be understood as the weight system corresponding to the sampled image data; the specific values ​​of the first preset weight information and the second preset weight information can be determined according to actual conditions and are not limited here.

[0159] In an embodiment of the present application, the distance information includes the distance information between the red center of gravity in the first image data and the red center of gravity in the sampled image data, the distance information between the green center of gravity in the first image data and the green center of gravity in the sampled image data, and the distance information between the blue center of gravity in the first image data and the blue center of gravity in the sampled image data.

[0160] It should be noted that the color information includes red information, green information and blue information. Based on the first preset weight information corresponding to the first image data, the second preset weight information corresponding to the sampled image data, the first brightness information, the second brightness information and the distance information, the color information corresponding to each of the light-emitting units is determined. It can be understood that the process of determining the red information is: determining the red information in the light-emitting unit according to the first preset weight information, the second preset weight information, the average brightness of red in the first image data, the average brightness of red in the sampled image data, and the distance information between the red center of gravity in the first image data and the red center of gravity in the sampled image data; the process of determining the green information is: determining the green information in the light-emitting unit according to the first preset weight information, the second preset weight information, the average brightness of green in the first image data, the average brightness of green in the sampled image data, and the distance information between the green center of gravity in the first image data and the green center of gravity in the sampled image data; the process of determining the blue information is: determining the blue information in the light-emitting unit according to the first preset weight information, the second preset weight information, the average brightness of blue in the first image data, the average brightness of blue in the sampled image data, and the distance information between the blue center of gravity in the first image data and the blue center of gravity in the sampled image data.

[0161] It should be noted that the process of determining the color information corresponding to each of the light-emitting units according to the first preset weight information corresponding to the first image data, the second preset weight information corresponding to the sampled image data, the first brightness information, the second brightness information and the distance information can be calculated by the above formulas (5), (6) and (7).

[0162] The solution of the embodiment of the present application can accurately calculate the color information of the light-emitting unit by weighted calculation of the color information of the light-emitting unit through the brightness information and color center of gravity information of the first image data and the brightness information and color center of gravity information of the sampled image data, thereby facilitating more precise control of the light-emitting unit.

[0163] S402, emitting light respectively according to corresponding color information.

[0164] In the implementation of the present application, the light-emitting units emit light respectively according to the corresponding color information.

[0165] The solution of the embodiment of the present application processes the first audio and video data by adopting the SOC processing unit, and determines the sampled image data corresponding to each light-emitting unit in the first image data through the arrangement order of a group of light-emitting units, determines the color information of each light-emitting unit according to the first image data and the sampled image data, and then controls each light-emitting unit to emit light according to the corresponding color information. That is, after the SOC processing unit performs image processing on the acquired audio and video data, it controls the light-emitting unit accordingly based on the acquired image data, thereby improving the display effect of the light-emitting unit.

[0166] In an embodiment of the present application, the control method also includes: obtaining audio data corresponding to the first audio and video data, analyzing the audio data, and obtaining rhythmic information corresponding to the audio data; determining the brightness change information of each light-emitting unit based on the rhythmic information; sending the brightness change information to the light-emitting unit, and emitting light according to the corresponding brightness change information and color information.

[0167] It should be noted that audio data is time series data, which can also be understood as linear data. Rhythm information can be understood as amplitude information of vibration in audio data.

[0168] For ease of understanding, an example is given here to illustrate that the amplitude information of vibration at each moment in the audio data is different, and the changing brightness information is determined based on the changing amplitude information. The SOC processing unit controls the light-emitting unit to emit light according to the corresponding brightness change information and color information.

[0169] It should be noted that in the process of analyzing the brightness change information obtained from the audio data and the light-emitting units emitting light respectively according to the brightness change information and the color information, the brightness change of each light-emitting unit is the same. For example, if it is bright at the first moment and dark at the second moment, each light-emitting unit is bright at the first moment and dark at the second moment, and the degree of brightness and darkness is the same.

[0170] The solution of the embodiment of the present application simplifies the system architecture by simultaneously processing audio data and video data in the SOC module, and the SOC module has a stronger data processing capability, thereby achieving fine control of the light-emitting unit.

[0171] In an embodiment of the present application, the control method further includes: sending first control information to the SOC processing unit; and sending the color information to the light-emitting unit based on the first control information.

[0172] It should be noted that the button control unit sends the first control information to the SOC processing unit. When the button control unit receives a button press by the user, the SOC processing unit sends the first control information to the SOC processing unit, and after receiving the first control information, the SOC processing unit controls each light-emitting unit to emit light according to the corresponding color information.

[0173] In an embodiment of the present application, the control method further includes: sending second control information to the SOC processing unit; and sending the color information to the light-emitting unit based on the second control information.

[0174] It should be noted that the APP control unit sends the second control information to the SOC processing unit. The APP control unit is connected to the SOC processing unit through a wireless controller; the wireless controller includes a wireless transmitting unit or a wireless transmitting controller module and a wireless receiving controller. The wireless transmitting unit or the wireless transmitting controller module is connected to the APP control unit and the SOC processing unit respectively; the wireless receiving controller is connected to the wireless transmitting unit or the wireless transmitting controller module.

[0175] It should be noted that when the APP control unit receives a user operation instruction, it sends an instruction to the wireless transmitting unit or the wireless transmitting controller module, the wireless transmitting unit or the wireless transmitting controller module sends the second control information to the SOC processing unit, and sends the second control information to the wireless receiving controller to control each light-emitting unit to emit light according to the corresponding color information.

[0176] It should be noted that in the embodiment of the present application, a button control unit and an APP control unit can be used at the same time to send control information, thereby instructing the SOC processing unit to control the light-emitting unit to emit light. Alternatively, only the button control unit can be used to send control information to instruct the SOC processing unit to control the light-emitting unit to emit light, or only the APP control unit can be used to send control information to instruct the SOC processing unit to control the light-emitting unit to emit light.

[0177] The method of the embodiment of the present application sends control information through button control and APP control, which is more flexible to use and facilitates corresponding control according to user operations, thereby improving user experience.

[0178] In an embodiment of the present application, the control method further includes: acquiring first audio and video data; and processing video data in the first audio and video data to obtain first image data.

[0179] It should be noted that the data processing unit obtains the first audio and video data; the data processing unit includes a split-screen processing unit and a conversion unit.

[0180] In an embodiment of the present application, the process of obtaining the first image data specifically includes: acquiring first audio and video data; performing data processing on the first audio and video data to obtain second audio and video data; performing frequency and / or resolution conversion processing on the video data in the second audio and video data to obtain the first image data.

[0181] It should be noted that the split screen processing unit obtains the first audio and video data; performs data processing on the first audio and video data to obtain the second audio and video data; the conversion unit performs frequency and / or resolution conversion processing on the video data in the second audio and video data to obtain the first image data. The split screen processing unit can be recorded as an HDMI splitter module in practical applications; the conversion unit can be recorded as an HDMI converter module in practical applications.

[0182] It should be noted that obtaining the first audio and video data; performing data processing on the first audio and video data to obtain the second audio and video data can be understood as the HDMI splitter module performing image processing on the first audio and video data to obtain the second audio and video data; the image processing includes HDR to SDR processing.

[0183] It should be noted that the frequency and / or resolution conversion processing is performed on the video data in the second audio and video data to obtain the first image data, which can be understood as the HDMI converter module reducing the frequency and / or reducing the resolution of the video data in the second audio and video data to obtain the first image data. Among them, the resolution reduction processing can be understood as reducing the 4K video data to 1080P video data. The conversion unit can also perform format conversion processing on the second audio and video data.

[0184] According to the solution of the embodiment of the present application, image processing of the first audio and video data by the HDMI splitter module can prevent color distortion and make the image more accurate; the HDMI converter module can perform frequency reduction and / or resolution reduction processing, as well as format conversion processing, so that the format is easier to process, thereby reducing costs.

[0185] The present application embodiment provides a control device, Figure 5 A schematic diagram of the structure of a control device provided in an embodiment of the present application; Figure 5 As shown, the control device 500 includes: a processor 501 and a memory 503 . Optionally, the control device 500 may also include a communication bus 502 .

[0186] In the process of a specific embodiment, the processor 501 may be at least one of an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing image processing device (DSPD), a programmable logic image processing device (PLD), a field programmable gate array (FPGA), a CPU, a controller, a microcontroller, and a microprocessor. It is understandable that for different devices, the electronic device used to implement the function of the processor may also be other, which is not specifically limited in this embodiment.

[0187] In the embodiment of the present application, the communication bus 502 is used to realize the connection and communication between the processor 501 and the memory 503; when the processor 501 executes the running program stored in the memory 503, the following control method is implemented:

[0188] Obtain the first image data corresponding to the first audio and video data, determine the sampled image data corresponding to each of the light-emitting units in the first image data according to the arrangement order of a group of light-emitting units, and determine the color information corresponding to each of the light-emitting units according to the first image data and the sampled image data, and send the color information to the light-emitting units; emit light respectively according to the corresponding color information.

[0189] Furthermore, the above-mentioned processor 501 is also used to obtain audio data corresponding to the first audio and video data, analyze the audio data, and obtain rhythm information corresponding to the audio data; determine the brightness change information of each of the light-emitting units based on the rhythm information; send the brightness change information to the light-emitting unit; and emit light respectively according to the corresponding brightness change information and color information.

[0190] Furthermore, the above-mentioned processor 501 is also used to respectively determine the first brightness information and the first color center of gravity information of the first image data, and the second brightness information and the second color center of gravity information of the sampled image data; and determine the color information corresponding to each of the light-emitting units according to the first brightness information, the first color center of gravity information, the second brightness information and the second color center of gravity information.

[0191] Furthermore, the processor 501 is also used to obtain first quantity information of a first pixel and first pixel value information of the first pixel contained in the first image data; determine third color center of gravity information of the first pixel in the first direction and fourth color center of gravity information of the first pixel in the second direction according to the first pixel value information; and determine the first color center of gravity information based on the third color center of gravity information and the fourth color center of gravity information; determine the first brightness information according to the first quantity information and the first pixel value information; obtain second quantity information of a second pixel and second pixel value information of the second pixel of the sampled image data; determine fifth color center of gravity information of the second pixel in the first direction and sixth color center of gravity information of the second pixel in the second direction according to the second pixel value information; and determine the second color center of gravity information based on the fifth color center of gravity information and the sixth color center of gravity information; determine the second brightness information according to the second quantity information and the second pixel value information.

[0192] Furthermore, the above-mentioned processor 501 is also used to determine the distance information between the first color center of gravity information and the second color center of gravity; and determine the color information corresponding to each of the light-emitting units based on the first preset weight information corresponding to the first image data, the second preset weight information corresponding to the sampled image data, the first brightness information, the second brightness information and the distance information.

[0193] Furthermore, the processor 501 is further configured to send first control information to the SOC processing unit; and send the color information to the light emitting unit based on the first control information.

[0194] Furthermore, the processor 501 is further configured to send second control information to the SOC processing unit; and send the color information to the light emitting unit based on the second control information.

[0195] Furthermore, the processor 501 is also used to obtain the first audio and video data; and process the video data in the first audio and video data to obtain the first image data.

[0196] Furthermore, the processor 501 is also used to obtain the first audio and video data; perform data processing on the first audio and video data to obtain second audio and video data; perform frequency and / or resolution conversion processing on the video data in the second audio and video data to obtain the first image data.

[0197] An embodiment of the present application provides a storage medium having a computer program stored thereon. The computer-readable storage medium stores one or more programs. The one or more programs can be executed by one or more processors. The computer program implements the control method as described above.

[0198] Based on the above embodiments, an embodiment of the present application provides a computer program product, including a computer program, which can be executed by one or more processors, and the computer program implements the control method as described above.

[0199] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0200] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present disclosure, or the part that contributes to the relevant technology, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for enabling an image display device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present disclosure.

[0201] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.

Claims

1. A control device, characterized in that: The control device at least comprises a system-on-chip (SOC) processing unit and a group of light-emitting units; the SOC processing unit is connected to the group of light-emitting units; The SOC processing unit is used to obtain the first image data corresponding to the first audio and video data, determine the sampled image data corresponding to each of the light-emitting units in the first image data according to the arrangement order of the group of light-emitting units, and determine the color information corresponding to each of the light-emitting units according to the first image data and the sampled image data, and send the color information to the light-emitting unit; Each of the light-emitting units is used to emit light according to corresponding color information.

2. The control device according to claim 1, characterized in that: The SOC processing unit is further used to obtain audio data corresponding to the first audio and video data, analyze the audio data, and obtain rhythm information corresponding to the audio data; and determine brightness change information of each of the light-emitting units based on the rhythm information; Sending the brightness change information to the light emitting unit; Each of the light-emitting units is further used to emit light according to corresponding brightness change information and color information.

3. The control device according to claim 1, characterized in that: The SOC processing unit is also used to respectively determine the first brightness information and the first color center of gravity information of the first image data, and the second brightness information and the second color center of gravity information of the sampled image data; and determine the color information corresponding to each of the light-emitting units according to the first brightness information, the first color center of gravity information, the second brightness information and the second color center of gravity information.

4. The control device according to claim 3, characterized in that: The SOC processing unit is further used to obtain first quantity information of first pixels and first pixel value information of the first pixels included in the first image data; determine third color center of gravity information of the first pixels in the first direction and fourth color center of gravity information of the first pixels in the second direction according to the first pixel value information; and determine the first color center of gravity information based on the third color center of gravity information and the fourth color center of gravity information; determine the first brightness information according to the first quantity information and the first pixel value information; The SOC processing unit is further used to obtain second quantity information of a second pixel of the sampled image data and second pixel value information of the second pixel; and determine fifth color center of gravity information of the second pixel in the first direction and sixth color center of gravity information of the second pixel in the second direction according to the second pixel value information; The second color center of gravity information is determined based on the fifth color center of gravity information and the sixth color center of gravity information; and the second brightness information is determined according to the second quantity information and the second pixel value information.

5. The control device according to claim 3, characterized in that: The SOC processing unit is also used to determine the distance information between the first color center of gravity information and the second color center of gravity; and determine the color information corresponding to each of the light-emitting units based on the first preset weight information corresponding to the first image data, the second preset weight information corresponding to the sampled image data, the first brightness information, the second brightness information and the distance information.

6. The control device according to claim 1, characterized in that: The control device further comprises a key control unit; the key control unit is connected to the SOC processing unit via a general purpose input and output port GPIO; the SOC processing unit is connected to the group of light-emitting units via a serial peripheral interface SPI; The button control unit is used to send the first control information to the SOC processing unit; The SOC processing unit is used to send the color information to the light emitting unit based on the first control information.

7. The control device according to claim 1, characterized in that: The control device further comprises an application APP control unit; the APP control unit is connected to the SOC processing unit via a wireless controller; the wireless controller is connected to the group of light-emitting units; The APP control unit is used to send second control information to the SOC processing unit; The SOC processing unit is used to send the color information to the light emitting unit based on the second control information.

8. The control device according to claim 1, characterized in that: The control device further comprises a data processing unit; the data processing unit is connected to the SOC processing unit; The data processing unit is used to obtain the first audio and video data; process the video data in the first audio and video data to obtain the first image data.

9. The control device according to claim 8, characterized in that: The data processing unit includes a split screen processing unit and a conversion unit; the conversion unit is connected to the split screen processing unit and the SOC processing unit respectively; The split-screen processing unit is used to obtain the first audio and video data; perform data processing on the first audio and video data to obtain second audio and video data; The conversion unit is used to perform frequency and / or resolution conversion processing on the video data in the second audio and video data to obtain the first image data.

10. The control device according to claim 9, characterized in that: The control device further comprises an input unit and an output unit; the split screen processing unit is connected to the input unit and the output unit respectively; The input unit is used to input the first audio and video data into the split-screen processing unit; The split-screen processing unit is also used to input the second audio and video data into an external display device through the output unit.

11. An electronic device, characterized in that: The electronic device comprises the control device according to any one of claims 1-10.

12. A control method, characterized in that: The method comprises: Acquire first image data corresponding to the first audio and video data, determine sampled image data corresponding to each light-emitting unit in the first image data according to the arrangement order of a group of light-emitting units, and determine color information corresponding to each light-emitting unit according to the first image data and the sampled image data, and send the color information to the light-emitting unit; The lights are emitted according to the corresponding color information.

13. The method according to claim 12, characterized in that The method further comprises: Acquire audio data corresponding to the first audio and video data, analyze the audio data, and obtain rhythm information corresponding to the audio data; determine brightness change information of each of the light-emitting units based on the rhythm information; and send the brightness change information to the light-emitting units; The light is emitted according to the corresponding brightness change information and color information.

14. The method according to claim 12, characterized in that The step of determining the color information corresponding to each of the light-emitting units respectively according to the first image data and the sampled image data comprises: Determine the first brightness information and the first color center of gravity information of the first image data, and the second brightness information and the second color center of gravity information of the sampled image data respectively; and determine the color information corresponding to each of the light-emitting units according to the first brightness information, the first color center of gravity information, the second brightness information and the second color center of gravity information.

15. The method according to claim 14, characterized in that The determining of first brightness information and first color center of gravity information of the first image data, and second brightness information and second color center of gravity information of the sampled image data respectively includes: Acquire first quantity information of first pixels and first pixel value information of the first pixels included in the first image data; determine third color center of gravity information of the first pixels in the first direction and fourth color center of gravity information of the first pixels in the second direction respectively according to the first pixel value information; and determine the first color center of gravity information based on the third color center of gravity information and the fourth color center of gravity information; determine the first brightness information according to the first quantity information and the first pixel value information; Acquire the second quantity information of the second pixel of the sampled image data and the second pixel value information of the second pixel; determine the fifth color centroid information of the second pixel in the first direction and the sixth color centroid information of the second pixel in the second direction according to the second pixel value information; and determine the second color centroid information based on the fifth color centroid information and the sixth color centroid information; determine the second brightness information according to the second quantity information and the second pixel value information.

16. The method according to claim 14, characterized in that The determining the color information corresponding to each of the light-emitting units according to the first brightness information, the first color center of gravity information, the second brightness information, and the second color center of gravity information includes: Determine the distance information between the first color center of gravity information and the second color center of gravity; and determine the color information corresponding to each of the light-emitting units based on the first preset weight information corresponding to the first image data, the second preset weight information corresponding to the sampled image data, the first brightness information, the second brightness information and the distance information.

17. The method according to claim 12, characterized in that The method further comprises: Sending first control information to the SOC processing unit; and sending the color information to the light-emitting unit based on the first control information.

18. The method according to claim 12, characterized in that The method further comprises: Sending second control information to the SOC processing unit; and sending the color information to the light-emitting unit based on the second control information.

19. The method according to claim 12, characterized in that The method further comprises: Acquire the first audio and video data; process the video data in the first audio and video data to obtain the first image data.

20. The method according to claim 19, characterized in that The obtaining of the first image data comprises: Acquire the first audio and video data; perform data processing on the first audio and video data to obtain second audio and video data; The video data in the second audio and video data is subjected to frequency and / or resolution conversion processing to obtain the first image data.

21. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 12 to 20 are implemented.

Images