Mini LED dynamic backlight module control method and system

Abstract

The present invention relates to the field of display technology, and discloses a Mini LED dynamic backlight module control method and system, wherein the method comprises: analyzing the component status of the Mini LED dynamic backlight control system, constructing an ambient light-backlight brightness model and a user state-backlight brightness model of the viewing user; coupling the ambient light-backlight brightness model and the user state-backlight brightness model to obtain a coupled backlight brightness model, and defining the initial backlight brightness of the Mini LED corresponding to the Mini LED of the Mini LED dynamic backlight control system; receiving a display content signal of the Mini LED, extracting the display elements and display element features of the display content signal, analyzing the display content and display content type of the display content signal; analyzing the dimming parameters of the Mini LED using a content adaptive dimming algorithm, sending the dimming parameters to the Mini LED driving circuit in the Mini LED dynamic backlight control system, and executing the dynamic backlight control of the Mini LED through the Mini LED driving circuit. The present invention can improve the comfort of the user in terms of viewing experience.

Description

Technical Field

[0001] The present invention relates to a Mini LED dynamic backlight module control method and system, and belongs to the field of display technology. Background Art

[0002] Mini LED dynamic backlight module control refers to an advanced display technology that is made of Mini LED chips (usually flip chips) or LED packaging devices (may be face-mounted or flip chips); Mini LED dynamic backlight module is an important innovation in current display technology. It brings higher performance and better visual experience to LCD displays. It has also been widely used in many fields such as TVs, monitors, laptops, tablets, car displays and VR smart wearable devices.

[0003] Traditional Mini LED dynamic backlight module control technology usually relies on simple ambient light sensing and preset backlight adjustment modes. This method can only achieve basic light intensity adjustment, but lacks in-depth analysis of viewing user data and intelligent recognition of display content, resulting in poor user viewing experience comfort. Summary of the invention

[0004] The present invention provides a Mini LED dynamic backlight module control method and system, the main purpose of which is to improve the user's viewing comfort.

[0005] To achieve the above object, the present invention provides a Mini LED dynamic backlight module control method, comprising:

[0006] Determine an application scenario of a Mini LED dynamic backlight control system, perform a self-test on the Mini LED dynamic backlight control system in the application scenario to obtain self-test data, analyze component states of the Mini LED dynamic backlight control system based on the self-test data, and when the component states meet a preset component state threshold, use a sensor component in the Mini LED dynamic backlight control system to collect ambient light data and viewing user data of the application scenario;

[0007] Analyze the light environment of the application scene according to the ambient light data, analyze the position characteristics, action characteristics, biological characteristics and sound characteristics of the viewing user corresponding to the application scene based on the viewing user data, and construct the ambient light-backlight brightness model and user state-backlight brightness model of the viewing user according to the historical ambient light data and historical viewing user data of the application scene;

[0008] The ambient light-backlight brightness model and the user state-backlight brightness model are coupled to obtain a coupled backlight brightness model, and according to the light environment, the position feature, the action feature, the biological feature, and the sound feature, the coupled backlight brightness model is used to define the initial backlight brightness of the Mini LED corresponding to the Mini LED of the Mini LED dynamic backlight control system;

[0009] receiving a display content signal of the Mini LED, extracting display elements and display element features of the display content signal, and analyzing display content and display content type of the display content signal according to the display elements and the display element features;

[0010] Define a content adaptive dimming algorithm for the display content, analyze the dimming parameters of the Mini LED using the content adaptive dimming algorithm according to the display content type, send the dimming parameters to the Mini LED drive circuit in the Mini LED dynamic backlight control system, and perform dynamic backlight control of the Mini LED through the Mini LED drive circuit.

[0011] Optionally, analyzing the component status of the Mini LED dynamic backlight control system based on the self-test data includes:

[0012] Extracting brightness data, temperature data, communication data, hardware data and software data from the self-test data;

[0013] Determining a brightness range of the brightness data according to the brightness data;

[0014] Analyzing the component temperature anomaly of the Mini LED dynamic backlight control system through the temperature data and the preset temperature safety threshold;

[0015] According to the communication data, marking a communication error of the Mini LED dynamic backlight control system;

[0016] Based on the hardware data, analyzing the hardware driving coefficient of the Mini LED dynamic backlight control system;

[0017] Analyzing the hardware driving state of the Mini LED dynamic backlight control system according to the hardware driving coefficient;

[0018] Analyzing the software operation compatibility coefficient of the Mini LED dynamic backlight control system through the software data;

[0019] Based on the software operation compatibility coefficient, define the software state of the Mini LED dynamic backlight control system;

[0020] In combination with the brightness range, the component temperature abnormality, the communication error, the hardware driver status and the software status, the component status of the Mini LED dynamic backlight control system is determined.

[0021] Optionally, analyzing the software operation compatibility coefficient of the Mini LED dynamic backlight control system through the software data includes:

[0022] Defining software operation influencing factors of the Mini LED dynamic backlight control system;

[0023] Determining the dynamic weight of the software operation influencing factor;

[0024] Extracting operation influencing factor characteristics of the software data;

[0025] Establishing a multi-layer perceptron model of adjustment factors of the software operation influencing factors;

[0026] Based on the adjustment factor multilayer perceptron model and the operation impact factor characteristics, the impact factor score of the software operation impact factor is calculated using the following formula:

[0027] ;

[0028] in, represents the impact factor score, Indicates The original score of the software operation impact factor, Indicates the characteristics of the operating impact factor, represents the adjustment factor, represents the Sigmoid function, represents the adjustment factor multilayer perceptron model, Represents the model parameters of the adjustment factor multilayer perceptron model;

[0029] Based on the impact factor score and the dynamic weight, the software operation compatibility coefficient of the Mini LED dynamic backlight control system is calculated using the following formula:

[0030] ;

[0031] in, Indicates the software compatibility coefficient of Mini LED dynamic backlight control system. MiniLED dynamic backlight control system Software operation impact factors The dynamic weight of the moment, Represents the impact factor score.

[0032] Optionally, determining the dynamic weight of the software operation influencing factor includes:

[0033] Define the fixed weight coefficients of the software operation influencing factors and Activation function;

[0034] According to the Activation function, establishing a multi-layer perceptron model with adjusted weights of the software operation influencing factors;

[0035] Based on the fixed weight coefficient, the The activation function and the weight-adjusted multi-layer perceptron model use the following formula to calculate the dynamic weight of the software operation influencing factor:

[0036] ;

[0037] in, Mini LED dynamic backlight control system Software operation impact factors The dynamic weight of the moment, represents the normalization function, Mini LED dynamic backlight control system The fixed weight coefficient of the software operation influencing factor, express Activation function, Represents the weight adjustment multilayer perceptron model, Indicates the characteristics of the operating impact factor, Indicates time, Represents the parameters of the multilayer perceptron model for adjusting weights.

[0038] Optionally, analyzing the light environment of the application scenario according to the ambient light data includes:

[0039] Preprocessing the ambient light data to obtain preprocessed ambient light data;

[0040] Extracting static ambient light data and dynamic ambient light data from the preprocessed ambient light data;

[0041] Analyzing the light intensity value of the application scenario based on the static ambient light data;

[0042] Defining a static light environment of the application scenario according to the light intensity value;

[0043] Analyzing changes in ambient light in the application scenario through the dynamic ambient light data;

[0044] Based on the ambient light changes, determining the dynamic light environment of the application scenario;

[0045] The static light environment and the dynamic light environment are combined to define the light environment of the application scenario.

[0046] Optionally, analyzing the location characteristics, action characteristics, biological characteristics, and sound characteristics of the viewing user corresponding to the application scenario based on the viewing user data includes:

[0047] dividing the viewing user data into user location data, user action data, user biological data and user voice data;

[0048] Defining continuous frame position changes of the viewing user according to the user position data;

[0049] Establishing a position heat map of the viewing user through the continuous frame position changes;

[0050] Based on the location heat map, determining the location characteristics of the viewing user;

[0051] According to the user action data, marking the action type of the viewing user, and calculating the action frequency and action duration of the action type;

[0052] Determining the action characteristics of the viewing user through the action type, action frequency and action duration;

[0053] extracting facial expressions of the viewing user based on the user biological data;

[0054] Determining the emotional state of the viewing user through the facial expression;

[0055] Based on the emotional state, determining a biometric characteristic of the viewing user;

[0056] Extracting the voice text and voice status of the viewing user according to the user voice data;

[0057] Based on the voice text and the sound state, the voice characteristics of the viewing user are defined.

[0058] Optionally, coupling the ambient light-backlight brightness model and the user state-backlight brightness model to obtain a coupled backlight brightness model includes:

[0059] Determining a coupling strategy of the ambient light-backlight brightness model and the user state-backlight brightness model;

[0060] According to the coupling strategy, defining a shared representation layer of the ambient light-backlight brightness model and the user state-backlight brightness model;

[0061] Based on the shared representation layer, defining a coupled model architecture of the ambient light-backlight brightness model and the user state-backlight brightness model, wherein the coupled model architecture includes an ambient light sub-network, a user state sub-network and an output layer;

[0062] Training the environment photon network and the user state sub-network to obtain a training environment photon network and a training user state sub-network;

[0063] Calculating the environment photon network performance and the user state subnetwork performance of the training environment photon network and the training user state subnetwork;

[0064] When the ambient photon network performance and the user state subnetwork performance simultaneously meet the preset ambient photon network performance threshold and the user state subnetwork performance threshold, a coupled backlight brightness model of the ambient light-backlight brightness model and the user state-backlight brightness model is established based on the trained ambient photon network, the trained user state subnetwork, the shared representation layer and the output layer.

[0065] Optionally, extracting the display element and the display element feature of the display content signal includes:

[0066] Decomposing the display content signal into frame images;

[0067] Performing pixel analysis on the frame image to obtain a pixel analysis result;

[0068] Marking display elements of the display content signal according to the pixel analysis result;

[0069] Extracting initial display element features of the display element, wherein the initial display element features include element color features, element texture features, element shape features, and element space features;

[0070] Establishing a feature pyramid network of the display element;

[0071] Based on the feature pyramid network, the element color features, element texture features, element shape features and element space features are fused to obtain display element features of the display content signal.

[0072] Optionally, analyzing the dimming parameters of the Mini LED by using the content adaptive dimming algorithm according to the display content type includes:

[0073] Determine, according to the display content type, a dimming parameter reference value, content average brightness, content contrast, reference brightness, and reference contrast of the Mini LED;

[0074] The dimming parameters of the Mini LED are analyzed by using the dimming parameter reference value, content average brightness, content contrast, reference brightness and reference contrast ratio using a content adaptive dimming algorithm, wherein the content adaptive dimming algorithm:

[0075] ;

[0076] in, Indicates dimming parameters, Indicates the average brightness of the content. Indicates the reference brightness, Indicates the benchmark for this degree, Content contrast, represents the adjustment coefficient function, Indicates the dimming parameter reference value, Indicates the current dimming parameters.

[0077] In order to solve the above problems, the present invention further provides a Mini LED dynamic backlight module control system, the system comprising:

[0078] A component status analysis module, used to determine an application scenario of a Mini LED dynamic backlight control system, perform a self-test on the Mini LED dynamic backlight control system in the application scenario to obtain self-test data, analyze component status of the Mini LED dynamic backlight control system based on the self-test data, and when the component status meets a preset component status threshold, collect ambient light data and viewing user data of the application scenario using a sensor component in the Mini LED dynamic backlight control system;

[0079] a brightness model building module, configured to analyze the light environment of the application scene according to the ambient light data, analyze the position characteristics, action characteristics, biological characteristics and sound characteristics of the viewing user corresponding to the application scene based on the viewing user data, and build the ambient light-backlight brightness model and the user state-backlight brightness model of the viewing user according to the historical ambient light data and the historical viewing user data of the application scene;

[0080] An initial backlight brightness setting module, used to couple the ambient light-backlight brightness model and the user state-backlight brightness model to obtain a coupled backlight brightness model, and define the initial backlight brightness of the Mini LED corresponding to the Mini LED of the Mini LED dynamic backlight control system using the coupled backlight brightness model according to the light environment, the position feature, the action feature, the biological feature and the sound feature;

[0081] A display content analysis module, used to receive the display content signal of the Mini LED, extract the display elements and display element features of the display content signal, and analyze the display content and the display content type of the display content signal according to the display elements and the display element features;

[0082] A dynamic backlight control module is used to define a content adaptive dimming algorithm for the display content, analyze the dimming parameters of the Mini LED using the content adaptive dimming algorithm according to the display content type, send the dimming parameters to the Mini LED drive circuit in the Mini LED dynamic backlight control system, and perform dynamic backlight control of the Mini LED through the Mini LED drive circuit.

[0083] In order to solve the above problem, the present invention further provides an electronic device, the electronic device comprising:

[0084] at least one processor; and,

[0085] a memory communicatively connected to the at least one processor; wherein,

[0086] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to implement the Mini LED dynamic backlight module control method described above.

[0087] In order to solve the above problems, the present invention also provides a computer-readable storage medium, in which at least one instruction is stored. The at least one instruction is executed by a processor in an electronic device to implement the above-mentioned Mini LED dynamic backlight module control method.

[0088] Compared with the problems described in the background technology, firstly, the present invention realizes adaptive adjustment of the light environment through precise ambient light analysis, ensuring that the Mini LED backlight can provide clear and comfortable visual effects under any lighting conditions. Secondly, combined with the user's position, action, biometrics and sound characteristics, the present invention provides each user with a personalized viewing experience, greatly improving the user's satisfaction and interactivity. In addition, the application of the coupled backlight brightness model enables the initial backlight brightness of the MiniLED to be dynamically adjusted according to the ambient light and user status, which not only improves the viewing comfort, but also significantly improves energy efficiency and reduces unnecessary energy consumption. The introduction of the content adaptive dimming algorithm further optimizes the display effect, so that both static images and dynamic videos can show higher contrast and detail levels. The implementation of the present invention also extends the service life of the device. By intelligently adjusting the backlight, the damage to the Mini LED caused by long-term high brightness is reduced. At the same time, this intelligent backlight control also brings users a more immersive viewing experience, especially in the performance of dark scenes and high dynamic range content, the Mini LED display device can show deeper black and brighter white. Therefore, the present invention can improve the stability of the network. BRIEF DESCRIPTION OF THE DRAWINGS

[0089] Figure 1 A schematic diagram of a flow chart of a Mini LED dynamic backlight module control method provided by an embodiment of the present invention;

[0090] Figure 2 A functional module diagram of a Mini LED dynamic backlight module control system provided by an embodiment of the present invention;

[0091] Figure 3 A schematic diagram of the structure of an electronic device of a Mini LED dynamic backlight module control system provided by an embodiment of the present invention;

[0092] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments. DETAILED DESCRIPTION

[0093] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0094] The embodiment of the present application provides a Mini LED dynamic backlight module control method. The execution subject of the Mini LED dynamic backlight module control method includes but is not limited to at least one of the electronic devices such as a server and a terminal that can be configured to execute the method provided by the embodiment of the present application. In other words, the Mini LED dynamic backlight module control method can be executed by software or hardware installed in a terminal device or a server device. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc.

[0095] Embodiment 1:

[0096] Reference Figure 1 FIG. 1 is a flow chart of a method for controlling a Mini LED dynamic backlight module according to an embodiment of the present invention. In this embodiment, the method for controlling a Mini LED dynamic backlight module includes:

[0097] S1. Determine an application scenario of a Mini LED dynamic backlight control system, perform a self-test on the Mini LED dynamic backlight control system under the application scenario to obtain self-test data, analyze component states of the Mini LED dynamic backlight control system based on the self-test data, and when the component state meets a preset component state threshold, use the sensor component in the Mini LED dynamic backlight control system to collect ambient light data and viewing user data of the application scenario.

[0098] The Mini LED dynamic backlight control system refers to a system that uses Mini LED technology to achieve local dimming. It controls the brightness of a large number of tiny LED lamp beads to achieve precise control of light in different areas of the screen, thereby optimizing the display effect. The application scenario refers to the place where the Mini LED dynamic backlight control system is actually used, including but not limited to high-end TVs, professional monitors, laptops, tablets, car displays, VR / AR devices and other scenarios.

[0099] The present invention performs self-test on the Mini LED dynamic backlight control system in the application scenario, and obtains self-test data, which can timely discover possible problems in the system through self-test, such as LED lamp bead damage, control circuit failure, communication problems and other abnormalities. The self-test data refers to a series of information collected by the self-diagnosis program of the device or system, including status information, performance indicators, fault codes, test results, configuration information, log records and diagnostic reports.

[0100] Based on the self-test data, the component status of the Mini LED dynamic backlight control system is analyzed to ensure its reliability and performance.

[0101] In detail, the analyzing the component status of the Mini LED dynamic backlight control system based on the self-test data includes:

[0102] Extracting brightness data, temperature data, communication data, hardware data and software data from the self-test data;

[0103] Determining a brightness range of the brightness data according to the brightness data;

[0104] Analyzing the component temperature anomaly of the Mini LED dynamic backlight control system through the temperature data and the preset temperature safety threshold;

[0105] According to the communication data, marking a communication error of the Mini LED dynamic backlight control system;

[0106] Based on the hardware data, analyzing the hardware driving coefficient of the Mini LED dynamic backlight control system;

[0107] Analyzing the hardware driving state of the Mini LED dynamic backlight control system according to the hardware driving coefficient;

[0108] Analyzing the software operation compatibility coefficient of the Mini LED dynamic backlight control system through the software data;

[0109] Based on the software operation compatibility coefficient, define the software state of the Mini LED dynamic backlight control system;

[0110] In combination with the brightness range, the component temperature abnormality, the communication error, the hardware driver status and the software status, the component status of the Mini LED dynamic backlight control system is determined.

[0111] Among them, the brightness data refers to the brightness level information collected from each Mini LED lamp bead in the Mini LED dynamic backlight control system, the temperature data refers to the temperature readings of each key component in the system (such as LED lamp beads, control boards, drive circuits, etc.), the communication data refers to the status information of the communication link between the control system and each Mini LED lamp bead, including the success rate, delay, error rate, etc. of data transmission, the hardware data refers to detailed information on the functions and performance of the system hardware components (such as LED lamp beads, drive circuits, control boards, etc.), the software data refers to the operating status information of the control system software, including version number, configuration settings, log files, error reports, etc., the brightness range refers to the interval between the maximum and minimum values ​​allowed by the brightness data, the component temperature anomaly refers to the situation where the actual temperature of the component exceeds the preset temperature safety threshold, and the communication error refers to the situation where the actual temperature of the component exceeds the preset temperature safety threshold in the Mini In the LED dynamic backlight control system, any error that occurs during data transmission, the hardware drive coefficient refers to the parameters used to measure the performance of the hardware drive circuit, such as efficiency, stability, response time, etc., the hardware drive status refers to the working status of the hardware drive circuit obtained by analyzing the hardware drive coefficient, including whether it is working normally, whether there is performance degradation, etc., the software operation compatibility coefficient refers to an indicator for measuring the compatibility of software with hardware and other software components, the software status refers to the overall situation of software operation obtained according to the software operation compatibility coefficient, including whether it is running normally, whether there are compatibility issues, etc., the component status refers to the comprehensive evaluation results of each component in the Mini LED dynamic backlight control system based on the brightness range, component temperature abnormalities, communication errors, hardware drive status and software status.

[0112] Furthermore, analyzing the software operation compatibility coefficient of the Mini LED dynamic backlight control system through the software data includes:

[0113] Defining software operation influencing factors of the Mini LED dynamic backlight control system;

[0114] Determining the dynamic weight of the software operation influencing factor;

[0115] Extracting operation influencing factor characteristics of the software data;

[0116] Establishing a multi-layer perceptron model of adjustment factors of the software operation influencing factors;

[0117] Based on the adjustment factor multilayer perceptron model and the operation impact factor characteristics, the impact factor score of the software operation impact factor is calculated using the following formula:

[0118] ;

[0119] in, represents the impact factor score, Indicates The original score of the software operation impact factor, Indicates the characteristics of the operating impact factor, represents the adjustment factor, represents the Sigmoid function, represents the adjustment factor multilayer perceptron model, Represents the model parameters of the adjustment factor multilayer perceptron model;

[0120] Based on the impact factor score and the dynamic weight, the software operation compatibility coefficient of the Mini LED dynamic backlight control system is calculated using the following formula:

[0121] ;

[0122] in, Indicates the software compatibility coefficient of Mini LED dynamic backlight control system. MiniLED dynamic backlight control system Software operation impact factors The dynamic weight of the moment, Represents the impact factor score.

[0123] Among them, the software operation influencing factor refers to various factors that can affect the performance and efficiency of the Mini LED dynamic backlight control system software, the dynamic weight refers to the importance coefficient of the influencing factor dynamically adjusted according to the current system status, user behavior or other relevant factors, the operation influencing factor feature is a related attribute extracted from the software operation data, which is used to describe the state of the influencing factor, the adjustment factor multilayer perceptron model is a machine learning model based on a multilayer perceptron (MLP), which is used to predict the adjustment coefficient of the influencing factor, the original score refers to the preliminary evaluation of each software operation influencing factor, the influencing factor score refers to the score processed by the adjustment factor multilayer perceptron model, the Sigmoid function refers to a commonly used activation function, which is used to map the input value to an interval between 0 and 1, and the software operation compatibility coefficient refers to a comprehensive indicator that combines the scores of all influencing factors and their dynamic weights to evaluate the overall operation compatibility of the Mini LED dynamic backlight control system software.

[0124] Furthermore, the determining of the dynamic weight of the software operation influencing factor includes:

[0125] Define the fixed weight coefficients of the software operation influencing factors and Activation function;

[0126] According to the Activation function, establishing a multi-layer perceptron model with adjusted weights of the software operation influencing factors;

[0127] Based on the fixed weight coefficient, the The activation function and the weight-adjusted multi-layer perceptron model use the following formula to calculate the dynamic weight of the software operation influencing factor:

[0128] ;

[0129] in, Mini LED dynamic backlight control system Software operation impact factors The dynamic weight of the moment, represents the normalization function, Mini LED dynamic backlight control system The fixed weight coefficient of the software operation influencing factor, express Activation function, Represents the weight adjustment multilayer perceptron model, Indicates the characteristics of the operating impact factor, Indicates time, Represents the parameters of the multilayer perceptron model for adjusting weights.

[0130] The fixed weight coefficient refers to the weight value pre-set for each software operation influencing factor. The activation function refers to a function in a neural network, which is used to introduce nonlinear factors into neurons. The weight adjustment multilayer perceptron model is based on a multilayer perceptron (MLP) model, which is used to dynamically adjust the weight of each software operation influencing factor. The normalization function refers to a mathematical function used to map data to a specific range, usually [0, 1].

[0131] In the present invention, when the component state meets the preset component state threshold, the ambient light data and viewing user data of the application scene collected by the sensor component in the Mini LED dynamic backlight control system can be used as the basis for the later initial backlight parameter setting. Among them, the component state threshold refers to the parameter for judging whether the component state meets the standard state, the sensor component refers to the hardware device integrated in the Mini LED dynamic backlight control system, which is used to detect and collect relevant information of the external environment or the user, the ambient light data refers to the information about the light conditions in the application scene collected by the ambient light sensor, including the light environment, spectral distribution and light direction, and the viewing user data refers to the information about the user's viewing behavior and state collected by the sensor component.

[0132] S2, analyzing the light environment of the application scene according to the ambient light data, analyzing the position characteristics, action characteristics, biological characteristics and sound characteristics of the viewing user corresponding to the application scene based on the viewing user data, and constructing the ambient light-backlight brightness model and the user state-backlight brightness model of the viewing user according to the historical ambient light data and historical viewing user data of the application scene;

[0133] The present invention can effectively analyze the light environment of the application scene according to the ambient light data and adjust the display settings accordingly to provide the best viewing experience.

[0134] In detail, analyzing the light environment of the application scenario according to the ambient light data includes:

[0135] Preprocessing the ambient light data to obtain preprocessed ambient light data;

[0136] Extracting static ambient light data and dynamic ambient light data from the preprocessed ambient light data;

[0137] Analyzing the light intensity value of the application scenario based on the static ambient light data;

[0138] Defining a static light environment of the application scenario according to the light intensity value;

[0139] Analyzing changes in ambient light in the application scenario through the dynamic ambient light data;

[0140] Based on the ambient light changes, determining the dynamic light environment of the application scenario;

[0141] The static light environment and the dynamic light environment are combined to define the light environment of the application scenario.

[0142] Among them, the pre-processed ambient light data refers to the ambient light data after a series of data cleaning and conversion steps, the static ambient light data refers to the average value or fixed value of the ambient light intensity collected within a certain time interval, the dynamic ambient light data refers to the data of the ambient light intensity changing with time, which reflects the changing trend of the lighting conditions, such as the increase and decrease speed and frequency of the light, the light intensity value refers to the ambient light intensity at a specific moment measured by the ambient light sensor, the static light environment refers to the lighting state of the application scene defined according to the light intensity value, which is a static concept, the ambient light change refers to the change of the lighting conditions over time reflected in the dynamic ambient light data, including the increase and decrease of light intensity, the fluctuation frequency and the change speed, etc., the dynamic light environment refers to the overall situation of the lighting conditions changing over time in the application scene, which takes into account the dynamic changes of light, such as "the light gradually dims", "the light changes rapidly", etc., the light environment refers to a comprehensive concept, which combines the static light environment and the dynamic light environment, and provides a comprehensive description for characterizing the lighting conditions in the application scene, including the intensity, stability, and change trend of the light.

[0143] Optionally, the present invention analyzes the location characteristics, action characteristics, biological characteristics and sound characteristics of the viewing user corresponding to the application scenario based on the viewing user data to better understand the behavior and needs of the viewing user, thereby providing a more intelligent and personalized display service.

[0144] In detail, the analyzing, based on the viewing user data, the location characteristics, action characteristics, biological characteristics, and sound characteristics of the viewing user corresponding to the application scenario includes:

[0145] dividing the viewing user data into user location data, user action data, user biological data and user voice data;

[0146] Defining continuous frame position changes of the viewing user according to the user position data;

[0147] Establishing a position heat map of the viewing user through the continuous frame position changes;

[0148] Based on the location heat map, determining the location characteristics of the viewing user;

[0149] According to the user action data, marking the action type of the viewing user, and calculating the action frequency and action duration of the action type;

[0150] Determining the action characteristics of the viewing user through the action type, action frequency and action duration;

[0151] extracting facial expressions of the viewing user based on the user biological data;

[0152] Determining the emotional state of the viewing user through the facial expression;

[0153] Based on the emotional state, determining a biometric characteristic of the viewing user;

[0154] Extracting the voice text and voice status of the viewing user according to the user voice data;

[0155] Based on the voice text and the sound state, the voice characteristics of the viewing user are defined.

[0156] Among them, the user location data refers to the user's location information in space collected by sensors or cameras, usually including two-dimensional or three-dimensional coordinates, the user action data refers to the user action information collected by sensors or image processing technology, such as gestures, body movements and other data, the user biometric data refers to the user's physiological or biometric information collected by biometric recognition technology, such as facial features, fingerprints, irises and other information, the user voice data refers to the user's voice information collected by a microphone, including the pitch, volume, rhythm and content of the voice, the continuous frame position change refers to the position change of the user in continuous video frames within a certain time interval, the location heat map refers to a data visualization tool for displaying the distribution of the frequency of users appearing in a specific area, the location feature refers to the feature of the user's location information extracted from the location heat map, such as the resident area, moving path, etc., the action type refers to the specific action category identified by analyzing the user action data, such as walking, Sit down, raise your hand, etc.; the action type and action frequency refer to the number of times a specific action type occurs within a certain period of time; the action duration refers to the length of time a user performs a specific action; the action feature refers to the feature extracted from the user's action data, including features such as action type, frequency and duration; the facial expression refers to the expression identified by analyzing the user's facial muscle activity through image processing technology, such as happiness, sadness, surprise, etc.; the emotional state refers to the emotional state inferred from the user's facial expression, such as happiness, anger, calmness, etc.; the biometric feature refers to the feature extracted from the user's biometric data, such as facial features, emotional state, etc.; the voice text refers to the text form of the voice data of the user confirmed by facial recognition technology through voice recognition technology; the voice state refers to the non-language features in the user's voice data, such as pitch, volume, speaking speed, etc.; the voice feature refers to the feature extracted from the user's voice data, including voice text content and voice state.

[0157] Optionally, the definition of the continuous frame position change of the viewing user based on the user position data can be established by identifying and locating the user in each frame through a target detection algorithm (such as YOLO, SSD, Faster R-CNN, etc.).

[0158] Optionally, the location heat map of the viewing user established through the continuous frame position changes may be created using data aggregation technology (such as density estimation, clustering, etc.).

[0159] Optionally, extracting the facial expression of the viewing user based on the user biometric data may be performed by using facial recognition technology.

[0160] Optionally, the present invention constructs the ambient light-backlight brightness model and the user state-backlight brightness model of the viewing user according to the historical ambient light data and the historical viewing user data of the application scenario, and can construct a model that can intelligently adjust the backlight brightness according to the ambient light and the user state, thereby improving the viewing experience and saving energy. Among them, the ambient light-backlight brightness model refers to a model that takes the ambient light data as input and outputs the corresponding backlight brightness setting. The purpose of the ambient light-backlight brightness model is to ensure that the brightness of the screen can maintain the best visual effect under different ambient lighting conditions. The user state-backlight brightness model refers to a model that takes the user's state data (such as position, action, biometrics, etc.) as input and outputs the corresponding backlight brightness setting. The purpose of the user state-backlight brightness model is to personalize the screen brightness according to the user's actual viewing conditions and preferences.

[0161] S3. Couple the ambient light-backlight brightness model and the user state-backlight brightness model to obtain a coupled backlight brightness model, and define the initial backlight brightness of the Mini LED corresponding to the Mini LED of the Mini LED dynamic backlight control system using the coupled backlight brightness model according to the light environment, the position characteristics, the action characteristics, the biological characteristics and the sound characteristics.

[0162] The present invention couples the ambient light-backlight brightness model and the user status-backlight brightness model to obtain a coupled backlight brightness model, which can realize a coupled backlight brightness model that can simultaneously consider ambient light conditions and user status to provide more intelligent and personalized backlight control.

[0163] In detail, coupling the ambient light-backlight brightness model and the user state-backlight brightness model to obtain a coupled backlight brightness model includes:

[0164] Determining a coupling strategy of the ambient light-backlight brightness model and the user state-backlight brightness model;

[0165] According to the coupling strategy, defining a shared representation layer of the ambient light-backlight brightness model and the user state-backlight brightness model;

[0166] Based on the shared representation layer, defining a coupled model architecture of the ambient light-backlight brightness model and the user state-backlight brightness model, wherein the coupled model architecture includes an ambient light sub-network, a user state sub-network and an output layer;

[0167] Training the environment photon network and the user state sub-network to obtain a training environment photon network and a training user state sub-network;

[0168] Calculating the environment photon network performance and the user state subnetwork performance of the training environment photon network and the training user state subnetwork;

[0169] When the ambient photon network performance and the user state subnetwork performance simultaneously meet the preset ambient photon network performance threshold and the user state subnetwork performance threshold, a coupled backlight brightness model of the ambient light-backlight brightness model and the user state-backlight brightness model is established based on the trained ambient photon network, the trained user state subnetwork, the shared representation layer and the output layer.

[0170] Among them, the coupling strategy refers to a method for determining how to combine the ambient light-backlight brightness model and the user state-backlight brightness model, the shared representation layer refers to one or more layers in the neural network, which are used by the ambient light sub-network and the user state sub-network at the same time to learn the common features of ambient light and user state data, the ambient light sub-network refers to a part in the coupling model, which is specifically used to process ambient light data and learn the relationship between ambient light and backlight brightness, the user state sub-network refers to another part in the coupling model, which processes user state data and learns the relationship between user state and backlight brightness, the output layer refers to the last layer of the coupling model, which receives features from the ambient light sub-network and the user state sub-network, and outputs the final backlight brightness prediction, the trained ambient light sub-network refers to an ambient light sub-network whose weights have been adjusted after the training process, and the training The trained user state subnetwork refers to a user state subnetwork whose weights have been adjusted after the training process. The ambient photon network performance refers to the performance of the trained ambient photon network in predicting backlight brightness. The user state subnetwork performance refers to the performance of the trained user state subnetwork in predicting backlight brightness. The ambient photon network performance threshold refers to a pre-set performance standard. The performance of the ambient photon network must meet or exceed this standard to be considered acceptable. The user state subnetwork performance threshold refers to another pre-set performance standard. The performance of the user state subnetwork must meet or exceed this standard to be considered acceptable. The coupled backlight brightness model refers to integrating the trained ambient photon network, user state subnetwork, shared representation layer and output layer to form a comprehensive model that can simultaneously consider ambient light and user state data to predict backlight brightness.

[0171] Optionally, the environment photon network and the user state sub-network are trained to obtain a training environment photon network and a training user state sub-network which can be trained by a loss function, typically a combination of two task losses (eg, weighted average).

[0172] The present invention defines the initial backlight brightness of the Mini LED corresponding to the Mini LED in the Mini LED dynamic backlight control system by using the coupled backlight brightness model according to the light environment, the position characteristics, the action characteristics, the biological characteristics and the sound characteristics, so as to ensure that the backlight brightness satisfies both viewing comfort and energy saving requirements. The initial backlight brightness refers to the backlight brightness value calculated by the system through the coupled backlight brightness model according to the current environmental conditions and user status in the Mini LED dynamic backlight control system before further dynamic adjustment.

[0173] S4. Receive the display content signal of the Mini LED, extract the display elements and display element features of the display content signal, and analyze the display content and display content type of the display content signal according to the display elements and the display element features.

[0174] It should be explained that the display content signal refers to an electronic signal sent from a content source (such as a computer, TV box, game console, mobile device, etc.) to a display device (such as a Mini LED screen).

[0175] The present invention extracts the display elements and display element features of the display content signal, which can effectively extract the display elements and display element features of the display content signal, and performs intelligent backlight control based on the information to provide a better viewing experience.

[0176] In detail, the extracting the display elements and display element features of the display content signal includes:

[0177] Decomposing the display content signal into frame images;

[0178] Performing pixel analysis on the frame image to obtain a pixel analysis result;

[0179] Marking display elements of the display content signal according to the pixel analysis result;

[0180] Extracting initial display element features of the display element, wherein the initial display element features include element color features, element texture features, element shape features, and element space features;

[0181] Establishing a feature pyramid network of the display element;

[0182] Based on the feature pyramid network, the element color features, element texture features, element shape features and element space features are fused to obtain display element features of the display content signal.

[0183] Among them, the frame image refers to a single image frame extracted from a display content signal, the pixel analysis result, the display element refers to the result of a series of analyses on each pixel in the frame image, which may include information such as pixel brightness, color, saturation, etc., the display element refers to a specific content unit marked and identified in the frame image, such as text, image, graphic, video object and other elements, the element color feature refers to the color attribute of the display element, including color distribution, main color, color contrast and other features, the element texture feature refers to the texture attribute of the display element, such as roughness, directionality, contrast and other features, the element shape feature refers to the geometric shape of the display element, including contour, size, angle and other features, the element spatial feature refers to the spatial position and arrangement of the display element in the image, including the relative position, direction and distance relationship between elements, the feature pyramid network refers to a neural network architecture that can extract and fuse features at different scales, and the display element feature refers to the comprehensive feature representation after fusion through the feature pyramid network, which combines color, texture, shape and spatial features to provide a comprehensive description for the display element.

[0184] Optionally, the feature pyramid network for establishing the display element may be constructed through multi-layer convolution and pooling operations of a convolutional neural network.

[0185] It should be explained that the display content refers to the visual information presented on a display device (such as a liquid crystal display, an organic light-emitting diode display, a plasma display, etc.), and the display content type refers to the classification or type of the display content, which is usually defined based on the characteristics, purpose or form of expression of the content, such as videos, animations, movies, TV programs, charts, maps and other categories.

[0186] S5. Define a content adaptive dimming algorithm for the display content, analyze the dimming parameters of the Mini LED using the content adaptive dimming algorithm according to the display content type, send the dimming parameters to the Mini LED driving circuit in the Mini LED dynamic backlight control system, and perform dynamic backlight control of the Mini LED through the Mini LED driving circuit.

[0187] It should be explained that the content adaptive dimming algorithm refers to an optimization technology that can dynamically adjust the dimming parameters of the Mini LED display according to the characteristics of the displayed content (such as brightness, contrast, etc.). The core of the algorithm is to analyze and adapt to changes in the displayed content in real time.

[0188] The present invention analyzes the dimming parameters of the Mini LED using the content adaptive dimming algorithm according to the display content type, and can dynamically adjust the dimming parameters of the Mini LED according to different display content types to provide the best viewing experience.

[0189] In detail, analyzing the dimming parameters of the Mini LED using the content adaptive dimming algorithm according to the display content type includes:

[0190] Determine, according to the display content type, a dimming parameter reference value, content average brightness, content contrast, reference brightness, and reference contrast of the Mini LED;

[0191] The dimming parameters of the Mini LED are analyzed by using the dimming parameter reference value, content average brightness, content contrast, reference brightness and reference contrast ratio using a content adaptive dimming algorithm, wherein the content adaptive dimming algorithm:

[0192] ;

[0193] in, Indicates dimming parameters, Indicates the average brightness of the content. Indicates the reference brightness, Indicates the benchmark for this degree, Content contrast, represents the adjustment coefficient function, Indicates the dimming parameter reference value, Indicates the current dimming parameters.

[0194] Among them, the dimming parameter reference value, the content average brightness refers to the average brightness value of the displayed content, the content contrast refers to the contrast value of the displayed content, the reference brightness refers to the brightness reference value preset for a specific content type, the reference contrast refers to the contrast reference value preset for a specific content type, the dimming parameter refers to the parameter used to control the Mini LED backlight, which may include the brightness level, the size of the local dimming area, the brightness curve, etc., the adjustment coefficient function refers to the calculation of the adjustment coefficient based on the comparison results of the average brightness and contrast of the content with the reference brightness and reference contrast, and the current dimming parameter is the dimming parameter value currently applied to the Mini LED display.

[0195] Finally, the present invention sends the dimming parameters to the MiniLED driving circuit in the MiniLED dynamic backlight control system, and executes the dynamic backlight control of the MiniLED through the MiniLED driving circuit to achieve precise control of the MiniLED.

[0196] Compared with the problems described in the background technology, firstly, the present invention realizes adaptive adjustment of the light environment through precise ambient light analysis, ensuring that the Mini LED backlight can provide clear and comfortable visual effects under any lighting conditions. Secondly, combined with the user's position, action, biometrics and sound characteristics, the present invention provides each user with a personalized viewing experience, greatly improving the user's satisfaction and interactivity. In addition, the application of the coupled backlight brightness model enables the initial backlight brightness of the MiniLED to be dynamically adjusted according to the ambient light and user status, which not only improves the viewing comfort, but also significantly improves energy efficiency and reduces unnecessary energy consumption. The introduction of the content adaptive dimming algorithm further optimizes the display effect, so that both static images and dynamic videos can show higher contrast and detail levels. The implementation of the present invention also extends the service life of the device. By intelligently adjusting the backlight, the damage to the Mini LED caused by long-term high brightness is reduced. At the same time, this intelligent backlight control also brings users a more immersive viewing experience, especially in the performance of dark scenes and high dynamic range content, the Mini LED display device can show deeper black and brighter white. Therefore, the present invention can improve the stability of the network.

[0197] Embodiment 2:

[0198] like Figure 2 , is a functional module diagram of a Mini LED dynamic backlight module control system provided by an embodiment of the present invention.

[0199] The Mini LED dynamic backlight module control system 200 of the present invention can be installed in an electronic device. According to the functions to be implemented, the Mini LED dynamic backlight module control system 200 may include a component state analysis module 201, a brightness model construction module 202, an initial backlight brightness setting module 203, a display content analysis module 204 and a dynamic backlight control module 205. The module of the present invention can also be referred to as a unit, which refers to a series of computer program segments that can be executed by an electronic device processor and can complete fixed functions, which are stored in the memory of the electronic device.

[0200] In this embodiment, the functions of each module / unit are as follows:

[0201] The component status analysis module 201 is used to determine the application scenario of the Mini LED dynamic backlight control system, perform self-test on the Mini LED dynamic backlight control system in the application scenario, obtain self-test data, analyze the component status of the Mini LED dynamic backlight control system based on the self-test data, and when the component status meets the preset component status threshold, use the sensor component in the Mini LED dynamic backlight control system to collect the ambient light data and viewing user data of the application scenario;

[0202] The brightness model building module 202 is used to analyze the light environment of the application scene according to the ambient light data, analyze the position characteristics, action characteristics, biological characteristics and sound characteristics of the viewing user corresponding to the application scene based on the viewing user data, and build the ambient light-backlight brightness model and user state-backlight brightness model of the viewing user according to the historical ambient light data and historical viewing user data of the application scene;

[0203] The initial backlight brightness setting module 203 is used to couple the ambient light-backlight brightness model and the user state-backlight brightness model to obtain a coupled backlight brightness model, and define the initial backlight brightness of the Mini LED corresponding to the Mini LED of the Mini LED dynamic backlight control system using the coupled backlight brightness model according to the light environment, the position feature, the action feature, the biological feature and the sound feature;

[0204] The display content analysis module 204 is used to receive the display content signal of the Mini LED, extract the display elements and display element features of the display content signal, and analyze the display content and the display content type of the display content signal according to the display elements and the display element features;

[0205] The dynamic backlight control module 205 is used to define a content adaptive dimming algorithm for the display content, analyze the dimming parameters of the Mini LED using the content adaptive dimming algorithm according to the display content type, send the dimming parameters to the Mini LED driving circuit in the Mini LED dynamic backlight control system, and perform dynamic backlight control of the Mini LED through the Mini LED driving circuit.

[0206] In detail, each module described in the Mini LED dynamic backlight module control system 200 described in the embodiment of the present invention adopts the same technical means as the Mini LED dynamic backlight module control method described in the accompanying drawings when in use, and can produce the same technical effects, which will not be repeated here.

[0207] An embodiment of the present invention provides an electronic device for implementing a Mini LED dynamic backlight module control method.

[0208] See also Figure 3 As shown, the electronic device may include a processor 30, a memory 31, a communication bus 32 and a communication interface 33, and may also include a computer program stored in the memory 31 and executable on the processor 30, such as a Mini LED dynamic backlight module control method program.

[0209] In some embodiments, the processor may be composed of an integrated circuit, for example, a single packaged integrated circuit, or a plurality of integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and a combination of various control chips. The processor is the control core (Control Unit) of the electronic device, and uses various interfaces and lines to connect the various components of the entire electronic device, and executes or executes the program or module stored in the memory (for example, executes the Mini LED dynamic backlight module control program, etc.), and calls the data stored in the memory to execute various functions of the electronic device and process data.

[0210] The memory includes at least one type of readable storage medium, and the readable storage medium includes flash memory, mobile hard disk, multimedia card, card-type memory (for example: SD or DX memory, etc.), magnetic memory, disk, optical disk, etc. In some embodiments, the memory may be an internal storage unit of an electronic device, such as a mobile hard disk of the electronic device. In other embodiments, the memory may also be an external storage device of an electronic device, such as a plug-in mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device. Furthermore, the memory may also include both an internal storage unit and an external storage device of the electronic device. The memory can not only be used to store application software and various types of data installed in the electronic device, such as code based on the Mini LED dynamic backlight module control program, but also can be used to temporarily store data that has been output or is to be output.

[0211] The communication bus may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. The bus is configured to realize connection and communication between the memory and at least one processor, etc.

[0212] The communication interface is used for communication between the above-mentioned electronic device and other devices, including a network interface and a user interface. Optionally, the network interface may include a wired interface and / or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), which is generally used to establish a communication connection between the electronic device and other electronic devices. The user interface may be a display (Display), an input unit (such as a keyboard (Keyboard)), and optionally, the user interface may also be a standard wired interface, a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, and an OLED (Organic Light-Emitting Diode, organic light-emitting diode) touch device, etc. Among them, the display may also be appropriately referred to as a display screen or a display unit, which is used to display information processed in the electronic device and to display a visual user interface.

[0213] For example, although not shown, the electronic device may also include a power source (such as a battery) for supplying power to various components. Preferably, the power source may be logically connected to the at least one processor through a power management system, so that the power management system can realize functions such as charging management, discharging management, and power consumption management. The power source may also include any components such as one or more DC or AC power sources, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators. The electronic device may also include a variety of sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.

[0214] It should be understood that the embodiment is for illustration only and the scope of the patent application is not limited to this structure.

[0215] The Mini LED dynamic backlight module control program stored in the memory of the electronic device is a combination of multiple instructions. When running in the processor, it can achieve:

[0216] Determine an application scenario of a Mini LED dynamic backlight control system, perform a self-test on the Mini LED dynamic backlight control system in the application scenario to obtain self-test data, analyze component states of the Mini LED dynamic backlight control system based on the self-test data, and when the component states meet a preset component state threshold, use a sensor component in the Mini LED dynamic backlight control system to collect ambient light data and viewing user data of the application scenario;

[0217] Analyze the light environment of the application scene according to the ambient light data, analyze the position characteristics, action characteristics, biological characteristics and sound characteristics of the viewing user corresponding to the application scene based on the viewing user data, and construct the ambient light-backlight brightness model and user state-backlight brightness model of the viewing user according to the historical ambient light data and historical viewing user data of the application scene;

[0218] The ambient light-backlight brightness model and the user state-backlight brightness model are coupled to obtain a coupled backlight brightness model, and according to the light environment, the position feature, the action feature, the biological feature, and the sound feature, the coupled backlight brightness model is used to define the initial backlight brightness of the Mini LED corresponding to the Mini LED of the Mini LED dynamic backlight control system;

[0219] receiving a display content signal of the Mini LED, extracting display elements and display element features of the display content signal, and analyzing display content and display content type of the display content signal according to the display elements and the display element features;

[0220] Define a content adaptive dimming algorithm for the display content, analyze the dimming parameters of the Mini LED using the content adaptive dimming algorithm according to the display content type, send the dimming parameters to the Mini LED drive circuit in the Mini LED dynamic backlight control system, and perform dynamic backlight control of the Mini LED through the Mini LED drive circuit.

[0221] Specifically, the specific implementation method of the processor for the above instructions can refer to the description of the relevant steps in the corresponding embodiment of the accompanying drawings, which will not be repeated here.

[0222] Furthermore, if the module / unit integrated in the electronic device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. The computer-readable storage medium can be volatile or non-volatile. For example, the computer-readable medium can include: any entity or system that can carry the computer program code, a recording medium, a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, and a read-only memory (ROM).

[0223] The present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor of an electronic device, the computer program can implement:

[0224] Determine an application scenario of a Mini LED dynamic backlight control system, perform a self-test on the Mini LED dynamic backlight control system in the application scenario to obtain self-test data, analyze component states of the Mini LED dynamic backlight control system based on the self-test data, and when the component states meet a preset component state threshold, use a sensor component in the Mini LED dynamic backlight control system to collect ambient light data and viewing user data of the application scenario;

[0225] Analyze the light environment of the application scene according to the ambient light data, analyze the position characteristics, action characteristics, biological characteristics and sound characteristics of the viewing user corresponding to the application scene based on the viewing user data, and construct the ambient light-backlight brightness model and user state-backlight brightness model of the viewing user according to the historical ambient light data and historical viewing user data of the application scene;

[0226] The ambient light-backlight brightness model and the user state-backlight brightness model are coupled to obtain a coupled backlight brightness model, and according to the light environment, the position feature, the action feature, the biological feature, and the sound feature, the coupled backlight brightness model is used to define the initial backlight brightness of the Mini LED corresponding to the Mini LED of the Mini LED dynamic backlight control system;

[0227] receiving a display content signal of the Mini LED, extracting display elements and display element features of the display content signal, and analyzing display content and display content type of the display content signal according to the display elements and the display element features;

[0228] Define a content adaptive dimming algorithm for the display content, analyze the dimming parameters of the Mini LED using the content adaptive dimming algorithm according to the display content type, send the dimming parameters to the Mini LED drive circuit in the Mini LED dynamic backlight control system, and perform dynamic backlight control of the Mini LED through the Mini LED drive circuit.

[0229] In the several embodiments provided by the present invention, it should be understood that the disclosed devices, systems and methods can be implemented in other ways. For example, the system embodiments described above are only schematic, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation.

[0230] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0231] In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional modules.

[0232] It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0233] Therefore, no matter from which point of view, the embodiments should be regarded as illustrative and non-restrictive, and the scope of the present invention is limited by the appended claims rather than the above description, so it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present invention. Any attached figure mark in the claims should not be regarded as limiting the claims involved.

[0234] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0235] In addition, it is clear that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or systems stated in a system claim can also be implemented by one unit or system through software or hardware. The words first, second, etc. are used to indicate names, and do not indicate any particular order.

Claims

1. A Mini LED dynamic backlight module control method, characterized in that: The method comprises: Determine an application scenario of a Mini LED dynamic backlight control system, perform a self-test on the Mini LED dynamic backlight control system in the application scenario, obtain self-test data, analyze the component status of the Mini LED dynamic backlight control system based on the self-test data, and when the component status meets a preset component status threshold, use the sensor component in the Mini LED dynamic backlight control system to collect ambient light data and viewing user data of the application scenario, wherein the component status of the Mini LED dynamic backlight control system based on the self-test data includes: extracting brightness data, temperature data, communication data, hardware data and software data in the self-test data, determining the brightness range of the brightness data according to the brightness data, analyzing the component temperature abnormality of the Mini LED dynamic backlight control system through the temperature data and a preset temperature safety threshold, marking the communication error of the Mini LED dynamic backlight control system according to the communication data, analyzing the hardware driving coefficient of the Mini LED dynamic backlight control system based on the hardware data, analyzing the hardware driving status of the Mini LED dynamic backlight control system according to the hardware driving coefficient, and analyzing the Mini a software operation compatibility coefficient of the LED dynamic backlight control system, defining the software state of the Mini LED dynamic backlight control system based on the software operation compatibility coefficient, and determining the component state of the Mini LED dynamic backlight control system in combination with the brightness range, the component temperature abnormality, the communication error, the hardware driver state, and the software state; Analyze the light environment of the application scene according to the ambient light data, analyze the position characteristics, action characteristics, biological characteristics and sound characteristics of the viewing user corresponding to the application scene based on the viewing user data, and construct the ambient light-backlight brightness model and user state-backlight brightness model of the viewing user according to the historical ambient light data and historical viewing user data of the application scene; The ambient light-backlight brightness model and the user state-backlight brightness model are coupled to obtain a coupled backlight brightness model, and according to the light environment, the position feature, the action feature, the biological feature, and the sound feature, the coupled backlight brightness model is used to define the initial backlight brightness of the Mini LED corresponding to the Mini LED of the Mini LED dynamic backlight control system; receiving a display content signal of the Mini LED, extracting display elements and display element features of the display content signal, and analyzing display content and display content type of the display content signal according to the display elements and the display element features; Define a content adaptive dimming algorithm for the display content, analyze the dimming parameters of the Mini LED using the content adaptive dimming algorithm according to the display content type, send the dimming parameters to the Mini LED drive circuit in the Mini LED dynamic backlight control system, and perform dynamic backlight control of the Mini LED through the Mini LED drive circuit.

2. The Mini LED dynamic backlight module control method according to claim 1, characterized in that: The analyzing the software operation compatibility coefficient of the Mini LED dynamic backlight control system through the software data includes: Defining software operation influencing factors of the Mini LED dynamic backlight control system; Determining the dynamic weight of the software operation influencing factor; Extracting operation influencing factor characteristics of the software data; Establishing a multi-layer perceptron model of adjustment factors of the software operation influencing factors; Based on the adjustment factor multilayer perceptron model and the operation impact factor characteristics, the impact factor score of the software operation impact factor is calculated using the following formula: ； in, represents the impact factor score, Indicates The original score of the software operation impact factor, Indicates the characteristics of the operating impact factor, represents the adjustment factor, represents the Sigmoid function, represents the adjustment factor multilayer perceptron model, Represents the model parameters of the adjustment factor multilayer perceptron model; Based on the impact factor score and the dynamic weight, the software operation compatibility coefficient of the Mini LED dynamic backlight control system is calculated using the following formula: ； in, Indicates the software compatibility coefficient of Mini LED dynamic backlight control system. Mini LED dynamic backlight control system Software operation impact factors The dynamic weight of the moment, Represents the impact factor score.

3. The Mini LED dynamic backlight module control method according to claim 2, characterized in that: Determining the dynamic weight of the software operation influencing factor includes: Define the fixed weight coefficients of the software operation influencing factors and Activation function; According to the Activation function, establishing a multi-layer perceptron model with adjusted weights of factors affecting the operation of the software; Based on the fixed weight coefficient, the The activation function and the weight-adjusted multi-layer perceptron model use the following formula to calculate the dynamic weight of the software operation influencing factor: ； in, Mini LED dynamic backlight control system Software operation impact factors The dynamic weight of the moment, represents the normalization function, Mini LED dynamic backlight control system The fixed weight coefficient of the software operation influencing factor, express Activation function, Represents the weight adjustment multilayer perceptron model, Indicates the characteristics of the operating impact factor, Indicates time, Represents the parameters of the multilayer perceptron model for adjusting weights.

4. The Mini LED dynamic backlight module control method according to claim 3, characterized in that: Analyzing the light environment of the application scenario according to the ambient light data includes: Preprocessing the ambient light data to obtain preprocessed ambient light data; Extracting static ambient light data and dynamic ambient light data from the preprocessed ambient light data; Analyzing the light intensity value of the application scenario based on the static ambient light data; Defining a static light environment of the application scenario according to the light intensity value; Analyzing changes in ambient light in the application scenario through the dynamic ambient light data; Based on the ambient light changes, determining the dynamic light environment of the application scenario; The static light environment and the dynamic light environment are combined to define the light environment of the application scenario.

5. The Mini LED dynamic backlight module control method according to claim 4, characterized in that: The analyzing, based on the viewing user data, the location characteristics, action characteristics, biological characteristics, and sound characteristics of the viewing user corresponding to the application scenario includes: dividing the viewing user data into user location data, user action data, user biological data and user voice data; Defining continuous frame position changes of the viewing user according to the user position data; Establishing a position heat map of the viewing user through the continuous frame position changes; Based on the location heat map, determining the location characteristics of the viewing user; According to the user action data, marking the action type of the viewing user, and calculating the action frequency and action duration of the action type; Determining the action characteristics of the viewing user through the action type, action frequency and action duration; extracting facial expressions of the viewing user based on the user biological data; Determining the emotional state of the viewing user through the facial expression; Based on the emotional state, determining a biometric characteristic of the viewing user; Extracting the voice text and voice status of the viewing user according to the user voice data; Based on the voice text and the sound state, the voice characteristics of the viewing user are defined.

6. The Mini LED dynamic backlight module control method according to claim 5, characterized in that: The step of coupling the ambient light-backlight brightness model and the user state-backlight brightness model to obtain a coupled backlight brightness model includes: Determining a coupling strategy of the ambient light-backlight brightness model and the user state-backlight brightness model; According to the coupling strategy, defining a shared representation layer of the ambient light-backlight brightness model and the user state-backlight brightness model; Based on the shared representation layer, defining a coupled model architecture of the ambient light-backlight brightness model and the user state-backlight brightness model, wherein the coupled model architecture includes an ambient light sub-network, a user state sub-network and an output layer; Training the environment photon network and the user state sub-network to obtain a training environment photon network and a training user state sub-network; Calculating the environment photon network performance and the user state subnetwork performance of the training environment photon network and the training user state subnetwork; When the ambient photon network performance and the user state subnetwork performance simultaneously meet the preset ambient photon network performance threshold and the user state subnetwork performance threshold, a coupled backlight brightness model of the ambient light-backlight brightness model and the user state-backlight brightness model is established based on the trained ambient photon network, the trained user state subnetwork, the shared representation layer and the output layer.

7. The Mini LED dynamic backlight module control method according to claim 6, characterized in that: The extracting the display element and the display element feature of the display content signal includes: Decomposing the display content signal into frame images; Performing pixel analysis on the frame image to obtain a pixel analysis result; Marking display elements of the display content signal according to the pixel analysis result; Extracting initial display element features of the display element, wherein the initial display element features include element color features, element texture features, element shape features, and element space features; Establishing a feature pyramid network of the display element; Based on the feature pyramid network, the element color features, element texture features, element shape features and element space features are fused to obtain display element features of the display content signal.

8. The Mini LED dynamic backlight module control method according to claim 7, characterized in that: The analyzing the dimming parameters of the Mini LED using the content adaptive dimming algorithm according to the display content type includes: Determine, according to the display content type, a dimming parameter reference value, content average brightness, content contrast, reference brightness, and reference contrast of the Mini LED; The dimming parameters of the Mini LED are analyzed by using the dimming parameter reference value, content average brightness, content contrast, reference brightness and reference contrast ratio using a content adaptive dimming algorithm, wherein the content adaptive dimming algorithm: ； in, Indicates dimming parameters, Indicates the average brightness of the content. Indicates the reference brightness, Indicates the benchmark for this degree, Content contrast, represents the adjustment coefficient function, Indicates the dimming parameter reference value, Indicates the current dimming parameters.

9. A Mini LED dynamic backlight module control system, characterized in that: Used to execute the Mini LED dynamic backlight module control method according to any one of claims 1 to 8, the system comprising: A component status analysis module is used to determine an application scenario of a Mini LED dynamic backlight control system, perform a self-test on the Mini LED dynamic backlight control system in the application scenario, obtain self-test data, analyze the component status of the Mini LED dynamic backlight control system based on the self-test data, and when the component status meets a preset component status threshold, use the sensor component in the Mini LED dynamic backlight control system to collect ambient light data and viewing user data of the application scenario, wherein the component status of the Mini LED dynamic backlight control system based on the self-test data includes: extracting brightness data, temperature data, communication data, hardware data and software data from the self-test data, determining the brightness range of the brightness data according to the brightness data, analyzing the component temperature abnormality of the Mini LED dynamic backlight control system through the temperature data and a preset temperature safety threshold, marking the communication error of the Mini LED dynamic backlight control system according to the communication data, analyzing the hardware drive coefficient of the Mini LED dynamic backlight control system based on the hardware data, analyzing the hardware drive status of the Mini LED dynamic backlight control system according to the hardware drive coefficient, and analyzing the Mini a software operation compatibility coefficient of the LED dynamic backlight control system, defining the software state of the Mini LED dynamic backlight control system based on the software operation compatibility coefficient, and determining the component state of the Mini LED dynamic backlight control system in combination with the brightness range, the component temperature abnormality, the communication error, the hardware driver state, and the software state; a brightness model building module, configured to analyze the light environment of the application scene according to the ambient light data, analyze the position characteristics, action characteristics, biological characteristics and sound characteristics of the viewing user corresponding to the application scene based on the viewing user data, and build the ambient light-backlight brightness model and the user state-backlight brightness model of the viewing user according to the historical ambient light data and the historical viewing user data of the application scene; An initial backlight brightness setting module, used to couple the ambient light-backlight brightness model and the user state-backlight brightness model to obtain a coupled backlight brightness model, and define the initial backlight brightness of the Mini LED corresponding to the Mini LED of the Mini LED dynamic backlight control system using the coupled backlight brightness model according to the light environment, the position feature, the action feature, the biological feature and the sound feature; A display content analysis module, used to receive the display content signal of the Mini LED, extract the display elements and display element features of the display content signal, and analyze the display content and the display content type of the display content signal according to the display elements and the display element features; A dynamic backlight control module is used to define a content adaptive dimming algorithm for the display content, analyze the dimming parameters of the Mini LED using the content adaptive dimming algorithm according to the display content type, send the dimming parameters to the Mini LED drive circuit in the Mini LED dynamic backlight control system, and perform dynamic backlight control of the Mini LED through the Mini LED drive circuit.

Images