Environment brightness adjusting system and method based on screen content display

Abstract

The invention provides an ambient brightness adjusting system and method based on screen content display. The system comprises a screen display assembly, a content analysis assembly and an equipment control assembly. The method comprises the following steps: realizing visualization of to-be-displayed contents through a main running program; meanwhile, the display content is coded to form a video stream, and the video stream is sent to a video channel; receiving a video stream sent by the video channel, analyzing display content contained in the video stream, and analyzing a hiding instruction contained in the display content; meanwhile, the hidden instruction is transmitted to an instruction center, and the instruction center converts the hidden instruction into an equipment adjusting instruction; and responding to the equipment adjusting instruction through the network connection instruction center, sending a radio frequency signal to the equipment according to the response, and adjusting by the equipment according to the response. The environment brightness is automatically adjusted according to the content displayed on the screen, and the comfort level and the visual effect of user experience are improved; through accurate brightness adjustment, unnecessary energy waste is avoided, and more efficient energy use is realized.

Description

Technical Field

[0001] The present invention relates to the technical field of visualization equipment, and in particular to a system and method for adjusting ambient brightness based on screen content display. Background Art

[0002] With the continuous advancement of visualization technology, the size of televisions and LED screens has gradually increased, enriching their functionality while also providing a superior user experience. Large screens are often used in environments such as conferences and education, presenting diverse content. Because the background brightness of content varies, the user experience would be enhanced if the ambient lighting and other conditions could be automatically adjusted. Even within the same presentation, the content displayed on the screen may vary at different times; some content requires brighter ambient lighting, while others require dimmer lighting. Currently, few systems support automatic adjustment of the ambient lighting based on the content, and existing technologies rely heavily on manual adjustments. For example, turning off some lights while watching a movie and then turning them back on during a PowerPoint presentation results in the large screen's content display system and ambient lighting system being isolated, preventing them from working together to achieve automatic adjustment.

[0003] Prior art 1, application number: CN 202410317477.6 discloses a brightness adjustment method, apparatus, display device, and computer-readable storage medium, which are applied to a display device, including: collecting a reference ambient light increment of the display device through a light sensor; obtaining the current display brightness of the display device when the display device normally outputs a display image; determining the current ambient light increment based on the current display brightness and the reference ambient light increment; collecting the current ambient light intensity through a light sensor, and determining the actual ambient light intensity based on the current ambient light intensity and the current ambient light increment; determining a target dimming parameter based on the actual ambient light intensity and a preset numerical correspondence table, and adjusting the brightness of the display device based on the target dimming parameter. Although the automatic brightness adjustment function of the display device has been optimized to ensure that the brightness change of the screen itself does not affect the automatic brightness adjustment effect, it is impossible to achieve the linkage control of the screen brightness and the ambient light, resulting in the screen brightness being adjusted only by the brightness of the environment, resulting in poor automatic brightness adjustment capability of the screen.

[0004] Prior art 2, application number: CN 202410140340.8, discloses a multi-sensor-based LED display control system and terminal, comprising a sensor module, a control module, and a terminal display module. The sensor module is used to monitor the illumination and color information of the environment surrounding the terminal display module in real time, as well as the posture information of the terminal display module itself. The control module is used to process the illumination intensity information, the color value, and the color temperature information, and send corresponding control instructions to adjust the display position. The terminal display module is used to adjust the displayed content, the brightness of the terminal display module, the display color of the terminal display module, and the position of the displayed content on the terminal display module. Although the display effect is optimized by adjusting the brightness and color, and the position of the displayed content is adjusted using a reference positioning method, a more adaptive, uniform, and color-accurate display effect is provided. However, the screen adjustment method is single and cannot achieve adaptive adjustment with the ambient light, resulting in a low degree of intelligent adjustment.

[0005] Prior art three, application number: CN 202410596862.9 discloses a color gamut control method based on multi-color light, including the following steps: color calibration of LED lights to ensure the consistency of their color output; mapping the colors in the input signal to the color space of the LED through a color mapping algorithm; adjusting the brightness of the LED according to the color mapping result to ensure accurate color reproduction; smoothing the grayscale of the LED to ensure a natural and continuous grayscale transition; adjusting the backlight parameters of the LED in real time according to the ambient light and image content through a dynamic adjustment algorithm; establishing a color gamut calibration system to regularly calibrate the color gamut of the display screen to maintain the stability of color performance. Although the problem of possible differences in color output of different LED lights, resulting in inconsistent displayed colors, and the problem of discontinuous grayscale in LED brightness adjustment is solved, it does not involve the linkage adjustment of the LED screen and the ambient light, resulting in a relatively simple method for adjusting the brightness of the LED.

[0006] Currently, existing technologies 1, 2, and 3 have the problem that the large-screen content display system and the environmental adjustment system are isolated, resulting in a lack of linkage and poor automatic adjustment function. Therefore, the invention provides an environmental brightness adjustment system and method based on screen content display, which links the large-screen content display system and the environmental adjustment system to achieve automatic environmental adjustment function and improve user experience. Summary of the Invention

[0007] In order to solve the above technical problems, the present invention provides an ambient brightness adjustment system based on screen content display, comprising:

[0008] The screen display component is responsible for visualizing the content to be displayed through the main running program; at the same time, it encodes the display content to form a video stream and sends it to the video channel;

[0009] The content analysis component is responsible for receiving the video stream sent by the video channel, analyzing the display content contained in the video stream, and resolving the hidden instructions contained in the display content; at the same time, the hidden instructions are transmitted to the command center, and the command center converts the hidden instructions into device adjustment instructions;

[0010] The device control component is responsible for responding to device adjustment instructions through the network connection command center, sending radio frequency signals to the device according to the response, and the device adjusts according to the response.

[0011] Optional screen display component, including:

[0012] The type and attribute corresponding module is responsible for setting the object that generates the hidden instructions for the content to be displayed;

[0013] An instruction set object association module is responsible for obtaining a first position of the content to be displayed where the object is located, confirming a second position of the object pointed to by the hidden instruction through the first position, and associating the hidden instruction with the object through a mapping strategy based on the second position to form content containing the hidden instruction and the object;

[0014] The startup program triggering module is responsible for automatically triggering the startup program containing the hidden instructions and the object content when the object is displayed on the screen, and sending the content containing the hidden instructions and the object to the command center for parsing.

[0015] Optionally, the objects in the type and attribute corresponding module include text, color, image and function; at the same time, different types of hidden instructions are set according to the objects, and the types correspond to the specific attributes of the objects.

[0016] Optional, type and attribute corresponding modules, including:

[0017] The attribute definition submodule is responsible for defining the attributes of the object through the initialization method;

[0018] The instruction generation submodule is responsible for traversing all attributes of the object, parsing the type and specific value of each attribute, and determining the attribute category. It also references a predefined rule set that maps the attribute category to the expected behavior. Based on the parsed results of each attribute, it generates a special hidden instruction structure that contains the instruction type and required parameters.

[0019] The confirmation and mapping submodule is responsible for recording the relationship between all instruction types and corresponding attributes and establishing a mapping. Each attribute is mapped to the corresponding hidden instruction type.

[0020] Optionally, the attributes in the attribute definition submodule include: text content, color value, image path, function data and information storage; and the initial state of the object including visibility and activation state is set to a default value.

[0021] Optional, instruction set object association module, including:

[0022] The position conversion submodule is responsible for determining the reachable area by analyzing the first position; the second position is logically deduced and the interaction area or state of the object is calculated for the first position;

[0023] The instruction association submodule is responsible for converting the first position into the second position and determining the corresponding instruction. After obtaining the second position, it checks the hidden instructions related to the current position to confirm whether the area at the current position belongs to a certain interaction category.

[0024] The structure formation submodule is responsible for forming a new data structure after the instruction and the object are successfully associated, which includes: the object text content, color and function attribute information and the corresponding hidden instruction type and parameters.

[0025] Optionally, if the area at the current position in the instruction association submodule belongs to a certain interaction category, the area will be associated with the corresponding hidden instruction.

[0026] Optionally, the screen display component also includes:

[0027] The resolution processing module is responsible for obtaining the content to be displayed and confirming the format of the content, which includes images, videos and animations. The format is to dynamically capture the current frame at preset intervals, perform resolution processing, and change the content to the target resolution.

[0028] The code stream sorting module is responsible for calculating the motion vector between the current frame and the previous frame, performing discrete cosine transform processing to convert the spatial domain signal into the frequency domain signal, quantizing the discrete cosine transform coefficients, and performing Huffman encoding on the quantized content to generate the code stream; dividing the code stream into segments and prioritizing each segment according to its acquisition timestamp;

[0029] The video stream encapsulation module is responsible for encapsulating the encoded content according to priority to form a standard data packet structure, that is, obtaining a video stream sorted by priority.

[0030] Optionally, the standard data packet structure of the video stream encapsulation module includes: video frame data, timestamp, frame number, video resolution, encoding format and frame rate.

[0031] The present invention provides a method for adjusting ambient brightness based on screen content display, comprising the following steps:

[0032] Through the main running program, the content to be displayed is visualized; at the same time, the display content is encoded to form a video stream and sent to the video channel;

[0033] Receive the video stream sent by the video channel, analyze the display content contained in the video stream, and parse out the hidden instructions contained in the display content; at the same time, transmit the hidden instructions to the command center, and the command center converts the hidden instructions into equipment adjustment instructions;

[0034] The command center responds to the device adjustment command through a network connection, sends a radio frequency signal to the device according to the response, and the device adjusts according to the response.

[0035] The screen display component of the present invention visualizes the content to be displayed, transmitting the information in the form of a video stream. The displayed content is encoded and processed into a format suitable for transmission over a video channel. Significance: By providing high-quality visual content, users are guaranteed to receive clear information. Improved encoding and transmission efficiency ensures the real-time and stability of the video stream, providing a high-quality data source for subsequent content analysis. The content analysis component receives and analyzes the video stream, extracting the displayed content and hidden instructions contained therein, and accurately transmits the extracted hidden instructions to the command center. Significance: This provides the system with intelligent recognition capabilities, ensuring that the required control instructions can be extracted from ordinary content, improving the system's automation level. It also enhances the interaction between screen content and environmental control devices, ensuring that brightness adjustment is not based on static conditions but is dynamically related to the displayed content. The command center receives and parses the hidden instructions sent by the content analysis component, converting them into device adjustment instructions and formulating specific control strategies. Significance: As the system's core decision-making unit, the command center effectively integrates analysis results with device adjustment requirements, improving the speed and accuracy of adjustment responses, ensuring that environmental effects adapt to changes in screen content in a timely manner. The device control component receives device adjustment commands from the command center via a network connection and sends radio frequency signals to the adjustment device to control its status. Significance: This enables the actual execution of commands and, through connection with surrounding devices, automatically adjusts ambient brightness. This enhances the system's responsiveness and flexibility, allowing the user's visual experience to harmonize with the surrounding environment, improving the user experience.

[0036] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.

[0037] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0039] Figure 1 This is a block diagram of an ambient brightness adjustment system based on screen content display in Example 1 of the present invention;

[0040] Figure 2 The screen display component frame in embodiment 2 of the present invention Figure 1 ;

[0041] Figure 3 This is a block diagram of modules corresponding to types and attributes in Example 3 of the present invention;

[0042] Figure 4 This is a block diagram of the instruction set object association module in Example 4 of the present invention

[0043] Figure 5 The screen display component frame in embodiment 5 of the present invention Figure 2 ;

[0044] Figure 6 This is a block diagram of a code stream sorting module in Example 6 of the present invention;

[0045] Figure 7 This is a block diagram of the content analysis component in Example 7 of the present invention;

[0046] Figure 8 This is a block diagram of a content parsing module in Example 8 of the present invention;

[0047] Figure 9 This is a block diagram of the marker identification submodule in Example 9 of the present invention;

[0048] Figure 10 This is a block diagram of the device control component in Example 10 of the present invention;

[0049] Figure 11 This is a flow chart of the method for adjusting ambient brightness based on screen content display in Example 11 of the present invention. DETAILED DESCRIPTION

[0050] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0051] The terms used in the embodiments of the present application are for the purpose of describing specific embodiments only and are not intended to limit the embodiments of the present application. The singular forms "a", "the" and "the" used in the embodiments of the present application are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0052] When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application. In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances.

[0053] Example 1: Figure 1 As shown, an embodiment of the present invention provides an ambient brightness adjustment system based on screen content display, comprising:

[0054] The screen display component is responsible for visualizing the content to be displayed through the main running program; at the same time, it encodes the display content to form a video stream and sends it to the video channel;

[0055] The content analysis component is responsible for receiving the video stream sent by the video channel, analyzing the display content contained in the video stream, and resolving the hidden instructions contained in the display content; at the same time, the hidden instructions are transmitted to the command center, and the command center converts the hidden instructions into device adjustment instructions;

[0056] The device control component is responsible for responding to device adjustment instructions through the network connection command center, sending radio frequency signals to the device according to the response, and the device adjusts according to the response.

[0057] The working principle and beneficial effects of the above technical solution are as follows: The screen display component of this embodiment visualizes the content to be displayed through the main running program; simultaneously, it encodes the displayed content to form a video stream, which is transmitted to the video channel; the content analysis component receives the video stream transmitted by the video channel, analyzes the displayed content contained in the video stream, and parses out the hidden instructions contained in the displayed content; simultaneously, it transmits the hidden instructions to the command center, which converts the hidden instructions into device adjustment instructions; the device control component responds to the device adjustment instructions via a network connection to the command center, and based on the response, transmits a radio frequency signal to the device, which then adjusts the device accordingly. The screen display component of the above solution visualizes the content to be displayed, transmits the information in the form of a video stream, and encodes the displayed content into a format suitable for transmission through the video channel. Significance: By providing high-quality visual content, users can ensure clear information reception; improved encoding and transmission efficiency ensures the real-time and stability of the video stream, providing a high-quality data source for subsequent content analysis. The content analysis component receives and analyzes the video stream, parses out the displayed content and hidden instructions contained therein, and accurately transmits the extracted hidden instructions to the command center. Significance: This system equips the system with intelligent recognition capabilities, ensuring it can extract control commands from general content, improving system automation. It also enhances interaction between screen content and environmental control devices, ensuring that brightness adjustment is not based solely on static conditions but dynamically correlated with the displayed content. The command center receives and interprets hidden commands sent by the content analysis component, converting them into device adjustment commands and formulating specific control strategies. Significance: As the system's core decision-making unit, the command center effectively integrates analysis results with device adjustment requirements, improving adjustment response speed and accuracy, ensuring that environmental effects adapt to changes in screen content. The device control component receives device adjustment commands from the command center via a network connection and sends radio frequency signals to the control devices to adjust their status. Significance: This system implements actual command execution and automatically adjusts ambient brightness through connection with environmental devices. This enhances the system's responsiveness and flexibility, allowing the user's visual experience to harmonize with the surrounding environment, improving the user experience. The display screen, devices, and control unit are located in a single room, which could be a conference room or a classroom.

[0058] In summary, this embodiment ensures automatic adjustment of ambient brightness based on the content displayed on the screen, enhancing user comfort and visual quality. Precise brightness adjustment avoids unnecessary energy waste and achieves more efficient energy use. Human-computer interaction is enhanced, allowing users to obtain an optimal visual experience in a variety of environments and displayed content. Through modular design between components, the system can rapidly expand and upgrade functionality based on diverse needs. This provides an effective technical solution for environmental adaptability in diverse usage scenarios (such as home, office, and presentations), laying the foundation for future innovations in human-computer interaction and smart home environments.

[0059] Example 2: Figure 2 As shown, based on Example 1, the screen display component provided by the embodiment of the present invention includes:

[0060] The type and attribute corresponding module is responsible for setting the objects that generate hidden instructions for the displayed content. The objects include text, color, image, and function. At the same time, different types of hidden instructions are set according to the objects, and the types correspond to the specific attributes of the objects.

[0061] An instruction set object association module is responsible for obtaining a first position of the content to be displayed where the object is located, confirming a second position of the object pointed to by the hidden instruction through the first position, and associating the hidden instruction with the object through a mapping strategy based on the second position to form content containing the hidden instruction and the object;

[0062] The startup program triggering module is responsible for automatically triggering the startup program containing the hidden instructions and the object content when the object is displayed on the screen, and sending the content containing the hidden instructions and the object to the command center for parsing.

[0063] The working principle and beneficial effects of the above technical solution are as follows: the type and attribute corresponding module of this embodiment sets the object for generating hidden instructions for the content to be displayed, and the object includes text, color, picture and function, etc.; at the same time, different types of hidden instructions are set according to the object, and the type corresponds to the specific attributes of the object; the instruction set object association module obtains the first position of the content to be displayed where the object is located, confirms the second position of the object pointed to by the hidden instruction through the first position, and associates the hidden instruction with the object through the mapping strategy according to the second position to form content containing hidden instructions and objects; the startup program triggering module automatically triggers the startup program containing the content of hidden instructions and objects when the object is displayed on the screen, and sends the content containing hidden instructions and objects to the instruction center for parsing. The type and attribute corresponding module of the above scheme can generate corresponding hidden instruction objects according to the attributes of the content to be displayed (such as text, color, picture, etc.); enables the system to flexibly handle content of different types and attributes; sets the corresponding hidden instruction type according to the specific attributes of the object, so that the generation of instructions matches the structure of the content. Significance: Through refined content classification and generation, objects with different attributes can be dynamically processed and displayed as needed. This is crucial for complex user interface design and interaction logic. Its modular design facilitates future expansion. For example, adding new object attributes or command types requires only updating this module, without modifying the entire system structure. The command set object association module obtains the primary position of the content to be displayed and accurately determines the object's location within the interface. Using a mapping strategy, it determines the secondary position of the object designated by the hidden command and associates the hidden command with the corresponding object, generating content containing both the hidden command and the object. Significance: This ensures that hidden commands are correctly associated with specific objects, avoiding errors caused by inaccurate positioning. The dynamic matching mechanism enhances the user experience and ensures consistent user operation. Through timely association and structured data management, users can easily access hidden information when displaying content, improving data processing efficiency and accuracy. The launcher trigger module monitors the object's display status on the screen and automatically triggers the launcher containing the hidden command and object. This can be controlled by various conditions (such as visibility and user clicks). Data containing the hidden command and object content is sent to the command center for subsequent analysis and processing. Significance: Through the automatic triggering mechanism, users can respond quickly, reduce waiting time, and improve the interactive experience of the system; through the automatic parsing and processing of instructions, the system can implement more complex logic and functions, provide users with customized services and feedback, and improve the intelligence level of the system.

[0064] In summary, the various modules of the screen display component in this embodiment, through the creation of workflows, enhance the flexibility, maintainability, and user interaction experience of the system's content processing. Each module not only improves system efficiency but also significantly enhances the user experience. Through precise command mapping and dynamic object association, the system can more intelligently respond to user operations and needs. This provides a solid foundation for future system expansion, functional enhancements, and user interaction.

[0065] Example 3: Figure 3 As shown, based on Example 2, the type and attribute corresponding modules provided by this embodiment of the present invention include:

[0066] The attribute definition submodule is responsible for defining the attributes of the object through initialization methods, including text content, color value, image path, function data and information storage, etc.; setting the initial state of the object including visibility and activation state to the default value;

[0067] Among them, text content: parses the text input by the user or obtained from the data source, which may include multi-line text, font style, etc.; color value: defines the color in RGB, HEX or HSL format. This involves setting the color as background color, font color or border color, etc.; image path: specifies the address or file path of the image, and obtains the image data through the URL or file system path; function data: defines the interactive functions of the object, such as click events, mouse hover effects, animation effects, etc. Each function is equipped with corresponding parameters to ensure its consistent behavior when displayed; information storage: all extracted attribute information is stored in the memory structure of the object, usually organized in the form of key-value pairs;

[0068] The instruction generation submodule is responsible for traversing all attributes of the object, parsing the type and specific value of each attribute, and determining the attribute category; for example, text attributes, color attributes, image attributes, and functional attributes. It also references a predefined rule set that maps attribute categories to expected behaviors. Based on the parsed results for each attribute, it generates a special hidden instruction structure that contains the instruction type and required parameters.

[0069] For text content, if the attribute value is not an empty string and conforms to a certain input format, it is recognized as a situation where text display is required, and the corresponding "TEXT_DISPLAY" hidden instruction is returned. When a color attribute is detected, for example, a color value is too bright or too dark, the corresponding "COLOR_ADJUST" instruction type is automatically matched for subsequent ambient brightness adjustment. For "TEXT_DISPLAY", information such as content, font style, font size, and initial position is included; for "COLOR_ADJUST", the target color value, change range, and change conditions (such as lighting environment) are included.

[0070] The confirmation and mapping submodule is responsible for recording the relationship between all instruction types and corresponding attributes and establishing a mapping. Each attribute is mapped to the corresponding hidden instruction type.

[0071] The working principle and beneficial effects of the above technical solution are as follows: the attributes of the attribute definition submodule object of this embodiment are defined through an initialization method, including: text content, color value, image path, functional data and information storage, etc.; the initial state of the object including visibility and activation state is set to the default value; the instruction generation submodule traverses all attributes of the object, parses the type and specific value of each attribute, and determines the category of the attribute; for example, text attributes, color attributes, image attributes and functional attributes, etc.; references a predefined rule set, and the rule set is designed according to the mapping relationship between the attribute category and the expected behavior; a special hidden instruction structure is generated according to the parsing result of each attribute, and the hidden instruction structure contains the instruction type and required parameters; confirms and maps all instruction types and corresponding attribute relationship records of the mapping submodule, and establishes a mapping, and each attribute is mapped to the corresponding hidden instruction type. The attribute definition submodule of the above solution defines and initializes all basic attributes of an object, including text content, color values, image paths, functional data, and status information. It ensures that all attributes are fully captured and stored in a structured manner, laying the foundation for subsequent processing. A key-value memory structure allows for efficient access and modification of object attributes, ensuring data consistency and reliability. Objects are guaranteed to have default visibility and activation settings upon creation, avoiding logical errors or abnormal behavior caused by uninitialized objects. Significance: It provides a unified initial framework for the basic behavior and appearance of objects, ensuring that subsequent operations are based on a clear state. Standardized attribute initialization improves system robustness and stability. The instruction generation submodule automatically traverses each attribute of an object, determines their type and corresponding value, and determines the attribute category accordingly. It applies a predefined set of rules to match each attribute with an implicit instruction, quickly and accurately converting the attribute into a specific instruction type. Based on the parsing results, it generates a specific hidden instruction structure, which contains the instruction type and the parameters required for execution. Significance: It realizes the automated conversion from attribute information to instructions, and enhances the system's ability to respond to dynamic changes; by introducing a rule set, it can ensure that when faced with different types of input, the system can intelligently generate appropriate adjustment instructions, thereby improving the fluency of user interaction. The confirmation and mapping submodule maintains and records the relationship between all hidden instructions and their corresponding attributes, forming a clear mapping document; it ensures that each attribute can be accurately mapped to the appropriate instruction type for subsequent system processing and device control; it can quickly re-evaluate the mapping relationship when the attribute or rule set changes, providing the ability to respond quickly. Significance: It makes the entire system well-maintained and extensible. By recording and managing the mapping between instructions and attributes, new attributes or instruction types can be easily added in the future to ensure that the system can adapt to changing needs; it not only improves the automation level of the system, but also enhances the collaboration and clarity between modules, making the entire environmental brightness adjustment system more efficient and intelligent.

[0072] In summary, this embodiment realizes efficient attribute management, automatic instruction generation and clear recording of mapping relationships through three sub-modules and the entire type and attribute corresponding module, laying a solid foundation for the sustainable development and intelligent response of the system.

[0073] Example 4: Figure 4 As shown, based on Example 3, the instruction set object association module provided by the embodiment of the present invention includes:

[0074] The position conversion submodule is responsible for analyzing the first position to determine the reachable area. The second position is logically derived and then the interaction area or state of the object is calculated based on the first position. For example, if the first position is the center of the screen and the object has a click function, the second position is the distance extending from the center to the perimeter, which is the boundary of the click area. If the object is a button, the second position is formed by defining a rectangular or circular area outward from the first position.

[0075] The first position refers to the initial coordinates of the object on the screen, which are used to identify the specific location where the object is to be displayed. For example, if the screen is divided into a grid, the first position can be the coordinates of a cell in the grid. When preparing to display an object (such as text, an image, or a button), the first position is used to determine the placement of the object on the screen.

[0076] The command association submodule is responsible for converting the first position into the second position and determining the corresponding command. After obtaining the second position, it checks the hidden command associated with the current position to confirm whether the area at the current position belongs to a certain interaction category. If so, it associates the area with the corresponding hidden command.

[0077] The structure formation submodule is responsible for forming a new data structure after the instruction and the object are successfully associated, which includes: the object text content, color and function attribute information and the corresponding hidden instruction type and parameters.

[0078] The working principle and beneficial effects of the above technical solution are as follows: the position conversion submodule of this embodiment confirms the reachable area by analyzing the first position; the second position is logically deduced, and the interactive area or state of the object is calculated for the first position; for example, if the first position is the center of the screen, and the object has a click function, then the second position is a distance extending from the center to the surrounding area, that is, the boundary of the click area; if the object is a button, a rectangular or circular area is defined outward from the first position to form the second position; wherein the first position refers to the initial coordinates of the object on the screen, which is used to identify the specific position where the object is to be displayed; for example, if the screen Divided into a grid, the first position can be the coordinates of a cell of the object in this grid; when preparing to display an object (such as text, image or button), the placement of the object on the screen is determined; the instruction association submodule converts the first position to the second position and determines the corresponding instruction; after obtaining the second position, the hidden instruction related to the current position is checked to confirm whether the area of ​​the current position belongs to a certain interaction category. If so, the area will be associated with the corresponding hidden instruction; when the instruction and the object are successfully associated, the structure formation submodule forms a new data structure, which includes: attribute information of the object's text content, color and function and the corresponding hidden instruction type and parameters. The position conversion submodule of the above scheme performs an in-depth analysis of the first position to determine the interactive area or state of the object on the screen; based on the coordinates of the first position, it deduces the second position that can be reached, which is an area that can be interacted with by the user, such as the click area of ​​a button or the hover area of ​​an image; for different objects (such as buttons, text boxes or images), the interaction boundary is defined by setting geometric shapes (such as rectangles or circles), making the user interaction more intuitive and clear. Significance: Effectively transforms visual display locations into interactive areas, supporting user actions or interactions on the screen. Clearly defined areas ensure that user clicks or other interactive actions do not produce unexpected effects, enhancing the user experience. The command association submodule converts the first location to the second location. After identifying the hidden command associated with the second location, it determines whether the area is suitable for a specific interaction type (such as click, hover, or drag). Once the area is confirmed to meet a certain interaction category, the team associates it with the corresponding hidden command (such as "CLICK_ACTION" or "HOVER_ACTION"), providing a command basis for subsequent operations. Significance: Automates and intelligently processes commands, ensuring that the system can respond quickly and accurately to user actions. Through dynamic command association, user interactions can directly trigger intended functions, enhancing the smoothness and effectiveness of interactions. Once the hidden command is successfully associated with an object, the structure formation submodule creates a new data structure that condenses the object's various attribute information (such as text content, color, function, etc.) and the corresponding hidden command type and its parameters, organizing all relevant information in a structured manner.Significance: By forming a new data structure containing all necessary information, relevant properties can be quickly accessed when executing instructions, thereby improving overall performance. The integration ensures that the system can quickly find the required instructions and object properties at runtime, improving responsiveness. It also facilitates expansion and adjustment, making maintenance and updates easier.

[0079] In summary, the instruction set object association module of this embodiment optimizes the interaction between objects and instructions through the design of submodules such as position conversion, instruction association, and structure formation. Each submodule forms a good synergistic effect with each other. Through accurate area definition, intelligent instruction processing, and efficient data structure creation, it not only improves the system's responsiveness, but also enhances the intuitiveness and convenience of user operations, thereby significantly enhancing the user experience.

[0080] Example 5: Figure 5 As shown, based on Example 1, the screen display component provided by the embodiment of the present invention further includes:

[0081] The resolution processing module is responsible for obtaining the content to be displayed and confirming the format of the content, which includes images, videos, and animations. The format is to dynamically capture the current frame at preset intervals, perform resolution processing, and change the content to the target resolution.

[0082] The code stream sorting module is responsible for calculating the motion vector between the current frame and the previous frame, performing discrete cosine transform processing to convert the spatial domain signal into the frequency domain signal, quantizing the discrete cosine transform coefficients, and performing Huffman encoding on the quantized content to generate the code stream; dividing the code stream into segments and prioritizing each segment according to its acquisition timestamp;

[0083] The video stream encapsulation module is responsible for encapsulating the encoded content according to priority to form a standard data packet structure, that is, obtaining a video stream sorted by priority. The standard data packet structure includes: video frame data, timestamp, frame number, video resolution, encoding format and frame rate, etc.

[0084] The working principle and beneficial effects of the above technical solution are as follows: the resolution processing module of this embodiment obtains the content to be displayed and confirms the format of the content, which includes images, videos and animations, etc.; the format is to dynamically capture the current frame at preset intervals, perform resolution processing, and change the content to the target resolution; the code stream sorting module calculates the motion vector between the current frame and the previous frame, performs discrete cosine transform processing, converts the spatial domain signal into a frequency domain signal, quantizes the discrete cosine transform coefficients, and performs Huffman encoding on the quantized content to generate a code stream; the code stream is divided into segments, and priority is sorted according to the acquisition timestamp of each segment; the video stream encapsulation module encapsulates the encoded content according to priority sorting to form a standard data packet structure, that is, a video stream sorted according to priority is obtained, and the standard data packet structure includes: video frame data, timestamp, frame number, video resolution, encoding format and frame rate, etc. The resolution processing module in the above solution supports input in multiple formats (images, videos, animations, etc.), offering greater flexibility. During processing, it can identify the input format and perform conversions as appropriate (e.g., converting images of varying resolutions or color depths to the target format). Regularly capturing the current frame ensures real-time display, making it suitable for dynamic scenarios and user interactions. Significance: By standardizing the resolution and format of content, the module ensures consistency and visual quality across all displayed content on the target device, ensuring a smooth and coherent user experience. The module's compatibility with multiple input formats allows the system to process a wide range of content types, enhancing versatility. The code stream sorting module uses optical flow or other motion estimation methods to effectively calculate frame-to-frame changes for motion compensation. This saves storage and bandwidth. The discrete cosine transform (DCT) converts spatial domain signals into frequency domain signals, preserving essential information while compressing high-frequency redundant information. The DCT coefficients are quantized and then compressed using Huffman coding to form an efficient code stream. Significance: Through motion compensation and frequency domain conversion, the amount of data is reduced, storage requirements and bandwidth usage are optimized, and the transmission efficiency of the system is improved; the combination of quantization and Huffman coding effectively reduces data redundancy, improves overall coding efficiency, and makes subsequent transmission smoother. The video stream encapsulation module prioritizes the encoded content according to the timestamp to ensure that key frames and important data are transmitted first; encapsulates data in a standard format (such as MPEG, H.264) to ensure that the encapsulated data includes the necessary metadata (video frame data, timestamp, frame number, etc.). Significance: Priority sorting can ensure that important content can be sent first in the case of unstable network, maintaining the continuity and smoothness of the video stream; the use of a standard data packet structure ensures that data can be compatible and used between different players and decoders, promoting data portability.

[0085] In summary, this embodiment implements an efficient and flexible content processing and transmission mechanism, specifically including: ensuring consistent, high-quality display effects on various display devices; optimizing system performance and response speed by reducing data redundancy and bandwidth usage, and improving content transmission efficiency; maintaining the stability and smoothness of the system when processing high-demand content through priority mechanisms and data flow standardization under different network conditions; and helping to build an efficient and stable ambient brightness adjustment system to meet the needs of different scenarios.

[0086] Example 6: Figure 6 As shown, based on Example 5, the code stream sorting module provided by the embodiment of the present invention includes:

[0087] The vector transform submodule is responsible for performing initial estimation based on the global density function, refining the motion vector in local regions, and adaptively adjusting it based on the local motion intensity to balance the impact of the current frame and the reference frame. It also extends the standard discrete cosine transform to a variable step size version to handle content regions with different frequency characteristics.

[0088] in,

[0089]

[0090] Where: is a weight function used to weight pixel differences. α and β are dynamic parameters that are adaptively adjusted according to the local motion intensity to weigh the impact of the current frame and the reference frame. MV(i, j) represents the motion vector of pixel (i, j) in the current frame. The motion vector is a vector that describes the pixel displacement between adjacent frames. argmin (x,y) Indicates the parameter for finding the minimum value, and returns the motion vector (x, y) that can minimize the expression in the brackets; σ is the parameter that determines the weight decay rate, which controls the relationship between pixel position and weight in motion estimation. t Indicates the current frame content, I t-1 Represents the content of the previous frame; (m,n) is the offset used for operations on neighboring pixels;

[0091] Variable step size discrete cosine transform:

[0092]

[0093] Where L adaptively changes according to the local frequency characteristics and is obtained using the adaptive filtering result: L = {NifCis high frequency MifCis low frequency; X(u,v) represents the coefficients after the variable step size discrete cosine transform, which represents the performance of the content in the frequency domain, N represents the block size used in the discrete cosine transform, and f(x,y) represents the pixel value of the input content block;

[0094] The coding table generation submodule is responsible for using content-aware adaptive hierarchical quantization, with the quantization factor dynamically adjusted according to the content complexity. It integrates a multi-level entropy coding mechanism and performs frequency analysis to generate a dynamic coding table, optimizing space utilization based on one-dimensional arithmetic coding.

[0095]

[0096] The quantization matrix is ​​combined with the texture complexity C within the block i Dynamic adjustment, Q adaptive (u,v)=Q base (u,v)·(1+λ·C i ); Adaptive factor C i Obtained through wavelet transform analysis; (u, v) is the index of the frequency coefficient, which is used to describe the signal after discrete cosine transform;

[0097] Perform frequency analysis to generate a dynamic coding table that optimizes space utilization based on one-dimensional arithmetic coding:

[0098] Frequency Analysis:

[0099]

[0100] In the formula, P(y i ) represents the quantized value y i The probability of , based on the frequency of occurrence in the data set, count(y i ) represents the number of occurrences of the quantitative value yi in the data set, Represents the total number of occurrences of all quantitative values ​​in the data set;

[0101] Dynamically generate Huffman tree and perform entropy coding, using one-dimensional arithmetic coding to achieve efficient coding: C(y i )=ArithmeticEncode(y i ,P(y i )), C(y i ) represents the quantized value y i The encoding result is stored efficiently using arithmetic coding. ArithmeticEncode(y i ,P(y i )) represents a one-dimensional arithmetic coding function that accepts quantized values ​​and their probabilities for encoding;

[0102] Update the sorting by judging the intensity of exercise:

[0103] P k =β1T k +β2·max(magnitude(MV k ),edgeResponse(It ))

[0104] Among them, edgeResponse(I t ) is implemented through edge detection operators to capture important changes within the frame to adjust the sending priority of the fragment; k Indicates the priority of the current segment k, which is calculated by combining the timestamp and motion intensity. k Indicates the timestamp of the current segment k, reflecting the time information of its generation or capture, max(magnitude(MV k ),edgeResponse(I t )) indicates that when calculating the priority, the absolute value of the motion vector and the maximum value of the edge response are taken to determine the importance of the current segment; β1 and β2 are weight factors that guide the balance of the importance of different information in the priority calculation;

[0105] The sorting and updating submodule is responsible for dynamically calculating the priority by combining the timestamp and motion vector, using edge-aware strategies to update the sorting by judging the motion intensity and generating a standard data packet structure.

[0106] S={S sorted ,meta=T k ,C(y i ), P k , magnitude(MV k )}

[0107] Where S represents the final generated data packet structure, which includes sorted data and metadata. sorted Represents a set of segments sorted by priority. Meta contains metadata related to the current segment, such as timestamp, coding data, priority, and motion vector magnitude.

[0108] The working principle and beneficial effects of the above technical solution are as follows: the vector transformation submodule of this embodiment performs initial estimation based on the global density function, refines the local area of ​​the motion vector, and adaptively adjusts according to the local motion intensity to weigh the impact of the current frame and the reference frame; the standard discrete cosine transform is extended to a variable step size version to cope with content areas with different frequency characteristics; the coding table generation submodule adopts content-aware adaptive hierarchical quantization, and the quantization factor is dynamically adjusted with the complexity of the content; it integrates a multi-level entropy coding mechanism, performs frequency analysis to generate a dynamic coding table, and optimizes space utilization based on one-dimensional arithmetic coding; the sorting update submodule combines timestamps and motion vectors to dynamically calculate priority, uses edge-aware strategies, updates the sorting by judging the motion intensity, and generates a standard data packet structure. The vector transformation submodule of the above scheme uses a global density function to perform initial estimation, refine motion vectors, and dynamically adjust local motion intensity. It also extends the standard discrete cosine transform (DCT) to a variable-step-size version to better handle the varying frequency characteristics of the content. This improves the accuracy of motion estimation, enabling the model to better identify and utilize local motion information, thereby enhancing the correlation between adjacent frames. The variable-step-size DCT allows for more detailed analysis of different frequency characteristics, helping to maintain content quality while reducing data redundancy during encoding. Significance: By refining motion estimation and frequency domain analysis, the module can effectively capture important dynamic components in the video stream, providing a more efficient foundation for subsequent encoding and improving overall video processing efficiency. The coding table generation submodule uses content-aware adaptive hierarchical quantization to dynamically adjust quantization factors to adapt to varying content complexity. It performs frequency analysis to generate a dynamic coding table, which is then combined with a multi-level entropy coding mechanism for data encoding. Dynamic quantization improves coding efficiency and effectively mitigates data redundancy caused by content complexity. The generated dynamic coding table, combined with one-dimensional arithmetic coding, significantly reduces the storage space required for the video stream and improves data transmission efficiency. Significance: As the complexity of video content increases, the encoding strategy can be adaptively adjusted, which greatly improves the flexibility and adaptability of encoding, thereby adapting to changes in complex scenes and minimizing content distortion. The frequency analysis module is responsible for analyzing the frequency of occurrence of quantized data and generating a dynamic Huffman tree for encoding; efficient data encoding is achieved by statistically analyzing the frequency of occurrence of quantized values, providing a basis for subsequent encoding, and using one-dimensional arithmetic coding to achieve higher storage efficiency. Significance: The dynamically generated coding table can reflect the characteristics of the data in real time, so that the encoding algorithm can be adjusted in time to ensure the optimization of the encoding effect, thereby improving the overall compression rate of the video stream. The motion intensity update sorting module calculates the priority of each segment based on information such as edge detection, and dynamically updates the segment sorting by judging factors such as motion intensity and timestamp; it improves the transmission priority of important data in the encoding process, so that key frames or segments with important changes can be processed and sent first.Significance: By prioritizing high-importance segments, the user experience can be improved, reducing latency and lag. This is particularly important for real-time video streaming applications. The sorting and updating submodule integrates the priority information of each segment to generate a standard data packet structure and implement dynamic prioritization. This standard packet structure contains key information, improving the efficiency and manageability of data conversion and transmission. Significance: By organizing data packets in an orderly manner, the efficiency of subsequent processing and transmission can be greatly improved, laying a solid foundation for real-time processing and transmission. It also improves the convenience of error correction and data calculation.

[0109] In summary, the entire code stream sorting module of this embodiment collaborates through different technical approaches during the video processing process, ultimately achieving efficient, dynamic, and highly adaptable video encoding and transmission. This design not only improves processing performance but also fundamentally optimizes the user experience, making it widely applicable in fields such as real-time video streaming, video compression, and transmission. It not only optimizes the data compression process but also enhances the ability to perceive content complexity, making the encoding process more intelligent and efficient. The data processing method, combined with multi-level information, can provide a better visual experience in highly dynamic and complex scenes.

[0110] Example 7: Figure 7 As shown, based on Example 1, the content analysis component provided by this embodiment of the present invention includes:

[0111] The content parsing module is responsible for receiving video stream data sent by the screen display component in real time, obtaining the video frame image content and related metadata, and converting the compressed encoded content in the video stream into a processable format. Based on the parsing logic, it extracts individual frames from the video stream to represent the content displayed at a specific point in time.

[0112] The content recognition module is responsible for identifying each frame, analyzing each object in it, extracting the information and specific attributes contained in the object, and obtaining the visibility and activation status of the object. According to the defined rule set, the extracted attributes are used to generate a series of hidden instructions. Each attribute is mapped and the corresponding instruction type is identified.

[0113] The instruction transmission module is responsible for transmitting the generated hidden instructions to the instruction center through the internal interface and storing them in the form of structured data, including information such as instruction type, related attributes and parameters.

[0114] The working principle and beneficial effects of the above technical solution are as follows: the content parsing module of this embodiment receives the video stream data sent by the screen display component in real time, obtains the video frame image content and related metadata, and converts the compressed encoded content in the video stream into a processable format; according to the parsing logic, extracts a single frame from the video stream, representing the content displayed at a specific time point; the content recognition module recognizes each frame, analyzes each object in it, extracts the information and specific attributes contained in the object, and obtains the visibility and activation status of the object; according to the defined rule set, uses the extracted attributes to generate a series of hidden instructions, and each attribute is mapped to identify the corresponding instruction type; the instruction transmission module transmits the generated hidden instructions to the instruction center through the internal interface and stores them in the form of structured data, including information such as instruction type, related attributes and parameters. The content parsing module of the above solution receives and decodes the video stream data from the screen display component in real time, and converts the compressed encoded content into a processable video frame through decoding; according to the parsing logic, extracts a single frame image from the stream, each frame represents the content displayed at a certain moment, and the frame will be the basic unit of content recognition. Significance: The converted and extracted video frames enable subsequent content analysis and ensure that these frames are efficiently processed by the recognition module, ensuring the system's ability to respond to dynamic content in real time. Rapid real-time processing means the system can promptly update displayed content based on environmental changes, providing the best user experience. The content recognition module identifies each frame, extracting the objects contained within and their specific attributes (such as text, color, and images), and determining the objects' visibility and activation status. Based on these extracted attributes, a set of hidden commands is generated using a predefined rule set, ensuring that the command type corresponding to each attribute is correctly identified. Significance: Through in-depth analysis of objects and attributes, a more natural interaction between humans and computers is achieved. The efficient operation of the recognition module directly enhances the user experience, ensuring a smooth transition between user operations and system responses. Generating hidden commands based on real-time displayed content enables the system to automatically adjust its response strategy as the environment changes, providing flexibility for complex application scenarios. The command transmission module transmits the generated hidden commands to the command center via an internal interface, ensuring that the commands are structured and manageable. The commands are stored as structured data, including the command type, related attributes, and parameters, to facilitate further parsing and execution by the command center. Significance: By storing instructions in a structured manner, the management and call process is simplified, making the flow of instructions through the system more efficient, reducing the possibility of errors, and enhancing the overall system response speed. The design of the instruction transmission module not only improves the clarity of information flow but also provides a good foundation for subsequent data processing and execution.

[0115] In summary, this embodiment forms a powerful and effective information processing mechanism through the collaborative work of the three modules of content analysis, content recognition and instruction transmission, which can realize the monitoring and feedback of the real-time changing content on the screen. Rapid and accurate analysis and response are crucial to user interaction. The efficient collaboration of each module enables the system to provide immediate feedback and effectively meet user needs; better support for real-time display adjustment and adaptation in complex environments, so that the system is not just a passive response, but has intelligent decision-making capabilities, which improves the autonomy of the system; modular design allows the system to be flexibly expanded and adjusted when facing different application scenarios, achieving good decoupling between modules and facilitating subsequent maintenance and function upgrades. The content analysis component becomes the core of dynamic content processing, ensuring that the system can respond to various display needs efficiently and accurately.

[0116] Example 8: Figure 8 As shown, based on Example 7, the content parsing module provided by this embodiment of the present invention includes:

[0117] The content display submodule is responsible for feeding the video stream data into the decoder, decoding it according to the video encoding format, converting it into the original video frames, and generating a series of decoded frames. Each frame is independent and displays the content presented at a specific moment in the frame. The timestamp information is also processed. The timestamp provides context for each frame, indicating the time when the frame is played in the video.

[0118] The tag recognition submodule is responsible for identifying the start and end of each frame through the start tag and end tag, extracting the frame data, and creating a new object;

[0119] The set formation submodule is responsible for adding each extracted frame to a list, where each element includes data and a corresponding timestamp, forming a structured and sequentially processable frame set; monitoring the size of the buffer and the capacity of the frame list.

[0120] The working principle and beneficial effects of the above technical solution are as follows: the content display submodule of this embodiment sends the video stream data into the decoder, decodes it according to the video encoding format, converts it into the original video frame, and generates a series of decoded frames, each frame is independent and displays the content presented in the frame at a specific moment; at the same time, it processes the timestamp information, which provides context for each frame, indicating the time of the frame in the video playback; the tag recognition submodule identifies the start and end of each frame through the start tag and end tag, extracts the frame data, and creates a new object; each frame extracted by the set formation submodule is added to a list, each element includes data and corresponding timestamp, forming a structured and sequentially processable frame set; the size of the buffer and the capacity of the frame list are monitored. The content display submodule of the above solution sends the received video stream data into the decoder, and the decoding process converts the compressed video stream into original, operable independent video frames; each generated frame is associated with a timestamp to ensure that the specific moment of the frame in the entire video playback can be accurately identified, providing context information for subsequent analysis. Significance: Through fast decoding, the content display submodule ensures that the system can process video streams in real time and respond to user needs; real-time performance is very important for interactive applications and can provide a smoother user experience; the capture of timestamps provides the necessary time context for analysis and processing, so that subsequent analysis of content can accurately evaluate the information at a certain moment, which is helpful for subsequent content recognition and instruction generation. The marker recognition submodule analyzes the frame data generated by decoding and uses start and end markers to accurately locate the start and end positions of each video frame; after identifying the boundaries, the complete frame data is extracted and a new object is created to represent the frame. The frame object is the basis for subsequent content processing. Significance: The structure ensures that the system can effectively extract each frame in the video stream, ensure the integrity and accuracy of the frame data, and avoid data loss or errors; through clearly defined start and end markers, the efficiency of the video frame extraction process is guaranteed, so that subsequent content analysis can be carried out based on accurate data, enhancing the reliability and stability of the entire system. The collection formation submodule adds each extracted frame and its corresponding timestamp to a list, forming a structured, serializable collection of frames that can be accessed and processed sequentially as needed. The buffer size and frame list capacity are monitored in real time to ensure good memory management during data processing and prevent memory overflow or data loss. Significance: By forming a frame collection, subsequent processing modules (such as the content recognition module) can access and process each frame sequentially, ensuring the logic and stability of the analysis process. The buffer monitoring mechanism enables the system to reasonably allocate memory and control data flow when receiving large amounts of data, preventing system crashes due to buffer overflow or excessive data, thereby helping to improve overall performance and user experience.

[0121] In summary, the content parsing module of this embodiment forms an efficient, accurate, and real-time video frame parsing mechanism. It not only enables rapid decoding and extraction of video content, but also ensures data accuracy and management efficiency. This lays a solid foundation for subsequent video content analysis, object recognition, and command generation, significantly enhancing the system's overall intelligence and responsiveness. Furthermore, this modular structure facilitates subsequent maintenance and expansion, achieving system flexibility and scalability.

[0122] Example 9: Figure 9 As shown, based on Example 8, the tag recognition submodule provided by the embodiment of the present invention includes:

[0123] The position recording unit is responsible for parsing the data stream byte by byte, looking for the marker indicating the start of a frame. Once the start marker is found, the search for the end marker will continue. The data between the identified start and end markers is defined as the data of the current frame. The positions of the start and end markers are recorded to extract the original data and copied to a temporary buffer.

[0124] The attribute assignment unit is responsible for creating a new frame object, which is a container for storing frame data. The original data copied from the buffer is assigned to an attribute of the frame object, including pixel information. At the same time, the timestamp corresponding to the current frame is assigned to another attribute of the frame object, and context analysis is performed based on the timestamp.

[0125] The parameter verification unit is responsible for verifying the integrity of the frame object after it is created, checking whether the format and color channel are correct, whether the data length meets expectations, and whether the timestamp is consistent with the timestamp of the previous frame.

[0126] The working principle and beneficial effects of the above technical solution are as follows: the position recording unit of this embodiment parses the data stream byte by byte, looking for the marker indicating the start of a frame. Once the start marker is found, the search for the end marker will continue. The data between the identified start and end markers is defined as the data of the current frame. The positions of the start and end markers are recorded to extract the original data and copied to a temporary buffer. The attribute assignment unit creates a new frame object, which is a container for storing frame data. The original data copied from the buffer is assigned to an attribute of the frame object, including pixel information. At the same time, the timestamp corresponding to the current frame is assigned to another attribute of the frame object, and context analysis is performed based on the timestamp. After creating the frame object, the parameter verification unit verifies the integrity of the object, checks whether the format and color channel are correct, and whether the data length meets the expectation. The timestamp is consistent with the timestamp of the previous frame. The position recording unit of the above solution parses the video stream data byte by byte, with the purpose of finding special markers indicating the start and end of the video frame in the compressed data stream. The key is to accurately locate these markers to ensure accurate segmentation of the data stream. Between the identified start and end markers, the data of the current frame is accurately defined, so that the complete image information can be effectively extracted. Significance: By finding start and end markers, this unit ensures the integrity of each extracted frame. This accuracy is crucial for subsequent content processing, as any data loss or errors can affect subsequent analysis and presentation. Byte-by-byte parsing enables the unit to quickly locate locations of interest within a larger data stream, improving overall processing efficiency and ensuring the system's ability to respond to changes in video data in real time. The attribute assignment unit's primary task is to create a new frame object, which acts as a data structure to store the data of a single frame. Each frame object is independent and contains detailed information about the video frame. The image data extracted from the temporary buffer and the corresponding timestamp information are assigned to the frame object's attributes, allowing the frame object to fully represent a video frame. Significance: By creating frame objects, the attribute assignment unit structures the extracted image data and timestamps into a manageable and processable format. This structuring makes subsequent data analysis more efficient and logically clear. The timestamp assignment provides temporal context for each frame, enabling the content analysis module to perform temporal-based processing, such as identifying dynamic changes or event triggers within the video, enhancing the system's intelligence. The parameter verification unit performs an integrity check on the frame object after creation to ensure that the data mapped to the frame object is valid; the verification content includes whether the format and color channels are correct and whether the data length is consistent with the expectation; and it verifies whether the timestamp of the current frame object is consistent with the timestamp of the previous frame to ensure the consistency and accuracy of the time series.Significance: By verifying frame objects and timestamps, the parameter verification unit can maintain data reliability during system operation. Invalid or inconsistent data may lead to subsequent content analysis errors, and the verification mechanism can effectively avoid such problems. Ensuring the integrity and consistency of frame objects helps maintain system stability, allowing the system to operate more robustly in complex data environments, avoiding crashes or freezes caused by data problems, and providing the necessary security guarantees for real-time video processing.

[0127] In summary, this embodiment, through precise division of responsibilities and functional implementation, enables efficient operation of the tag recognition submodule; the location recording unit ensures the accuracy and efficiency of data extraction; the attribute assignment unit enhances data operability and contextual analysis capabilities through a structured approach; and the parameter verification unit ensures data reliability and consistency. These units complement each other, not only improving the performance and accuracy of the entire system but also laying a solid foundation for subsequent content analysis and application development.

[0128] Example 10: Figure 10 As shown, based on Example 1, the device control component provided by this embodiment of the present invention includes:

[0129] The command parsing module is responsible for receiving adjustment commands sent by the command center, which include specific operations that the device needs to perform, such as adjusting parameters such as brightness, contrast, and color temperature; parsing the received commands and identifying the specific intent of the commands;

[0130] The signal arrangement module is responsible for reading the current status of the device, obtaining the current brightness and contrast settings, etc.; based on the parsed adjustment instructions, it calculates the new parameter values, converts them into RF signals that can be understood by the device, and arranges the RF signals to include the device ID so that they are received by the correct device; the generated RF signals are sent to the device via a wireless transmitter;

[0131] The state adjustment module is responsible for receiving and decoding RF signals, extracting the actual content and instructions for parameter adjustment, and performing state adjustment based on the received RF signals. After the adjustment is completed, the device feeds back the new state to the device control component.

[0132] The working principle and beneficial effects of the above technical solution are as follows: the instruction parsing module of this embodiment receives the adjustment instruction sent by the command center, which contains the specific operation that the device needs to perform, such as adjusting parameters such as brightness, contrast and color temperature; parses the received instruction and identifies the specific intention of the instruction; the signal arrangement module reads the current state of the device and obtains the current brightness setting and contrast setting; calculates the new parameter value based on the parsed adjustment instruction, converts it into a radio frequency signal that can be understood by the device, and arranges the radio frequency signal, including the device ID, so that it is accepted by the correct device; the generated radio frequency signal is sent to the device via a wireless transmitter; the state adjustment module receives the radio frequency signal, decodes the radio frequency signal, and extracts the actual content and instructions for parameter adjustment; adjusts the state based on the received radio frequency signal, and after the adjustment is completed, the device feeds the new state back to the device control component. The instruction parsing module of the above solution receives the adjustment instruction from the command center, ensuring that it can accurately obtain the control command issued by the system; by parsing the received instruction, it identifies the specific operation that the device needs to perform, such as adjusting settings such as brightness, contrast and color temperature; ensuring that the module can understand the instruction content and classify and structure the device operation. Significance: Effectiveness ensures correct communication between the command center and the device control components, reducing the possibility of misunderstandings and misoperations; accurate command parsing not only improves the system's intelligent response capabilities, allowing the device to flexibly adapt to different environmental needs and user requirements, but also enables complex control logic to enhance user experience. The signal orchestration module reads the current status of the device (such as brightness, contrast, etc.) and calculates new parameter values ​​based on the parsed instructions to adjust the device settings; the calculated new parameter values ​​are converted into radio frequency signals, and these signals are arranged to include necessary information such as device ID to ensure that the signals can be correctly received and interpreted by specific devices. Significance: By converting adjustment instructions into radio frequency signals, the signal orchestration module realizes data format conversion, enabling the device to receive control instructions wirelessly, improving the flexibility of signal transmission; the signal contains the device ID and specific operation information to ensure that the instructions are accurately conveyed to the target device, avoiding signal interference or mistransmission. The state adjustment module receives and decodes the RF signal, extracting the actual content and execution instructions for parameter adjustment. This ensures that the device accurately understands the received control information. Based on the decoded signal, the module can perform the corresponding state adjustment (such as adjusting brightness) and, after the adjustment is complete, feedback the new state to the device control component. Significance: The state adjustment module ensures that the device responds quickly to received instructions, ensuring that user operations and needs are met promptly, thereby improving the user experience. The feedback mechanism ensures that the device state is updated promptly after the adjustment is completed and informs the device control component of the current state, facilitating the system's subsequent judgment and decision-making. This process is particularly important for adjustments in dynamic environments, helping the system to instantly adapt to environmental changes.

[0133] In summary, this embodiment achieves efficient operation of the device control components through the complementary functions of their respective functions. The command parsing module ensures accurate reception and understanding of commands; the signal orchestration module converts commands into specific control signals through state reading and signal generation; and the state adjustment module is responsible for receiving signals and executing specific state adjustments. This ensures that the device can quickly and accurately respond to the adjustment requests from the command center, thereby achieving the effectiveness and intelligence of the ambient brightness adjustment system, improving the overall user experience and system performance.

[0134] Example 11: Figure 11 As shown, based on Examples 1 to 10, the method for adjusting ambient brightness based on screen content display provided by the embodiment of the present invention includes the following steps:

[0135] S100: Visualizing the content to be displayed is realized through the main running program; at the same time, the display content is encoded to form a video stream and sent to the video channel;

[0136] S200: Receive a video stream sent by a video channel, analyze the display content contained in the video stream, and parse out the hidden instructions contained in the display content; at the same time, transmit the hidden instructions to a command center, and the command center converts the hidden instructions into device adjustment instructions;

[0137] S300: The command center responds to the device adjustment command via the network connection, sends a radio frequency signal to the device according to the response, and the device adjusts according to the response.

[0138] The working principle and beneficial effects of the above technical solution are as follows: This embodiment first visualizes the content to be displayed through the main running program; simultaneously, the displayed content is encoded to form a video stream, which is sent to the video channel; secondly, the video stream sent by the video channel is received, the displayed content contained in the video stream is analyzed, and hidden instructions contained in the displayed content are parsed; simultaneously, the hidden instructions are transmitted to the command center, which converts the hidden instructions into device adjustment instructions; finally, the command center responds to the device adjustment instructions through a network connection, and based on the response, a radio frequency signal is sent to the device, which then adjusts accordingly. In step S100 of the above solution, visualization and video stream encoding are performed. The main running program visualizes the content to be displayed, ensuring that users can intuitively view the information to be displayed and enhancing user interaction with the content; the visualized content is encoded into a video stream format and sent to the video channel. This process converts static content into a dynamic display, facilitating subsequent processing. Significance: Through visualization, users can more clearly understand and perceive information, thereby improving the user-friendliness of the system; after being encoded into a video stream, the information can be transmitted in a standardized format, applicable to various network environments, achieving cross-device compatibility, and ensuring real-time information updates and display. Step S200: Video stream analysis and hidden command parsing. It can receive the video stream sent by the video channel, perform real-time analysis on it, and identify the display content contained therein, thereby ensuring the efficiency and responsiveness of the system; by processing the analyzed content, it extracts the adjustment instructions hidden in the display content, and transmits these instructions to the command center. Significance: The extraction of hidden instructions realizes the ability to dynamically adjust parameters such as ambient brightness, enabling the system to intelligently respond to the needs of different display content; automatically extracting instructions from the video stream reduces the need for human intervention, improves the degree of system automation, and makes the adjustment more efficient and trustworthy. Step S300: Device adjustment instruction execution. Through the network connection to the command center, the device can receive the adjustment instructions in a timely manner and perform corresponding processing; generating and sending radio frequency signals to the device actually converts the parsed instructions into specific commands that can be understood and executed by the corresponding hardware. Significance: The device can respond quickly and adjust the brightness, contrast or other display parameters in real time according to the received instructions to improve visual comfort; by adjusting parameters, the device can better adapt to environmental changes (such as lighting conditions) and optimize user experience and content display effects.

[0139] In summary, the three steps of this embodiment constitute a complete ambient brightness adjustment process. Through visualization and real-time encoding of video streams, the system can better analyze the displayed content and extract adjustment information from it. Subsequently, the dynamically generated instructions are quickly transmitted to the device to ensure real-time adjustment. Overall, this not only improves the user experience, but also enhances the intelligence, automation, and adaptability of the system, effectively meeting the needs of different users in different environments and promoting seamless connection between information technology and smart home devices.

[0140] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the present invention's equivalent technologies, the present invention is also intended to include these modifications and variations.

Claims

1. An ambient brightness adjustment system based on screen content display, characterized in that: Include: The screen display component is responsible for realizing the visualization of the content to be displayed through the main running program; at the same time, it encodes the display content to form a video stream and sends it to the video channel; The content analysis component is responsible for receiving the video stream sent by the video channel, analyzing the display content contained in the video stream, and resolving the hidden instructions contained in the display content; at the same time, the hidden instructions are transmitted to the command center, and the command center converts the hidden instructions into device adjustment instructions; The device control component is responsible for responding to the device adjustment command through the network connection command center, sending the RF signal to the device according to the response, and the device adjusts according to the response.

2. The ambient brightness adjustment system based on screen content display according to claim 1, characterized in that: Screen display component, including: The type and attribute corresponding module is responsible for setting the object that generates the hidden instruction for the content to be displayed; The instruction set object association module is responsible for obtaining the first position of the content to be displayed where the object is located, confirming the second position of the object pointed to by the hidden instruction through the first position, and associating the hidden instruction with the object through a mapping strategy according to the second position to form content including the hidden instruction and the object; The startup program triggering module is responsible for automatically triggering the startup program containing the hidden instructions and the object content when the object is displayed on the screen, and sending the content containing the hidden instructions and the object to the command center for parsing.

3. The ambient brightness adjustment system based on screen content display according to claim 2, characterized in that: The objects in the type and attribute correspondence module include text, color, image and function; at the same time, different types of hidden instructions are set according to the objects, and the types correspond to the specific attributes of the objects.

4. The ambient brightness adjustment system based on screen content display according to claim 2, characterized in that: Type and attribute corresponding modules, including: The attribute definition submodule is responsible for defining the attributes of the object through the initialization method; The instruction generation submodule is responsible for traversing all attributes of the object, parsing the type and specific value of each attribute, and determining the category of the attribute; referencing the predefined rule set, which is designed based on the mapping relationship between the attribute category and the expected behavior; generating a special hidden instruction structure based on the parsing result of each attribute, which contains the instruction type and required parameters; The confirmation and mapping submodule is responsible for recording the relationship between all instruction types and corresponding attributes and establishing mappings. Each attribute is mapped to the corresponding hidden instruction type.

5. The ambient brightness adjustment system based on screen content display according to claim 4, characterized in that: The attributes in the attribute definition submodule include: text content, color value, image path, function data and information storage; the initial state of the object including visibility and activation state is set to the default value.

6. The ambient brightness adjustment system based on screen content display according to claim 2, characterized in that: Instruction set object association module, including: The position conversion submodule is responsible for confirming the reachable area by analyzing the first position; the second position is responsible for calculating the interactive area or state of the object at the first position after logical deduction; The instruction association submodule is responsible for converting the first position into the second position and determining the corresponding instruction; After obtaining the second position, checking the hidden instructions related to the current position to confirm whether the area of ​​the current position belongs to a certain interaction category; The structure formation submodule is responsible for forming a new data structure after the instruction and the object are successfully associated, which includes: the object text content, color and function attribute information and the corresponding hidden instruction type and parameters.

7. The ambient brightness adjustment system based on screen content display according to claim 6, characterized in that: The area at the current position in the instruction association submodule belongs to a certain interaction category, and the area will be associated with the corresponding hidden instruction.

8. The ambient brightness adjustment system based on screen content display according to claim 1, characterized in that: The screen display component also includes: The resolution processing module is responsible for obtaining the content to be displayed and confirming the format of the content, which includes images, videos and animations; the format is to dynamically capture the current frame at a preset time, perform resolution processing, and change the content to the target resolution; The code stream sorting module is responsible for calculating the motion vector between the current frame and the previous frame, performing discrete cosine transform processing, converting the spatial domain signal into a frequency domain signal, quantizing the discrete cosine transform coefficients, performing Huffman coding on the quantized content, and generating a code stream; Divide the code stream into segments and prioritize each segment based on its acquisition timestamp; The video stream encapsulation module is responsible for encapsulating the encoded content according to priority to form a standard data packet structure, that is, obtaining a video stream sorted according to priority.

9. The ambient brightness adjustment system based on screen content display according to claim 8, characterized in that: The standard data packet structure of the video stream encapsulation module includes: video frame data, timestamp, frame number, video resolution, encoding format and frame rate.

10. A method for adjusting ambient brightness based on screen content display, characterized in that: The following steps are involved: Through the main running program, the visualization of the content to be displayed is realized; at the same time, the display content is encoded to form a video stream and sent to the video channel; Receive the video stream sent by the video channel, analyze the display content contained in the video stream, and parse out the hidden instructions contained in the display content; at the same time, transmit the hidden instructions to the command center, and the command center converts the hidden instructions into equipment adjustment instructions; The command center responds to the device adjustment command through a network connection, sends a radio frequency signal to the device according to the response, and the device adjusts according to the response.

Images