Method and system for remotely switching screen modes
Through user authentication and behavior analysis, remote screen mode switching is optimized, solving the problems of low security, chaotic window arrangement and high energy consumption in traditional technologies, and achieving safe and stable display effects and energy efficiency management.
Patent Information
- Application Number
- CN202510504301.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-22
- Publication Date
- 2025-09-26
- Estimated Expiration
- 2045-04-22
AI Technical Summary
Traditional remote screen mode switching technology lacks dynamic permission control, resulting in low operational security, chaotic window arrangement, poor display effects, high energy consumption, and inability to adapt to different lighting conditions, affecting the visual experience and energy efficiency of remote work.
By obtaining user authentication information, analyzing user behavior characteristics, identifying abnormal operations, adjusting window layout and display parameters, combining content type and lighting conditions, optimizing display mode, and achieving dynamic permission control and energy-saving management.
It enhances the security and operational stability of remote devices, optimizes window arrangement, improves visual experience, adapts to different lighting conditions, and improves energy efficiency management.
Smart Images

Figure CN120434283B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of remote control technology, and in particular to a method and system for remotely switching screen modes. Background Art
[0002] The field of remote control technology aims to enable the operation and management of remote devices through networks or communication methods. Its core content is to enable users to remotely control the operating status, display content, or function settings of another device from their local device through data transmission and command interaction. Remote control technology involves network communication protocols, data transmission encryption, device status synchronization, and user interface design. It is applied in scenarios such as remote office, remote maintenance, and distance education, aiming to overcome geographical limitations and improve the flexibility and efficiency of device management. The overall technical field covers the collaborative work of hardware devices, software systems, and network infrastructure to achieve an efficient and secure remote operation experience.
[0003] Among them, the method of remotely switching screen modes refers to the technology of adjusting the screen display mode through a remote control device over the network. The technical matters targeted by the patent subject include switching of screen resolution, adjustment of display direction, and configuration of multi-screen mode. Through the remote desktop protocol or screen management software, the control instructions are transmitted from the local device to the remote device. After receiving the instructions, the remote device calls the relevant interface of the operating system or graphics card driver to complete the screen mode switching operation, which mainly relies on the collaborative work of network communication, instruction parsing, and device hardware drivers.
[0004] Traditional screen mode switching technology lacks dynamic permission control during the remote screen mode switching process, which makes the operation security of remote devices low and there is a risk of unauthorized changes to the screen mode. After the display mode is changed, the task window fails to adapt to the new screen layout, resulting in chaotic window arrangement and affecting the stability of remote operation. The display mode adjustment fails to meet the needs of different content types, resulting in reduced text clarity, limited video playback smoothness, and image color distortion, affecting the visual experience of remote work. It cannot automatically adjust the brightness and contrast according to changes in ambient light, making the screen display unstable under different lighting conditions, which can easily lead to visual fatigue. It still maintains high energy consumption operation in a low-interaction state, increasing energy consumption in remote office and remote monitoring scenarios. Summary of the Invention
[0005] In order to solve the technical problems existing in the prior art, the embodiments of the present invention provide a method and system for remotely switching screen modes. The technical solution is as follows:
[0006] In order to achieve the above object, the present invention adopts the following technical solution, a method for remotely switching screen modes, comprising the following steps:
[0007] S1: Obtain user authentication information, identify device identification and identity permission level information, extract user input behavior characteristics, identify abnormal behavior and send a secondary verification request, parse the user's operation instructions, extract mode change parameters, and obtain the operation instruction parsing results;
[0008] S2: using the analysis result of the operation instruction, analyzing the task windows on the screen after the display mode is changed, identifying the window layout, calculating the distance between the windows, analyzing the window overlap, and adjusting the window positions and arrangement order according to the window priorities to establish window adjustment adaptation parameters;
[0009] S3: Using the window to adjust the adaptation parameters, analyzing the requirements of each content type for multiple display parameters, combining the real-time display window, analyzing the proportion of each content type, matching the display mode adjustment suggestion information and sending it to the user, thereby generating content adaptability parameters;
[0010] S4: Using the content adaptability parameters, a light sensor is used to collect ambient light intensity data in real time, and the brightness compensation value is calculated in combination with the rated screen reflectivity data. In combination with the brightness distribution characteristics of the displayed image, the visual effect of the image is evaluated, the contrast parameters are adjusted, and the ambient light adaptation parameters are established.
[0011] As a further solution of the present invention, the operation instruction parsing result includes user authentication status, identity authority level data, and secondary verification request information; the window adjustment adaptation parameters include window priority data, window layout information, window spacing data, and window arrangement order data; the content adaptability parameters include content type classification information, display parameter requirement data, and real-time display window data; the ambient light adaptation parameters include brightness compensation value, picture brightness distribution characteristic data, and display contrast parameters.
[0012] As a further solution of the present invention, the steps of obtaining user authentication information, identifying device identification and identity authority level information, extracting user input behavior characteristics, identifying abnormal behavior and sending a secondary verification request, parsing the user's operation instructions, extracting mode change parameters, and obtaining the operation instruction parsing results are specifically as follows:
[0013] S101: Obtain user authentication information, extract identification data, including device identification, user account credentials, and permission level information, monitor user interaction behavior in real time, extract behavioral features, and generate user identification parameters;
[0014] S102: Calling the user identity recognition parameters, analyzing the stability of the interactive behavior, detecting abnormal operation data, and sending a secondary identity verification request to obtain a secondary verification trigger request;
[0015] S103: calling the secondary verification trigger request, parsing the user's operation instruction in real time, extracting mode change related parameters, obtaining the display mode adjustment value, and obtaining the operation instruction parsing result.
[0016] As a further solution of the present invention, the steps of using the analysis results of the operation instruction to identify the window layout by analyzing the task windows on the screen after the display mode is changed, calculating the distance between windows, analyzing the window overlap, and adjusting the window position and arrangement order according to the window priority to establish the window adjustment adaptation parameters are as follows:
[0017] S201: Switching the display mode based on the analysis result of the operation instruction, analyzing the task windows on the changed screen, including extracting the size, position, and priority data of multiple windows, and generating window distribution parameters;
[0018] S202: Based on the window distribution parameters, according to the distances between the multiple windows and the geometric dimensions of the windows, the overlapping areas between the multiple windows are calculated, the adjustment requirements of the windows are evaluated, and the window overlap data is generated;
[0019] S203: Based on the window overlap data, adjust the position and arrangement priority of the window, and establish window adjustment adaptation parameters.
[0020] As a further solution of the present invention, the window is used to adjust the adaptation parameters, the requirements of each content type for multiple display parameters are analyzed, the proportion of each content type is analyzed in combination with the real-time display window, and the display mode adjustment suggestion information is matched and sent to the user. The steps of generating content adaptability parameters are specifically as follows:
[0021] S301: calling the window to adjust the adaptation parameters, analyzing the display parameter requirements of each content type, including text, video, and picture, and establishing content type display requirement data;
[0022] S302: Calling the content type display demand data, combining it with the content distribution data of the real-time display window, calculating the proportion of each content type in the current screen, and establishing content type proportion analysis data;
[0023] S303: Call the content type ratio analysis data, calculate the matching degree between the screen display content and each display mode in real time, send adjustment suggestion information to the user, and establish content adaptability parameters.
[0024] As a further solution of the present invention, the specific formula for real-time calculation of the matching degree between the screen display content and each display mode is:
[0025]
[0026] Calculate content matching parameters;
[0027] Among them, M c′ Represents the content matching parameter, P i′ Represents the proportion of the i′th category content in the current screen, R i′,c′ represents the recommendation ratio of the i′th category content in display mode c′, W i′ represents the importance weight of the i′th category of content, n′ represents the total number of content categories, c′ represents the index of the display mode, and i′ is the index of the content type.
[0028] As a further solution of the present invention, the steps of using the content adaptability parameters, using a light sensor to collect ambient light intensity data in real time, combining the rated screen reflectivity data, calculating the brightness compensation value, combining the brightness distribution characteristics of the displayed image, evaluating the visual effect of the image, adjusting the contrast parameter, and establishing the ambient light adaptation parameters are specifically as follows:
[0029] S401: Calling the content adaptability parameters, using a light sensor to obtain ambient light intensity data in real time, combining the rated reflectivity data of the screen, calculating the screen brightness adaptation range under the current lighting conditions, and establishing screen brightness adaptation parameters;
[0030] S402: Calling the screen brightness adaptation parameter, calculating the brightness compensation value by analyzing the change trend of the ambient light intensity, and establishing the brightness adjustment parameter;
[0031] S403: Calling the brightness adjustment parameter, analyzing the brightness distribution of the display screen in real time, evaluating the visual effect of the screen, adjusting the contrast parameter of the display, and establishing the ambient light adaptation parameter.
[0032] As a further embodiment of the present invention, the method further comprises:
[0033] S5: Utilizing the ambient light adaptation parameters, the user's input behavior characteristics, including the number of mouse movements, keyboard input intervals, and window switching frequency, are analyzed to calculate screen usage activity. Combined with the amount of dynamic updates to the screen content, the screen usage status is evaluated, the screen display mode is adjusted, and energy-saving mode adaptation parameters are established.
[0034] The energy-saving mode adaptation parameters include screen usage activity data, screen usage status evaluation data, and display mode adjustment data.
[0035] As a further solution of the present invention, the ambient light adaptation parameters are used to analyze the user's input behavior characteristics, including the number of mouse movements, keyboard input intervals, and window switching frequency, to calculate the screen usage activity, combine the dynamic update amount of the screen content, evaluate the screen usage status, adjust the screen display mode, and establish the energy-saving mode adaptation parameters in the following steps:
[0036] S501: Calling the ambient light adaptation parameter to extract user input behavior characteristics, including the number of mouse movements, keyboard input intervals, and window switching frequency, calculate the activity of the user's interactive behavior, and analyze the changing trend of the interaction frequency to establish screen usage activity data;
[0037] The specific formula for calculating the activity of user interaction behavior is:
[0038]
[0039] Calculate the interactive behavior activity parameters;
[0040] Among them, U a is the activity parameter of user interaction behavior, w m is the weight coefficient of mouse movement, w k is the weight coefficient entered by the keyboard, w w is the weight coefficient of window switching, w a is the weight coefficient of mouse movement acceleration, w r is the weight coefficient of keyboard input rate, M d A is the cumulative distance the mouse moves. m is the mouse movement acceleration, K c The total number of characters entered on the keyboard, R k is the keyboard input rate, W c is the total number of window switches, T is the time period;
[0041] S502: Calling the screen usage activity data, obtaining dynamic update data of the current screen content, calculating the continuity of content update, and establishing screen usage status evaluation data based on the user interaction frequency;
[0042] S503: calling the screen usage status evaluation data, comparing it with a preset energy-saving mode switching threshold, adjusting the display mode of the screen, and establishing energy-saving mode adaptation parameters.
[0043] On the other hand, a system for remotely switching screen modes is provided, which is applied to a method for remotely switching screen modes, and the system includes:
[0044] The identity and authority management module extracts the user's input behavior characteristics based on user authentication information, detects abnormal operation behavior and triggers a secondary verification request, parses the user's operation instructions and extracts mode change parameters, and obtains the operation instruction parsing results;
[0045] The window layout optimization module identifies the task window layout after the screen mode change based on the analysis result of the operation instruction, calculates the relative distance and overlapping area between the windows, adjusts the position and arrangement order of the windows according to the priority of the windows, and obtains the window adjustment adaptation parameters;
[0046] The content mode recommendation module adjusts the adaptation parameters of the window based on the window, identifies the display parameter requirements of each content type, calculates the matching degree between the screen display content and each display mode in real time based on the proportion of content types in the real-time display window, and sends adjustment suggestion information to the user to establish content adaptability parameters;
[0047] The brightness contrast adjustment module collects ambient light intensity data in real time based on the content adaptability parameters, calculates the screen brightness compensation value in combination with the screen rated reflectivity data, adjusts the contrast parameters by analyzing the brightness distribution of the displayed screen, and establishes the ambient light adaptation parameters;
[0048] The screen status energy-saving module analyzes the user input behavior characteristic data based on the ambient light adaptation parameters, calculates the screen usage activity value, combines the screen dynamic update data, evaluates the screen usage status, adjusts the screen display mode parameters, and establishes energy-saving mode adaptation parameters.
[0049] The beneficial effects brought about by the technical solution provided by the embodiment of the present invention include at least:
[0050] By detecting input behavior characteristics, the security protection capabilities of remote devices are enhanced. By analyzing window distribution, the arrangement of task windows is optimized, and window misalignment, occlusion, and overlap are reduced. Combined with content type recognition, the display effect is more in line with scene requirements, improving the visual experience. Display parameters are automatically adjusted according to external lighting conditions to improve visibility in different environments. By evaluating the usage status of the device and adjusting the screen display mode, the energy efficiency management of remote devices is enhanced. BRIEF DESCRIPTION OF THE DRAWINGS
[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0052] Figure 1 It is a schematic diagram of the workflow of the present invention;
[0053] Figure 2 It is a system flow chart of the present invention. DETAILED DESCRIPTION
[0054] The technical solution of the present invention is described below in conjunction with the accompanying drawings.
[0055] In the embodiments of the present invention, words such as "exemplarily" and "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as an "exemplary" in the present invention should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of the word "exemplary" is intended to present concepts in a concrete manner. Furthermore, in the embodiments of the present invention, "and / or" can mean both or either of the two.
[0056] In the embodiments of the present invention, the terms "image" and "picture" may be used interchangeably. It should be noted that, when the distinction between them is not emphasized, their intended meanings are the same. The terms "of," "corresponding," and "corresponding" may be used interchangeably. It should be noted that, when the distinction between them is not emphasized, their intended meanings are the same.
[0057] In the embodiments of the present invention, sometimes a subscript such as W1 may be written as a non-subscript such as W1. When the difference is not emphasized, the meanings to be expressed are the same.
[0058] In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.
[0059] See also Figure 1 The present invention provides a technical solution, a method for remotely switching screen modes, comprising the following steps:
[0060] S1: Obtain user authentication information, identify device identification and identity permission level information, extract user input behavior characteristics, identify abnormal behavior and send a secondary verification request, parse the user's operation instructions, extract mode change parameters, and obtain the operation instruction parsing results;
[0061] S2: Using the results of the operation command analysis, the task windows on the screen after the display mode change are analyzed to identify the window layout, calculate the distance between windows, analyze the window overlap, and adjust the window position and arrangement order according to the window priority to establish the window adjustment adaptation parameters;
[0062] S3: Utilizes the window to adjust adaptation parameters, analyzes the requirements of each content type for various display parameters, combines the real-time display window, analyzes the proportion of each content type, matches the display mode adjustment suggestion information, and sends it to the user to generate content adaptability parameters;
[0063] S4: Using content adaptability parameters, a light sensor collects ambient light intensity data in real time. This data is combined with the rated screen reflectivity data to calculate brightness compensation values. Combined with the brightness distribution characteristics of the displayed image, the visual effect of the image is evaluated, contrast parameters are adjusted, and ambient light adaptation parameters are established.
[0064] S5: Utilizes ambient light adaptation parameters to analyze user input behavior characteristics, including mouse movement times, keyboard input intervals, and window switching frequency, to calculate screen usage activity. Combined with the dynamic update volume of screen content, the screen usage status is evaluated, the screen display mode is adjusted, and energy-saving mode adaptation parameters are established.
[0065] The results of the operation instruction analysis include user authentication status, identity authority level data, and secondary verification request information. The window adjustment adaptation parameters include window priority data, window layout information, window spacing data, and window arrangement order data. The content adaptability parameters include content type classification information, display parameter requirement data, and real-time display window data. The ambient light adaptation parameters include brightness compensation value, picture brightness distribution characteristic data, and display contrast parameters. The energy-saving mode adaptation parameters include screen usage activity data, screen usage status evaluation data, and display mode adjustment data.
[0066] The steps for obtaining user authentication information, identifying device identification and identity permission level information, extracting user input behavior characteristics, identifying abnormal behavior and sending a secondary verification request, parsing user operation instructions, extracting mode change parameters, and obtaining the operation instruction parsing results are as follows:
[0067] S101: Obtain user authentication information, extract identification data, including device identification, user account credentials, and permission level information, monitor user interaction behavior in real time, extract behavioral features, and generate user identification parameters;
[0068] Obtain user authentication information and extract identity data, including device identification, user account credentials, and permission level information. Call the identity authentication server to read the user's device unique identification and extract account credential data from the security chip or key storage area of the user's terminal device. Parse the encrypted hash value of the credential, calculate the credential integrity check code, and compare it with the user key stored in the authentication server to determine the authenticity of the account credential. After obtaining the authentication status, extract the user's permission level information. Combined with the permission structure of the identity database, match the user's operation permissions on the remote device and calculate the user's permission level value. If the permission level value is less than the set access permission threshold, terminate the subsequent operation. Otherwise, enter the behavior feature extraction phase, monitor the user's interaction data in real time, collect the number of mouse clicks, keyboard input intervals, touch operation rate, and remote command input mode, and input the data into the behavior analysis engine. Calculate the user's average input response time, smooth the user interaction frequency using the window sliding average method, generate a stability trend curve of the user's operation behavior, extract interaction feature points, and calculate the behavior stability index. If the index is lower than the set threshold, record the current behavior abnormality. Combined with the user's identity information, establish the interaction behavior matching parameter, calculate the matching difference, and obtain the user's identity identification parameters. Calculate the user's permission level value:
[0069]
[0070] Among them, P u is the user authority level value, W h is the historical authority weight recorded by the user in the database, W c Determines the authority weight of the current device to the user.
[0071] If a user's historical permission weight is W h =8, the current device authority weight determination value is W c =6, then we can calculate:
[0072]
[0073] If the set access permission threshold is 5, the user can continue the operation; otherwise, access will be denied.
[0074] S102: Calling user identity recognition parameters, analyzing the stability of interactive behavior, detecting abnormal operation data, and sending a secondary identity verification request to obtain a secondary verification trigger request;
[0075] Call the user identity identification parameters, analyze the stability of the interactive behavior, detect abnormal operation data, extract the time series data of the user operation trajectory, calculate the response time of the user input, use Z-score normalization to calculate the user behavior volatility, and judge whether the user's current operation mode is abnormal based on the interactive behavior trend curve. If the behavior volatility is higher than the abnormal judgment threshold, the user's operation behavior is marked as abnormal. Further analyze the characteristics of the abnormal behavior, obtain the type of abnormal input command, including abnormal patterns such as rapid mouse movement, continuous repeated input, and short-term high-frequency input after abnormally long stagnation. Combined with past behavior records, calculate the matching index of abnormal behavior. If the abnormal behavior matching degree is higher than a specific threshold, the secondary authentication mechanism is triggered, the security policy engine is called, and a secondary verification request is generated. It is sent to the user terminal using the security authentication protocol, requiring the user to provide additional authentication methods, such as entering a one-time verification code, fingerprint verification, or facial recognition, to obtain a secondary verification trigger request. Calculate user behavior volatility:
[0076]
[0077] Among them, B s is the user behavior volatility, T r is the user's current input response time, μ r is the historical average response time of users, σ r The standard deviation of the user input time.
[0078] If the user's current input response time is T r =1.2s, historical average response time μ r =0.8s, standard deviation of input time σ r =0.3s, then:
[0079]
[0080] If the anomaly determination threshold is 1.2, the user behavior is marked as abnormal and a secondary identity verification request will be triggered.
[0081] S103: Invoke a secondary verification trigger request, parse the user's operation instruction in real time, extract mode change related parameters, obtain the display mode adjustment value, and obtain the operation instruction parsing result;
[0082] Call the secondary verification trigger request, parse the user's operation instructions in real time, extract the mode change related parameters, extract the user's input instruction data stream in the remote session, analyze the target operation type in the instruction data packet, obtain the screen mode change category involved in the instruction, including resolution adjustment, display direction switching, multi-screen mode configuration, etc., and calculate the current remote device's display mode status, call the screen status parsing engine, compare the mode change parameters requested by the user with the device's current display mode parameters, calculate the adjustment range required for the mode change, match the optimal mode adjustment plan based on the resolution, refresh rate and display direction supported by the device, and determine whether the current mode adjustment requires administrator authorization. If necessary, send a mode change approval request to the administrator account, obtain authorization confirmation, parse the mode adjustment parameters, calculate the scope of the mode change, and adjust the display mode adjustment parameters based on the user's operation behavior analysis results, and finally obtain the operation instruction parsing results. Calculate the mode change adjustment range:
[0083] M d =|R t -R s |;
[0084] Among them, M d Adjust the range for mode change, R t is the target resolution requested by the user, R s The current resolution of the device.
[0085] If the user requests a target resolution of R t =1920×1080, the current resolution of the device is R s =1366×768, then we get:
[0086] M d =|1920×1080-1366×768|=|2073600-1049088|=1024512;
[0087] If the calculated adjustment range exceeds the maximum supported resolution of the device, the system will reject the mode change request and require the user to select a resolution within the adaptation range.
[0088] Using the results of the operation command analysis, the task windows on the screen after the display mode change are analyzed to identify the window layout, the distance between windows is calculated, the window overlap is analyzed, and the window positions and arrangement order are adjusted according to the window priorities. The specific steps for establishing window adjustment adaptation parameters are as follows:
[0089] S201: Based on the result of the operation instruction analysis, the display mode is switched and the task windows on the changed screen are analyzed, including extracting the size, position, and priority data of multiple windows and generating window distribution parameters;
[0090] Based on the results of the operation instruction analysis, the display mode is switched, the task window data in the changed screen is extracted, the size, position, and priority information of all windows are obtained, the window data analysis unit is called, the boundary coordinate data of each window is read, the window width and height are calculated, and normalized in combination with the screen resolution, the window position is converted into numerical data in the relative coordinate system, the window area is calculated, the proportion of the window on the screen is extracted, and it is determined whether the window exceeds the current display area. The display priority value of the window is obtained, and the window list is arranged from high to low according to the priority value. A window hierarchy relationship is established, and the hierarchy depth of each window is calculated. If the window hierarchy depth exceeds the set threshold, the window is marked as an overlay state. Combined with the window display parameters, the layout characteristics of the task window are calculated, and the window alignment analysis method is used to calculate the adjacent distance between windows. If the distance between windows is less than the minimum visible gap threshold, the window is recorded as being in a close proximity state, and the window distribution parameters are finally generated. Calculate the window ratio:
[0091]
[0092] Among them, A w is the window ratio, W w is the window width, H w is the window height, W s is the screen width, H s is the screen height.
[0093] If the window size is 800×600 pixels and the screen size is 1920×1080 pixels, then the calculation is:
[0094]
[0095] The window takes up 23.14% of the total screen area.
[0096] S202: Based on the window distribution parameters, the distances between the multiple windows, and the geometric dimensions of the windows, the overlapping areas between the multiple windows are calculated, the adjustment requirements of the windows are evaluated, and the window overlap data is generated;
[0097] Based on the window distribution parameters, according to the distance between multiple windows and the geometric dimensions of the windows, the overlapping area between multiple windows is calculated, the coordinates of the upper left corner and the lower right corner of each window are obtained, the boundary intersection of adjacent windows is calculated, the horizontal overlapping area of the two windows is determined, and the x-axis coordinates of the starting intersection and the ending intersection are calculated. If the starting coordinate is less than the ending coordinate, the horizontal overlapping width is calculated, the vertical overlapping area is calculated, and the y-axis coordinate intersection of the window is obtained. If the starting y coordinate is less than the ending y coordinate, the vertical overlapping height is calculated. The overlapping area of the windows is calculated using the intersection area calculation method. If the overlapping area exceeds the set overlapping threshold, the window is marked as needing adjustment, and the coordinate data of the overlapping area is recorded. Combined with the priority of the task window, the adjustment requirements of the window are calculated to generate the window overlapping data. Calculate the window overlapping area:
[0098] A o =(X e -X s )×(Y e -Y s );
[0099] Among them, A o is the window overlap area, X s is the starting x coordinate of the overlapping area, X e The ending x coordinate of the overlapping area, s is the starting y coordinate of the overlapping area, Y e The ending y coordinate of the overlapping area.
[0100] If the starting coordinates of the intersection area of the two windows (X s ,Y s )=(500,300), ending coordinate (X e ,Y e )=(700,500), then we can calculate:
[0101] A o =(700-500)×(500-300)=200×200=40000;
[0102] The overlapping area of the window is 40,000 pixels. If this value exceeds the set overlap adjustment threshold, the window needs to be adjusted.
[0103] S203: Based on the window overlap data, adjust the window position and arrangement priority, and establish window adjustment adaptation parameters;
[0104] Based on the window overlap data, the position and arrangement priority of the window are adjusted. The window adjustment unit is called to read the arrangement order of the current window and calculate the possible offset after the window adjustment. According to the window priority value, the window adjustment strategy is determined. If the window priority is low, the window position is adjusted to avoid the high-priority window. The adjusted window coordinate value is calculated. According to the screen boundary constraint, it is determined whether the window exceeds the screen boundary. If it exceeds, the window coordinate is clipped and the final arrangement order of the window is calculated. According to the coordinate data of the adjusted window, the window layout structure is rebuilt and the window hierarchy information is established to finally generate the window adjustment adaptation parameters. Calculate the window offset:
[0105] D w =P c -P a ;
[0106] Among them, D w is the window offset, P c is the position of the current window before adjustment, P a The position of the window after adjustment.
[0107] If the position P of a window before adjustment c = 600 pixels, the adjusted position P a =750 pixels, then we get:
[0108] D w =600-750=-150;
[0109] The window is offset to the right by 150 pixels. If the offset exceeds the screen boundary, coordinate correction is required.
[0110] Use the window to adjust the adaptation parameters, analyze the requirements of each content type for various display parameters, combine the real-time display window, analyze the proportion of each content type, match the display mode adjustment suggestion information and send it to the user. The specific steps for generating content adaptability parameters are as follows:
[0111] S301: Calling a window to adjust adaptation parameters, analyzing the display parameter requirements of each content type, including text, video, and image, and establishing content type display requirement data;
[0112] Call the window to adjust the adaptation parameters, analyze the display parameter requirements of each content type, read all window information on the current screen, extract the content category identification data in the window, including text, video, and pictures, obtain the format information of each content category, call the content analysis unit, detect the main content features in each window, calculate the content category ratio of the window, obtain the color information, contrast parameters, and frame rate requirements of the content, determine the font size, line spacing, and clarity parameters of the text content, calculate the color range, brightness average, and pixel density of the picture content, analyze the refresh rate, dynamic range, and frame rate data of the video content, match the supportable display parameter range based on the requirement parameters of each category of content, calculate the degree of matching between the content and the display parameters, and if the matching degree is lower than the set content matching threshold, record the adjustment requirements of the window and establish the content type display requirement data. Calculate content matching degree:
[0113]
[0114] Among them, M c is the content matching degree, P d is the current display parameter, P s The optimal parameters required for the content.
[0115] If the optimal refresh rate of a video content is P s =120Hz, the current screen refresh rate is P d =60Hz, then we can calculate:
[0116]
[0117] The matching degree is 0.5. If the matching degree is lower than 0.8, the display parameters of the window need to be adjusted.
[0118] S302: Calling content type display demand data, combining it with content distribution data of the real-time display window, calculating the proportion of each content type in the current screen, and establishing content type proportion analysis data;
[0119] Call the content type display demand data, combine it with the content distribution data of the real-time display window, obtain the number of all windows on the current screen, extract the coordinate position, size and content category of each window, calculate the area ratio of the window, obtain the distribution of each content category on the screen, calculate the total area of each content type, call the window layout analysis unit, determine the distribution weight of text, picture and video content, calculate the relative proportion of each content type on the screen, if the proportion of a certain content type exceeds a specific proportion threshold of the total screen area, mark the content as the dominant type, record the distribution data of the content, and establish content type proportion analysis data. Calculate content type proportion:
[0120]
[0121] Among them, R c is the content type ratio, A c is the total area of the current content category, A s is the total screen area.
[0122] If the total area of the text content window is A c =800,000 pixels, total screen area is A s =1920000 pixels, then we get:
[0123]
[0124] The text content accounts for 41.67%. If the text content accounts for more than 40%, the content type is recorded as the dominant display content on the screen.
[0125] S303: Calling content type ratio analysis data, calculating the matching degree between the screen display content and each display mode in real time, and sending adjustment suggestion information to the user to establish content adaptability parameters;
[0126] The specific formula for real-time calculation of the matching degree between the screen display content and each display mode is:
[0127]
[0128] Calculate content matching parameters;
[0129] Among them, M c′ Represents the content matching parameter, P i′ Represents the proportion of the i′th category content in the current screen, R i′,c′ represents the recommendation ratio of the i′th category content in display mode c′, W i′ represents the importance weight of the i′th category of content, n′ represents the total number of content categories, c′ represents the index of the display mode, and i′ is the index of the content type.
[0130] formula:
[0131]
[0132] Detailed explanation of the formula and the process of formula calculation and derivation:
[0133] The formula is used to calculate the content matching parameter. The result is used to measure the degree of adaptation between the current screen display content and different display modes. The lower the matching degree, the more suitable the display mode is for the current screen content.
[0134] Parameter meaning and setting value
[0135] P i′For the proportion of the i′th category of content in the current screen, set the video proportion to 40%, the text proportion to 35%, and the image proportion to 25%;
[0136] R i′,c′ The recommended proportion of the i′th category of content in display mode c′ is set to 50% for videos, 30% for text, and 20% for images.
[0137] W i′ is the importance weight of the i′th category content, which is set to 0.6 for video, 0.3 for text, and 0.1 for image;
[0138] n′ is the total number of content categories, which is set to 3;
[0139] c′ is the index value of the display mode;
[0140] Substitute the parameters into the formula for calculation
[0141] |P 视频 -R 视频,c′ |·W 视频 =|0.40-0.50|×0.6=0.10×0.6=0.06;
[0142] |P 文本 -R 文本,c′ |·W 文本 =|0.35-0.30|×0.3=0.05×0.3=0.015;
[0143] |P 图像 -R 图像,c′ |·W 图像 =|0.25-0.20|×0.1=0.05×0.1=0.005;
[0144]
[0145] A result of 0.08 indicates that the current screen content and the display mode match well, and the mode is suitable for the current content and does not need to be adjusted. If the match is too high, the system will push adjustment suggestions to the user, prompting the user to select a display mode more suitable for the current content.
[0146] Using content adaptability parameters, a light sensor collects ambient light intensity data in real time, combines it with rated screen reflectivity data, calculates brightness compensation values, evaluates the visual effects of the display based on the brightness distribution characteristics of the display, adjusts contrast parameters, and establishes ambient light adaptation parameters. Specific steps are as follows:
[0147] S401: Calling content adaptability parameters, using a light sensor to obtain ambient light intensity data in real time, combining it with the rated reflectivity data of the screen, calculating the screen brightness adaptation range under the current lighting conditions, and establishing screen brightness adaptation parameters;
[0148] Call the content adaptability parameters, use the light sensor to obtain ambient light intensity data in real time, read the light intensity value detected by the light sensor, extract the numerical data of the current light level, obtain the rated reflectivity parameter of the screen surface, combine the ambient light data and reflectivity parameter, calculate the ambient light impact value received by the current screen, analyze the light reflection of the screen at different angles, calculate the impact of viewing angle changes on screen brightness, use ambient light adaptation analysis to calculate the optimal screen brightness range, and if the ambient light intensity exceeds the set brightness adaptation threshold, perform brightness range correction and adjust the adaptation parameters to make it meet the current lighting conditions. Finally, establish the screen brightness adaptation parameters. Calculate the impact of light on screen brightness:
[0149]
[0150] Among them, L s The ambient light on the screen surface affects the brightness, L e is the ambient light intensity, R s is the reflectivity of the screen surface.
[0151] If the ambient light intensity is L e =500lx, screen reflectivity is R s =0.15, then we can calculate:
[0152]
[0153] The ambient light on the screen surface affects the brightness of 88.24lx. If it exceeds the screen brightness adaptation range, the screen brightness needs to be adjusted.
[0154] S402: Calling screen brightness adaptation parameters, calculating brightness compensation values by analyzing the changing trend of ambient light intensity, and establishing brightness adjustment parameters;
[0155] Call the screen brightness adaptation parameters, analyze the changing trend of the ambient light intensity, obtain the light data recorded by the light sensor in different time periods, calculate the rate of change of the ambient light intensity, determine the rising or falling trend of the light level, extract the maximum and minimum light values within the change range, calculate the average light level, use light fluctuation analysis to calculate the adjustment range required for brightness compensation, and if the light change rate exceeds the set brightness adjustment threshold, perform brightness compensation correction and adjust the brightness parameters to make it smoothly transition to a level that adapts to the current light, and finally establish the brightness adjustment parameters. Calculate the ambient light change rate:
[0156]
[0157] Among them, R l is the rate of change of light, L t is the current light intensity, L p is the light intensity in the previous time period, T t is the current time, T p For the previous time.
[0158] If the current time T t =10s, the previous time T p =5s, current light intensity L t =600lx, the light intensity at the previous time L p =400lx, then we can calculate:
[0159]
[0160] The illumination change rate is 40 lx / s. If the rate exceeds the set illumination compensation threshold (eg, 30 lx / s), brightness compensation adjustment needs to be performed.
[0161] S403: Calling brightness adjustment parameters, analyzing the brightness distribution of the display screen in real time, evaluating the visual effect of the screen, adjusting the contrast parameters of the display, and establishing ambient light adaptation parameters;
[0162] Call the brightness adjustment parameters, analyze the brightness distribution of the display screen in real time, obtain the current screen brightness mean data, extract the distribution of bright and dark areas of the image content, calculate the balance of the screen brightness distribution, obtain the contrast parameters, analyze whether the current contrast is adapted to the light level, and if there is a deviation between the screen contrast and the optimal adaptation value, calculate the optimal contrast adjustment value, use the brightness and contrast matching calculation to adjust the contrast parameters of the display to adapt it to the current lighting environment, and finally establish the ambient light adaptation parameters. Calculate the optimal contrast adjustment value:
[0163]
[0164] Among them, C a is the adjusted contrast value, C o is the current contrast, L s The ambient light on the screen surface affects the brightness, L m For maximum adaptive light brightness.
[0165] If the current contrast C o =1.2, ambient light affects brightness L s =90lx, maximum adaptive light luminance L m =300lx, then we can calculate:
[0166]
[0167] The optimal contrast after adjustment is 0.84. If this value deviates from the current contrast, adjustment is performed.
[0168] Using ambient light adaptation parameters, we analyze the user's input behavior characteristics, including the number of mouse movements, keyboard input intervals, and window switching frequency, to calculate the screen usage activity. Combined with the amount of dynamic updates to the screen content, we evaluate the screen usage status and adjust the screen display mode. The specific steps for establishing energy-saving mode adaptation parameters are as follows:
[0169] S501: Invoke ambient light adaptation parameters to extract user input behavior characteristics, including mouse movement times, keyboard input intervals, and window switching frequency, calculate the activity of user interaction behavior, analyze the changing trend of interaction frequency, and establish screen usage activity data;
[0170] The specific formula for calculating the activity of user interaction behavior is:
[0171]
[0172] Calculate the interactive behavior activity parameters;
[0173] Among them, U a is the activity parameter of user interaction behavior, w m is the weight coefficient of mouse movement, w k is the weight coefficient entered by the keyboard, w w is the weight coefficient of window switching, w a is the weight coefficient of mouse movement acceleration, w r is the weight coefficient of keyboard input rate, M d A is the cumulative distance the mouse moves. m is the mouse movement acceleration, K c The total number of characters entered on the keyboard, R k is the keyboard input rate, W c is the total number of window switches, T is the time period;
[0174] formula:
[0175]
[0176] Detailed explanation of the formula and the process of formula calculation and derivation:
[0177] The formula is used to calculate the activity of user interaction behavior. The result is used to evaluate the intensity of user screen interaction within a specific time period. It is based on the weighted sum of the cumulative mouse movement distance, the number of keyboard input characters, the number of window switches, the mouse movement acceleration and the keyboard input rate. It is normalized by the monitoring period to provide a stable interaction behavior evaluation indicator.
[0178] Parameter meaning and setting value:
[0179] M d The cumulative distance the mouse moves during the monitoring period, in millimeters, is set to 3200mm;
[0180] K c The total number of characters input by the keyboard during the monitoring period, in characters, with a set value of 4800 characters;
[0181] W c The total number of window switches within the monitoring period, in times, with a set value of 40 times;
[0182] A m is the average acceleration of the mouse movement, in millimeters per second squared, and the specific value is 15mm / s 2 ;
[0183] R k The average keyboard input rate is expressed in characters per second, with a specific value of 8 characters per second.
[0184] w m 、w k 、w w 、w a 、w r They are the corresponding parameter weight coefficients, and set the mouse cumulative movement distance weight w m =0.25, weight of the number of characters input by keyboard w k =0.35, window switching times weight w w =0.15, mouse movement acceleration weight w a =0.15, keyboard input rate weight w r =0.10;
[0185] T is the monitoring time period, in seconds, and the setting value is 600s;
[0186] Substitute the parameters into the formula for calculation:
[0187]
[0188] Results a=4.15 indicates that the user's interactive behavior activity is in the medium-high range during the 600-second monitoring period. This result is used to determine whether the user is in a frequent interaction state and serves as a basis for further adjustments to the screen display mode.
[0189] S502: Calling screen usage activity data, obtaining dynamic update data of the current screen content, calculating the continuity of content updates, and establishing screen usage status evaluation data based on user interaction frequency;
[0190] Call the screen usage activity data to obtain the dynamic update data of the current screen content, extract the number of screen update frames in different time intervals, calculate the screen refresh frame rate per unit time, detect the changing area of the screen content, record the total amount of pixel changes between the previous and next frames, calculate the dynamic change of the screen content update, combine the user interaction frequency, analyze the synchronization between user input behavior and screen content changes, calculate the continuity of content updates, use time series analysis methods to calculate the rate of change of screen content, extract the screen refresh rate curve in the recent period, calculate the average refresh rate, combine the interaction frequency data, evaluate the stability of content updates, calculate the correlation index of content changes, and if the content update rate exceeds the set threshold, adjust the update evaluation value to finally establish the screen usage status evaluation data. Calculate the dynamic change of screen content:
[0191]
[0192] Among them, C d is the dynamic change of screen content, P t and P t-1 are the total pixel changes of the current frame and the previous frame respectively, and T is the time interval.
[0193] If the pixel change of the screen within a certain period of time is P t =5000 pixels, the change in the previous frame is P t-1 =3000 pixels, time interval T = 5 seconds, then we can calculate:
[0194]
[0195] The calculated dynamic change amount of the screen content is 400. If this value exceeds the set update continuity threshold, it indicates that the screen content is updated quickly.
[0196] S503: Calling the screen usage status evaluation data, comparing it with the preset energy-saving mode switching threshold, adjusting the screen display mode, and establishing energy-saving mode adaptation parameters;
[0197] Call the screen usage status evaluation data, compare it with the preset energy-saving mode switching threshold, obtain the trigger conditions of the energy-saving mode, calculate the current screen activity index and the adaptability of the energy-saving mode, analyze the changing state of the screen content, calculate the dynamic change rate of the content, extract the current activity data, compare the activity of the user interaction behavior with the content change rate, calculate the stability of the screen state, and determine whether the screen is in a low-activity state. If the screen activity is lower than the set energy-saving threshold, calculate the adjustment range of the display mode, adopt a dynamic adjustment strategy, adjust the screen display mode, reduce the refresh rate, reduce power consumption, and finally establish the energy-saving mode adaptation parameters. Calculate the adaptability of the energy-saving mode:
[0198] E a =U a -C d ;
[0199] Among them, E a is the energy-saving mode adaptability index, U a is the user interaction activity, C d The amount of dynamic change in screen content.
[0200] If the user interaction activity U is calculated a =8.05, dynamic change of screen content C d =400, then we can calculate:
[0201] E a =8.05-400=-391.95;
[0202] If the trigger threshold of energy saving mode is -350, then E a Below that threshold, the system triggers energy-saving mode, adjusting screen brightness and refresh rate to reduce power consumption.
[0203] See also Figure 2 , a system for remotely switching screen modes, the system for remotely switching screen modes is used to execute the above-mentioned method for remotely switching screen modes, and the system includes:
[0204] The identity and authority management module extracts the user's input behavior characteristics based on user authentication information, detects abnormal operation behavior and triggers a secondary verification request, parses the user's operation instructions and extracts mode change parameters, and obtains the operation instruction parsing results;
[0205] The window layout optimization module identifies the task window layout after the screen mode change based on the operation instruction analysis results, calculates the relative distance and overlapping area between windows, adjusts the position and arrangement order of windows according to their priorities, and obtains window adjustment adaptation parameters;
[0206] The content mode recommendation module adjusts the adaptation parameters based on the window, identifies the display parameter requirements of each content type, and calculates the matching degree between the screen display content and each display mode in real time based on the real-time display window content type ratio. It then sends adjustment suggestions to the user and establishes content adaptability parameters.
[0207] The brightness contrast adjustment module collects ambient light intensity data in real time based on content adaptability parameters. Combined with the screen's rated reflectivity data, it calculates the screen brightness compensation value. By analyzing the brightness distribution of the displayed screen, it adjusts the contrast parameters and establishes the ambient light adaptation parameters.
[0208] The screen status energy-saving module analyzes user input behavior characteristic data based on ambient light adaptation parameters, calculates the screen usage activity value, combines the screen dynamic update data, evaluates the screen usage status, adjusts the screen display mode parameters, and establishes energy-saving mode adaptation parameters.
[0209] The above embodiments can be implemented in whole or in part through software, hardware (such as circuits), firmware, or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer program are loaded or executed on a computer, the process or function according to the embodiments of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired method (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that contains a collection of one or more available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, or magnetic tape), an optical medium (such as a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state drive.
[0210] It should be understood that the term "and / or" as used herein simply describes a relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A alone, A and B together, or B alone. A and B can be singular or plural. Furthermore, the character " / " as used herein generally indicates an "or" relationship between the associated objects, but it may also indicate an "and / or" relationship. For specific understanding, please refer to the context.
[0211] In this disclosure, "at least one" means one or more, and "plurality" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, "at least one of a, b, or c" can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or plural.
[0212] It should be understood that in various embodiments of the present invention, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
[0213] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present invention.
[0214] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described equipment, devices and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0215] In the several embodiments provided by the present invention, it should be understood that the disclosed devices, apparatuses and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interface, indirect coupling or communication connection of the device or unit, which can be electrical, mechanical or other forms.
[0216] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.
[0217] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0218] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0219] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present invention should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.
Claims
1. A method for remotely switching screen modes, characterized in that: The method comprises: S1: Obtain user authentication information, identify device identification and identity permission level information, extract user input behavior characteristics, identify abnormal behavior and send a secondary verification request, parse the user's operation instructions, extract mode change parameters, and obtain the operation instruction parsing results; S2: using the analysis result of the operation instruction, analyzing the task windows on the screen after the display mode is changed, identifying the window layout, calculating the distance between the windows, analyzing the window overlap, and adjusting the window positions and arrangement order according to the window priorities to establish window adjustment adaptation parameters; S3: Using the window to adjust the adaptation parameters, analyzing the requirements of each content type for multiple display parameters, combining the real-time display window, analyzing the proportion of each content type, matching the display mode adjustment suggestion information and sending it to the user, thereby generating content adaptability parameters; S4: Using the content adaptability parameters, a light sensor is used to collect ambient light intensity data in real time, and the brightness compensation value is calculated in combination with the rated screen reflectivity data. In combination with the brightness distribution characteristics of the displayed image, the visual effect of the image is evaluated, the contrast parameters are adjusted, and the ambient light adaptation parameters are established.
2. The method for remotely switching screen modes according to claim 1, characterized in that: The operation instruction parsing result includes user authentication status, identity authority level data, and secondary verification request information; the window adjustment adaptation parameters include window priority data, window layout information, window spacing data, and window arrangement order data; the content adaptability parameters include content type classification information, display parameter requirement data, and real-time display window data; the ambient light adaptation parameters include brightness compensation value, picture brightness distribution characteristic data, and display contrast parameters.
3. The method for remotely switching screen modes according to claim 1, wherein: The steps for obtaining user authentication information, identifying device identification and identity permission level information, extracting user input behavior characteristics, identifying abnormal behavior and sending a secondary verification request, parsing user operation instructions, extracting mode change parameters, and obtaining the operation instruction parsing results are as follows: S101: Obtain user authentication information, extract identification data, including device identification, user account credentials, and permission level information, monitor user interaction behavior in real time, extract behavioral features, and generate user identification parameters; S102: Calling the user identity recognition parameters, analyzing the stability of the interactive behavior, detecting abnormal operation data, and sending a secondary identity verification request to obtain a secondary verification trigger request; S103: calling the secondary verification trigger request, parsing the user's operation instruction in real time, extracting mode change related parameters, obtaining the display mode adjustment value, and obtaining the operation instruction parsing result.
4. The method for remotely switching screen modes according to claim 1, wherein: The steps of analyzing the task windows on the screen after the display mode change using the operation instruction analysis results to identify the window layout, calculating the distance between windows to analyze the window overlap, and adjusting the window positions and arrangement order according to the window priorities to establish the window adjustment adaptation parameters are as follows: S201: Switching the display mode based on the analysis result of the operation instruction, analyzing the task windows on the changed screen, including extracting the size, position, and priority data of multiple windows, and generating window distribution parameters; S202: Based on the window distribution parameters, according to the distances between the multiple windows and the geometric dimensions of the windows, the overlapping areas between the multiple windows are calculated, the adjustment requirements of the windows are evaluated, and the window overlap data is generated; S203: Based on the window overlap data, adjust the position and arrangement priority of the window, and establish window adjustment adaptation parameters.
5. The method for remotely switching screen modes according to claim 1, characterized in that: The steps of using the window to adjust the adaptation parameters, analyzing the requirements of each content type for multiple display parameters, combining the real-time display window, analyzing the proportion of each content type, matching the display mode adjustment suggestion information and sending it to the user, and generating content adaptability parameters are as follows: S301: calling the window to adjust the adaptation parameters, analyzing the display parameter requirements of each content type, including text, video, and picture, and establishing content type display requirement data; S302: Calling the content type display demand data, combining it with the content distribution data of the real-time display window, calculating the proportion of each content type in the current screen, and establishing content type proportion analysis data; S303: Call the content type ratio analysis data, calculate the matching degree between the screen display content and each display mode in real time, send adjustment suggestion information to the user, and establish content adaptability parameters.
6. The method for remotely switching screen modes according to claim 5, characterized in that: The specific formula for real-time calculation of the matching degree between the screen display content and each display mode is: Calculate content matching parameters; Among them, M c′ Represents the content matching parameter, P i′ Represents the proportion of the i′th category content in the current screen, R i′,c′ represents the recommendation ratio of the i′th category content in display mode c′, W i′ represents the importance weight of the i′th category of content, n′ represents the total number of content categories, c′ represents the index of the display mode, and i′ is the index of the content type.
7. The method for remotely switching screen modes according to claim 1, characterized in that: The steps of using the content adaptability parameters, collecting ambient light intensity data in real time using a light sensor, calculating the brightness compensation value in combination with the rated screen reflectivity data, evaluating the visual effect of the screen in combination with the brightness distribution characteristics of the display screen, adjusting the contrast parameters, and establishing the ambient light adaptation parameters are as follows: S401: Calling the content adaptability parameters, using a light sensor to obtain ambient light intensity data in real time, combining the rated reflectivity data of the screen, calculating the screen brightness adaptation range under the current lighting conditions, and establishing screen brightness adaptation parameters; S402: Calling the screen brightness adaptation parameter, calculating the brightness compensation value by analyzing the change trend of the ambient light intensity, and establishing the brightness adjustment parameter; S403: Calling the brightness adjustment parameter, analyzing the brightness distribution of the display screen in real time, evaluating the visual effect of the screen, adjusting the contrast parameter of the display, and establishing the ambient light adaptation parameter.
8. The method for remotely switching screen modes according to claim 1, wherein: The method further comprises: S5: Utilizing the ambient light adaptation parameters, the user's input behavior characteristics, including the number of mouse movements, keyboard input intervals, and window switching frequency, are analyzed to calculate screen usage activity. Combined with the amount of dynamic updates to the screen content, the screen usage status is evaluated, the screen display mode is adjusted, and energy-saving mode adaptation parameters are established. The energy-saving mode adaptation parameters include screen usage activity data, screen usage status evaluation data, and display mode adjustment data.
9. The method for remotely switching screen modes according to claim 1, characterized in that: The steps of establishing the energy-saving mode adaptation parameters are as follows: using the ambient light adaptation parameters, analyzing the user's input behavior characteristics, including the number of mouse movements, keyboard input intervals, and window switching frequency, calculating the screen usage activity, combining the dynamic update amount of the screen content, evaluating the screen usage status, and adjusting the screen display mode. S501: Calling the ambient light adaptation parameter to extract user input behavior characteristics, including the number of mouse movements, keyboard input intervals, and window switching frequency, calculate the activity of the user's interactive behavior, and analyze the changing trend of the interaction frequency to establish screen usage activity data; The specific formula for calculating the activity of user interaction behavior is: Calculate the interactive behavior activity parameters; Among them, U a is the activity parameter of user interaction behavior, w m is the weight coefficient of mouse movement, w k is the weight coefficient entered by the keyboard, w w is the weight coefficient of window switching, w a is the weight coefficient of mouse movement acceleration, w r is the weight coefficient of keyboard input rate, M d A is the cumulative distance the mouse moves. m is the mouse movement acceleration, K c The total number of characters entered on the keyboard, R k is the keyboard input rate, W c is the total number of window switches, T is the time period; S502: Calling the screen usage activity data, obtaining dynamic update data of the current screen content, calculating the continuity of content update, and establishing screen usage status evaluation data based on the user interaction frequency; S503: calling the screen usage status evaluation data, comparing it with a preset energy-saving mode switching threshold, adjusting the display mode of the screen, and establishing energy-saving mode adaptation parameters.
10. A system for remotely switching screen modes, characterized in that: The method for remotely switching screen modes according to any one of claims 1 to 9, wherein the system comprises: The identity and authority management module extracts the user's input behavior characteristics based on user authentication information, detects abnormal operation behavior and triggers a secondary verification request, parses the user's operation instructions and extracts mode change parameters, and obtains the operation instruction parsing results; The window layout optimization module identifies the task window layout after the screen mode change based on the analysis result of the operation instruction, calculates the relative distance and overlapping area between the windows, adjusts the position and arrangement order of the windows according to the priority of the windows, and obtains the window adjustment adaptation parameters; The content mode recommendation module adjusts the adaptation parameters of the window based on the window, identifies the display parameter requirements of each content type, calculates the matching degree between the screen display content and each display mode in real time based on the proportion of content types in the real-time display window, and sends adjustment suggestion information to the user to establish content adaptability parameters; The brightness contrast adjustment module collects ambient light intensity data in real time based on the content adaptability parameters, calculates the screen brightness compensation value in combination with the screen rated reflectivity data, adjusts the contrast parameters by analyzing the brightness distribution of the displayed screen, and establishes the ambient light adaptation parameters; The screen status energy-saving module analyzes the user input behavior characteristic data based on the ambient light adaptation parameters, calculates the screen usage activity value, combines the screen dynamic update data, evaluates the screen usage status, adjusts the screen display mode parameters, and establishes energy-saving mode adaptation parameters.
Citation Information
Patent Citations
Multi-screen linkage demonstration control system and method
CN110661986A
Remote teaching screen automatic switching method and remote teaching system
CN112463091A