Screen display method and system of intelligent ring

Abstract

The invention discloses a screen display method and system for an intelligent ring, and relates to the technical field of screen display methods, and the method comprises the steps: determining a display mode of a screen according to the content displayed by a next interface and the posture of the screen; when the user is in the motion state, the anti-shake coefficient of the screen is determined based on the display mode of the screen and the shake parameter of the screen, so that the dynamic display effect of the next interface is improved; therefore, a plurality of display areas are determined based on the next interface, and abnormal display features are determined according to the plurality of display areas; according to the form of the abnormal display feature, the display area where the abnormal display feature is located and the display content of the next interface, the corresponding interface optimization event is determined, at the moment, the other display areas are in the normal display state, optimization of the abnormal display feature is achieved, and normal display of the other display areas is guaranteed. The multi-layer interface optimization effect of the intelligent ring is ensured, and the screen display effect of the intelligent ring is further improved.

Description

Technical Field

[0001] The present invention relates to the technical field of screen display methods, and particularly to a screen display method and system for an intelligent ring. Background Art

[0002] With the development of technology, intelligent rings have gradually been applied to people's lives and worn on users' hands. The intelligent ring is provided with an electronic screen and displays a corresponding interface through the electronic screen. In the prior art, the electronic screen displays a corresponding interface according to the user's instruction, and the interface is displayed along a preset single mode without considering the diversity of the screen display mode, resulting in a poor dynamic display effect of the next interface. Summary of the Invention

[0003] An object of the present invention is to overcome the deficiencies of the prior art, and the present invention provides a screen display method and system for an intelligent ring.

[0004] An embodiment of the present invention provides a screen display method for an intelligent ring, including: when a user wears the intelligent ring, determining the next interface of the screen according to the user's instruction and the current interface of the screen; determining the display mode of the screen according to the content displayed on the next interface and the posture of the screen, and the display mode includes an inclined plane display mode, a three-dimensional display mode or a curved surface display mode; when the user is in a motion state, determining an anti-shake coefficient of the screen based on the display mode of the screen and the shake parameter of the screen to improve the dynamic display effect of the next interface; determining a plurality of display areas based on the next interface, and determining an abnormal display feature according to the plurality of display areas; determining a corresponding interface optimization event according to the form of the abnormal display feature, the display area where the abnormal display feature is located, and the display content of the next interface, and at this time, the remaining display areas are in a normal display state.

[0005] An embodiment of the present invention provides a screen display system for an intelligent ring. The screen display system for the intelligent ring is applied to the above screen display method for the intelligent ring, and the screen display system for the intelligent ring includes:

[0006] An interface module, configured to determine the next interface of the screen according to the user's instruction and the current interface of the screen when the user wears the intelligent ring;

[0007] A display module, configured to determine the display mode of the screen according to the content displayed on the next interface and the posture of the screen, and the display mode includes an inclined plane display mode, a three-dimensional display mode or a curved surface display mode;

[0008] An anti-shake module, configured to determine an anti-shake coefficient of the screen based on the display mode of the screen and the shake parameter of the screen to improve the dynamic display effect of the next interface when the user is in a motion state;

[0009] Anomaly module, configured to determine multiple display areas based on the next interface, and determine anomaly display features according to the multiple display areas;

[0010] Interface optimization module, configured to determine corresponding interface optimization events according to the form of the anomaly display features, the display area where the anomaly display features are located, and the display content of the next interface. At this time, the remaining display areas are in a normal display state.

[0011] Compared with the prior art, the beneficial effects of the present invention are:

[0012] In the embodiments of the present invention, by the method in the embodiments of the present invention, when the user wears the smart ring, the next interface of the screen is determined according to the user's instruction and the current interface of the screen; the display mode of the screen is determined according to the content displayed on the next interface and the posture of the screen, and the display mode includes an inclined plane display mode, a three-dimensional display mode, or a curved surface display mode; when the user is in a moving state, the anti-shake coefficient of the screen is determined based on the display mode of the screen and the jitter parameter of the screen, which is compatible with the display mode of the screen and the anti-shake coefficient of the screen, fully considering the diversity of the display mode of the screen, so as to improve the dynamic display effect of the next interface;

[0013] Therefore, multiple display areas are determined based on the next interface, and anomaly display features are determined according to the multiple display areas; corresponding interface optimization events are determined according to the form of the anomaly display features, the display area where the anomaly display features are located, and the display content of the next interface. At this time, the remaining display areas are in a normal display state, realizing the optimization of the anomaly display features and ensuring the normal display of the remaining display areas, ensuring the multi-layer interface optimization effect of the smart ring, and further improving the screen display effect of the smart ring. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 is a schematic flowchart of the screen display method of the smart ring in the embodiments of the present invention;

[0015] Figure 2 is a schematic flowchart of step S11 in the screen display method of the smart ring in the embodiments of the present invention;

[0016] Figure 3 is a schematic flowchart of step S12 in the screen display method of the smart ring in the embodiments of the present invention;

[0017] Figure 4 is a schematic flowchart of step S13 in the screen display method of the smart ring in the embodiments of the present invention;

[0018] Figure 5 is a schematic flowchart of step S14 in the screen display method of the smart ring in the embodiments of the present invention;

[0019] Figure 6 It is a schematic flowchart of step S15 in the screen display method of the smart ring in the embodiment of the present invention;

[0020] Figure 7 It is a schematic diagram of the structural composition of the screen display system of the smart ring in the embodiment of the present invention. Specific embodiments

[0021] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention.

[0022] Please refer to Figures 1 to 7 , a screen display method for a smart ring, which is applied to the screen display scenario of the smart ring; the screen of the smart ring can display interfaces such as time, steps, health parameters, calories, etc., and the inner diameter of the smart ring is between 18.3 mm and 22.3 mm; the smart ring is built-in with a Bluetooth chip. The screen display method of the smart ring includes:

[0023] Step S11: When the user wears the smart ring, determine the next interface of the screen according to the user's instruction and the current interface of the screen;

[0024] Step S12: Determine the display mode of the screen according to the content displayed in the next interface and the posture of the screen. The display mode includes an inclined plane display mode, a three-dimensional display mode, or a curved surface display mode;

[0025] Step S13: When the user is in a moving state, determine the anti-shake coefficient of the screen based on the display mode of the screen and the shake parameters of the screen to improve the dynamic display effect of the next interface;

[0026] Step S14: Determine multiple display areas based on the next interface, and determine the abnormal display characteristics according to the multiple display areas;

[0027] Step S15: Determine the corresponding interface optimization event according to the form of the abnormal display characteristics, the display area where the abnormal display characteristics are located, and the display content of the next interface. At this time, the remaining display areas are in a normal display state;

[0028] Refer to Figure 2 , in step S11, when the user wears the smart ring, determine the next interface of the screen according to the user's instruction and the current interface of the screen;

[0029] In the specific implementation process of the present invention, the specific steps are as follows:

[0030] S111: The smart ring is worn on the user's hand and is in a working state; if voice commands, operation commands, and gesture commands of the user are collected within the same time period, multimodal commands are determined based on the synthesis of the voice commands, operation commands, and gesture commands.

[0031] S112: Based on the smart ring, multiple dynamic information of the user is collected, and the motion state of the user is determined according to the multiple dynamic information and the current scenario of the user.

[0032] S113: Determine the final command information according to the motion state of the user and the multimodal commands; determine the interface transformation path based on the final command information and the current interface of the screen, and present the next interface of the screen along with the execution of the interface transformation path.

[0033] In an embodiment of the present application, the smart ring is worn on the user's hand and is in a working state; if voice commands, operation commands, and gesture commands of the user are collected within the same time period, multimodal commands are determined based on the synthesis of the voice commands, operation commands, and gesture commands, ensuring the accuracy of the multimodal commands.

[0034] At this time, the user needs to correctly wear the smart ring on the finger, ensuring that the ring is in close contact with the skin and will not fall off. The smart ring needs to be turned on and in a normal working state, capable of receiving and processing commands from the user; the sensors inside the ring (such as microphones, accelerometers, gyroscopes, etc.) need to be in an active state to collect the user's voice, gesture, and operation commands. Optionally, voice commands: The user verbally utters specific commands, such as "Check the weather" or "Play music"; operation commands: The user issues commands by touching the buttons on the ring or swiping the screen, such as touching the surface of the ring to activate a certain function; gesture commands: The user issues commands through specific hand movements, such as rotating the ring to adjust the volume or flipping the wrist to switch the interface. These commands can appear simultaneously or individually within the same time period.

[0035] Optionally, assume that the user is using the smart ring for navigation; the user wears the ring and is in a working state. At this time, the user simultaneously issues the following commands: Voice command: "Go to the nearest coffee shop"; Operation command: The user touches the "Confirm" button on the ring; Gesture command: The user gently rotates the ring once, indicating that they want to view the list of nearby coffee shops.

[0036] When the smart ring receives multiple types of instructions within the same time period, it needs to use an algorithm to synthesize these instructions; the algorithm takes into account the priority of the instructions (e.g., voice instructions usually have a higher priority than gesture instructions), conflict resolution of the instructions (e.g., when voice instructions and gesture instructions conflict with each other, the system needs to decide which instruction to execute first), and fusion of the instructions (e.g., combining voice instructions and gesture instructions to provide richer control information); ultimately, the algorithm will output a unified multimodal instruction, which will more accurately reflect the user's intentions and needs;

[0037] Optionally, after receiving these instructions, the smart ring performs the following processing: First, the ring recognizes the voice instruction "Go to the nearest coffee shop" as the main navigation request; then, the ring notices that the user has simultaneously tapped the "Confirm" button, which usually indicates that the user agrees or confirms the previous instruction; finally, the ring also notices that the user has rotated the ring, which means that the user wants to view more options or details. Further, the smart ring synthesizes a multimodal instruction: "Confirm and view the navigation information to the nearest coffee shop, and at the same time display a list of nearby coffee shops;" then, the ring adjusts the screen interface according to this instruction to display the navigation information and the coffee shop list to meet the user's needs.

[0038] Further, based on the smart ring collecting multiple dynamic information of the user and determining the user's motion state according to the multiple dynamic information and the user's current scenario, the user's motion state is introduced.

[0039] At this time, the smart ring is equipped with a variety of sensors, such as accelerometers, gyroscopes, magnetometers, etc., for real-time collection of the user's dynamic information. These dynamic information include the user's hand acceleration, angular velocity, direction changes, etc., which can reflect the subtle movements and overall motion trends of the user's hand; the smart ring will also use these sensor data to calculate higher-level motion parameters, such as steps, speed, distance, etc.

[0040] Optionally, assume that the user is using the smart ring for daily activity monitoring; the user wears the smart ring to do fitness training indoors, including multiple stages such as running, jumping, and resting; during the running stage, the smart ring collects significantly increased acceleration and angular velocity data of the user's hand, indicating that the user is performing fast and regular movements; during the jumping stage, the smart ring detects a sharp change in the acceleration data and subsequent rapid recovery, which is in line with the characteristics of jumping movements; during the resting stage, the data collected by the smart ring is relatively stable, indicating that the user is in a stationary or slightly active state; optionally, the smart ring processes these data and extracts motion characteristics, such as the peak value of acceleration, the change range of angular velocity, etc.; by comparing these characteristics with a preset motion pattern library, the smart ring preliminarily judges the types of movements the user is performing in different stages.

[0041] The processor inside the smart ring analyzes and processes the collected dynamic information to extract useful motion features, including the stability of the hand (such as whether it shakes frequently), the smoothness of the motion trajectory (such as whether it moves in a straight line), the range of speed changes, etc. By analyzing these features, the smart ring preliminarily determines which motion state the user is in.

[0042] Optionally, the smart ring also notices that the user is indoors and the ambient noise is relatively low (because it is in the gym). Combining this information, the smart ring finally determines that the user is in the "running" state during the running phase, in the "jumping" state during the jumping phase, and in the "static" state during the rest phase.

[0043] In addition to dynamic information, the smart ring also combines other information to determine the user's motion state, such as time, location, ambient noise, etc. For example, if the user is outdoors and the ambient noise is high, the smart ring will think that the user is walking or running; if the user is indoors and the environment is relatively quiet, it is considered that the user is in a static or slightly active state. The smart ring also uses machine learning algorithms to continuously optimize its judgment accuracy and automatically adjusts the judgment criteria according to the user's habits and environmental changes.

[0044] Therefore, the final instruction information is determined according to the user's motion state and multi-modal instructions. Based on the final instruction information and the current interface of the screen, the interface transformation path is determined, and the next interface of the screen is presented along with the execution of the interface transformation path, taking into account the overall compatibility of the final instruction information and the current interface of the screen, ensuring the accuracy of the interface transformation path.

[0045] At this time, after receiving the user's voice instructions, operation instructions, and gesture instructions (as described in S111), the smart ring combines the currently detected user motion state to comprehensively judge the user's true intention. For example, if the user is walking and issues a voice instruction of "check messages", and at the same time the gesture instruction points to the wrist (meaning to check the messages on the smart watch or ring), the smart ring will combine these information and understand that the user wants to check messages while walking. If there is a conflict between the user's motion state and the instruction (such as the user is driving but issues an instruction that requires fine operation gestures), the smart ring will ignore or adjust certain instructions according to the preset safety rules.

[0046] Specifically, assume that the user is using a smart ring for outdoor running and wishes to view running data. The following is a specific example of how the smart ring determines the final instruction information, the interface transformation path, and presents the next interface: The user wears the smart ring and runs in the park. Suddenly, the user wants to view data such as their running speed, distance, and heart rate. The user issues a voice command of "View running data" while pointing a gesture command at the wrist (where the smart ring is located). The smart ring detects that the user is running (judged by the accelerometer and gyroscope data), and combines the voice and gesture commands to determine that the user's intention is to view running data.

[0047] Once the final instruction information is determined, the smart ring calculates the transformation path required from the current interface to the target interface based on this information and the content displayed on the current screen. This transformation path includes dynamic changes of a series of interface elements, such as sliding, zooming, fading in and out, etc., to ensure that the user can smoothly and intuitively transition to the target interface. The smart ring also considers the impact of the user's motion state on the interface transformation. For example, if the user is running, the interface transformation will be more concise and fast to reduce interference with the user's movement.

[0048] Specifically, the information such as time, date, or weather is displayed on the current screen. The smart ring calculates the transformation path from the current interface to the running data interface based on the user's command and the current interface content. This path includes an animation effect that slides in from the edge of the screen, and the interface displaying the running data gradually covers the current interface.

[0049] According to the determined interface transformation path, the smart ring gradually executes the dynamic changes of the interface elements and finally presents the next interface expected by the user. This process includes the smooth transition of the interface, the addition of animation effects, and necessary user feedback (such as sound prompts, vibrations, etc.). The smart ring also continuously monitors the user's commands and motion states to adjust the interface transformation path or present a new interface when necessary.

[0050] Specifically, along the determined interface transformation path, the smart ring executes the animation effect and gradually presents an interface containing data such as running speed, distance, and heart rate. The user can understand their running status in real time through this interface and make adjustments as needed. This example shows how the smart ring combines the user's motion state and multimodal commands to determine the final instruction information, calculates the interface transformation path based on this information, and finally presents the next interface expected by the user. This intelligent interface transformation method not only improves the user experience but also ensures that the user can conveniently obtain the required information in various motion states.

[0051] In an embodiment of the present application, it is assumed that the user is walking and issues a voice command of "View Messages", while gesturing towards the wrist (the location where the smart ring is located). After the smart ring detects these commands, it looks up the matching table to determine that the final command information is "Display Message List". Then, based on the current time interface content, it calculates the weight scores of all interface conversion paths and selects the path with the highest score, "Swipe from the time interface to the message list". Finally, the smart ring executes a sliding animation effect to smoothly transition the time interface to the message list interface.

[0052] Reference Figure 3 , in step S12, the display mode of the screen is determined according to the content displayed on the next interface and the posture of the screen. The display mode includes an inclined display mode, a three-dimensional display mode, or a curved display mode;

[0053] In the specific implementation process of the present invention, the specific steps are as follows:

[0054] S121: The screen adjusts its posture with the movement of the user, collects multiple posture parameters of the screen within a preset time period, and determines the posture of the screen according to the multiple posture parameters and the real-time position of the screen;

[0055] S122: Collect the content displayed on the next interface, match the corresponding APP for the content, and determine the viewing angle parameter of the user relative to the screen according to the relative position between the user and the screen;

[0056] S123: Determine the first mode parameter according to the content displayed on the next interface and the APP, determine the second mode parameter according to the content displayed on the next interface and the viewing angle parameter, and determine the display mode of the screen according to the first mode parameter, the second mode parameter, and the display mode mapping relationship, which includes an inclined display mode, a three-dimensional display mode, or a curved display mode;

[0057] In an embodiment of the present application, the screen adjusts its posture with the movement of the user, collects multiple posture parameters of the screen within a preset time period, and determines the posture of the screen according to the multiple posture parameters and the real-time position of the screen, taking into account the overall compatibility of multiple posture parameters and the real-time position of the screen to ensure the accuracy of the screen posture.

[0058] At this time, the screen adjusts its posture with the movement of the user. At the same time, the display screen controlled by the smart ring can sense the movement state of the user, including the user's body movement, gesture change, or head rotation, etc.; based on these sensed information, the device will automatically adjust the posture of its screen to ensure that the screen content always remains within the user's best line of sight, or make specific display adjustments according to the user's intention; optionally, sensors (such as accelerometers, gyroscopes, magnetometers, etc.) are used to detect the user's movement to drive actions such as rotation, tilt, or translation of the screen.

[0059] During the process of screen attitude adjustment, the system continuously collects multiple parameters related to the screen attitude. These parameters include the tilt angle of the screen, the rotation direction, the translation distance, and the real-time position relative to the user, etc. The purpose of collecting these parameters is to accurately record the changes of the screen over a period of time for subsequent analysis and determination of the final attitude. At this time, the system uses built-in sensors to directly measure these parameters or indirectly obtains them through technologies such as image recognition. In addition, to obtain more accurate data, the system collects these parameters multiple times at certain time intervals and takes the average value or performs other statistical processing.

[0060] After collecting sufficient attitude parameters, the system combines these parameters with the real-time position information of the screen and determines the final attitude of the screen through algorithm calculation. This final attitude is the attitude that the system believes can best meet the user's viewing needs or conform to the user's intention. At the same time, the system uses a rule engine to analyze and process these parameters to find the optimal screen attitude. For example, if the system detects that the user is tilting their head to one side to better view the screen, it will automatically tilt the screen in the opposite direction to keep the content horizontally displayed.

[0061] Specifically, assume that the user is using a portable display controlled by a smart ring for a video call. The user is sitting on the sofa at a certain distance from the display. During the call, the user slightly adjusts their sitting posture and tilts their head slightly for a more comfortable view of the other person's video. The smart ring detects the changes in the user's sitting posture and head tilt angle and automatically makes a fine adjustment to the display in the opposite direction of the user's tilt to keep the video horizontally displayed.

[0062] During the screen adjustment process, the system continuously collects multiple parameters such as the tilt angle of the display, the rotation direction, and the real-time position relative to the user. The system combines these parameters with the user's viewing needs and determines the final attitude of the display through calculation. In this example, the final attitude is that the display tilts a certain angle in the opposite direction of the user's tilt slightly to keep the video horizontally displayed and achieve the best viewing effect.

[0063] Furthermore, the content displayed on the next interface is collected, the corresponding APP for this content is matched, and the viewing angle parameter of the user relative to the screen is determined according to the relative position between the user and the screen, and the viewing angle parameter is introduced.

[0064] At this time, before the display screen controlled by the smart ring is ready to display the next interface, the system will first collect the content to be displayed on this interface, which includes text, images, videos, or other multimedia elements; the collected content will be used for subsequent APP matching and display mode adjustment, introducing the content to be displayed on the next interface. At the same time, the system will read the interface content from the internal memory or external data sources (such as cloud servers), or obtain it through communication with other devices; the collected content is usually stored in digital form and contains metadata about its type, format, and display requirements.

[0065] Once the content to be displayed on the next interface is collected, the system will automatically match the most suitable APP (application program) for displaying this content according to information such as the type, format, or metadata of the content. This matching process involves the extraction and analysis of content features, as well as the search and comparison of installed APPs in the device; optionally, the system will use algorithms or databases to store and retrieve the association information between APPs and content; when new interface content is collected, the system will query this database, find the matching APP, and prepare to use it for displaying the content.

[0066] After determining the APP and content to be displayed, the system will further analyze the relative position relationship between the user and the screen to determine the viewing angle parameters of the user relative to the screen. These parameters include line-of-sight angle, viewing distance, screen tilt angle, and information such as the user's height and sitting posture; optionally, the system will use sensors (such as cameras, infrared sensors, etc.) to detect the user's position and posture, or indirectly obtain this information through sensors in devices such as smart rings; then, the system will use a preset viewing angle parameter matching table to process this data and match the viewing angle parameters of the user relative to the screen.

[0067] Specifically, assume that the user is using a smart ring to control navigation; the user is walking on a city street and plans to go to a nearby café; the user starts the navigation function through the smart ring, and the navigation information can be displayed through the screen of the smart ring; the system collects the content to be displayed on the navigation interface, including the name, address, estimated arrival time, and route information of the café, etc.; the system automatically matches the navigation APP according to the collected content and prepares to use it for displaying the navigation information. This APP has functions such as displaying maps, routes, and navigation instructions, and is very suitable for walking navigation.

[0068] The system detects the user's position and posture through the sensors in the smart ring, including information such as the user's line of sight direction, viewing distance, and the tilt angle of the smart ring's screen relative to the user's head. Then, the system processes these data using algorithms and calculates the viewing angle parameters of the user relative to the smart ring's screen. These parameters will be used to adjust the display mode of the navigation information to ensure that the user can clearly see the navigation instructions and map information.

[0069] Therefore, determine the first mode parameter according to the content displayed on the next interface and the APP, determine the second mode parameter according to the content displayed on the next interface and the viewing angle parameter, determine the display mode of the screen according to the first mode parameter, the second mode parameter, and the display mode mapping relationship, which includes the inclined plane display mode, the stereoscopic display mode, or the curved surface display mode, and takes into account the overall consideration of the first mode parameter, the second mode parameter, and the display mode mapping relationship to ensure the accuracy of the screen display mode.

[0070] At this time, determine the first mode parameter according to the content displayed on the next interface and the APP. At the same time, after determining the content of the next interface to be displayed and the corresponding APP, the system will analyze the characteristics of these content and APP to determine the first mode parameter. These first mode parameters involve the type of content (such as text, image, video), color scheme, interface layout, interaction method, etc., as well as the specific requirements of the APP for the display mode. Optionally, the system will use a rule engine to parse the metadata of the content and APP, extract key information, and determine the first mode parameter according to this information. The first mode parameter will be used to guide the subsequent display mode selection.

[0071] Specifically, assume that the user is using a virtual reality headset controlled by a smart ring to play a game; the user is playing a racing game and hopes to obtain a more realistic driving experience; the game contains a large amount of 3D images and dynamic video content, as well as complex interaction operations; First mode parameter determination: The system analyzes the characteristics of the game interface and the APP to determine the first mode parameter, which includes the rendering quality of the 3D image, color scheme, interface layout (such as dashboard, steering wheel control, etc.), and interaction method (such as head tracking, gesture control, etc.).

[0072] A second mode parameter is introduced. The second mode parameter is determined based on the content displayed on the next interface and the viewing angle parameters. At the same time, after the first mode parameter is determined, the system will further consider the viewing angle parameters of the user relative to the screen to determine the second mode parameter. These parameters involve the field of view angle, viewing distance, screen tilt angle, stereoscopic display effect, etc., aiming to optimize the user's viewing experience at different viewing angles; optionally, the system will use sensor data (such as the user's line of sight direction, viewing distance, etc.) and algorithms to calculate the viewing angle parameters, and adjust the relevant settings of the display mode according to these parameters; for example, if the system detects that the user is viewing the screen at a large viewing angle, it will increase the field of view angle to improve viewing comfort.

[0073] Specifically, the system determines the second mode parameter according to the user's viewing angle parameters (such as the line of sight direction, head tilt angle, etc.) and the game content. These second mode parameters include the field of view angle (to ensure that the user can see the complete game scene), the screen tilt angle (to match the user's line of sight direction), and the stereoscopic display effect (to enhance the immersion of the game).

[0074] After determining the first and second mode parameters, the system will refer to a preset display mode mapping relationship to determine the display mode that best suits the current scene and user needs. This mapping relationship is a complex algorithm or rule set that outputs the best display mode according to the input mode parameters; optionally, the system will use methods such as machine learning models, decision trees, or look-up tables to implement the display mode mapping relationship; after receiving the first and second mode parameters, the system will query this mapping relationship, find the matching display mode, and prepare to apply it to the screen. At the same time, the inclined plane display mode: the screen is tilted at a certain angle to adapt to the user's line of sight direction and improve viewing comfort; the stereoscopic display mode: through special display technologies and algorithms, the content on the screen presents a three-dimensional stereoscopic effect, enhancing the immersion and visual effect; the arc surface display mode: the screen presents an arc or curved surface shape, providing a wider field of view and a more natural viewing experience.

[0075] Specifically, the system determines the display mode that best suits the current game scene according to the first and second mode parameters and the preset display mode mapping relationship; in this example, the system selects the stereoscopic display mode and adjusts parameters such as the field of view angle and the screen tilt angle to provide the most realistic driving experience; the user can make fine-tuning through the smart ring to ensure that the display mode fully meets their personal preferences and needs.

[0076] In an embodiment of the present application, assume that there is a display mode matching table for determining the display mode according to the interface content, APP characteristics, and viewing angle parameters; the display mode matching table is shown in Table 1:

[0077] Table 1 Display Mode Matching Table

[0078] Interface content APP features Viewing parameters Display mode Text-based Reading APP Frontal view Flat display mode Image-based Image viewing APP Oblique view Inclined display mode Video-based Video playback APP Large field of view Curved display mode 3D model Game / design APP Stereoscopic view Stereoscopic display mode

[0079] Suppose the user is using smart glasses controlled by a smart ring to view a high - resolution landscape photo; Suppose the user is using smart glasses controlled by a smart ring to view a high - resolution landscape photo; The following content: Image - centered (high - resolution landscape photo); APP feature: Picture viewing APP; Viewing angle parameter: The user tilts the head slightly to view the photo at an oblique angle; According to the display mode matching table, these parameters match the "image - centered" interface content, the "picture viewing APP" feature, and the "oblique - angle viewing" viewing angle parameter. Therefore, the system determines to use the bevel display mode to optimize the viewing experience.

[0080] Reference Figure 4 , in step S13, when the user is in a motion state, determine the anti - shake coefficient of the screen based on the display mode of the screen and the jitter parameter of the screen to improve the dynamic display effect of the next interface;

[0081] In the specific implementation process of the present invention, the specific steps are as follows:

[0082] S131: Determine the jitter parameter of the screen according to the type of motion of the user during the motion, the set of the user's motion actions, and the jitter mapping relationship;

[0083] S132: Obtain the viewing angle parameter of the user relative to the screen, and determine the first sub - anti - shake coefficient according to the viewing angle parameter of the user relative to the screen and the jitter parameter of the screen, and determine the second sub - anti - shake coefficient according to the display mode of the screen and the jitter parameter of the screen;

[0084] S133: Determine the anti - shake coefficient of the screen based on the synthesis of the first sub - anti - shake coefficient and the second sub - anti - shake coefficient, trigger the anti - shake control of the screen based on the anti - shake coefficient of the screen, and improve the dynamic display effect of the next interface.

[0085] In the embodiment of the present application, determining the jitter parameter of the screen according to the type of motion of the user during the motion, the set of the user's motion actions, and the jitter mapping relationship takes into account the overall consideration of the type of motion of the user during the motion, the set of the user's motion actions, and the jitter mapping relationship, ensuring the accuracy of the jitter parameter of the screen.

[0086] At this time, the system first collects the user's motion data through sensors (such as accelerometers, gyroscopes, etc.) on the smart ring; According to the collected data, the system uses a preset recognition model to identify the type of motion of the user, such as walking, running, cycling, driving a car, etc.; The preset recognition model is trained based on past motion data and types of motion.

[0087] Optionally, assume that the user is using a smart ring for outdoor running; the accelerometer and gyroscope on the smart ring detect the user's motion data, including the acceleration of the steps and the rapid changes in direction; the system identifies the type of the user's motion as "running" based on this data.

[0088] The system obtains a preset set of motion actions, which contains the typical action features corresponding to various types of motion; the identified type of motion will be matched with the actions in this set to find the action features that best match the current user's motion; the system also maintains a jitter mapping relationship table or model, which defines the corresponding relationship between different motion actions and screen jitter parameters; according to the matched motion action features, the system looks up the jitter mapping relationship to determine the corresponding screen jitter parameters; the screen jitter parameters include the frequency, amplitude, direction, etc. of the jitter.

[0089] Optionally, the system looks up the action features that match "running" in the preset set of motion actions, including continuous acceleration changes, periodicity of steps, etc.; the system successfully matches the features that best match the "running" action.

[0090] The system looks up the jitter mapping relationship table and finds the screen jitter parameters corresponding to the "running" action; assume that the jitter mapping relationship table defines that the jitter frequency of the screen during running is 2 times per second, the amplitude is 5% of the screen height, and the direction is up and down jitter; the system thus determines the screen jitter parameters as a frequency of 2 Hz, an amplitude of 5% of the screen height, and a direction of up and down.

[0091] These jitter parameters will be used to adjust the display mode of the screen or enable a specific anti-shake algorithm to reduce or compensate for the screen jitter caused by the user's motion, thereby improving the user's visual experience; for example, the screen of the smart ring will adjust the image refresh rate or enable the image stabilization function according to these parameters to ensure that the map or video content displayed during running remains clear and stable.

[0092] Furthermore, obtain the viewing angle parameters of the user relative to the screen, and determine the first sub anti-shake coefficient according to the viewing angle parameters of the user relative to the screen and the screen jitter parameters, determine the second sub anti-shake coefficient according to the display mode of the screen and the screen jitter parameters, taking into account the overall consideration of the display mode of the ABC screen and the screen jitter parameters to ensure the accuracy of the second sub anti-shake coefficient.

[0093] At this time, the perspective parameters of the user relative to the screen are obtained, and the first sub-anti-shake coefficient is introduced. The first sub-anti-shake coefficient is determined according to the perspective parameters of the user relative to the screen and the jitter parameters of the screen. At the same time, the system uses a matching table to combine the perspective parameters and the jitter parameters of the screen to calculate a first sub-anti-shake coefficient, which reflects the influence of the user's perspective on the anti-shake requirement. For example, if the user is viewing the screen straight on and the jitter is small, the anti-shake requirement is low; if the user is viewing from the side and the jitter is large, the anti-shake requirement is high.

[0094] The second sub-anti-shake coefficient is introduced. The anti-shake coefficient of the screen is determined according to the display mode of the screen and the jitter parameters of the screen to determine the second sub-anti-shake coefficient. At this time, the system first determines a basic anti-shake requirement according to the current display mode of the screen (such as flat display, bevel display, stereoscopic display, etc.); different display modes have different requirements for anti-shake. For example, the stereoscopic display mode requires higher anti-shake accuracy to maintain the stability of the 3D effect; the system combines the jitter parameters of the screen with the basic anti-shake requirement and adjusts a second sub-anti-shake coefficient through an algorithm or a look-up table, which reflects the combined influence of the display mode and the jitter parameters on the anti-shake requirement.

[0095] Specifically, assume that the user is using a smart ring to watch a 3D movie and the user tilts the head slightly to better view the screen; the camera and sensor on the smart ring detect the action of the user tilting the head slightly and obtain perspective parameters such as the user's line of sight direction and the head tilt angle. The system calculates the first sub-anti-shake coefficient according to the perspective parameters of the user and the jitter parameters of the screen (assuming the jitter caused by the user's slight movement); since the user only tilts the head slightly and the screen jitter is not large, the system calculates a relatively low first sub-anti-shake coefficient, indicating that the current anti-shake requirement is not particularly high.

[0096] The system recognizes that the current display mode of the screen is the stereoscopic display mode, so a relatively high basic anti-shake requirement is determined to maintain the stability of the stereoscopic effect; the system combines the jitter parameters of the screen (also the jitter caused by the user's slight movement) with the basic anti-shake requirement and adjusts a second sub-anti-shake coefficient through an algorithm; since the display mode is stereoscopic display and the stereoscopic effect needs to be maintained stably, even if the jitter is not large, the system calculates a relatively high second sub-anti-shake coefficient, indicating that the current anti-shake requirement is high;

[0097] In practical applications, the system combines the first sub anti-shake coefficient and the second sub anti-shake coefficient (e.g., through a weighted average algorithm) to obtain a final anti-shake coefficient, and adjusts the anti-shake strategy of the screen accordingly; for example, the smart ring adjusts the refresh rate of the image, enables or disables the image stabilization function, adjusts the screen brightness or contrast, etc. based on this final anti-shake coefficient to improve the visual experience of the user when watching a 3D movie.

[0098] Therefore, the anti-shake coefficient of the screen is determined based on the synthesis of the first sub anti-shake coefficient and the second sub anti-shake coefficient, the anti-shake control of the screen is triggered based on the anti-shake coefficient of the screen, and the dynamic display effect of the next interface is improved, which is compatible with the display mode of the screen and the anti-shake coefficient of the screen, and fully considers the diversity of the display mode of the screen.

[0099] At this time, based on the first sub anti-shake coefficient and the second sub anti-shake coefficient calculated previously, a final anti-shake coefficient is determined, and corresponding anti-shake control measures are triggered accordingly to improve the dynamic display effect of the next interface. At the same time, the system synthesizes the first sub anti-shake coefficient and the second sub anti-shake coefficient, usually through weighted average, multiplication or other mathematical operations. The purpose of the synthesis is to obtain an anti-shake coefficient that comprehensively considers the user's perspective, screen jitter and display mode.

[0100] The result after synthesis is the final anti-shake coefficient, which reflects the anti-shake intensity required by the screen under the current conditions. This coefficient will be further adjusted or optimized according to specific situations to ensure the accuracy and stability of the anti-shake effect.

[0101] The system triggers corresponding anti-shake control measures according to the final anti-shake coefficient. These measures include adjusting the refresh rate of the screen, enabling or disabling the image stabilization function, adjusting the screen brightness or contrast, etc. The purpose of anti-shake control is to reduce or eliminate image blurring or distortion caused by user movement or screen jitter and improve the dynamic display effect of the next interface. By triggering anti-shake control measures, the system can improve the display effect of the screen, make the image clearer and more stable, which is crucial for enhancing the user experience, especially in scenarios such as watching videos, playing games or other scenarios that require high dynamic display effects.

[0102] Specifically, assume that the user is using a smart ring to watch a live broadcast of a fast-paced sports game and the user is quickly moving their head to track the key actions in the game. The smart ring system first calculates the first sub anti-shake coefficient based on the user's head movement (fast and large amplitude), and this coefficient reflects the anti-shake requirements due to the rapid change of the user's perspective. Then, the system synthesizes according to the display mode of the screen (assume it is a flat display mode, but the live broadcast of the game itself contains a lot of fast-moving pictures) and the second sub anti-shake coefficient (considering the slight jitter of the screen due to user movement). The result after synthesis is relatively high.

[0103] The system further adjusts and optimizes the synthesized anti-shake coefficient to ensure the accuracy and stability of the anti-shake effect. The finally determined anti-shake coefficient is used to guide the subsequent anti-shake control measures. According to the final anti-shake coefficient, the smart ring system triggers a series of anti-shake control measures, including increasing the screen refresh rate, enabling image stabilization functions (such as electronic image stabilization or optical image stabilization), and adjusting the screen brightness to adapt to different light conditions. Under the combined action of these measures, the image blur and distortion caused by the user's rapid head movement and slight screen jitter are significantly reduced.

[0104] By triggering the anti-shake control measures, the smart ring system significantly improves the dynamic display effect of live sports broadcasts. The image becomes clearer and more stable, and users can more easily track the key actions and details in the game, which not only enhances the user experience but also makes watching the game more enjoyable and immersive.

[0105] In an embodiment of the present application, assume that the weight of the first sub anti-shake coefficient is 0.6 and the weight of the second sub anti-shake coefficient is 0.4; the current first sub anti-shake coefficient is 0.7 (full score of 1), and the second sub anti-shake coefficient is 0.6 (full score of 1); the score of the first sub anti-shake coefficient = 0.7 * 0.6 = 0.42; the score of the second sub anti-shake coefficient = 0.6 * 0.4 = 0.24; the anti-shake coefficient = (0.42 + 0.24) / (0.6 + 0.4) = 0.66 (normalized processing).

[0106] The system selects appropriate measures or combinations of measures from the preset anti-shake control measures according to the anti-shake coefficient (such as 0.66); the system selects to increase the refresh rate to 120Hz and enable the advanced image stabilization algorithm; after the anti-shake control measures take effect, the system evaluates whether the dynamic display effect is improved through sensors or user feedback; the user finds that the image on the screen is more smooth and stable, and the dynamic display effect is significantly improved.

[0107] Reference Figure 5 , in step S14, multiple display areas are determined based on the next interface, and abnormal display characteristics are determined according to the multiple display areas;

[0108] In the specific implementation process of the present invention, the specific steps are as follows:

[0109] S141: Trigger the corresponding area division mode according to the next interface and the corresponding APP, and determine multiple display areas according to the next interface and the area division mode;

[0110] S142: Determine multiple groups of semantic sets based on the synchronous recognition of multiple display regions, determine abnormal semantic segments according to the traversal of multiple groups of semantic sets, and determine the current abnormal region based on the abnormal semantic segments and the real-time images of the corresponding display regions;

[0111] S143: Trigger the overall abnormal detection of the next interface based on the current abnormal region. If additional abnormal regions are collected during the detection process, determine the abnormal display features based on the current abnormal region and the additional abnormal regions.

[0112] In the embodiments of the present application, trigger the corresponding region division mode according to the next interface and the corresponding APP, and determine multiple display regions according to the next interface and the region division mode, taking into account the overall consideration of the next interface and the region division mode, and ensuring the accuracy of multiple display regions.

[0113] At this time, the next interface and the corresponding APP are introduced. At the same time, the system first recognizes the next interface to be displayed, which is usually achieved by parsing the interface data or receiving instructions from the application layer; the interface data includes the layout information, element types, positions, etc. of the interface; the system recognizes the application program (APP) that triggers this interface, which is completed by analyzing the list of currently running application programs, monitoring user operations, or receiving explicit instructions from the application layer.

[0114] Based on the recognized interface and APP, the system selects the most suitable mode for the current situation from the preset region division mode library. These modes vary depending on factors such as APP type, interface layout, user preferences, etc.; for example, the interface of a social media APP adopts a region division mode that emphasizes the display of user-generated content (UGC), while a news reading APP adopts another mode that highlights news headlines and summaries; once the appropriate region division mode is selected, the system triggers this mode to prepare for the next step of determining the display regions.

[0115] Specifically, assume that the user is using a news reading APP named "NewsReader"; when the user clicks on a news headline to view the detailed content, the system first recognizes that the interface to be displayed is the news detailed content interface; then, the system recognizes that the APP that triggers this interface is "NewsReader"; based on this information, the system selects a mode designed specifically for news reading interfaces from the region division mode library, which emphasizes the display of news headlines, text, pictures, and related links; finally, the system triggers this mode to prepare to enter the next step of determining the display regions.

[0116] The system analyzes the layout of the interface to be displayed according to the selected region division mode, which usually involves analyzing the types, sizes, positions, and hierarchies of interface elements; based on the results of the layout analysis, the system divides the interface into multiple display regions according to the requirements of the region division mode, and these regions represent different information blocks, function buttons, or interactive elements; for example, in a news reading interface, the system divides the interface into a title area, a body area, a picture area, and a related link area; the system records information such as the position, size, and type of elements included in each display region for subsequent content recognition, anomaly detection, or user interaction processing.

[0117] Specifically, in the news details interface of the "NewsReader" APP, the system divides the interface into four display regions according to the selected region division mode: a title area (displaying the news title), a body area (displaying the news body), a picture area (displaying pictures related to the news), and a related link area (displaying links to other articles related to the news); the system records the position and size information of each region and is ready to use this information in subsequent steps to identify content, detect anomalies, or process user interactions; the system can automatically select an appropriate region division mode according to the next interface and the corresponding APP and determine multiple display regions based on this, which provides a basis for subsequent content recognition, anomaly detection, and user interaction.

[0118] Furthermore, multiple sets of semantic collections are determined based on the synchronous recognition of multiple display regions, and abnormal semantic segments are determined according to the traversal of multiple sets of semantic collections, and the current abnormal region is determined according to the abnormal semantic segments and the real-time images of the corresponding display regions, taking into account the overall consideration of the abnormal semantic segments and the real-time images of the corresponding display regions, ensuring the accuracy of the current abnormal region.

[0119] At this time, the system simultaneously recognizes and processes the content in multiple display regions, which usually involves technologies such as image recognition, text parsing, and natural language processing; for each display region, the system extracts the semantic information therein, which includes text content, objects or scenes in the image, and the relationships between these elements; the semantic information in each display region is integrated into a semantic collection, and this collection represents the main content and meaning contained in that region; repeat the above process to form a semantic collection for each display region, thus obtaining multiple sets of semantic collections.

[0120] Specifically, assume that in a social media APP, a user is viewing a page containing multiple posts; the system identifies three main display areas on the page: the post title area, the post content area, and the post picture area; for the post title area, the system extracts the title of each post as semantic information; for the post content area, the system parses the text content and extracts keywords and sentences; for the post picture area, the system uses image recognition technology to identify the objects in the picture. In this way, the system forms a semantic set for each display area. For example, the semantic set of the post title area contains keywords such as "travel" and "food", and the semantic set of the post content area contains descriptions of travel locations and evaluations of food.

[0121] The system traverses the semantic sets of each display area and analyzes the semantic information therein; the system applies preset anomaly detection rules to identify semantic segments that do not meet expectations or have potential problems. These rules are based on factors such as content type, keywords, and context relationships; when the system discovers that a certain semantic information in a semantic set violates the anomaly detection rules, it is marked as an abnormal semantic segment.

[0122] Specifically, in the example of the social media APP, the system traverses the semantic sets of the post title area, the post content area, and the post picture area; assume that the system has a rule to identify content that does not match the page theme; in the post content area, the system discovers a section of advertisement content that is completely unrelated to other posts on the page, and this content is therefore marked as an abnormal semantic segment.

[0123] The system associates the marked abnormal semantic segments with the display areas where they are located; for the display areas containing abnormal semantic segments, the system further analyzes the real-time images of these areas (if available), which helps to confirm whether the abnormal semantic segments actually exist in the currently displayed interface; combining the results of the analysis of the abnormal semantic segments and the real-time images, the system determines the currently abnormal display areas.

[0124] Specifically, in the example of the social media APP, the system determines that the post content area containing the abnormal advertisement content is the currently abnormal display area; through real-time image analysis, the system confirms that this advertisement content is indeed displayed on the user's screen and does not match the content of other posts on the page; therefore, the system determines that the current abnormal area is a specific part of the post content area. The system can determine abnormal semantic segments based on the synchronous recognition of multiple display areas and further determine the currently abnormal display areas, which provides a basis for subsequent appropriate handling measures.

[0125] Therefore, based on the current abnormal area, an overall abnormal detection of the next interface is triggered. If additional abnormal areas are collected during the detection process, the abnormal display features are determined according to the current abnormal area and the additional abnormal areas, taking into account both the current abnormal area and the additional abnormal areas as a whole, and ensuring the accuracy of the abnormal display features.

[0126] At this time, once the system determines the current abnormal area, it will immediately trigger an overall abnormal detection of the next interface (which is an updated version of the current interface, a new interface navigated to by the user, or an interface displayed in response to an exception). This detection is comprehensive and aims to identify any abnormalities on the interface.

[0127] The overall abnormal detection involves a comprehensive evaluation of multiple aspects such as the interface layout, element arrangement, text content, image quality, and interaction behavior; the system uses machine learning models, rule engines, or a combination of both to perform this detection. Although the detection is triggered by the current abnormal area, its scope extends to the entire interface because some abnormalities are not just local problems but are related to the overall design or function implementation of the interface.

[0128] Specifically, assume that in an online shopping APP, the user is browsing the product list page; the system detects an abnormality in the product image area, that is, some product images cannot be loaded or are displayed incorrectly; based on this abnormal area, the system triggers an overall abnormal detection of the next interface (i.e., the product details page entered after the user clicks on a product); the detection strategy includes checking whether the layout of the product details page is consistent, whether the product description is accurate, whether the price information is displayed correctly, and whether the user interactions (such as adding to the cart, sharing the product, etc.) work as expected.

[0129] During the process of performing the overall abnormal detection, the system will find other abnormal areas in addition to the abnormal area that initially triggered the detection. These areas are located in different parts of the interface and involve different types of problems (such as text errors, missing images, function failures, etc.).

[0130] Specifically, in the example of the online shopping APP, during the overall abnormal detection of the product details page, the system found that in addition to the problem of unable to load product images, there were also abnormal areas such as spelling mistakes in the product description text, inconsistent price information display (such as different prices displayed on different devices), and the add-to-cart button not responding; the system recorded this information and conducted a preliminary analysis, and found that these problems were related to data synchronization on the server, API call errors, or bugs in the front-end code.

[0131] The system combines the current abnormal area with other abnormal areas found during the detection process to extract common abnormal display features, which include the absence of interface elements, the display of error messages, the failure of interactive functions, etc.; it deeply analyzes the extracted abnormal display features to determine whether they represent specific abnormal patterns or problem categories, which helps the system more accurately identify and handle similar problems.

[0132] Specifically, in the example of a shopping APP, the system determines several key abnormal display features based on multiple detected abnormal areas: inconsistent display of product information (such as mismatched pictures and descriptions), failure of interactive functions (such as unresponsive buttons), and the absence or error of interface elements (such as spelling mistakes); the system generates a detailed abnormal detection report and provides repair suggestions, such as checking the data synchronization logic, fixing API call errors, and updating the front-end code to fix these problems. The system can trigger holistic abnormal detection of the next interface based on the current abnormal area, and collect and analyze other abnormal areas during the detection process, and finally determine the abnormal display features to guide subsequent problem repair and interface optimization work.

[0133] In an embodiment of the present application, assume that in an online video platform APP, the user is viewing the video list page; the system detects an abnormality in the video thumbnail area, that is, some video thumbnails cannot be correctly displayed; based on the current abnormal area, it triggers holistic abnormal detection of the next interface. At this time, the current abnormal area is the video thumbnail area; the user clicks on a certain video to enter the video playback page, and the system triggers holistic abnormal detection of this page.

[0134] During the detection process of the video playback page, the system discovers that in addition to the problem of video thumbnails not being loaded, there are also abnormal areas such as incorrect display of video title text and unresponsive video playback buttons;

[0135] An abnormal display feature matching table is introduced, and this abnormal display feature matching table is shown in Table 2:

[0136] Table 2 Abnormal Display Feature Matching Table

[0137] Abnormal display characteristics Reason Video thumbnail cannot be loaded Server image resources are missing, network request fails Video title text is displayed incorrectly Data synchronization problem, text encoding error Video playback button is unresponsive Front-end code bug, back-end service does not respond

[0138] Based on the detected abnormal areas, the system looks up the corresponding abnormal display features in the abnormal display feature matching table and preliminarily judges the reasons; in this example, the system determines that the abnormal display feature is "abnormal display or function of video-related elements", and the reasons include server resource problems, data synchronization problems, or code bugs, etc.

[0139] Reference Figure 6, in step S15, corresponding interface optimization events are determined according to the form of the abnormal display feature, the display area where the abnormal display feature is located, and the display content of the next interface. At this time, the remaining display areas are in a normal display state;

[0140] In the specific implementation process of the present invention, the specific steps are as follows:

[0141] S151: Determine the form of the abnormal display feature based on the traversal of the abnormal display feature, and mark the display area where the abnormal display feature is located;

[0142] S152: Determine the first interface influence event according to the form of the abnormal display feature and the display area where the abnormal display feature is located, determine the second interface influence event according to the form of the abnormal display feature and the display content of the next interface, and determine the corresponding interface optimization event according to the first interface influence event, the second interface influence event, and the optimization mapping relationship;

[0143] S153: If the remaining display areas in the next interface are running, determine the interface optimization plan according to the interface optimization event and the running process of the remaining display areas, and ensure the normal display of the remaining display areas.

[0144] In the embodiment of the present application, the form of the abnormal display feature is determined based on the traversal of the abnormal display feature, and the display area where the abnormal display feature is located is marked, and the form of the abnormal display feature is introduced.

[0145] At this time, the system will check each detected abnormal display feature one by one, and these features include text errors, image missing, button unresponsive, layout disorder, etc.; the traversal process involves classifying, sorting, or determining the priority of the abnormal features for more effective processing.

[0146] For each abnormal display feature, the system needs to determine its specific form or type, which is usually based on information such as the visual performance of the feature, user feedback, or system logs; the determination of the form involves a detailed analysis of the feature, such as checking the correctness of the text content, the integrity of the image, the interactivity of the button, etc.

[0147] Specifically, assume that in an online learning platform APP, the user is viewing the course list page; the system detects the following abnormal display features: Abnormal feature 1: There is a spelling mistake in the text of a certain course title; Abnormal feature 2: An image of a course cover cannot be displayed; Abnormal feature 3: The "Add to Course Schedule" button is unresponsive.

[0148] The system checks these three abnormal features one by one and classifies them as text errors, image missing, and button interaction problems; for abnormal feature 1, the system analyzes the text content and determines its form as "text spelling error"; for abnormal feature 2, the system checks the image loading status and determines its form as "image missing"; for abnormal feature 3, the system tests the interaction function of the button and determines its form as "button unresponsive".

[0149] The system highlights the course title area where abnormal feature 1 is located on the interface and records the information of this area in the log; for abnormal feature 2, the system replaces the un-displayable image with a placeholder on the interface and records the detailed information of the missing image in the log, including the image URL, loading status, etc.; for abnormal feature 3, the system displays an error prompt icon around the button and records the detailed information of the button unresponsiveness in the log, including the button ID, user click time, system response status, etc.

[0150] Furthermore, determine the first interface impact event according to the form of the abnormal display feature and the display area where the abnormal display feature is located, determine the second interface impact event according to the form of the abnormal display feature and the display content of the next interface, and determine the corresponding interface optimization event according to the first interface impact event, the second interface impact event, and the optimization mapping relationship, taking into account the overall consideration of the form of the abnormal display feature and the display content of the next interface to ensure the accuracy of the second interface impact event.

[0151] At this time, the first interface impact event is introduced. The system needs to analyze the form of each abnormal display feature in detail, such as text errors, image missing, function failure, etc. according to the form of the abnormal display feature and the display area where the abnormal display feature is located; the system evaluates the importance of the display area where these abnormal features are located to the user experience; for example, abnormalities in the title bar or main content area are usually more important than those in the sidebar or bottom navigation bar; based on the form of the abnormal feature and the importance of the area where it is located, the system determines the specific impact events on the first interface (current interface), and these events include information misunderstanding, operation obstruction, visual interference, etc.

[0152] Optionally, assume that in an online shopping APP, the user is viewing the product details page (the first interface) and is about to add it to the shopping cart. The system detects the following abnormal display features: there are spelling mistakes in the product title; the product image fails to load and a placeholder is displayed. The system analyzes the spelling mistakes in the product title and determines that its form is "text error". Since the product title is one of the main channels for users to understand product information, this error causes "information misunderstanding" for users. The system evaluates the impact of the failure to load the product image and determines that its form is "image missing". Since the product image is an important basis for users to judge the appearance and quality of the product, this missing causes "visual interference" and "decreased purchase intention" for users. Based on the above analysis, the system determines that the impact events of the first interface are "information misunderstanding" and "decreased purchase intention caused by visual interference".

[0153] The second interface impact event is introduced. The second interface impact event is determined according to the form of the abnormal display features and the display content of the next interface. At this time, the system needs to know the display content of this interface after the user navigates from the current interface to the next interface. Based on the abnormal display features of the current interface, the system predicts the potential impact of these features on the next interface. For example, if the product information on the current interface is incorrect, it will affect the user's decision-making on the shopping cart or settlement page. The system determines that these potential impacts constitute the second interface impact event, such as the user's decision-making being blocked and the trust level decreasing, etc.

[0154] The system analyzes the interface (the second interface) that the user navigates to after adding the product to the shopping cart, that is, the shopping cart page. The system predicts the impact of the spelling mistakes in the product title and the failure to load the image on the shopping cart page. For example, the title error causes the user to be confused when reconfirming the product information in the shopping cart; the missing image affects the user's overall impression of the product and the purchase decision. Based on the above predictions, the system determines that the impact events of the second interface are "difficulty in confirming product information in the shopping cart" and "blocked purchase decision".

[0155] The system maintains an optimization mapping relationship that associates interface impact events with corresponding interface optimization events. The system looks up the corresponding interface optimization events in the optimization mapping relationship according to the impact events of the first interface and the second interface. The system determines the interface optimization events that need to be executed, and these events include correcting text content, replacing missing images, fixing function failures, etc.

[0156] Optionally, the system maintains an optimization mapping relationship, such as "information misunderstanding" corresponding to "correct text content", "visual interference" corresponding to "replace missing images", etc.; the system looks up the corresponding interface optimization event in the optimization mapping relationship according to the influencing events of the first interface and the second interface; for example, "information misunderstanding" corresponds to "correct the product title text", "visual interference leading to a decline in purchase intention" and "difficulty in confirming product information in the shopping cart" jointly correspond to "replace product images", "hindrance to purchase decision-making" corresponds to "provide detailed product information and user reviews to enhance trust"; based on the above matching, the interface optimization events determined by the system to be executed are "correct the product title text", "replace product images", and "provide detailed product information and user reviews on the shopping cart page".

[0157] Therefore, if the remaining display areas in the next interface are running, the interface optimization plan is determined according to the interface optimization event and the running process of the remaining display areas, and the normal display of the remaining display areas is ensured, which guarantees the multi-layer interface optimization effect of the smart ring and further improves the screen display effect of the smart ring.

[0158] At this time, after determining the interface optimization event, the system needs to check the running status of the remaining display areas in the next interface that the user is about to navigate to, excluding the areas affected by abnormal display features. This involves monitoring the loading of dynamic content, the response to user interactions, the playing of animation effects, etc.

[0159] Optionally, assume that in an online video playback APP, the user is watching a video list page (the first interface) and is about to click on a certain video to enter the playback page (the second interface); the system detects that there is a spelling mistake in the title of a certain video on the video list page and determines the corresponding interface optimization event as "correct the video title text"; before the user clicks on the video to enter the playback page, the system checks the running status of the remaining display areas on this page; for example, whether the video thumbnail is being loaded, whether the play button responds to click events, whether the related video recommendations are being scrolled and updated, etc.

[0160] The system needs to combine the interface optimization event (such as correcting text, replacing images, adjusting layout, etc.) and the current running process of the remaining display areas to formulate an optimization plan that will not interfere with the normal display of these areas; the optimization plan needs to consider how to smoothly update interface elements, how to avoid interface flickering or freezing, how to maintain the coherence of user interactions, etc.

[0161] Optionally, the system combines the optimization event of "correct the video title text" and the running status of the remaining display areas on the playback page to formulate an optimization plan; for example, it is decided to asynchronously load the corrected video title in the background and smoothly display the new title when the user enters the playback page, while avoiding interfering with the loading of the video thumbnail and the response of the play button.

[0162] When implementing the optimization plan, the system needs to ensure that the normal operation of the remaining display areas is not affected, which involves strategies such as asynchronously processing data updates in the background, using transition animations to smoothly display new content, and pausing unnecessary interface updates during user interactions; after the implementation of the optimization plan, the system needs to continuously monitor the operation status of the remaining display areas and the user's feedback on the optimization effect; if any problems are found or the user feedback is poor, the system needs to timely adjust the optimization plan to ensure the continuous improvement of the user experience.

[0163] Specifically, when the system implements the optimization plan, it ensures that when the user enters the playback page, the corrected video title can be smoothly displayed, while the video thumbnail continues to load, the play button normally responds to click events, and the related video recommendations continue to scroll and update. The system continuously monitors the operation status of the remaining display areas on the playback page and the user's feedback on the corrected video title; if problems such as slower video thumbnail loading or delayed play button response are found, the system timely adjusts the optimization plan, such as reducing the frequency of background data updates or optimizing the performance of interface rendering.

[0164] In an embodiment of the present application, assume that in a complex Web application, a user is browsing a page containing multiple dynamic components (referred to as the "current page") and is about to navigate to a new page (referred to as the "next page"); the system detects a spelling error in a text area on the current page and determines that an interface optimization event needs to be executed to correct this error; the system constructs an optimization plan matching table that associates the interface optimization event with the optimization plan; at the same time, the table also considers the operation status and importance of the remaining display areas on the next page. The optimization plan matching table is shown in Table 3:

[0165] Table 3 Optimization Plan Matching Table

[0166]

[0167] When the system detects a text error on the current page, it looks up the corresponding optimization plan in the optimization plan matching table; considering that a video player is playing a video on the next page and its importance is relatively high, the system decides to adopt the optimization plan of "asynchronously loading the corrected text without interrupting the video playback"; for other areas, such as related content recommendations and advertisement banners, the system adopts different optimization strategies according to their operation status and importance respectively; the system implements the optimization plan to ensure that when the user navigates to the next page, the corrected text can be smoothly displayed without interfering with the normal operation of other display areas; for example, while the video player continues to play the video, the system will asynchronously load the corrected text in the background and display it on the user interface at an appropriate time.

[0168] Please refer to Figure 7 , Figure 7 , which is a schematic structural diagram of the screen display system of the smart ring in the embodiment of the present invention; the screen display system of the smart ring includes:

[0169] An interface module 21, configured to determine the next interface of the screen according to the user's instruction and the current interface of the screen when the user wears the smart ring;

[0170] A display module 22, configured to determine the display mode of the screen according to the content displayed in the next interface and the posture of the screen, and the display mode includes an inclined surface display mode, a three-dimensional display mode or a curved surface display mode;

[0171] An anti-shake module 23, configured to determine the anti-shake coefficient of the screen based on the display mode of the screen and the shake parameters of the screen when the user is in a moving state, so as to improve the dynamic display effect of the next interface;

[0172] An exception module 24, configured to determine multiple display areas based on the next interface and determine the abnormal display characteristics according to the multiple display areas;

[0173] An interface optimization module 25, configured to determine the corresponding interface optimization event according to the form of the abnormal display characteristics, the display area where the abnormal display characteristics are located, and the display content of the next interface. At this time, the remaining display areas are in a normal display state.

[0174] Arbitrary combinations of the technical features of the above embodiments are made. For the sake of brevity of description, not all combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in this specification.

Claims

1. A screen display method for a smart ring, characterized in that, Including: When the user wears the smart ring, determine the next interface of the screen according to the user's instructions and the current interface of the screen; Determine the display mode of the screen according to the content displayed on the next interface and the posture of the screen, and the display mode includes an inclined plane display mode, a three-dimensional display mode or a curved surface display mode; When the user is in a moving state, determine the anti-shake coefficient of the screen based on the display mode of the screen and the jitter parameter of the screen to improve the dynamic display effect of the next interface; Determine multiple display areas based on the next interface, and determine the abnormal display characteristics according to the multiple display areas; Determine the corresponding interface optimization event according to the form of the abnormal display characteristic, the display area where the abnormal display characteristic is located, and the content displayed on the next interface. At this time, the remaining display areas are in a normal display state.

2. The screen display method of the smart ring according to claim 1, wherein The step of when the user wears the smart ring, determining the next interface of the screen according to the user's instructions and the current interface of the screen, includes: The smart ring is worn on the user's hand and is in a working state; if voice instructions, operation instructions, and gesture instructions of the user are collected within the same time period, determine the multimodal instruction according to the synthesis of the voice instructions, operation instructions, and gesture instructions; Collect multiple dynamic information of the user based on the smart ring, and determine the motion state of the user according to the multiple dynamic information and the current scene of the user; Determine the final instruction information according to the motion state of the user and the multimodal instruction; determine the interface conversion path based on the final instruction information and the current interface of the screen, and present the next interface of the screen along the execution of the interface conversion path.

3. The screen display method of the smart ring according to claim 1, wherein The step of determining the display mode of the screen according to the content displayed on the next interface and the posture of the screen, and the display mode includes an inclined plane display mode, a three-dimensional display mode or a curved surface display mode, includes: The screen adjusts its posture as the user moves, collects multiple posture parameters of the screen within a preset time period, and determines the posture of the screen according to the multiple posture parameters and the real-time position of the screen; Collect the content displayed on the next interface, match the corresponding APP of the content, and determine the viewing angle parameter of the user relative to the screen according to the relative position between the user and the screen; Determine the first mode parameter according to the content displayed on the next interface and the APP, determine the second mode parameter according to the content displayed on the next interface and the viewing angle parameter, and determine the display mode of the screen according to the first mode parameter, the second mode parameter and the display mode mapping relationship, and cover the inclined plane display mode, the three-dimensional display mode or the curved surface display mode.

4. The screen display method of the smart ring according to claim 1, characterized in that, The step of when the user is in a moving state, determining the anti-shake coefficient of the screen based on the display mode of the screen and the jitter parameter of the screen to improve the dynamic display effect of the next interface, includes: Determine the jitter parameter of the screen according to the motion type of the user during the movement, the set of the user's motion actions, and the jitter mapping relationship; Obtain the viewing angle parameter of the user relative to the screen, determine the first sub anti-shake coefficient according to the viewing angle parameter of the user relative to the screen and the jitter parameter of the screen, and determine the second sub anti-shake coefficient according to the display mode of the screen and the jitter parameter of the screen to determine the anti-shake coefficient of the screen.

5. The screen display method of the smart ring according to claim 4, wherein, When the user is in a moving state, determine the anti-shake coefficient of the screen based on the display mode of the screen and the shaking parameters of the screen to improve the dynamic display effect of the next interface. It further includes: Determine the anti-shake coefficient of the screen based on the synthesis of the first sub anti-shake coefficient and the second sub anti-shake coefficient, trigger the anti-shake control of the screen based on the anti-shake coefficient of the screen, and improve the dynamic display effect of the next interface.

6. The screen display method of the smart ring according to claim 1, characterized in that, The determining of multiple display areas based on the next interface and determining the abnormal display characteristics according to the multiple display areas includes: Trigger the corresponding area division mode according to the next interface and the corresponding APP, and determine multiple display areas according to the next interface and the area division mode.

7. The screen display method of the smart ring according to claim 6, wherein The determining of multiple display areas based on the next interface and determining the abnormal display characteristics according to the multiple display areas further includes: Determine multiple groups of semantic sets based on the synchronous recognition of multiple display areas, determine abnormal semantic segments according to the traversal of multiple groups of semantic sets, and determine the current abnormal area according to the abnormal semantic segments and the real-time images of the corresponding display areas. Trigger the overall abnormal detection of the next interface based on the current abnormal area. If other abnormal areas are collected during the detection process, determine the abnormal display characteristics according to the current abnormal area and the other abnormal areas.

8. The screen display method of the intelligent ring according to claim 1, wherein The determining of the corresponding interface optimization event according to the form of the abnormal display characteristics, the display area where the abnormal display characteristics are located, and the display content of the next interface. At this time, the remaining display areas are in the normal display state, including: Determine the form of the abnormal display characteristics based on the traversal of the abnormal display characteristics, and mark the display area where the abnormal display characteristics are located. Determine the first interface influence event according to the form of the abnormal display characteristics and the display area where the abnormal display characteristics are located, determine the second interface influence event according to the form of the abnormal display characteristics and the display content of the next interface, and determine the corresponding interface optimization event according to the first interface influence event, the second interface influence event, and the optimization mapping relationship.

9. The screen display method of the smart ring according to claim 8, wherein, The determining of the corresponding interface optimization event according to the form of the abnormal display characteristics, the display area where the abnormal display characteristics are located, and the display content of the next interface. At this time, the remaining display areas are in the normal display state further includes: If the remaining display areas in the next interface are running, determine the interface optimization scheme according to the interface optimization event and the running processes of the remaining display areas, and ensure the normal display of the remaining display areas.

10. A screen display system for an intelligent ring, characterized in that, The screen display system of the smart ring is applied to the screen display method of the smart ring as described in any one of claims 1-9. The screen display system of the smart ring includes: An interface module, used to determine the next interface of the screen according to the user's instruction and the current interface of the screen when the user wears the smart ring. A display module, used to determine the display mode of the screen according to the content displayed on the next interface and the posture of the screen. The display mode includes an inclined plane display mode, a three-dimensional display mode, or a curved surface display mode. An anti-shake module, used to determine the anti-shake coefficient of the screen based on the display mode of the screen and the shaking parameters of the screen when the user is in a moving state to improve the dynamic display effect of the next interface. Anomaly module, configured to determine multiple display areas based on the next interface, and determine anomaly display features according to the multiple display areas; Interface optimization module, configured to determine corresponding interface optimization events according to the form of the anomaly display features, the display area where the anomaly display features are located, and the display content of the next interface. At this time, the remaining display areas are in a normal display state.

Images