Screen display method and system for smart ring

Abstract

This invention discloses a screen display method and system for a smart ring. The invention relates to the technical field of screen display methods. The screen display mode is determined based on the content displayed on the next interface and the screen's orientation. When the user is in motion, the screen's anti-shake coefficient is determined based on the screen display mode and screen jitter parameters to improve the dynamic display effect of the next interface. Therefore, multiple display areas are determined based on the next interface, and abnormal display features are identified based on these areas. A corresponding interface optimization event is determined based on the shape of the abnormal display feature, the display area where the abnormal display feature is located, and the content displayed on the next interface. At this time, the remaining display areas are in a normal display state, thus optimizing the abnormal display features and ensuring the normal display of the remaining display areas. This ensures the multi-layer interface optimization effect of the smart ring and further improves the screen display effect of the smart ring.

Description

Technical Field

[0001] This invention relates to the technical field of screen display methods, and more particularly to a screen display method and system for a smart ring. Background Technology

[0002] With the development of technology, smart rings are gradually being applied to people's lives and worn on their hands. Smart rings are equipped with electronic screens and display corresponding interfaces through these screens. In the existing technology, the electronic screen displays the corresponding interface according to the user's instructions. This interface is displayed along a preset single mode and does not take into account the diversity of screen display modes, resulting in poor dynamic display effects of the next interface. Summary of the Invention

[0003] The purpose of this invention is to overcome the shortcomings of the prior art. This invention provides a screen display method and system for a smart ring.

[0004] This invention provides a screen display method for a smart ring, comprising: when a user wears the smart ring, determining the next screen interface based on the user's instructions and the current screen interface; determining the screen display mode based on the content displayed on the next screen interface and the screen's orientation, the display mode including a slanted display mode, a stereoscopic display mode, or a curved display mode; when the user is in motion, determining the screen's anti-shake coefficient based on the screen display mode and screen jitter parameters to improve the dynamic display effect of the next screen interface; determining multiple display areas based on the next screen interface, and determining abnormal display features based on the multiple display areas; determining a corresponding interface optimization event based on the shape of the abnormal display features, the display area where the abnormal display features are located, and the display content of the next screen interface, while the remaining display areas are in a normal display state.

[0005] This invention provides a screen display system for a smart ring, which is applied to the aforementioned screen display method for a smart ring. The screen display system for the smart ring includes:

[0006] The interface module is used to determine the next screen interface based on the user's instructions and the current screen interface when the user is wearing the smart ring.

[0007] The display module is used to determine the display mode of the screen based on the content to be displayed on the next interface and the orientation of the screen. The display mode includes a tilted display mode, a stereoscopic display mode, or a curved display mode.

[0008] The image stabilization module is used to determine the screen stabilization coefficient based on the screen's display mode and screen jitter parameters when the user is in motion, in order to improve the dynamic display effect of the next interface.

[0009] The exception module is used to determine multiple display areas based on the next interface, and to determine the abnormal display characteristics based on the multiple display areas;

[0010] The interface optimization module is used to determine the corresponding interface optimization event based on the shape of the abnormal display feature, the display area where the abnormal display feature is located, and the display content of the next interface. At this time, the remaining display areas are in normal display state.

[0011] Compared with the prior art, the beneficial effects of the present invention are:

[0012] In this embodiment of the invention, the method described herein determines the next screen interface based on the user's instructions and the current screen interface when the user is wearing a smart ring; the display mode of the screen is determined based on the content displayed on the next screen and the screen's orientation, including a slanted display mode, a stereoscopic display mode, or a curved display mode; when the user is in motion, the screen's anti-shake coefficient is determined based on the screen's display mode and the screen's jitter parameters, thus accommodating both the screen's display mode and the anti-shake coefficient, fully considering the diversity of the screen's display modes, and improving the dynamic display effect of the next screen interface.

[0013] Therefore, multiple display areas are determined based on the next interface, and abnormal display features are determined based on these multiple display areas. The corresponding interface optimization event is determined based on the shape of the abnormal display features, the display area where the abnormal display features are located, and the display content of the next interface. At this time, the remaining display areas are in a normal display state, thus realizing the optimization of abnormal display features and ensuring the normal display of the remaining display areas. This ensures the multi-layer interface optimization effect of the smart ring and further improves the screen display effect of the smart ring. Attached Figure Description

[0014] Figure 1 This is a flowchart illustrating the screen display method of the smart ring in an embodiment of the present invention;

[0015] Figure 2 This is a flowchart illustrating step S11 of the screen display method for a smart ring in an embodiment of the present invention.

[0016] Figure 3 This is a flowchart illustrating step S12 of the screen display method for a smart ring in an embodiment of the present invention.

[0017] Figure 4 This is a flowchart illustrating step S13 of the screen display method for a smart ring in an embodiment of the present invention.

[0018] Figure 5 This is a flowchart illustrating step S14 of the screen display method for a smart ring in an embodiment of the present invention.

[0019] Figure 6 This is a flowchart illustrating step S15 of the screen display method for a smart ring in an embodiment of the present invention.

[0020] Figure 7 This is a schematic diagram of the structure of the screen display system of the smart ring in an embodiment of the present invention. Detailed Implementation

[0021] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.

[0022] Please see Figures 1 to 7 A screen display method for a smart ring is disclosed, applicable to screen display scenarios in smart rings. The smart ring's screen can display information such as time, steps, health parameters, and calories. The inner diameter of the smart ring ranges from 18.3mm to 22.3mm. The smart ring has a built-in Bluetooth chip. The screen display method for this smart ring includes:

[0023] Step S11: When the user is wearing the smart ring, determine the next screen interface based on the user's instructions and the current screen interface;

[0024] Step S12: Determine the screen display mode based on the content displayed on the next screen and the screen orientation. The display mode includes a tilted display mode, a stereoscopic display mode, or a curved display mode.

[0025] Step S13: When the user is in motion, determine the screen stabilization coefficient based on the screen display mode and screen jitter parameters to improve the dynamic display effect of the next interface.

[0026] Step S14: Determine multiple display areas based on the next interface, and determine abnormal display characteristics based on the multiple display areas;

[0027] Step S15: Determine the corresponding interface optimization event based on the shape of the abnormal display feature, the display area where the abnormal display feature is located, and the display content of the next interface. At this time, the remaining display areas are in normal display state.

[0028] refer to Figure 2 In step S11, when the user is wearing the smart ring, the next screen is determined according to the user's instructions and the current screen interface.

[0029] In the specific implementation of this invention, the specific steps are as follows:

[0030] S111: The smart ring is worn on the user's hand and is in working condition; if the user's voice commands, operation commands and gesture commands are collected in the same time period, the multimodal command is determined based on the synthesis of the voice commands, operation commands and gesture commands.

[0031] S112: Based on the smart ring, collect multiple dynamic information about the user, and determine the user's movement state according to the multiple dynamic information and the user's current scene.

[0032] S113: Determine the final instruction information based on the user's motion state and multimodal instructions; determine the interface transition path based on the final instruction information and the current screen interface, and present the next screen interface by following the execution of the interface transition path.

[0033] In the embodiments of this application, the smart ring is worn on the user's hand and is in working condition; if the user's voice commands, operation commands and gesture commands are collected within the same time period, the multimodal command is determined by synthesizing the voice commands, operation commands and gesture commands, thus ensuring the accuracy of the multimodal command.

[0034] At this point, the user needs to wear the smart ring correctly on their finger, ensuring it fits snugly against the skin and won't fall off. The smart ring needs to be powered on and functioning properly, capable of receiving and processing user commands; the ring's internal sensors (such as a microphone, accelerometer, gyroscope, etc.) need to be activated to collect the user's voice, gestures, and operational commands. Optional commands include: voice commands (users verbally say specific commands, such as "check the weather" or "play music"); operational commands (users issue commands by touching buttons on the ring or swiping the screen, such as lightly touching the ring surface to activate a function); and gesture commands (users issue commands through specific hand movements, such as rotating the ring to adjust the volume or flipping their wrist to switch interfaces). These commands can appear simultaneously or individually.

[0035] Optionally, suppose the user is using a smart ring for navigation; the user is wearing the ring and it is in working order, and at this time the user simultaneously issues the following commands: voice command: "Go to the nearest coffee shop;" operation command: the user taps the "confirm" button on the ring; gesture command: the user gently rotates the ring to indicate that they want to view the list of nearby coffee shops.

[0036] When a smart ring receives multiple types of commands within the same time period, it needs to use an algorithm to synthesize these commands. The algorithm considers the priority of commands (e.g., voice commands usually have higher priority than gesture commands), conflict resolution of commands (e.g., when voice commands and gesture commands conflict, the system needs to decide which command to execute first), and command fusion (e.g., combining voice commands and gesture commands to provide richer control information). Ultimately, the algorithm will output a unified multimodal command that more accurately reflects the user's intent and needs.

[0037] Optionally, upon receiving these instructions, the smart ring processes them as follows: First, the ring recognizes the voice command "Go to the nearest coffee shop" as the primary navigation request; then, the ring notices that the user simultaneously taps the "Confirm" button, which typically indicates that the user agrees to or confirms the previous instruction; finally, the ring also notices that the user rotates the ring, indicating that the user wants to view more options or details. Further, the smart ring synthesizes a multimodal instruction: "Confirm and view navigation information to the nearest coffee shop, while displaying a list of nearby coffee shops." Then, the ring adjusts the screen interface according to this instruction, displaying navigation information and a list of coffee shops to meet the user's needs.

[0038] Furthermore, the user's motion state is determined based on multiple dynamic information collected by the smart ring and the user's current scene.

[0039] At this point, the smart ring has a variety of built-in sensors, such as accelerometers, gyroscopes, and magnetometers, to collect the user's dynamic information in real time. This dynamic information includes the user's hand acceleration, angular velocity, and directional changes, which can reflect the subtle movements of the user's hand and the overall movement trend. The smart ring will also use this sensor data to calculate higher-level motion parameters, such as steps, speed, and distance.

[0040] Optionally, assume the user is using a smart ring for daily activity monitoring; the user wears the smart ring for indoor fitness training, including multiple phases such as running, jumping, and resting; during the running phase, the smart ring collects a significant increase in the user's hand acceleration and angular velocity data, indicating that the user is performing rapid and regular exercise; during the jumping phase, the smart ring detects a sharp change in acceleration data, followed by a rapid recovery, which is consistent with the characteristics of jumping exercise; during the resting phase, the data collected by the smart ring is relatively stable, indicating that the user is in a state of stillness or slight activity; optionally, the smart ring processes this data to extract motion features, such as peak acceleration and range of angular velocity variation; by comparing these features with a preset motion pattern library, the smart ring preliminarily determines the type of exercise the user is performing at different phases.

[0041] The processor inside the smart ring analyzes and processes the collected dynamic information to extract useful motion features, including hand stability (such as whether there is frequent shaking), smoothness of the movement trajectory (such as whether it is linear movement), and range of speed variation. By analyzing these features, the smart ring can make a preliminary judgment on the user's motion state.

[0042] Optionally, the smart ring also notices that the user is active indoors and the ambient noise is relatively low (because it is in a gym); combining this information, the smart ring ultimately determines that the user is in a "running" state during the running phase, a "jumping" state during the jumping phase, and a "stationary" state during the rest phase.

[0043] In addition to dynamic information, the smart ring also combines other information to determine the user's movement status, such as time, location, and ambient noise. For example, if the user is outdoors and the ambient noise is loud, the smart ring will assume that the user is walking or running; if the user is indoors and the environment is relatively quiet, it will assume that the user is at rest or in a state of slight activity. The smart ring will also use machine learning algorithms to continuously optimize its judgment accuracy and automatically adjust the judgment criteria according to the user's habits and changes in the environment.

[0044] Therefore, the final instruction information is determined based on the user's motion state and multimodal commands; the interface transformation path is determined based on the final instruction information and the current screen interface, and the next screen interface is presented along the execution of the interface transformation path, which takes into account the overall consideration of the final instruction information and the current screen interface, and ensures the accuracy of the interface transformation path.

[0045] At this point, after receiving the user's voice commands, operation commands, and gesture commands (as described in S111), the smart ring will combine the currently detected user movement state to comprehensively judge the user's true intention. For example, if the user is walking and issues a voice command to "check messages," while the gesture command points to the wrist (meaning to check messages on the smartwatch or ring), the smart ring will combine this information and understand that the user wants to check messages while walking. If the user's movement state conflicts with the command (such as the user is driving but issues a command that requires fine-grained gestures), the smart ring will ignore or adjust certain commands according to preset safety rules.

[0046] Specifically, suppose a user is using a smart ring for an outdoor run and wants to view their running data. Here's a concrete example of how the smart ring determines the final instruction, the interface transition path, and presents the next screen: The user is wearing the smart ring and running in a park when they suddenly want to view their running speed, distance, and heart rate. The user issues a voice command to "view running data" while simultaneously gesturing towards their wrist (where the smart ring is located). The smart ring detects that the user is running (based on accelerometer and gyroscope data) and, combining the voice and gesture commands, determines that the user's intention is to view running data.

[0047] Once the final instruction information is determined, the smart ring will calculate the necessary transition path from the current interface to the target interface based on this information and the interface content currently displayed on the screen. This transition path includes a series of dynamic changes to interface elements, such as swiping, zooming, and fade-in / fade-out, to ensure that the user can smoothly and intuitively transition to the target interface. The smart ring will also consider the impact of the user's movement state on the interface transition; for example, if the user is running, the interface transition will be simpler and faster to reduce interference with the user's movement.

[0048] Specifically, the current screen displays information such as time, date, or weather; the smart ring calculates the transition path from the current screen to the running data screen based on the user's instructions and the current interface content. This path includes an animation effect that slides in from the edge of the screen, with the running data screen gradually covering the current screen.

[0049] Based on the determined interface transition path, the smart ring will gradually execute dynamic changes of interface elements to finally present the next interface expected by the user. This process includes smooth interface transitions, the addition of animation effects, and necessary user feedback (such as sound prompts, vibrations, etc.). The smart ring will also continuously monitor the user's commands and movement status in order to adjust the interface transition path or present a new interface when necessary.

[0050] Specifically, following a defined interface transition path, the smart ring executes animation effects, gradually presenting an interface containing data such as running speed, distance, and heart rate. Users can understand their running status in real time through this interface and make adjustments as needed. This example demonstrates how the smart ring combines the user's exercise status and multimodal commands to determine the final instruction information, and calculates the interface transition path based on this information, ultimately presenting the next interface the user expects. This intelligent interface transition method not only improves the user experience but also ensures that users can easily obtain the information they need in various exercise states.

[0051] In one embodiment of this application, assuming the user is walking and issues a voice command to "view messages" while gesturing towards their wrist (where the smart ring is located), the smart ring detects these commands, looks up the matching table to determine the final command information as "display message list". Then, based on the current time interface content, it calculates the weight score of all interface transition paths and selects the path with the highest score, "swipe from the time interface to the message list". Finally, the smart ring executes a swiping animation effect to smoothly transition the time interface to the message list interface.

[0052] refer to Figure 3 In step S12, the display mode of the screen is determined based on the content displayed on the next interface and the orientation of the screen. The display mode includes a slanted display mode, a stereoscopic display mode, or a curved display mode.

[0053] In the specific implementation of this invention, the specific steps are as follows:

[0054] S121: The screen adjusts its posture as the user moves, collects multiple posture parameters of the screen within a preset time period, and determines the posture of the screen based on the multiple posture parameters and the real-time position of the screen.

[0055] S122: Collect the content displayed on the next screen, match the corresponding APP for the content, and determine the user's viewing angle parameters relative to the screen based on the user's relative position to the screen.

[0056] S123: Determine the first mode parameters based on the content displayed on the next screen and the APP, determine the second mode parameters based on the content displayed on the next screen and the viewing angle parameters, and determine the screen display mode based on the mapping relationship between the first mode parameters, the second mode parameters and the display mode, which includes the oblique display mode, the stereoscopic display mode or the curved display mode.

[0057] In the embodiments of this application, the screen adjusts its posture as the user moves, and collects multiple posture parameters of the screen within a preset time period. The posture of the screen is determined based on the multiple posture parameters and the real-time position of the screen, which takes into account the overall consideration of multiple posture parameters and the real-time position of the screen, and ensures the accuracy of the screen posture.

[0058] At this time, the screen adjusts its posture according to the user's movement. Meanwhile, the display controlled by the smart ring can sense the user's movement status, including the user's body movement, gesture changes, or head rotation. Based on this sensing information, the device will automatically adjust the posture of its screen to ensure that the screen content is always within the user's optimal line of sight, or to make specific display adjustments according to the user's intention. Optionally, sensors (such as accelerometers, gyroscopes, magnetometers, etc.) are used to detect the user's movement to drive the screen to rotate, tilt, or translate.

[0059] During the screen's posture adjustment process, the system continuously collects multiple parameters related to the screen's posture, including the screen's tilt angle, rotation direction, translation distance, and real-time position relative to the user. The purpose of collecting these parameters is to accurately record the screen's changes over a period of time for subsequent analysis and determination of the final posture. At this time, the system uses built-in sensors to directly measure these parameters or indirectly obtains them through technologies such as image recognition. In addition, to obtain more accurate data, the system collects these parameters multiple times at certain time intervals and takes the average or performs other statistical processing.

[0060] After collecting sufficient posture parameters, the system combines these parameters with the screen's real-time position information and uses algorithms to determine the screen's final posture. This final posture is the one that the system believes best meets the user's viewing needs or aligns with the user's intentions. At the same time, the system uses a rule engine to analyze and process these parameters to find the optimal screen posture. For example, if the system detects that the user is tilting their head to one side to better view the screen, it will automatically tilt the screen in the opposite direction to maintain the horizontal display of the content.

[0061] Specifically, suppose a user is making a video call using a portable display controlled by a smart ring; the user is sitting on a sofa, maintaining a certain distance from the display; during the call, the user slightly adjusts their posture and tilts their head slightly to view the other party's video more comfortably; the smart ring detects the changes in the user's posture and head tilt angle, and automatically fine-tunes the display in the opposite direction of the user's tilt to maintain a horizontal display of the video image.

[0062] During screen adjustment, the system continuously collects multiple parameters such as the tilt angle, rotation direction, and real-time position of the display screen relative to the user. Combining these parameters with the user's viewing needs, the system calculates and determines the final posture of the display screen. In this example, the final posture is that the display screen is tilted slightly in the opposite direction to the user to maintain the horizontal display of the video image and the best viewing effect.

[0063] Furthermore, the content displayed on the next screen is collected and matched with the corresponding APP. The user's viewing angle parameters relative to the screen are determined based on the user's relative position to the screen, thus introducing viewing angle parameters.

[0064] At this point, before the display screen controlled by the smart ring prepares to show the next interface, the system first collects the content that the interface will display, including text, images, videos, or other multimedia elements. The collected content will be used for subsequent APP matching and display mode adjustment, introducing the content to be displayed on the next interface. Simultaneously, the system reads the interface content from internal storage or external data sources (such as cloud servers), or obtains it through communication with other devices. The collected content is typically stored digitally and includes metadata about its type, format, and display requirements.

[0065] Once the content to be displayed on the next screen is collected, the system will automatically match the most suitable APP (application) to display the content based on information such as the content type, format, or metadata. This matching process involves the extraction and analysis of content features, as well as the search and comparison of APPs already installed on the device. Optionally, the system will use algorithms or databases to store and retrieve the association information between APPs and content. When new screen content is collected, the system will query this database to find the matching APP and prepare it for displaying the content.

[0066] After determining the app and content to be displayed, the system further analyzes the relative position between the user and the screen to determine the user's viewing angle parameters relative to the screen. These parameters include the line of sight, viewing distance, screen tilt angle, and information such as the user's height and posture. Optionally, the system uses sensors (such as cameras, infrared sensors, etc.) to detect the user's position and posture, or indirectly obtains this information through sensors in devices such as smart rings. Then, the system uses a preset viewing angle parameter matching table to process this data and match the user's viewing angle parameters relative to the screen.

[0067] Specifically, suppose a user is using a smart ring to control navigation; the user is walking on a city street and plans to go to a nearby coffee shop; the user activates the navigation function through the smart ring, and navigation information is displayed on the smart ring's screen; the system collects the content to be displayed on the navigation interface, including the coffee shop's name, address, estimated arrival time, and route information; based on the collected content, the system automatically matches a navigation app and prepares to use it to display navigation information. This app has functions such as displaying maps, routes, and navigation instructions, making it very suitable for pedestrian navigation.

[0068] The system detects the user's position and posture using sensors in the smart ring, including the user's line of sight, viewing distance, and the tilt angle of the smart ring's screen relative to the user's head. Then, the system uses algorithms to process this data and calculate the user's viewing angle parameters relative to the smart ring's screen. These parameters will be used to adjust the display of navigation information to ensure that the user can clearly see navigation instructions and map information.

[0069] Therefore, the first mode parameters are determined based on the content displayed on the next screen and the APP, the second mode parameters are determined based on the content displayed on the next screen and the viewing angle parameters, and the screen display mode is determined based on the mapping relationship between the first mode parameters, the second mode parameters and the display mode. This method covers oblique display mode, stereoscopic display mode or curved display mode, and takes into account the overall consideration of the mapping relationship between the first mode parameters, the second mode parameters and the display mode, so as to ensure the accuracy of the screen display mode.

[0070] At this point, the first mode parameters are determined based on the content displayed on the next screen and the app. Simultaneously, after determining the content of the next screen and the corresponding app, the system analyzes the characteristics of this content and the app to determine the first mode parameters. These parameters include the content type (such as text, image, video), color scheme, interface layout, interaction method, and the app's specific requirements for the display mode. Optionally, the system uses a rule engine to parse the metadata of the content and the app, extract key information, and determine the first mode parameters based on this information. The first mode parameters will guide subsequent display mode selection.

[0071] Specifically, suppose a user is playing a game using a virtual reality headset controlled by a smart ring; the user is playing a racing game and wants a more realistic driving experience; the game contains a large amount of 3D images and dynamic video content, as well as complex interactive operations; the first mode parameters are determined: the system analyzes the characteristics of the game interface and the APP to determine the first mode parameters, which include the rendering quality of 3D images, color scheme, interface layout (such as dashboard, steering wheel control, etc.) and interaction methods (such as head tracking, gesture control, etc.).

[0072] A second mode parameter is introduced, determined based on the content displayed on the next screen and the viewing angle parameters. Simultaneously, after determining the first mode parameter, the system further considers the user's viewing angle relative to the screen to determine the second mode parameter. These parameters include field of view, viewing distance, screen tilt angle, and stereoscopic display effect, aiming to optimize the user's viewing experience from different perspectives. Optionally, the system uses sensor data (such as the user's line of sight and viewing distance) and algorithms to calculate the viewing angle parameters and adjust the relevant settings of the display mode accordingly. For example, if the system detects that the user is viewing the screen at a large angle, it increases the field of view to improve viewing comfort.

[0073] Specifically, the system determines the second mode parameters based on the user's perspective parameters (such as line of sight, head tilt angle, etc.) and the game content. These second mode parameters include the field of view (to ensure that the user can see the complete game scene), the screen tilt angle (to match the user's line of sight), and the stereoscopic display effect (to enhance the immersion of the game).

[0074] After determining the first and second mode parameters, the system refers to a preset display mode mapping relationship to determine the most suitable display mode for the current scene and user needs. This mapping relationship is a complex algorithm or rule set that outputs the optimal display mode based on the input mode parameters. Optionally, the system may use machine learning models, decision trees, or lookup tables to implement the display mode mapping relationship. Upon receiving the first and second mode parameters, the system queries this mapping relationship to find the matching display mode and prepares to apply it to the screen. Simultaneously, there are several display modes: Angled display mode: The screen tilts at a certain angle to adapt to the user's line of sight, improving viewing comfort; Stereoscopic display mode: Through special display technologies and algorithms, the content on the screen presents a three-dimensional effect, enhancing immersion and visual effects; Curved display mode: The screen presents an arc or curved shape, providing a wider field of view and a more natural viewing experience.

[0075] Specifically, the system determines the most suitable display mode for the current game scene based on the parameters of the first and second modes and the preset display mode mapping relationship. In this example, the system selects the stereoscopic display mode and adjusts parameters such as the field of view and screen tilt angle to provide the most realistic driving experience. Users can fine-tune the display mode through the smart ring to ensure that it fully meets their personal preferences and needs.

[0076] In one embodiment of this application, it is assumed that there is a display mode matching table used to determine the display mode based on the interface content, APP characteristics, and view parameters; the display mode matching table is shown in Table 1:

[0077] Table 1 shows the pattern matching table.

[0078] Interface content APP Features Viewpoint parameters Display mode Text-based Reading apps View from the front Flat display mode Image-based Image browsing app Viewing at an angle slant display mode Video-based Video playback app Wide field of view Curved display mode 3D model Game / Design App Stereoscopic view 3D display mode

[0079] Suppose a user is browsing a high-resolution landscape photo using smart glasses controlled by a smart ring; content: image-centric (high-resolution landscape photo); app characteristics: image browsing app; viewing angle parameters: the user tilts their head slightly to view the photo at an angle; according to the display mode matching table, these parameters match the "image-centric" interface content, the "image browsing app" characteristics, and the "angled viewing" viewing angle parameters, therefore the system determines to use the angled display mode to optimize the viewing experience.

[0080] refer to Figure 4 In step S13, when the user is in motion, the screen anti-shake coefficient is determined based on the screen display mode and screen jitter parameters to improve the dynamic display effect of the next interface.

[0081] In the specific implementation of this invention, the specific steps are as follows:

[0082] S131: Determine the screen's jitter parameters based on the user's movement type, movement action set, and jitter mapping relationship during the movement process;

[0083] S132: Obtain the user's viewing angle parameters relative to the screen, and determine the first sub-stabilization coefficient based on the user's viewing angle parameters relative to the screen and the screen's jitter parameters, and determine the second sub-stabilization coefficient based on the screen's display mode and the screen's jitter parameters.

[0084] S133: The screen's stabilization coefficient is determined based on the synthesis of the first sub-stabilization coefficient and the second sub-stabilization coefficient. The screen's stabilization control is triggered based on the screen's stabilization coefficient, and the dynamic display effect of the next interface is improved.

[0085] In the embodiments of this application, the screen jitter parameters are determined based on the user's type of movement, the user's set of movement actions, and the jitter mapping relationship during the movement process. This takes into account the overall consideration of the user's type of movement, the user's set of movement actions, and the jitter mapping relationship during the movement process, ensuring the accuracy of the screen jitter parameters.

[0086] At this point, the system first collects the user's motion data through sensors on the smart ring (such as accelerometers, gyroscopes, etc.); based on the collected data, the system uses a preset recognition model to identify the type of user's movement, such as walking, running, cycling, driving a car, etc.; the preset recognition model is trained based on previous motion data and the type of movement.

[0087] Optionally, suppose a user is using a smart ring for outdoor running; the accelerometer and gyroscope on the smart ring detect the user's motion data, including the acceleration of the steps and rapid changes in direction; based on this data, the system identifies the user's type of exercise as "running".

[0088] The system acquires a preset set of motion actions, which contains typical motion features corresponding to various types of motion. The identified motion type is matched with the motions in this set to find the motion feature that best matches the current user's motion. The system also maintains a jitter mapping table or model, which defines the correspondence between different motion actions and screen jitter parameters. Based on the matched motion action features, the system searches the jitter mapping relationship to determine the corresponding screen jitter parameters. The screen jitter parameters include the frequency, amplitude, and direction of the jitter.

[0089] Optionally, the system searches for movement features that match "running" in a preset set of movement movements, including continuous acceleration changes and the periodicity of strides; the system successfully matches the features that best match the "running" movement.

[0090] The system searches the jitter mapping table to find the screen jitter parameters corresponding to the "running" action. Assuming the jitter mapping table defines the screen jitter frequency as 2 times per second, the amplitude as 5% of the screen height, and the direction as up and down jitter during running, the system determines the screen jitter parameters as a frequency of 2Hz, an amplitude of 5% of the screen height, and an direction of up and down jitter.

[0091] These jitter parameters are used to adjust the screen's display mode or enable specific anti-shake algorithms to reduce or compensate for screen jitter caused by user movement, thereby improving the user's visual experience; for example, the screen of a smart ring will adjust the image refresh rate or enable image stabilization based on these parameters to ensure that the map or video content displayed during running remains clear and stable.

[0092] Furthermore, the user's viewing angle parameters relative to the screen are obtained, and the first sub-stabilization coefficient is determined based on the user's viewing angle parameters relative to the screen and the screen's jitter parameters. The second sub-stabilization coefficient is determined based on the screen's display mode and the screen's jitter parameters. This overall approach considers both the display modes and jitter parameters of ABC screens to determine the screen's stabilization coefficient, ensuring the accuracy of the second sub-stabilization coefficient.

[0093] At this point, the user's viewing angle parameters relative to the screen are obtained, and a first sub-stabilization coefficient is introduced. The first sub-stabilization coefficient is determined based on the user's viewing angle parameters relative to the screen and the screen's jitter parameters. At the same time, the system uses a matching table to combine the viewing angle parameters and the screen's jitter parameters to calculate a first sub-stabilization coefficient. This first sub-stabilization coefficient reflects the impact of the user's viewing angle on the stabilization requirements. For example, if the user is viewing the screen directly and the jitter is small, the stabilization requirement is low; if the user is viewing from the side and the jitter is large, the stabilization requirement is high.

[0094] A second sub-stabilization factor is introduced. The second sub-stabilization factor is determined based on the screen's display mode and jitter parameters. First, the system determines a basic stabilization requirement based on the screen's current display mode (e.g., planar display, angled display, stereoscopic display, etc.). Different display modes have different stabilization requirements; for example, stereoscopic display requires higher stabilization accuracy to maintain the stability of the 3D effect. The system combines the screen's jitter parameters with the basic stabilization requirement and adjusts it using an algorithm or lookup table to obtain a second sub-stabilization factor. This second sub-stabilization factor reflects the combined impact of the display mode and jitter parameters on the stabilization requirement.

[0095] Specifically, suppose a user is watching a 3D movie on a smart ring and slightly tilts their head to better view the screen. The camera and sensors on the smart ring detect this slight head tilt, obtaining viewing angle parameters such as the user's gaze direction and head tilt angle. The system calculates a first sub-stabilization coefficient based on the user's viewing angle parameters and screen jitter parameters (assuming it's due to slight user movement). Since the user is only tilting their head slightly and the screen jitter is minimal, the system calculates a relatively low first sub-stabilization coefficient, indicating that the current stabilization requirement is not particularly high.

[0096] The system recognizes that the current screen display mode is a stereoscopic display mode, and therefore determines a relatively high basic image stabilization requirement to maintain the stability of the stereoscopic effect. The system combines the screen's jitter parameters (also caused by slight user movements) with the basic image stabilization requirement and adjusts a second sub-image stabilization coefficient through an algorithm. Since the display mode is stereoscopic and the stability of the stereoscopic effect needs to be maintained, even if the jitter is not large, the system calculates a relatively high second sub-image stabilization coefficient, indicating that the current image stabilization requirement is high.

[0097] In practical applications, the system combines the first and second sub-stabilization coefficients (e.g., through a weighted average algorithm) to obtain a final stabilization coefficient, and adjusts the screen's stabilization strategy accordingly. For example, a smart ring will adjust the image refresh rate, enable or disable image stabilization, and adjust screen brightness or contrast based on this final stabilization coefficient to improve the user's visual experience when watching 3D movies.

[0098] Therefore, the screen's stabilization coefficient is determined by combining the first and second sub-stabilization coefficients. The screen's stabilization control is triggered based on the screen's stabilization coefficient, which improves the dynamic display effect of the next interface. This approach is compatible with both the screen's display mode and its stabilization coefficient, and fully considers the diversity of the screen's display modes.

[0099] At this point, based on the previously calculated first and second sub-stabilization coefficients, a final stabilization coefficient is determined, and corresponding stabilization control measures are triggered accordingly to improve the dynamic display effect of the next screen. Simultaneously, the system synthesizes the first and second sub-stabilization coefficients, typically through weighted averaging, multiplication, or other mathematical operations. The purpose of this synthesis is to obtain a stabilization coefficient that comprehensively considers the user's viewing angle, screen jitter, and display mode.

[0100] The synthesized result is the final image stabilization coefficient, which reflects the required image stabilization strength of the screen under the current conditions. This coefficient will be further adjusted or optimized according to the specific situation to ensure the accuracy and stability of the image stabilization effect.

[0101] Based on the final stabilization coefficient, the system triggers corresponding stabilization control measures. These measures include adjusting the screen refresh rate, enabling or disabling image stabilization, and adjusting screen brightness or contrast. The purpose of stabilization control is to reduce or eliminate image blurring or distortion caused by user movement or screen shaking, improving the dynamic display effect of the next screen. By triggering stabilization control measures, the system can improve the screen display effect, making the image clearer and more stable. This is crucial for enhancing the user experience, especially in scenarios such as watching videos, playing games, or other activities requiring high dynamic range.

[0102] Specifically, suppose a user is watching a fast-paced live sports broadcast using a smart ring, and the user is rapidly moving their head to track key movements in the game. The smart ring system first calculates a first sub-stabilization factor based on the user's head movements (rapid and large), which reflects the need for stabilization due to the rapid changes in the user's field of vision. Next, the system synthesizes the results based on the screen's display mode (assuming a flat display, but the live broadcast itself contains a lot of fast-moving footage) and a second sub-stabilization factor (which takes into account slight screen jitter caused by the user's movements). The resulting composite value is a relatively stable stabilization factor.

[0103] The system further adjusts and optimizes the synthesized stabilization coefficients to ensure the accuracy and stability of the stabilization effect. The final determined stabilization coefficients are used to guide subsequent stabilization control measures. Based on the final stabilization coefficients, the smart ring system triggers a series of stabilization control measures, including increasing the screen refresh rate, enabling image stabilization functions (such as electronic image stabilization or optical image stabilization), and adjusting screen brightness to adapt to different lighting conditions. These measures work together to significantly reduce image blur and distortion caused by the user's rapid head movements and slight screen shakes.

[0104] By triggering image stabilization measures, the smart ring system significantly improves the dynamic display of live sports broadcasts. Images become clearer and more stable, allowing users to more easily track key movements and details during the game. This not only enhances the user experience but also makes watching the game more enjoyable and immersive.

[0105] In one embodiment of this application, it is assumed that the weight of the first sub-stabilization coefficient is 0.6 and the weight of the second sub-stabilization coefficient is 0.4; the current first sub-stabilization coefficient is 0.7 (out of 1) and the second sub-stabilization coefficient is 0.6 (out of 1); the score of the first sub-stabilization coefficient = 0.7 * 0.6 = 0.42; the score of the second sub-stabilization coefficient = 0.6 * 0.4 = 0.24; the stabilization coefficient = (0.42 + 0.24) / (0.6 + 0.4) = 0.66 (normalized).

[0106] The system selects appropriate measures or combinations of measures from the preset anti-shake control measures based on the anti-shake factor (e.g., 0.66); the system selects to increase the refresh rate to 120Hz and enable the advanced image stabilization algorithm; after the anti-shake control measures take effect, the system evaluates whether the dynamic display effect has been improved through sensor or user feedback; users find that the image on the screen is smoother and more stable, and the dynamic display effect has been significantly improved.

[0107] refer to Figure 5 In step S14, multiple display areas are determined based on the next interface, and abnormal display characteristics are determined based on the multiple display areas;

[0108] In the specific implementation of this invention, the specific steps are as follows:

[0109] S141: Trigger the corresponding region division mode based on the next screen and the corresponding APP, and determine multiple display areas based on the next screen and the region division mode;

[0110] S142: Determine multiple semantic sets based on the synchronous recognition of multiple display areas, determine abnormal semantic segments based on the traversal of multiple semantic sets, and determine the current abnormal area based on the abnormal semantic segments and the real-time image of the corresponding display area;

[0111] S143: Trigger overall anomaly detection on the next interface based on the current anomaly area. If another anomaly area is collected during the detection process, determine the anomaly display characteristics based on the current anomaly area and the other anomaly areas.

[0112] In the embodiments of this application, the corresponding region division mode is triggered according to the next screen and the corresponding APP, and multiple display areas are determined according to the next screen and the region division mode, which is compatible with the overall consideration of the next screen and the region division mode and ensures the accuracy of multiple display areas.

[0113] At this point, the next screen and its corresponding app are introduced. The system first identifies the next screen to be displayed, which is usually done by parsing the screen data or receiving instructions from the application layer. The screen data includes the layout information, element types, and positions of the screen. The system identifies the application (app) that triggered the screen, which is done by analyzing the list of currently running applications, monitoring user operations, or receiving explicit instructions from the application layer.

[0114] Based on the identified interface and app, the system selects the most suitable pattern for the current context from a pre-set library of region division patterns. These patterns vary depending on factors such as app type, interface layout, and user preferences. For example, social media apps use a region division pattern that emphasizes user-generated content (UGC), while news reading apps use a different pattern that highlights news headlines and summaries. Once a suitable region division pattern is selected, the system will trigger that pattern to prepare for the next step of determining the display area.

[0115] Specifically, suppose a user is using a news reading app called "NewsReader". When the user clicks on a news headline to view the details, the system first recognizes that the interface to be displayed is the news details interface. Next, the system recognizes that the app that triggered this interface is "NewsReader". Based on this information, the system selects a mode specifically designed for news reading interfaces from the region division mode library. This mode emphasizes the display of news headlines, body text, images, and related links. Finally, the system triggers this mode and prepares to proceed to the next step of determining the display area.

[0116] The system analyzes the layout of the interface to be displayed based on the selected region division pattern. This typically involves analyzing the type, size, position, and hierarchy of interface elements. Based on the layout analysis results, the system divides the interface into multiple display areas according to the requirements of the region division pattern. These areas represent different information blocks, function buttons, or interactive elements. For example, in a news reading interface, the system divides the interface into a title area, a body text area, an image area, and a related link area. The system records information such as the position, size, and element types contained in each display area for subsequent content recognition, anomaly detection, or user interaction processing.

[0117] Specifically, in the news details interface of the "NewsReader" app, the system divides the interface into four display areas based on the selected area division mode: title area (displaying the news title), body area (displaying the news text), image area (displaying images related to the news), and related links area (displaying links to other articles related to the news). The system records the position and size information of each area and prepares to use this information in subsequent steps to identify content, detect anomalies, or handle user interactions. The system can automatically select an appropriate area division mode based on the next interface and the corresponding app, and determine multiple display areas accordingly, which provides a foundation for subsequent content recognition, anomaly detection, and user interaction.

[0118] Furthermore, multiple semantic sets are determined based on the synchronous recognition of multiple display areas, and abnormal semantic segments are determined by traversing the multiple semantic sets. The current abnormal region is determined based on the abnormal semantic segments and the real-time images of the corresponding display areas. This approach takes into account both the abnormal semantic segments and the real-time images of the corresponding display areas, ensuring the accuracy of the current abnormal region.

[0119] At this point, the system simultaneously identifies and processes content within multiple display areas, which typically involves technologies such as image recognition, text parsing, and natural language processing. For each display area, the system extracts semantic information, including text content, objects or scenes in the image, and the relationships between these elements. The semantic information within each display area is integrated into a semantic set, which represents the main content and meaning contained in that area. The above process is repeated to form a semantic set for each display area, thereby obtaining multiple sets of semantic sets.

[0120] Specifically, suppose a user is viewing a page containing multiple posts in a social media app. The system identifies three main display areas on the page: post title area, post content area, and post image area. For the post title area, the system extracts the title of each post as semantic information. For the post content area, the system parses the text content and extracts keywords and sentences. For the post image area, the system uses image recognition technology to identify objects in the images. In this way, the system forms a semantic set for each display area. For example, the semantic set for the post title area contains keywords such as "travel" and "food," while the semantic set for the post content area contains descriptions of travel destinations and reviews of food.

[0121] The system traverses the semantic set of each display area and analyzes the semantic information therein. The system applies preset anomaly detection rules to identify semantic segments that do not meet expectations or have potential problems. These rules are based on factors such as content type, keywords, and contextual relationships. When the system finds that a segment of semantic information in a semantic set violates the anomaly detection rules, it will be marked as an abnormal semantic segment.

[0122] Specifically, in the example of a social media app, the system traverses the semantic sets of the post title area, post content area, and post image area; suppose the system has a rule to identify content that is inconsistent with the page topic; in the post content area, the system finds a piece of advertising content that is completely unrelated to other posts on the page, and this content is therefore marked as an anomalous semantic segment.

[0123] The system associates the semantic segments marked as abnormal with their respective display areas. For display areas containing abnormal semantic segments, the system further analyzes the real-time image of that area (if available), which helps to confirm whether the abnormal semantic segments actually exist in the currently displayed interface. Combining the results of the abnormal semantic segments and the real-time image analysis, the system determines the display areas where anomalies currently exist.

[0124] Specifically, in the example of a social media app, the system identified the post content area containing abnormal advertising content as the currently abnormal display area. Through real-time image analysis, the system confirmed that this advertising content was indeed displayed on the user's screen and did not match the content of other posts on the page. Therefore, the system determined that the current abnormal area was a specific part of the post content area. The system's ability to identify abnormal semantic segments based on the simultaneous recognition of multiple display areas, and further determine the currently abnormal display area, provides a basis for taking appropriate subsequent processing measures.

[0125] Therefore, based on the current abnormal area, the overall abnormal detection of the next interface is triggered. If other abnormal areas are collected during the detection process, the abnormal display features are determined according to the current abnormal area and the other abnormal areas. This takes into account both the current abnormal area and the other abnormal areas as a whole, ensuring the accuracy of the abnormal display features.

[0126] Once the system identifies the current abnormal area, it immediately triggers a comprehensive anomaly detection of the next interface (whether it is an updated version of the current interface, a new interface that the user navigates to, or an interface displayed in response to an anomaly). This detection is comprehensive and aims to identify any anomalies on the interface.

[0127] Holistic anomaly detection involves a comprehensive evaluation of multiple aspects, including interface layout, element arrangement, text content, image quality, and interactive behavior. The system uses machine learning models, rule engines, or a combination of both to perform this detection. Although the detection is triggered by the current area of ​​anomaly, its scope extends to the entire interface because some anomalies are not merely localized issues but are related to the overall design or functionality of the interface.

[0128] Specifically, suppose in an online shopping app, a user is browsing a product list page; the system detects an anomaly in the product image area, that is, some product images fail to load or display incorrectly; based on this abnormal area, the system triggers a comprehensive anomaly detection on the next screen (i.e., the product details page that the user enters after clicking on a product); the detection strategy includes checking whether the layout of the product details page is consistent, whether the product description is accurate, whether the price information is displayed correctly, and whether user interactions (such as adding to the shopping cart, sharing products, etc.) work as expected.

[0129] During the overall anomaly detection process, the system will discover other anomaly areas besides the initially triggered anomaly area. These areas are located in different parts of the interface and involve different types of problems (such as text errors, missing images, and functional failures).

[0130] Specifically, in the example of an online shopping app, the system discovered the following issues during the overall anomaly detection process on the product details page: in addition to the problem of product images failing to load, there were also abnormal areas such as spelling errors in the product description text, inconsistent price information display (e.g., different prices displayed on different devices), and the "add to cart" button not responding. The system recorded this information and conducted a preliminary analysis, finding that these problems were related to server data synchronization errors, API call errors, or bugs in the front-end code.

[0131] The system combines the current abnormal area with other abnormal areas found during the detection process to extract common abnormal display features. These features include missing interface elements, error message display, and failure of interactive functions. The extracted abnormal display features are analyzed in depth to determine whether they represent specific abnormal patterns or problem categories. This helps the system to more accurately identify and handle similar problems.

[0132] Specifically, in the shopping app example, the system identified several key display anomalies based on detected abnormal areas: inconsistent product information display (e.g., mismatched images and descriptions), malfunctioning interactive functions (e.g., unresponsive buttons), and missing or incorrect UI elements (e.g., spelling errors). The system generated a detailed anomaly detection report and provided remedial suggestions, such as checking data synchronization logic, fixing API call errors, and updating front-end code to address these issues. The system can trigger a comprehensive anomaly detection for the next screen based on the current abnormal area, and collect and analyze other abnormal areas during the detection process to ultimately determine the abnormal display characteristics to guide subsequent problem fixing and UI optimization.

[0133] In one embodiment of this application, suppose a user is watching a video list page in an online video platform APP; the system detects an anomaly in the video thumbnail area, that is, some video thumbnails cannot be displayed correctly; based on the current abnormal area, the system triggers a global anomaly detection for the next interface, where the current abnormal area is the video thumbnail area; the user clicks on a video to enter the video playback page, and the system triggers a global anomaly detection for that page.

[0134] During the inspection of the video playback page, the system found that in addition to the problem of video thumbnails failing to load, there were also abnormal areas such as incorrect display of video title text and unresponsive video playback buttons.

[0135] An anomaly display feature matching table has been introduced, as shown in Table 2:

[0136] Table 2. Anomaly Display Feature Matching Table

[0137] Abnormal display characteristics reason Video thumbnails cannot be loaded Server image resource missing, network request failed. Video title text display error Data synchronization issues, text encoding errors The video play button is unresponsive. Front-end code bug, back-end service not responding

[0138] Based on the detected abnormal area, the system searches for the corresponding abnormal display feature in the abnormal display feature matching table and makes a preliminary judgment on the cause. In this example, the system determines that the abnormal display feature is "abnormal display or function of video-related elements", and the causes include server resource problems, data synchronization problems, or code bugs.

[0139] refer to Figure 6In step S15, the corresponding interface optimization event is determined based on the shape of the abnormal display feature, the display area where the abnormal display feature is located, and the display content of the next interface. At this time, the remaining display areas are in normal display state.

[0140] In the specific implementation of this invention, the specific steps are as follows:

[0141] S151: Determine the shape of the abnormal display features based on the traversal of the abnormal display features, and mark the display area where the abnormal display features are located;

[0142] S152: Determine the first interface impact event based on the shape of the abnormal display feature and the display area where the abnormal display feature is located; determine the second interface impact event based on the shape of the abnormal display feature and the display content of the next interface; and determine the corresponding interface optimization event based on the first interface impact event, the second interface impact event, and the optimization mapping relationship.

[0143] S153: If the remaining display areas in the next interface are running, determine the interface optimization scheme based on the interface optimization event and the running process of the remaining display areas, and ensure the normal display of the remaining display areas.

[0144] In the embodiments of this application, the shape of the abnormal display feature is determined based on the traversal of the abnormal display feature, and the display area where the abnormal display feature is located is marked, thus introducing the shape of the abnormal display feature.

[0145] At this point, the system will check each detected abnormal display feature one by one. These features include text errors, missing images, unresponsive buttons, and disordered layout. The traversal process involves classifying, sorting, or prioritizing abnormal features in order to process them more effectively.

[0146] For each abnormal display feature, the system needs to determine its specific form or type, which is usually based on information such as the feature's visual appearance, user feedback, or system logs; determining the form involves a detailed analysis of the feature, such as checking the correctness of the text content, the integrity of the image, and the interactivity of the button.

[0147] Specifically, suppose a user is viewing a course list page in an online learning platform app; the system detects the following abnormal display characteristics: Abnormal characteristic 1: There is a spelling error in the text of a course title; Abnormal characteristic 2: A course cover image cannot be displayed; Abnormal characteristic 3: The "Add to Schedule" button is unresponsive.

[0148] The system checks each of the three anomalies and categorizes them as text errors, missing images, and button interaction issues. For anomaly 1, the system analyzes the text content and determines its form as "text spelling error". For anomaly 2, the system checks the image loading status and determines its form as "image missing". For anomaly 3, the system tests the button's interactive function and determines its form as "button unresponsive".

[0149] The system highlights the course title area containing anomaly feature 1 on the interface and records information about that area in the log. For anomaly feature 2, the system replaces the undisplayed image with a placeholder on the interface and records detailed information about the missing image in the log, including the image URL and loading status. For anomaly feature 3, the system displays an error message icon around the button and records detailed information about the button's unresponsiveness in the log, including the button ID, user click time, and system response status.

[0150] Furthermore, the first interface impact event is determined based on the shape of the abnormal display feature and the display area where the abnormal display feature is located. The second interface impact event is determined based on the shape of the abnormal display feature and the display content of the next interface. The corresponding interface optimization event is determined based on the first interface impact event, the second interface impact event, and the optimization mapping relationship. This takes into account the overall consideration of the shape of the abnormal display feature and the display content of the next interface, ensuring the accuracy of the second interface impact event.

[0151] At this point, the concept of "first-interface impact events" is introduced. These events are determined based on the form of the abnormal display features and the display area where they are located. The system needs to analyze the form of each abnormal display feature in detail, such as text errors, missing images, and functional malfunctions. The system assesses the importance of the display area containing these abnormal features to the user experience; for example, abnormalities in the title bar or main content area are usually more important than abnormalities in the sidebar or bottom navigation bar. Based on the form of the abnormal features and the importance of their respective areas, the system determines the specific impact events on the first interface (current interface), including information misunderstanding, operational obstruction, and visual interference.

[0152] Optionally, suppose in an online shopping app, a user is viewing a product details page (first screen) and preparing to add it to their shopping cart; the system detects the following abnormal display characteristics: a spelling error in the product title; the product image fails to load and displays a placeholder; the system analyzes the spelling error in the product title and determines its form as a "text error"; since the product title is one of the main channels for users to understand product information, this error leads to "information misunderstanding" for the user; the system assesses the impact of the product image loading failure and determines its form as "image missing"; since product images are an important basis for users to judge the appearance and quality of products, this missing image leads to "visual interference" and "decreased purchase intention" for the user; based on the above analysis, the system determines that the impact events of the first screen are "information misunderstanding" and "visual interference leading to decreased purchase intention".

[0153] The system introduces a second-interface impact event, which is determined based on the form of abnormal display characteristics and the content displayed on the next interface. In this case, the system needs to understand the content displayed on the next interface after the user navigates from the current interface. Based on the abnormal display characteristics of the current interface, the system predicts the potential impact of these characteristics on the next interface. For example, if the product information on the current interface is incorrect, it will affect the user's decisions on the shopping cart or checkout page. The system determines that these potential impacts constitute second-interface impact events, such as user decision-making obstacles or decreased trust.

[0154] The system analyzes the interface (second interface) that users are navigated to after adding items to their shopping cart, i.e., the shopping cart page. The system predicts the impact of spelling errors in product titles and image loading failures on the shopping cart page. For example, title errors can cause confusion for users when they need to reconfirm product information in the shopping cart; missing images can affect users' overall impression of the products and their purchasing decisions. Based on the above predictions, the system determines that the impact events on the second interface are "difficulty in confirming product information in the shopping cart" and "obstruction of purchasing decisions".

[0155] The system maintains an optimization mapping relationship that associates interface impact events with corresponding interface optimization events. Based on the impact events of the first and second interfaces, the system searches for the corresponding interface optimization events in the optimization mapping relationship. The system determines the interface optimization events that need to be executed, including correcting text content, replacing missing images, and fixing function failures.

[0156] Optionally, the system maintains an optimization mapping relationship, such as "information misunderstanding" corresponding to "correcting text content", "visual interference" corresponding to "replacing missing images", etc. The system searches for the corresponding interface optimization events in the optimization mapping relationship based on the impact events of the first and second interfaces. For example, "information misunderstanding" corresponds to "correcting product title text", "visual interference leading to decreased purchase intention" and "difficulty in confirming product information in the shopping cart" both correspond to "replacing product images", and "obstructed purchase decision" corresponds to "providing detailed product information and user reviews to enhance trust". Based on the above matching, the system determines that the interface optimization events to be executed are "correcting product title text", "replacing product images", and "providing detailed product information and user reviews on the shopping cart page".

[0157] Therefore, if the remaining display areas in the next interface are running, the interface optimization scheme is determined based on the interface optimization event and the running process of the remaining display areas, and the normal display of the remaining display areas is guaranteed, thus ensuring the multi-layer interface optimization effect of the smart ring and further improving the screen display effect of the smart ring.

[0158] At this point, after identifying the interface optimization event, the system needs to check the operating status of the remaining display areas in the next interface that the user is about to navigate to, excluding the areas affected by abnormal display characteristics. This involves monitoring the loading of dynamic content, the response of user interactions, and the playback of animation effects.

[0159] Optionally, suppose in an online video playback app, a user is viewing a video list page (first interface) and is about to click on a video to enter the playback page (second interface); the system detects a spelling error in the title of a video in the video list page and determines the corresponding interface optimization event as "correct video title text"; before the user clicks on the video to enter the playback page, the system checks the running status of the remaining display areas on the page; for example, whether the video thumbnail is loading, whether the play button responds to click events, and whether related video recommendations are being updated.

[0160] The system needs to combine interface optimization events (such as text correction, image replacement, layout adjustment, etc.) with the current running process of other display areas to formulate an optimization plan that will not interfere with the normal display of these areas; the optimization plan needs to consider how to smoothly update interface elements, how to avoid interface flickering or lag, and how to maintain the continuity of user interaction.

[0161] Optionally, the system can combine the "correct video title text" optimization event with the running status of the rest of the display area on the playback page to formulate an optimization plan; for example, it can decide to load the corrected video title asynchronously in the background and smoothly display the new title when the user enters the playback page, while avoiding interference with the loading of the video thumbnail and the response of the play button.

[0162] When implementing the optimization plan, the system needs to ensure that the normal operation of other display areas is not affected. This involves strategies such as asynchronously processing data updates in the background, using transition animations to smoothly display new content, and pausing unnecessary interface updates during user interaction. After the optimization plan is implemented, the system needs to continuously monitor the operating status of other display areas and user feedback on the optimization effect. If any problems are found or user feedback is unsatisfactory, the system needs to adjust the optimization plan in a timely manner to ensure the continuous improvement of user experience.

[0163] Specifically, the system implements optimization measures to ensure that the corrected video title displays smoothly when a user enters the playback page, while the video thumbnail continues to load, the play button responds normally to click events, and related video recommendations continue to scroll and update. The system continuously monitors the operational status of the remaining display areas on the playback page and user feedback on the corrected video title; if issues such as slower video thumbnail loading or delayed play button response are detected, the system promptly adjusts the optimization measures, such as reducing the frequency of background data updates or optimizing the performance of interface rendering.

[0164] In one embodiment of this application, assuming a complex web application, a user is browsing a page containing multiple dynamic components (referred to as the "current page") and preparing to navigate to a new page (referred to as the "next page"); the system detects a spelling error in a text area of ​​the current page and determines that an interface optimization event needs to be executed to correct the error; the system constructs an optimization scheme matching table, which associates the interface optimization event with the optimization scheme; simultaneously, the table also considers the running status and importance of the remaining display areas in the next page. The optimization scheme matching table is shown in Table 3:

[0165] Table 3: Matching Table of Optimization Schemes

[0166]

[0167] When the system detects a text error on the current page, it searches for a corresponding optimization solution in the optimization solution matching table. Considering that a video player is playing on the next page and its importance, the system decides to adopt the optimization solution of "asynchronously loading the corrected text without interrupting video playback." For other areas, such as related content recommendations and banner ads, the system adopts different optimization strategies based on their running status and importance. The system implements the optimization solution to ensure that the corrected text is displayed smoothly when the user navigates to the next page, without interfering with the normal operation of other display areas. For example, while the video player continues to play the video, the system asynchronously loads the corrected text in the background and displays it on the user interface at the appropriate time.

[0168] Please see Figure 7 , Figure 7 This is a schematic diagram of the structural composition of the screen display system of the smart ring in an embodiment of the present invention; the screen display system of the smart ring includes:

[0169] Interface module 21 is used to determine the next screen interface based on the user's instructions and the current screen interface when the user is wearing the smart ring.

[0170] Display module 22 is used to determine the display mode of the screen based on the content displayed on the next interface and the orientation of the screen. The display mode includes a tilted display mode, a stereoscopic display mode, or a curved display mode.

[0171] The anti-shake module 23 is used to determine the anti-shake coefficient of the screen based on the screen display mode and screen shaking parameters when the user is in motion, so as to improve the dynamic display effect of the next interface.

[0172] Anomaly module 24 is used to determine multiple display areas based on the next interface and to determine abnormal display characteristics based on the multiple display areas.

[0173] The interface optimization module 25 is used to determine the corresponding interface optimization event based on the shape of the abnormal display feature, the display area where the abnormal display feature is located, and the display content of the next interface. At this time, the remaining display areas are in normal display state.

[0174] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity, not all combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

Claims

1. A method for displaying a screen of a smart ring, the method comprising: include: When a user is wearing a smart ring, the next screen will be determined based on the user's instructions and the current screen interface. The screen display mode is determined based on the content displayed on the next screen and the screen's orientation. This display mode includes a beveled display mode, a stereoscopic display mode, or a curved display mode. When the user is in motion, the screen stabilization coefficient is determined based on the screen's display mode and screen jitter parameters to improve the dynamic display effect of the next interface. This includes: determining the screen jitter parameters based on the user's movement type, set of movement actions, and jitter mapping relationship during the user's movement; obtaining the user's viewing angle parameters relative to the screen, and determining a first sub-stabilization coefficient based on the user's viewing angle parameters and screen jitter parameters; determining a second sub-stabilization coefficient based on the screen's display mode and screen jitter parameters; determining the screen stabilization coefficient based on the synthesis of the first and second sub-stabilization coefficients; triggering screen stabilization control based on the screen stabilization coefficient to improve the dynamic display effect of the next interface; the first sub-stabilization coefficient reflects the impact of the user's viewing angle on stabilization requirements; the second sub-stabilization coefficient reflects the combined impact of display mode and jitter parameters on stabilization requirements; the screen stabilization coefficient comprehensively considers the user's viewing angle, screen jitter, and display mode. Multiple display areas are determined based on the next interface, and abnormal display characteristics are determined based on the multiple display areas; The corresponding interface optimization event is determined based on the shape of the abnormal display feature, the display area where the abnormal display feature is located, and the display content of the next interface. At this time, the remaining display areas are in normal display state.

2. The screen display method of the smart ring according to claim 1, characterized in that, The step of determining the next screen interface based on the user's instructions and the current screen interface when the user is wearing the smart ring includes: The smart ring is worn on the user's hand and is in working condition; if the user's voice commands, operation commands and gesture commands are collected within the same time period, the multimodal command is determined by synthesizing the voice commands, operation commands and gesture commands. Based on the smart ring collecting multiple dynamic information points from the user, and considering these dynamic information points and the user's current scene, the user's movement state is determined. The final instruction information is determined based on the user's motion state and multimodal commands; the interface transition path is determined based on the final instruction information and the current interface of the screen, and the next interface of the screen is presented by executing the interface transition path.

3. The screen display method of the smart ring according to claim 1, characterized in that, The step of determining the screen display mode based on the content displayed on the next interface and the screen's orientation includes: a tilted display mode, a stereoscopic display mode, or a curved display mode. The screen adjusts its posture as the user moves, collects multiple posture parameters of the screen within a preset time period, and determines the screen's posture based on the multiple posture parameters and the screen's real-time position. Collect the content displayed on the next screen and match the corresponding APP for that content. Determine the user's viewing angle parameters relative to the screen based on the user's relative position to the screen. The first mode parameters are determined based on the content displayed on the next screen and the APP. The second mode parameters are determined based on the content displayed on the next screen and the viewing angle parameters. The screen display mode is determined based on the mapping relationship between the first mode parameters, the second mode parameters and the display mode, which includes oblique display mode, stereoscopic display mode or curved display mode.

4. The screen display method of the smart ring according to claim 1, characterized in that, The process of determining multiple display areas based on the next interface and determining abnormal display characteristics based on these multiple display areas includes: The corresponding region division mode is triggered based on the next screen and the corresponding APP, and multiple display areas are determined based on the next screen and the region division mode.

5. The screen display method of the smart ring according to claim 4, characterized in that, The step of determining multiple display areas based on the next interface and determining abnormal display characteristics based on the multiple display areas also includes: Multiple semantic sets are determined based on the synchronous recognition of multiple display areas, and abnormal semantic segments are determined based on the traversal of multiple semantic sets. The current abnormal area is determined based on the abnormal semantic segments and the real-time image of the corresponding display area. The overall anomaly detection of the next interface is triggered based on the current anomaly area. If other anomaly areas are collected during the detection process, the anomaly display characteristics are determined based on the current anomaly area and the other anomaly areas.

6. The screen display method of the smart ring according to claim 1, characterized in that, The corresponding interface optimization event is determined based on the shape of the abnormal display feature, the display area where the abnormal display feature is located, and the display content of the next interface. At this time, the remaining display areas are in a normal display state, including: The shape of the abnormal display features is determined by traversing the abnormal display features, and the display area where the abnormal display features are located is marked. The first interface impact event is determined based on the shape of the abnormal display feature and the display area where the abnormal display feature is located. The second interface impact event is determined based on the shape of the abnormal display feature and the display content of the next interface. The corresponding interface optimization event is determined based on the first interface impact event, the second interface impact event, and the optimization mapping relationship.

7. The screen display method of the smart ring according to claim 6, characterized in that, The step of determining the corresponding interface optimization event based on the shape of the abnormal display feature, the display area where the abnormal display feature is located, and the display content of the next interface, while the remaining display areas are in a normal display state, also includes: If the remaining display areas in the next screen are running, the screen optimization scheme is determined based on the screen optimization event and the running process of the remaining display areas, and the normal display of the remaining display areas is ensured.

8. A screen display system for a smart ring, characterized in that, The screen display system of the smart ring is applied to the screen display method of the smart ring as described in any one of claims 1-7, and the screen display system of the smart ring includes: The interface module is used to determine the next screen interface based on the user's instructions and the current screen interface when the user is wearing the smart ring. The display module is used to determine the display mode of the screen based on the content displayed on the next interface and the orientation of the screen. The display mode includes a tilted display mode, a stereoscopic display mode, or a curved display mode. The image stabilization module is used to determine the screen stabilization coefficient based on the screen's display mode and screen jitter parameters when the user is in motion, in order to improve the dynamic display effect of the next interface. This includes: determining the screen jitter parameters based on the user's movement type, set of movement actions, and jitter mapping relationship; acquiring the user's viewing angle parameters relative to the screen, and determining a first sub-stabilization coefficient based on the viewing angle parameters and screen jitter parameters; determining a second sub-stabilization coefficient based on the screen's display mode and screen jitter parameters; determining the final screen stabilization coefficient based on the synthesis of the first and second sub-stabilization coefficients; triggering screen stabilization control based on the final screen stabilization coefficient, and improving the dynamic display effect of the next interface. The first sub-stabilization coefficient reflects the impact of the user's viewing angle on stabilization requirements; the second sub-stabilization coefficient reflects the combined impact of the display mode and jitter parameters on stabilization requirements; the final screen stabilization coefficient comprehensively considers the user's viewing angle, screen jitter, and display mode. The exception module is used to determine multiple display areas based on the next interface, and to determine the abnormal display characteristics based on the multiple display areas; The interface optimization module is used to determine the corresponding interface optimization event based on the shape of the abnormal display feature, the display area where the abnormal display feature is located, and the display content of the next interface. At this time, the remaining display areas are in normal display state.

Images