Home screen awakening system based on outward walking metaphor

Abstract

The invention relates to the field of virtual interaction, and discloses a home screen wake-up system based on an outward walking metaphor, which comprises a boundary screen BS module, the boundary screen BS module comprises a boundary identification unit and a boundary trigger unit, in the invention, a boundary screen technology is introduced into VR, and a home screen and a functional component are integrated on a boundary screen by combining the boundary screen technology, so that the home screen wake-up effect is improved; a user wakes up a home screen and a functional component through a natural behavior (such as boundary movement towards a virtual environment) of walking outwards, and the interaction mode for waking up the home screen based on the VR boundary screen can make up for the limitation of methods such as voice wakeup, gesture wakeup and handle wakeup to a certain extent, can meet the requirements and operation habits of different users, and can improve the user experience. Therefore, more natural and smooth user experience is provided, interaction between the user action and the virtual environment boundary is more natural, the split feeling caused by a traditional screen wake-up button or gesture is reduced, and the user is easier to immerse in the virtual environment.

Description

Technical Field

[0001] The present invention relates to the field of virtual interaction, and in particular to a main screen wake-up system based on a metaphor of walking outwards. Background Art

[0002] The screen boundary wake-up system is a technology that allows users to wake up the device's main screen through specific operations, especially on multi-screen devices or devices that need to save energy. This system usually includes the following key components: Wake-up operation recognition: The system needs to be able to recognize specific user operations, such as double-clicking, sliding, or other gestures, as a signal to wake up the screen; Icon management: On multi-screen devices, the main screen boundary wake-up system needs to determine which icon should be woken up; User interface response: After waking up the screen, the system should respond quickly and provide a smooth user interface to improve the user experience.

[0003] According to the Chinese patent announcement number: CN107454955A, a screen wake-up scheme is disclosed, including: when an interrupt instruction triggered by the touch of the fingerprint sensor is obtained, it is determined whether the terminal device is currently in a deep sleep state; if it is in a deep sleep state, a wake-up instruction is sent to the processor of the terminal device to wake up the processor. Compared with the prior art, in the scheme provided by the embodiment of the present invention, once the interrupt instruction is received and it is determined that the terminal device is in a deep sleep state, a wake-up instruction is actively sent to the processor, and the wake-up instruction does not need to reach the operating system HAL layer, and it is no longer necessary to wait for the operating system HAL layer to wake up the processor, which saves the waiting time for the processor to wake up, improves the processing efficiency of the touch operation, and also improves the processor wake-up efficiency. However, there are still shortcomings in the screen wake-up method. The current main screen wake-up method mostly relies on fixed buttons or gestures, lacks innovation and diversity, and cannot meet the needs and operating habits of different users. Frequent screen wake-up operations may cause user fatigue, especially when using VR devices for a long time, the user may feel uncomfortable due to inconvenience in operation. Summary of the invention

[0004] In view of the shortcomings of the prior art, the present invention provides a main screen wake-up system based on the metaphor of walking outward, which solves the shortcomings of the screen wake-up method. The current main screen wake-up method mostly relies on fixed buttons or gestures, lacks innovation and diversity, and cannot meet the needs and operating habits of different users. Frequent screen wake-up operations may cause user fatigue, especially when using VR devices for a long time, the user may feel uncomfortable due to the inconvenience of operation.

[0005] To achieve the above objectives, the present invention is implemented through the following technical solutions: a main screen wake-up system based on the metaphor of walking outward, comprising: Boundary screen BS module, used to implement the dynamic boundary wake-up function of the main screen; The boundary screen BS module includes a boundary recognition unit and a boundary trigger unit. The boundary recognition unit monitors the user's position and movement status in the virtual environment in real time and recognizes the user's action of approaching or touching the preset boundary of the virtual environment. When the user performs a boundary action, the boundary trigger unit immediately triggers the wake-up of the main screen and provides a feedback signal of the boundary action. The boundary recognition unit further includes a distance detection module and a safety boundary distance judgment module. The distance detection module is used to detect the distance between the user and the preset boundary of the virtual environment to reduce the probability of false triggering. The safety boundary distance judgment module is used to add an additional interaction intention confirmation step when the user approaches the safety boundary to prevent false triggering.

[0006] Preferably, the system further comprises: Interaction intention confirmation module, used by users to summon the main screen and functional components through the border screen technology; The interaction intention confirmation module includes a user motion capture unit and a motion analysis unit. The user motion capture unit analyzes the user's motion intention to realize the dynamic summoning of the main screen. The motion analysis unit analyzes the user's interactive behavior and decomposes it into the following action sequence: walking to the safety boundary, waking up the safety wall, raising the hand, and interacting; The screen interface management module is used to process the interaction interface between the user and the main screen.

[0007] The screen interface management module includes an interface layout adjustment unit, which is used to organize the screen layout according to the user settings and the shape of the safety boundary, a content display optimization unit, which is used to optimize the display method of the main screen content and improve the efficiency of information transmission, and an interactive feedback unit, which is used to provide visual and auditory feedback to enhance the user interaction experience.

[0008] Preferably, the boundary recognition method of the boundary recognition unit is specifically in accordance with the following formula: Real-time monitoring of user location and motion status ; Identify when a user approaches or touches a preset boundary Actions; Distance from user to border ; in,( ) is the boundary point Coordinates of ,when When the user is considered to be approaching the boundary, a touch threshold is set ,when When the user touches the boundary, or And when the user's movement direction points to the boundary, wake-up is triggered.

[0009] Preferably, the strength of the feedback signal Adjust according to the following formula based on the distance between the user and the border: ; in, is the maximum feedback signal strength.

[0010] Preferably, the user motion capture unit uses sensors of a VR head display and a handle to capture the user's specific motion vector ; ; User action intention ,in, is the action vector The modulus indicates the intensity of the action. is the set intent recognition threshold.

[0011] Preferably, the sensitivity adjustment method in the motion analysis unit is according to the following formula: ; in, It's time The sensitivity factor, is the maximum speed of the user's actions, Is the user at time When the user's movement speed is close to the maximum value, the sensitivity is close to the maximum, and when the movement speed is slower, the sensitivity is reduced.

[0012] Preferably, the response speed adjustment method in the action analysis unit is according to the following formula: ; in, For time The response speed, and are the maximum and minimum response speeds, respectively. When the user's intention is recognized ( ), the response speed reaches the maximum value, otherwise it remains at the minimum value.

[0013] Preferably, the interface layout adjustment unit further includes a layout memory unit and a layout recommendation unit, the layout memory unit is used to record the user's historical layout preferences, and the layout recommendation unit recommends a current layout suitable for the user based on the user's historical layout preferences recorded in the layout memory unit.

[0014] Preferably, the content display optimization unit further includes a content recommendation unit and a content display unit, the content recommendation unit recommends content of interest to the user based on the user's historical behavior data, and the content display unit adjusts the display method of the main screen content based on the content recommended by the content recommendation unit. The system collects the user's layout adjustment data on the main screen through the screen interface management module, including the position of the icon, the size and arrangement of the window, etc. These layout preference data are stored on the local device or uploaded to the cloud to synchronize the user's personalized settings on different devices. As the user continues to adjust the layout, the system will continue to update the user's historical layout preference data to ensure the timeliness and accuracy of the data. The system analyzes the user's historical layout preference data to understand the user's operating habits and preferences. Based on the user's historical preferences and current task requirements, the layout recommendation unit recommends one or more layout options suitable for the user.

[0015] Preferably, the interactive feedback unit further includes a visual feedback unit, an auditory feedback unit and a tactile feedback unit. The visual feedback unit is used to change the visual effect of the main screen interface when the user operates, the auditory feedback unit is used to emit sound feedback when the user operates, and the tactile feedback unit is used to provide vibration feedback when the user operates. The system collects the user's operation data on the main screen, such as clicks, views, operations, etc., through the screen interface management module. The system analyzes the user's historical behavior data to identify the user's interests and preferences. According to the user's historical behavior data, the content recommendation unit recommends content that the user may be interested in. According to the recommendation results of the content recommendation unit, the system The content on the main screen is sorted, and the content that the user may be interested in is placed in a prominent position. When the user operates, the visual feedback unit changes the visual effects of the main screen interface, such as color changes, dynamic effects, etc., prompting the user's operation status and results through visual effects, and issues sound feedback when the user operates, such as prompt sounds, sound effects, etc., to confirm whether the user's operation is successful through sound feedback, and provides vibration feedback when the user operates, such as vibration on the handle or VR device, to enhance the user's operation perception and experience through tactile feedback. The content display optimization unit can recommend content that the user is interested in based on the user's historical behavior data, and adjust the display method of the main screen content to improve information transmission efficiency and user experience. At the same time, the interactive feedback unit provides visual, auditory and tactile feedback.

[0016] Beneficial Effects The present invention provides a main screen wake-up system based on the metaphor of walking outward, which has the following beneficial effects compared with the prior art: 1. In the present invention, by introducing the border screen technology in VR, the border screen integrates the main screen and functional components, and the user wakes up the main screen and functional components through the natural behavior of "walking out" (such as moving to the boundary of the virtual environment). This interactive method of waking up the main screen based on the VR border screen can make up for the limitations of methods such as voice wake-up, gesture wake-up, and handle wake-up to a certain extent, and can meet the needs and operating habits of different users, thereby providing a more natural and smooth user experience. The interaction between the user's action and the boundary of the virtual environment is more natural, reducing the sense of separation caused by the traditional screen wake-up button or gesture, making it easier for users to immerse themselves in the virtual environment; 2. In the present invention, through the collaborative work of the user motion capture unit and the motion analysis unit, multiple beneficial effects are achieved, such as improving the naturalness and intuitiveness of interaction, enhancing personalized experience, improving operation efficiency and response speed, optimizing system resource utilization, and enhancing user immersion. The user can quickly and naturally summon the main screen through simple body movements, and adjust the wake-up mechanism according to personal preferences and needs, thereby ensuring efficient operation while providing an interactive experience that is more in line with the user's instinct, personalized and immersive. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 A system framework diagram of a main screen wake-up system based on the metaphor of walking outward proposed by the present invention; Figure 2 This is a demonstration diagram of an interactive paradigm of a main screen wake-up system based on the metaphor of walking outwards proposed by the present invention; Figure 3 This is a VR main screen example diagram of a main screen wake-up system based on the metaphor of walking outward proposed by the present invention; Figure 4 A schematic diagram of a main screen wake-up system based on the metaphor of walking outward proposed by the present invention waking up behind a security wall; Figure 5 There are two existing home screen wake-up methods: PinchICon and TapHead. DETAILED DESCRIPTION

[0018] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0019] See also Figure 1-5 The present invention provides two technical solutions, which specifically include the following embodiments: Embodiment 1: A home screen wake-up system based on the walking-out metaphor, comprising: The boundary screen BS module is used to realize the dynamic boundary wake-up function of the main screen. The boundary screen BS module monitors the user's position and movement status in real time, and accurately recognizes the user's action of approaching or touching the preset boundary of the virtual environment through the collaborative work of the boundary recognition unit and the boundary trigger unit; The boundary screen BS module includes a boundary recognition unit and a boundary trigger unit. The boundary recognition unit monitors the user's position and movement status in the virtual environment in real time and recognizes the user's action of approaching or touching the preset boundary of the virtual environment. The boundary recognition unit further includes a distance detection module and a safety boundary distance judgment module. The distance detection module is used to detect the distance between the user and the preset boundary of the virtual environment to reduce the probability of false triggering. The safety boundary distance judgment module is used to add an additional interaction intention confirmation step when the user approaches the safety boundary to prevent false triggering. When the user performs a boundary action, the boundary trigger unit immediately triggers the wake-up of the main screen and provides a feedback signal of the boundary action. The strength of the feedback signal Adjust according to the following formula based on the distance between the user and the border: ; in, is the maximum feedback signal strength.

[0020] The interactive intention confirmation module is used for users to summon the main screen and functional components, including but not limited to menus, applications, settings, etc. through the boundary screen technology, so as to facilitate users to directly operate in the virtual environment. The interactive intention confirmation module realizes dynamic summoning of the main screen according to the user's action intention. The action analysis unit analyzes the user's interactive behavior and decomposes it into the following action sequence: walking to the safety boundary, waking up the safety wall, raising the hand, and interacting. The user's confirmation of the interactive intention link is placed after raising the hand. After the user raises his hand, he can confirm the user's interactive intention by tapping the main screen interaction area twice in succession. After the user taps the main screen twice, the main screen will be awakened. At this time, the application icon appears on the safety wall, and the user can click the icon normally; The interactive intention confirmation module includes a user motion capture unit and a motion analysis unit. The user motion capture unit analyzes the user's motion intention to realize the dynamic summoning of the main screen. The motion analysis unit analyzes the user's motion intention to realize the dynamic summoning of the main screen and adjust the sensitivity and response speed of the main screen wake-up. The user motion capture unit uses the sensors of the VR head display and the handle to capture the user's specific motion vector ; ; User action intention ,in, is the action vector The modulus indicates the intensity of the action. is the set intention recognition threshold. The sensitivity adjustment method in the action analysis unit is based on the following formula: ; in, It's time The sensitivity factor, is the maximum speed of the user's actions, Is the user at time When the user's action speed is close to the maximum value, the sensitivity is close to the maximum. When the action speed is slow, the sensitivity decreases. The response speed adjustment method in the action analysis unit is based on the following formula: ; in, For time The response speed, and are the maximum and minimum response speeds, respectively. When the user's intention is recognized ( ), the response speed reaches the maximum value, otherwise it remains at the minimum value.

[0021] The screen interface management module is used to process the interaction interface between the user and the main screen.

[0022] The boundary recognition method of the boundary recognition unit is specifically based on the following formula: Real-time monitoring of user location and motion status ; Identify when a user approaches or touches a preset boundary Actions; Distance from user to border ; in,( ) is the boundary point Coordinates of ,when When the user is considered to be approaching the boundary, a touch threshold is set , is 20m, when When the user touches the boundary, or When the user's movement direction points to the boundary, the wake-up is triggered. The user wakes up the main screen through the natural behavior of "walking out" (such as moving towards the boundary of the virtual environment). When the user performs boundary actions, the boundary of the main screen is dynamically adjusted to match the user's actions, thereby realizing dynamic boundary wake-up of the main screen. Specifically, when the user moves in the virtual environment, the system will monitor the user's position and motion status in real time. When the user approaches or touches the preset boundary of the virtual environment, the system will recognize this action and immediately trigger the wake-up of the main screen through the boundary trigger unit. At the same time, the system will also provide feedback signals of boundary actions to enhance the user's immersion and operation perception.

[0023] Preferably, by introducing boundary screen technology in VR, by combining boundary screen technology, the user wakes up the main screen through the natural behavior of "walking out" (such as moving to the boundary of the virtual environment). This "walking out" method can make up for the limitations of methods such as voice wake-up, gesture wake-up, and handle wake-up to a certain extent, and can meet the needs and operating habits of different users, thereby providing a more natural and smooth user experience, and the interaction between user actions and the boundary of the virtual environment is more natural, reducing the sense of separation caused by traditional screen wake-up buttons or gestures, making it easier for users to immerse themselves in the virtual environment. As shown in Figure 2, when the user uses the BoundaryScreen technology to switch applications, he only needs to walk to the safety boundary in any direction. After reaching the activation threshold (20cm) of the safety wall, the red safety wall will appear, the user raises his hand and taps the main screen twice (intention confirmation), the main screen appears, and the user can interact with the main screen.

[0024] Embodiment 2: On the basis of the first embodiment, the screen interface management module includes an interface layout adjustment unit, which is used to organize the layout of the screen according to the user settings and the shape of the security boundary, such as the position of the icon, the size and arrangement of the window, etc., and recommend the current layout suitable for the user according to the user's historical layout preferences recorded by the layout memory unit. The content display optimization unit is used to optimize the display method of the main screen content and improve the efficiency of information transmission. The content display optimization unit analyzes the user's historical behavior data, such as clicks, views, operations, etc., and adjusts the display method of the main screen content according to the content recommended by the content recommendation unit, including the sorting, grouping, and highlighting of the content, so as to improve the efficiency of information transmission and user experience, so as to recommend content that the user may be interested in. The interactive feedback unit is used to provide visual, auditory and tactile feedback to enhance the user's interactive experience, and change the visual effects of the main screen interface when the user operates, such as color changes, dynamic effects, etc. Visual feedback can enhance the user's operation perception and feedback, and auditory feedback emits sound feedback when the user operates, such as prompt sounds, sound effects, etc. Auditory feedback can provide Provide additional operation prompts and feedback. Haptic feedback provides vibration feedback when the user operates, such as vibration on a handle or VR device. Haptic feedback can enhance the user's immersion and operation experience. The interface layout adjustment unit further includes a layout memory unit and a layout recommendation unit. The layout memory unit is used to record the user's historical layout preferences. The layout recommendation unit recommends the current layout suitable for the user based on the user's historical layout preferences recorded by the layout memory unit. Specifically, the system collects the user's layout adjustment data on the main screen through the screen interface management module, including the position of the icon, the size and arrangement of the window, etc. These layout preference data are stored on the local device or uploaded to the cloud to synchronize the user's personalized settings on different devices. As the user continues to adjust the layout, the system will continue to update the user's historical layout preference data to ensure the timeliness and accuracy of the data. The system analyzes the user's historical layout preference data to understand the user's operating habits and preferences. Based on the user's historical preferences and current task requirements, the layout recommendation unit recommends one or more layout options suitable for the user.

[0025] The content display optimization unit further includes a content recommendation unit and a content display unit. The content recommendation unit recommends content that the user is interested in based on the user's historical behavior data. The content display unit adjusts the display method of the main screen content based on the content recommended by the content recommendation unit. The interactive feedback unit further includes a visual feedback unit, an auditory feedback unit and a tactile feedback unit. The visual feedback unit is used to change the visual effect of the main screen interface when the user operates. The auditory feedback unit is used to emit sound feedback when the user operates. The tactile feedback unit is used to provide vibration feedback when the user operates. The system collects the user's operation data on the main screen, such as clicks, views, operations, etc., through the screen interface management module. The system analyzes the user's historical behavior data to identify the user The system can use the user's historical behavior data to recommend content that the user may be interested in. Based on the recommendation results of the content recommendation unit, the system sorts the content on the main screen and places the content that the user may be interested in in a prominent position. When the user operates, the visual feedback unit changes the visual effects of the main screen interface, such as color changes, dynamic effects, etc., and prompts the user's operation status and results through visual effects. When the user operates, it issues sound feedback, such as prompt sounds, sound effects, etc., and confirms whether the user's operation is successful through sound feedback. The content display optimization unit can recommend content that the user is interested in based on the user's historical behavior data, and adjust the display method of the main screen content to improve information transmission efficiency and user experience. Figure 3 As shown, the content that the user is interested in and the corresponding sorting method are recommended. At the same time, the interactive feedback unit enhances the interactive experience between the user and the main screen through visual and tactile feedback, providing a richer and more immersive virtual reality experience. Through the collaborative work of the user motion capture unit and the motion analysis unit, multiple beneficial effects such as improving the naturalness and intuitiveness of the interaction, enhancing the personalized experience, improving the operating efficiency and response speed, optimizing the utilization of system resources, and enhancing the user's immersion are achieved.

[0026] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the application should be included in the protection scope of the present application.

Claims

1. A home screen wake-up system based on the metaphor of walking outward, characterized in that: include: Boundary screen BS module, used to implement the dynamic boundary wake-up function of the main screen; The boundary screen BS module includes a boundary recognition unit and a boundary trigger unit. The boundary recognition unit monitors the user's position and movement status in the virtual environment in real time and recognizes the user's action of approaching or touching the preset boundary of the virtual environment. When the user performs a boundary action, the boundary trigger unit instantly triggers the wake-up of the main screen and provides a feedback signal of the boundary action. The boundary recognition unit further includes a position detection module and a safety boundary distance judgment module. The position detection module is used to detect the position change of the user in the real environment, thereby mapping the position change information of the virtual avatar; the safety boundary distance judgment module is used to add an additional interaction intention confirmation step when the user approaches the safety boundary to prevent false triggering.

2. A home screen wake-up system based on the walking out metaphor according to claim 1, characterized in that: The system further comprises: Interaction intention confirmation module, used by users to summon the main screen and functional components through the border screen technology; The interaction intention confirmation module includes a user motion capture unit and a motion analysis unit. The user motion capture unit analyzes the user's motion intention to realize the dynamic summoning of the main screen. The motion analysis unit analyzes the user's interactive behavior and decomposes it into the following action sequence: walking to the safety boundary, waking up the safety wall, raising the hand, and interacting; Screen interface management module, used to handle the interaction interface between the user and the main screen; The screen interface management module includes an interface layout adjustment unit, which is used to organize the screen layout according to the user settings and the shape of the safety boundary, a content display optimization unit, which is used to optimize the display method of the main screen content and improve the efficiency of information transmission, and an interactive feedback unit, which is used to provide visual and auditory feedback to enhance the user interaction experience.

3. The main screen wake-up system based on the walking-outward metaphor according to claim 1, characterized in that: The boundary recognition method of the boundary recognition unit is specifically in accordance with the following formula: Real-time monitoring of user location and motion status ; Identify when a user approaches or touches a preset boundary Actions; Distance from user to border ; in,( ) is the boundary point Coordinates of ,when When the user is considered to be approaching the boundary, the safety wall is awakened and a touch threshold is set. ,when When the user touches the boundary, or And when the user's movement direction points to the boundary, wake-up is triggered.

4. The main screen wake-up system based on the walking-outward metaphor according to claim 1, characterized in that: The strength of the feedback signal Adjust according to the following formula based on the distance between the user and the border: ； in, is the maximum feedback signal strength.

5. The main screen wake-up system based on the walking-outward metaphor according to claim 1, characterized in that: The user motion capture unit uses sensors of the VR headset and handle to capture the user's specific motion vectors. ; ； User action intention ,in, is the action vector The modulus indicates the intensity of the action. is the set intent recognition threshold.

6. The main screen wake-up system based on the walking-outward metaphor according to claim 1, characterized in that: The sensitivity adjustment method in the motion analysis unit is according to the following formula: ； in, It's time The sensitivity factor, is the maximum speed of the user's actions, Is the user at time When the user's movement speed is close to the maximum value, the sensitivity is close to the maximum, and when the movement speed is slower, the sensitivity is reduced.

7. The main screen wake-up system based on the walking-outward metaphor according to claim 1, characterized in that: The response speed adjustment method in the action analysis unit is according to the following formula: ； in, For time The response speed, and are the maximum and minimum response speeds, respectively. When the user's intention is recognized ( ), the response speed reaches the maximum value, otherwise it remains at the minimum value.

8. The main screen wake-up system based on the walking-outward metaphor according to claim 2, characterized in that: The interface layout adjustment unit further includes a layout memory unit and a layout recommendation unit. The layout memory unit is used to record the user's historical layout preferences. The layout recommendation unit recommends a current layout suitable for the user based on the user's historical layout preferences recorded in the layout memory unit.

9. The main screen wake-up system based on the walking-outward metaphor according to claim 2, characterized in that: The content display optimization unit further includes a content recommendation unit and a content display unit. The content recommendation unit recommends content that the user is interested in according to the user's historical behavior data, and the content display unit adjusts the display mode of the main screen content according to the content recommended by the content recommendation unit.

10. The main screen wake-up system based on the walking-outward metaphor according to claim 2, characterized in that: The interactive feedback unit further includes a visual feedback unit, an auditory feedback unit and a tactile feedback unit. The visual feedback unit is used to change the visual effect of the main screen interface when the user operates, the auditory feedback unit is used to emit sound feedback when the user operates, and the tactile feedback unit is used to provide vibration feedback on the handle when the user operates.

Images