Prompt display method and device, storage medium and program product

Abstract

Provided in the embodiments of the present disclosure are a prompt display method and device, a storage medium and a program product. The method comprises: in response to a change of the immersion degree satisfying a preset condition, displaying a target boundary on a screen, the immersion degree being related to the proportion of a virtual picture in a currently displayed picture, and the target boundary being used for representing a predefined spatial range.

Description

Method, device, storage medium and program product for prompt display

[0001] Cross-reference to Related Applications

[0002] This application claims the benefit of Chinese Patent Application No. 202411132163.5, filed August 16, 2024. The entire teachings of the above application are incorporated herein by reference. TECHNICAL FIELD

[0003] Embodiments of the present disclosure relate to the technical field of extended reality, and in particular, to a prompt display method, device, storage medium and program product. BACKGROUND

[0004] In order to improve the user experience of using a head-mounted device, a plurality of selectable virtual environments can be provided for the user to select, and activities such as email sending and receiving and web browsing can be performed in the selected virtual environment as the background. At the same time, the user can adjust the degree of immersion to adjust the display ratio of the virtual environment. By adjusting the degree of immersion, the user can switch between a completely immersive virtual reality mode and a mode in which the real environment is exposed.

[0005] When the degree of immersion is switched, the user's spatial perception may change. How to improve the correctness of the user's spatial perception is a technical problem to be solved. SUMMARY

[0006] Embodiments of the present disclosure provide a prompt display method, device, storage medium and program product.

[0007] In a first aspect, embodiments of the present disclosure provide a prompt display method, comprising:

[0008] In response to the change in the degree of immersion meeting a preset condition, a target boundary is displayed in the screen; the degree of immersion is related to the proportion of a virtual picture in a currently displayed picture, and the target boundary is used to represent a predefined spatial range.

[0009] In a second aspect, embodiments of the present disclosure provide a prompt display device, comprising:

[0010] The display module is configured to display a target boundary in the screen in response to the change in the degree of immersion meeting a preset condition; the degree of immersion is related to the proportion of a virtual picture in a currently displayed picture, and the target boundary is used to represent a predefined spatial range.

[0011] In a third aspect, embodiments of the present disclosure provide an electronic device, comprising a processor and a memory;

[0012] The memory stores computer execution instructions;

[0013] The processor executes computer-executable instructions stored in the memory, so that the at least one processor executes the prompt display method according to the first aspect and various possible designs of the first aspect.

[0014] In a fourth aspect, the embodiments of the present disclosure provide a computer-readable storage medium, and the computer-readable storage medium stores computer-executable instructions. When a processor executes the computer-executable instructions, the prompt display method according to the first aspect and various possible designs of the first aspect is implemented.

[0015] In a fifth aspect, the embodiments of the present disclosure provide a computer program product, and the computer program product includes a computer program. When a processor executes the computer program, the prompt display method according to the first aspect and various possible designs of the first aspect is implemented. BRIEF DESCRIPTION OF DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative labor.

[0017] FIG. 1 is a schematic diagram of an application scenario of a prompt display method according to an embodiment of the present disclosure;

[0018] FIG. 2 is a schematic diagram of a prompt display method flow according to an embodiment of the present disclosure;

[0019] FIG. 3 is a schematic diagram of a principle of 50% immersion according to an embodiment of the present disclosure;

[0020] FIG. 4 is a schematic diagram of a scenario of adjusting immersion according to an embodiment of the present disclosure;

[0021] FIG. 5 is a schematic diagram of a scenario of switching applications according to an embodiment of the present disclosure;

[0022] FIG. 6 is a schematic diagram of a prompt display method flow according to an embodiment of the present disclosure;

[0023] FIG. 7 is a schematic diagram of a scenario of gradually revealing a real environment according to an embodiment of the present disclosure;

[0024] FIG. 8 is a structural block diagram of a prompt display device according to an embodiment of the present disclosure;

[0025] FIG. 9 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0026] In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present disclosure with reference to the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only some but not all of the embodiments of the present disclosure. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present disclosure.

[0027] In order to improve user experience, multiple selectable virtual environments can be provided for users, so that the user can select a virtual environment as a background when using a specific application. At the same time, the user can adjust the degree of immersion to adjust the display ratio of the virtual environment, that is, the ratio between the virtual environment and the visible real environment. The visible real environment can include a real environment displayed through a video see-through (VST) method in a virtual reality (VR) scene, and can also include a real environment directly seen through a lens in an augmented reality (AR) glasses scene. By adjusting the degree of immersion, the user can switch between a completely immersive virtual reality mode and a real environment mode.

[0028] The degree of immersion can be the area ratio between the display area of the virtual environment and the display area of the real environment. For example, in the VST scene of the AR device or the VR device, the display area of the virtual environment can be increased or reduced, and the display area of the real environment can be correspondingly reduced or increased to achieve different degrees of real environment transparency. The degree of immersion can also refer to the transparency superposition ratio. For example, in the VST scene of the AR device or the VR device, the virtual content can be superimposed with the real environment with a certain transparency. High transparency means that the user can clearly see the display world behind, and low transparency makes the virtual content more prominent and reduces the interference of the real world. During the adjustment of the degree of immersion, different degrees of real environment transparency can be achieved by setting different transparencies for the virtual content and superimposing them with the real environment.

[0029] In the related art, the boundary is usually automatically set. When the user moves to or out of the boundary, different degrees of real environment transparency are used to ensure the safety of the user. However, the protection of the user in the above-mentioned manner is small, and the safety is poor.

[0030] To solve the above technical problems, the present inventors have found that the target boundary can be displayed in a specific scenario, for example, when the immersion degree changes, so that the user pays attention to the target boundary range when using the head-mounted device in the specific scenario, improves the correctness of spatial perception, and knows the situation in advance in the subsequent activity process, thereby improving the safety of the head-mounted device.

[0031] FIG. 1 is a schematic diagram of an application scenario of the prompt display method provided by the present disclosure. As shown in FIG. 1, a user wears a head-mounted device 101, which can include a control for changing the immersion degree. For example, a hardware control 1011, by rotating the control 1011, the immersion degree of the head-mounted device 101 can be adjusted. In a specific implementation process, the head-mounted device 101 obtains the change of the immersion degree, which is related to the proportion of the virtual picture in the currently displayed picture. If the change meets a preset condition, the target boundary is displayed on the screen, which is used to represent the range of the space that can be freely moved. The prompt display method provided by the present disclosure can display the target boundary in time when the immersion degree changes, so that the user improves the correctness of spatial perception, perceives the safety situation around according to the target boundary, adjusts the position, and has an expectation of the movable range, thereby improving the safety of the device.

[0032] It should be noted that the scene diagram shown in FIG. 1 is only an example, and the prompt display method and the scene described in the embodiments of the present disclosure are used to more clearly illustrate the technical solutions of the embodiments of the present disclosure, and do not constitute a limitation on the technical solutions provided by the embodiments of the present disclosure. Those skilled in the art can know that the technical solutions provided by the embodiments of the present disclosure are also applicable to similar technical problems as the system evolves and new business scenarios appear.

[0033] The technical solutions of the present application will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0034] FIG. 2 is a flowchart of the prompt display method provided by the present disclosure. As shown in FIG. 2, the prompt display method includes:

[0035] 201, in response to the change of the immersion degree meeting a preset condition, displaying a target boundary in the screen; the immersion degree is related to the proportion of the virtual picture in the currently displayed picture, and the target boundary is used to represent a predefined spatial range.

[0036] The execution subject of the embodiments of the present disclosure can be a display device, for example, a virtual reality (VR), augmented reality (AR), mixed reality (MR), or extended reality (XR) device, and specifically can be a head-mounted device.

[0037] Specifically, when the change of the immersion degree meets the preset condition, for example, the immersion degree is greater than a preset threshold, the immersion degree adjustment speed is greater than a preset threshold, and the like, the target boundary can be displayed on the screen to make the user perceive the surrounding safety situation according to the target boundary, adjust the position, and have an expectation of the moving range. The display mode of the target boundary can be gradual display or sudden display. After the target boundary is lit, to prevent disturbing the user experience, the target boundary can be hidden when a specific condition is met. The hiding mode of the target boundary can be gradual disappearance or sudden disappearance. The form of the target boundary can be a ground boundary, a three-dimensional protective fence, or a mesh reconstructed from an object surface, and the like.

[0038] In an embodiment of the present disclosure, to protect the safety of the user, the target boundary can be a safety boundary, and accordingly, the predefined spatial range can refer to a boundary range in which the user can move freely.

[0039] In an embodiment of the present disclosure, the immersion degree can be the area ratio between the display area of the virtual environment and the display area of the real environment. For example, in the VST scene of the AR device or the VR device, the display area of the virtual environment can be increased or decreased, and accordingly, the display area of the real environment can be decreased or increased to achieve different degrees of exposure to the real environment. The immersion degree can also refer to the transparency superposition ratio. For example, in the VST scene of the AR device or the VR device, the virtual content can be superimposed with the real environment with a certain transparency. High transparency means that the user can clearly see the display world behind, and low transparency makes the virtual content more prominent and reduces the interference of the real world. During the adjustment of the immersion degree, the virtual content can be superimposed with the real environment by setting different transparencies for the virtual content to achieve different degrees of exposure to the real environment.

[0040] Taking the immersion degree as an example, which is the proportion of the virtual picture in the currently displayed picture. The currently displayed picture can be a 360-degree view picture. As shown in FIG. 3, after the center of the view (0 degree) is defined, it is assumed that the immersion degree is 50%. Therefore, in the 360-degree view, the picture of the virtual environment will be displayed between-90 degrees and 90 degrees. That is, after the user tilts the head by a certain angle to the left or to the right, the picture of the real environment outside-90 degrees or 90 degrees can be seen.

[0041] The change of the immersion degree includes an adjustment speed of the immersion degree, an adjusted value of the immersion degree, and the like.

[0042] In the embodiments of the present disclosure, there are multiple scenarios in which the immersion degree changes.

[0043] For the scenario in which the user adjusts the immersion degree through a special immersion degree adjustment control or adjustment gesture, the obtaining of the change of the immersion degree can include: receiving an immersion degree adjustment request input by the user, and determining the change of the immersion degree according to the immersion degree adjustment request.

[0044] Specifically, the immersion degree adjustment can be set to be available in part of the interface, and can also be set to be applicable to any interface. The immersion degree adjustment can be rotation adjustment through a hardware or software watch face, can also be direct input of the value of the immersion degree through a virtual keyboard, or can be sliding adjustment through gesture recognition (for example, moving or rotating in a certain direction to increase the immersion degree, and moving or rotating in the opposite direction to decrease the immersion degree). When the user adjusts the immersion degree, the head-mounted device receives an immersion degree adjustment request, and then can determine the change of the immersion degree based on the immersion degree adjustment request. The immersion degree adjustment request can include a parameter representing the adjustment degree.

[0045] As shown in FIG. 4, in the immersion degree adjustment scenario in which the immersion degree adjustment is performed through a hardware control, the immersion degree can be adjusted by rotating a hardware watch face, for example, from 20% to 50%.

[0046] In an embodiment of the present disclosure, for the above scenario, there are multiple ways to determine the change of the immersion degree.

[0047] In one implementation manner, the determining of the change of the immersion degree according to the immersion degree adjustment request can include: in response to receiving the immersion degree adjustment request input by the user, detecting the immersion degree, and determining the change of the immersion degree according to a detection result.

[0048] Specifically, after the head-mounted device receives the immersion degree adjustment request input by the user, the current immersion degree can be detected in real time or periodically to obtain an adjusted immersion degree. Then, the adjustment speed of the immersion degree and the like can be determined based on the adjusted immersion degree and the adjusted immersion degree. When the adjusted immersion degree is higher than a certain threshold, a target boundary (for example, a ground boundary) is lit up. During the adjustment process of being greater than the threshold, the ground boundary is always lit up. When the user adjusts to a certain value and stops adjusting, the boundary gradually fades away to prevent disturbing the user experience.

[0049] In another implementation manner, determining the change of the immersion degree according to the immersion degree adjustment request can include: parsing the immersion degree adjustment request to obtain an adjustment parameter; and determining the change of the immersion degree according to the adjustment parameter.

[0050] Specifically, the immersion degree adjustment request carries an adjustment parameter representing an adjustment degree. After the head-mounted device receives the immersion degree adjustment request input by the user, the immersion degree adjustment request can be parsed to obtain the adjustment parameter. According to the adjustment parameter, the numerical value of the adjusted immersion degree or the adjustment speed can be determined.

[0051] In an embodiment of the present disclosure, considering that the adjustment speed is too fast, the immersion degree can quickly increase to a certain extent, so that the user cannot perceive the surrounding real environment, and a safety hazard is formed. Therefore, for the case where the adjustment speed is fast, the target boundary is reminded. Specifically, if the change meets a preset condition, the target boundary is displayed in the screen. For example, if the continuous change speed of the immersion degree is greater than a preset speed, the target boundary is displayed in the screen.

[0052] In an embodiment of the present disclosure, no matter whether the immersion degree is adjusted by rotating the dial, directly inputting a numerical value, or adjusting the immersion degree through gesture recognition, one or more continuous adjustments may be required to complete the selection of the immersion degree. Therefore, the immersion degree can be kept unchanged, or the interval time length can be taken as a judgment basis. If the preset time length is exceeded, it indicates that the adjustment is completed. Specifically, the method includes: receiving an immersion degree adjustment request input by a user, and determining the change of the immersion degree according to the immersion degree adjustment request. If the change meets a preset condition, a target boundary is displayed in the screen. If the immersion degree remains unchanged for a first preset time length, the target boundary is hidden. If no new immersion degree adjustment request is received within a second preset time length since the current immersion degree adjustment request is received, the target boundary is hidden. If the immersion degree remains unchanged for a first preset time length, the target boundary is hidden. If no new immersion degree adjustment request is received within a second preset time length since the current immersion degree adjustment request is received, the target boundary is hidden. The two conditions can be implemented simultaneously, or alternatively. The present disclosure does not limit this.

[0053] For the scenario of switching from a black screen state (shutdown or hibernation) to an application interface with a lower immersion degree, or switching from an application interface with a lower immersion degree to an application interface with an immersion degree of 100% or a higher immersion degree. The change of the immersion degree can include: in response to receiving a target instruction for entering a target interface, determining the change of the immersion degree according to the target instruction; and the immersion degree of the target interface is greater than 0.

[0054] Specifically, when the user powers on, wakes up from hibernation, switches applications back to / into the home interface (the Launcher interface or the home interface), or switches from another interface (for example, the home interface) to an application interface (the interface of a fully immersive game), the system can determine the change in the degree of immersion. In order to determine whether to display the target boundary according to the change in the degree of immersion, so as to improve the correctness of the user's spatial perception, perceive the surrounding safety according to the target boundary, adjust the position, and have an expectation of the moving range.

[0055] For example, as shown in FIG. 5, in the scenario in which the application switching causes the change in the degree of immersion, the game, album, mail, and settings icons are displayed in the home interface. The current degree of immersion is 10%. In response to the click operation on the icon of the game application, the interface of the game application can be entered, and the fully immersive game scene is displayed, that is, the degree of immersion reaches 100%.

[0056] In the embodiments of the present disclosure, the target instruction can include at least one of the following: a power-on instruction, a hibernate wake-up instruction, and an application switching instruction.

[0057] In an embodiment of the present disclosure, in order to increase the alertness, a prompt box can be displayed at the same time as the target boundary is displayed. Specifically, when the boundary is lit up to prompt, a prompt box can be popped up: please ensure the safety of the space within the ground boundary. The prompt can be reduced in frequency according to the needs to prevent disturbing the user, for example, only once when powering on, until the next time the device is powered off and then powered on again.

[0058] In an embodiment of the present disclosure, if the degree of immersion reaches a certain degree (for example, 20%), it indicates that the user cannot fully ensure safety by observing the picture in the real environment on the screen, and there is a safety hazard. Therefore, the target boundary needs to be prompted. Specifically, the change meets the preset condition, which can include that the current degree of immersion is greater than a preset threshold. The preset threshold can be set to a value between 15% and 25%, for example, 20%.

[0059] In an embodiment of the present disclosure, the target boundary is determined according to at least one of the following data: data 1: the position of the display device; data 2: the grid data of the surrounding real environment; and data 3: the preset boundary.

[0060] Specifically, the target boundary can be determined according to one or more of data 1 to data 3.

[0061] In a realizable manner, the target boundary can be determined according to the position of the display device. For example, a cylindrical boundary can be set around the display device. The relative position between the cylindrical boundary and the display device is fixed, that is, it does not change with the movement of the display device, and it can move relative to the world coordinate system.

[0062] In another implementation, the target boundary can be determined according to mesh data of the surrounding real environment. Specifically, the mesh data can be obtained by dynamically scanning the surrounding objects. The obtained mesh data is fixed relative to the world coordinate system, and the mesh data is dynamically generated as the position of the display device changes.

[0063] In yet another implementation, the target boundary can be determined according to a preset boundary. Specifically, the user can draw a closed figure on the ground as the preset boundary when using the display device. The preset boundary is fixed relative to the world coordinate system.

[0064] In one embodiment of the present disclosure, displaying a target boundary in a screen includes: obtaining position coordinates of feature points of the target boundary; determining a boundary range of the target boundary according to the position coordinates of the feature points based on a preset rule; and displaying the target boundary according to the boundary range.

[0065] Specifically, to save resources, the head-mounted device can only store the position coordinates of the feature points (center points) of the target boundary, and does not need to store the position coordinates of each point of the target boundary (for example, a ground circular boundary). When the target boundary needs to be displayed, the boundary range of the target boundary is determined based on the feature points again.

[0066] In one embodiment of the present disclosure, the position coordinates of the feature points are determined according to the position coordinates of the head-mounted device in response to entering a target interface; or the position coordinates of the feature points are determined according to the current position coordinates of the head-mounted device.

[0067] Specifically, the position coordinates of the feature points can be recorded at a specific event (for example, entering a main interface) as the determination time. For example, when entering the main interface, the current position coordinates of the head-mounted device can be recorded as the position coordinates of the feature points of the target boundary. In this way, when the target boundary needs to be displayed subsequently, the boundary range of the target boundary can be determined based on the position coordinates of the head-mounted device.

[0068] In one implementation, the current time can also be used as the determination time for determining the position coordinates of the feature points based on the display requirement. For example, when it is determined that the target boundary needs to be displayed, the current position coordinates of the head-mounted device are obtained as the position coordinates of the feature points, and then the boundary range of the target boundary is determined based on the position coordinates to display the target boundary.

[0069] In an embodiment of the present disclosure, the determining the boundary range of the target boundary according to the position coordinates of the feature points based on the preset rule can include: determining the boundary range of the target boundary with the position coordinates of the feature points as the center and with a preset length as the radius; or obtaining grid data of a real environment around the position coordinates of the feature points; and determining the boundary range of the target boundary according to the grid data.

[0070] Specifically, in an implementable manner, after obtaining the position coordinates of the feature points, a ground circular boundary can be determined with the position coordinates as the center and with a preset length (for example, 1 meter) as the radius, or a bucket-shaped safety guard with a circular ground circular boundary as the bottom surface. In another implementable manner, the object surfaces in the real environment can be reconstructed by a space grid technology to obtain grid data, and the grid data is determined as the target boundary. After obtaining the grid data, an irregular three-dimensional boundary can also be determined based on the grid data, for example, a bucket-shaped safety guard with an irregular shape as the bottom surface, and no obstacle exists in the safety guard.

[0071] As can be seen from the above description, the method provided by the embodiment first obtains the change of the immersion degree, the immersion degree is related to the proportion of the virtual picture in the currently displayed picture, if the change meets the preset condition, the target boundary is displayed in the screen, and the target boundary is used to represent the space range that can be freely moved. The method provided by the embodiment can display the target boundary in time when the immersion degree changes, so as to improve the correctness of the space perception of the user, perceive the safety situation around according to the target boundary, adjust the position of the user, and have an expectation of the movable range, thereby improving the safety of the use of the device.

[0072] FIG. 6 is a flowchart of a second prompt display method provided by an embodiment of the present disclosure. As shown in FIG. 6, on the basis of the above-mentioned embodiment, for example, on the basis of the embodiment shown in FIG. 2, in order to ensure the experience of the user and save resources such as power, and also considering that the target boundary has achieved the reminding effect after being displayed for a certain time, the target boundary can be hidden. The prompt display method includes:

[0073] 601, obtaining the change of the immersion degree; the immersion degree is related to the proportion of the virtual picture in the currently displayed picture.

[0074] 602, judging whether the change meets the preset condition, if yes, performing step 603, and if no, not displaying the target boundary.

[0075] 603, displaying the target boundary in the screen; the target boundary is used to represent the predefined space range.

[0076] Steps 601 to 603 in the embodiments of the present disclosure are similar to steps 201 to 202 in the above disclosed embodiments, and thus are not described here again.

[0077] 604, determining whether the display duration of the target boundary is greater than a preset duration, if yes, performing step 605, if not, continuing to display the target boundary.

[0078] 605, hiding the target boundary.

[0079] Specifically, after displaying the target boundary, the display duration of the target boundary is detected, if the display duration exceeds the preset duration, it indicates that the user has known the range of the target boundary, therefore, in order to prevent disturbing the user experience, the target boundary can be hidden. The hiding manner can be gradual hiding or sudden hiding, which can be set according to actual needs, and the present disclosure does not limit this.

[0080] From the above description, it can be seen that the prompt display method provided by the embodiments of the present disclosure can reduce power consumption, save resources, and not affect the user experience by hiding the target boundary after displaying for a preset duration.

[0081] In one embodiment of the present disclosure, the method further comprises, for example, after step 202, further comprising: obtaining a moving direction of the head-mounted device; if the included angle between the moving direction and the user's face orientation is greater than a first preset angle, obtaining a first distance threshold; if the distance between the head-mounted device and the center position of the target boundary is greater than the first distance threshold, displaying the picture of the real environment within a preset range in the moving direction; if the included angle between the moving direction and the user's face orientation is less than a second preset angle, obtaining a second distance threshold; if the distance between the head-mounted device and the center position of the target boundary is greater than the second distance threshold, increasing the transparency of the virtual environment within the preset range in the moving direction to a first transparency; the first preset angle is greater than the second preset angle, and the first preset angle is less than 180 degrees; and the first distance threshold is less than the second distance threshold.

[0082] For example, the head-mounted device can set a target boundary by default, which can be a ground circular boundary centered on the position coordinates of the head-mounted device when the user enters the main interface, with a preset length (e.g., 0.5 meters) as the radius. When the user is within the boundary, the user can move freely without affecting the display of the virtual environment and the window. When the user moves away from the center by a first preset distance (e.g., 0.5 meters), a gradual hole-out effect starts in the moving-away direction. When the user moves to a second preset distance (e.g., 1.5 meters), the virtual environment will disappear completely. Considering that the brain reaction speed, visual field perception ability, and the like of the user will weaken when the user is retreating, in order to ensure that the safety of the user when retreating can reach the safety when advancing, the hole-out speed when retreating can be increased, so that the picture of the real environment is transparent from the virtual environment picture at the edge of the visual field as soon as possible. Specifically, when the user retreats away from the center of the target boundary, the virtual picture is transparent at the same distance from the center of the target boundary when advancing, so that the user can see the real environment transparent at the edge of the visual field faster. The hole-out effect refers to gradually increasing the transparency of the virtual environment at the hole-out position while displaying the picture of the real environment. As shown in FIG. 7, the hole-out effect becomes more obvious as the distance from the center of the target boundary increases, from a picture that completely displays the virtual environment of the beach, to a picture that increases the transparency of the virtual environment and transmits the real environment, to a picture that completely displays the real environment.

[0083] In one embodiment of the present disclosure, the method further includes, for example, after step 202, the method can further include: if the display device is located within the target boundary and the distance between the display device and the target boundary is less than a preset threshold, displaying the target boundary; and / or if the display device is located outside the target boundary and the distance between the display device and the target boundary is greater than the preset threshold, hiding the target boundary.

[0084] For example, when the user wearing the head-mounted device approaches the target boundary within the target boundary, the boundary can gradually light up and prompt. When the user walks out of the target boundary far enough, the target boundary can gradually disappear, so as not to disturb the use of the user. In an embodiment of the present disclosure, the display and hiding manner of the target boundary is only an example, and other manners can be used in other embodiments, and the embodiments of the present disclosure are not limited.

[0085] In one embodiment of the present disclosure, the method further includes, for example, after step 202, the method can further include: in response to a reset operation on the center of the visual field of the display device, resetting the target boundary, and if the current immersion degree is greater than a preset threshold, displaying the reset target boundary.

[0086] Specifically, the center of the field of view of the head-mounted device can be reset generally, and the target boundary can be reset at the same time. When the center of the field of view is reset, the position coordinates of the head-mounted device at the time of resetting the center of the field of view can be obtained, the position coordinates of the feature points of the target boundary after resetting are determined as the position coordinates, and then the boundary range of the target boundary after resetting is determined based on the position coordinates of the feature points, so that the target boundary after resetting is displayed.

[0087] Corresponding to the prompt display method of the above embodiment, FIG. 8 is a structural block diagram of a prompt display device provided by an embodiment of the present disclosure. For ease of description, only parts related to the embodiments of the present disclosure are shown. Referring to FIG. 8, the device includes an acquisition module 801 and a display module 802.

[0088] The display module 801 is configured to display a target boundary in the screen in response to a change condition of the immersion degree meeting a preset condition. The immersion degree is related to a proportion of a virtual picture in a currently displayed picture. The target boundary is used to represent a predefined spatial range.

[0089] In an embodiment of the present disclosure, the device further includes the acquisition module 801, which is configured to, before displaying the target boundary in the screen in response to the change condition of the immersion degree meeting the preset condition, receive a user inputted immersion degree adjustment request and determine the change condition of the immersion degree according to the immersion degree adjustment request.

[0090] In an embodiment of the present disclosure, when determining the change condition of the immersion degree according to the immersion degree adjustment request, the acquisition module 801 is specifically configured to detect the immersion degree in response to receiving the user inputted immersion degree adjustment request, and determine the change condition of the immersion degree according to a detection result.

[0091] In an embodiment of the present disclosure, when determining the change condition of the immersion degree according to the immersion degree adjustment request, the acquisition module 801 is specifically configured to analyze the immersion degree adjustment request to obtain an adjustment parameter, and determine the change condition of the immersion degree according to the adjustment parameter.

[0092] In an embodiment of the present disclosure, the change condition meeting the preset condition includes that a continuous change speed of the immersion degree is greater than a preset speed.

[0093] In an embodiment of the present disclosure, the display module 802 is further configured to hide the target boundary if the immersion degree remains unchanged for a first preset time length, and / or hide the target boundary if no new immersion degree adjustment request is received within a second preset time length since receiving a current immersion degree adjustment request.

[0094] In an embodiment of the present disclosure, the acquisition module 801 is specifically configured to, when acquiring the change of the immersion degree, determine the change of the immersion degree according to the target instruction in response to receiving the target instruction for entering the target interface; and the immersion degree of the target interface is greater than 0.

[0095] In an embodiment of the present disclosure, the target instruction comprises at least one of the following: a power-on instruction, a hibernation wake-up instruction, and an application switching instruction.

[0096] In an embodiment of the present disclosure, the change meets a preset condition, and the preset condition comprises that the current immersion degree is greater than a preset threshold.

[0097] In an embodiment of the present disclosure, the display module 802 is further configured to hide the target boundary if a display duration of the target boundary is greater than a preset duration.

[0098] In an embodiment of the present disclosure, the target boundary is determined according to at least one of the following data:

[0099] A position of the display device;

[0100] Mesh data of a surrounding real environment;

[0101] A preset boundary.

[0102] In an embodiment of the present disclosure, the display module 802 is further configured to acquire a moving direction of the head-mounted device; acquire a first distance threshold if an included angle between the moving direction and a user face orientation is greater than a first preset angle; display a picture of the real environment within a preset range in the moving direction if a distance between the head-mounted device and a center position of the target boundary is greater than the first distance threshold; acquire a second distance threshold if the included angle between the moving direction and the user face orientation is less than a second preset angle; and increase a transparency of a virtual environment within a preset range in the moving direction to a first transparency if the distance between the head-mounted device and the center position of the target boundary is greater than the second distance threshold; the first preset angle is greater than the second preset angle, and the first preset angle is less than 180 degrees; and the first distance threshold is less than the second distance threshold.

[0103] In an embodiment of the present disclosure, the display module 802 is further configured to display the target boundary if the display device is located within the target boundary and a distance between the display device and the target boundary is less than a preset threshold, and / or hide the target boundary if the display device is located outside the target boundary and the distance between the display device and the target boundary is greater than the preset threshold.

[0104] In an embodiment of the present disclosure, the display module 802 is further configured to reset the target boundary in response to a reset operation on the center of the field of view of the display device, and display the reset target boundary if the current immersion degree is greater than the preset threshold.

[0105] The device provided by the embodiment can be used to execute the technical solutions of the method embodiments, and has similar implementation principles and technical effects. Details are not described herein.

[0106] To implement the above-described embodiments, the present disclosure further provides an electronic device.

[0107] Referring to FIG. 9, a structural diagram of an electronic device 900 suitable for implementing the embodiments of the present disclosure is shown. The electronic device 900 can be a terminal device or a server. The terminal device can include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a personal digital assistant (PDA), a tablet computer (PAD), a portable multimedia player (PMP), a vehicle-mounted terminal (e.g., a car navigation terminal), and the like, and a fixed terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in FIG. 9 is merely an example, and should not impose any limitation on the functions and use range of the embodiments of the present disclosure.

[0108] As shown in FIG. 9, the electronic device 900 can include a processing device (e.g., a central processing unit, a graphics processing unit, or the like) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. Various programs and data required for the operation of the electronic device 900 are also stored in the RAM 903. The processing device 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0109] In general, the following devices can be connected to the I / O interface 905: input devices 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, and the like; output devices 907 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage devices 908 including, for example, a tape, a hard disk, and the like; and communication devices 909. The communication devices 909 can allow the electronic device 900 to communicate wirelessly or wiredly with other devices to exchange data. While FIG. 9 shows the electronic device 900 with various devices, it is understood that all of the shown devices are not required to be implemented or possessed. More or less devices can be alternatively implemented or possessed.

[0110] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer readable medium, the computer program containing program code for executing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network through the communication devices 909, or installed from the storage devices 908, or installed from the ROM 902. When the computer program is executed by the processing devices 901, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are performed.

[0111] It should be noted that the computer-readable medium in the above disclosure can be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. The computer-readable storage medium may, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device or apparatus. In the present disclosure, the computer-readable signal medium can include a data signal carried in a baseband or as a part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take many forms, including but not limited to an electromagnetic signal, an optical signal or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, which can send, propagate or transmit a program for use by or in conjunction with an instruction execution system, device or apparatus. The program code contained in the computer-readable medium can be transmitted by any suitable medium, including but not limited to a wire, a cable, an RF (radio frequency) or the like, or any suitable combination of the above.

[0112] The computer-readable medium described above can be contained in the electronic device described above; or can exist separately and not be assembled into the electronic device.

[0113] The computer-readable medium described above carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above embodiments.

[0114] Computer program code for carrying out operations of the present disclosure can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0115] The flow diagrams and the block diagrams in the drawings are meant as methodological and functional description of implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks can sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flow diagrams, and combinations thereof, can be implemented by special purpose hardware-based systems that perform the specified functions or operations, or combinations of special purpose hardware and computer instructions.

[0116] The units described in the embodiments of the present disclosure can be implemented by software, or by hardware. In some cases, the name of the unit does not constitute a limitation on the unit itself. For example, the first obtaining unit can also be described as a unit for obtaining at least two Internet protocol addresses.

[0117] The functions described in this specification can be implemented in part or in whole by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Program-specific Integrated Circuits (ASICs), Program-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0118] In the context of this disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium would include a lined- up electrical connection, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0119] The above description is only preferred embodiments of the present disclosure and the explanation of the applied technical principles. It should be understood by those skilled in the art that the disclosure range involved in the present disclosure is not limited to the technical solutions formed by the specific combinations of the above technical features, and also covers other technical solutions formed by any combination of the above technical features or equivalent features without departing from the above disclosed concept. For example, the technical solutions formed by replacing the above features with the technical features disclosed in the present disclosure (but not limited to) having similar functions.

[0120] In addition, although each operation is described in a particular order, this should not be understood as requiring the operations to be performed in the specific order shown or in a sequential order. In certain circumstances, multitasking and parallel processing can be advantageous. Similarly, although several implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Certain features described in the context of separate embodiments can also be combined in a single embodiment. Conversely, various features described in the context of a single embodiment can also be separated and implemented in multiple embodiments.

[0121] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A method for prompting display, applied to a display device, the method comprising: displaying a target boundary in a screen in response to a change condition of an immersion degree satisfying a preset condition, wherein the immersion degree is related to a proportion of a virtual picture in a currently displayed picture, and the target boundary is used to represent a predefined spatial range. 2.The method of claim 1, wherein before the displaying the target boundary in the screen in response to the change condition of the immersion degree satisfying the preset condition, the method further comprises: receiving an immersion degree adjustment request input by a user, and determining the change condition of the immersion degree according to the immersion degree adjustment request. 3.The method of claim 2, wherein the determining the change condition of the immersion degree according to the immersion degree adjustment request comprises: analyzing the immersion degree adjustment request to obtain an adjustment parameter; and determining the change condition of the immersion degree according to the adjustment parameter. 4.The method of claim 2, wherein the change condition comprises a continuous change speed of the immersion degree, and the change condition satisfying the preset condition comprises: the continuous change speed of the immersion degree being greater than a preset speed. 5.The method of claim 2, wherein after the displaying the target boundary in the screen, the method further comprises: if the immersion degree remains unchanged for a first preset time length, hiding the target boundary; and / or if no new immersion degree adjustment request is received within a second preset time length since a current immersion degree adjustment request is received, hiding the target boundary. 6.The method of claim 1, wherein before the displaying the target boundary in the screen in response to the change condition of the immersion degree satisfying the preset condition, the method further comprises: in response to receiving a target instruction for entering a target interface, determining the change condition of the immersion degree according to the target instruction; and the immersion degree of the target interface being greater than 0. 7.The method of claim 6, wherein the target instruction comprises at least one of the following: a power-on instruction, a hibernate wake-up instruction, and an application switching instruction. 8.The method of any one of claims 1-7, wherein the change condition satisfying the preset condition comprises: the current immersion degree being greater than a preset threshold. 9.The method of any one of claims 1-7, wherein after the displaying the target boundary in the screen, the method further comprises: if a display time length of the target boundary is greater than a preset time length, hiding the target boundary. 10.The method of any one of claims 1-7, wherein the target boundary is determined according to at least one of the following data: a position of the display device; mesh data of a surrounding real environment; and a preset boundary. 11.The method of any one of claims 1-7, wherein the display device is a head-mounted device, and the method further comprises: obtaining a moving direction of the head-mounted device; if an included angle between the moving direction and a user face orientation is greater than a first preset angle, obtaining a first distance threshold; if a distance between the head-mounted device and a center position of the target boundary is greater than the first distance threshold, displaying a picture of the real environment within a preset range in the moving direction; if the included angle between the moving direction and the user face orientation is less than a second preset angle, obtaining a second distance threshold; and if a distance between the head-mounted device and the center position of the target boundary is greater than the second distance threshold, displaying a picture of the real environment within a preset range in the moving direction. ​ if the distance between the head-mounted device and the center position of the target boundary is greater than a second distance threshold, increase the transparency of the virtual environment within the preset range of the movement direction to a first transparency; the first preset angle is greater than the second preset angle, and the first preset angle is less than 180 degrees; the first distance threshold is less than the second distance threshold.

12. The method of any one of claims 1-7, wherein the method further comprises: if the display device is located within the target boundary and the distance between the display device and the target boundary is less than a preset threshold, displaying the target boundary; and / or, if the display device is located outside the target boundary and the distance between the display device and the target boundary is greater than a preset threshold, hiding the target boundary.

13. The method of any one of claims 1-7, wherein the method further comprises: in response to a reset operation on the center of the field of view of the display device, resetting the target boundary, and if the current degree of immersion is greater than a preset threshold, displaying the target boundary after the reset.

14. The method of any one of claims 1-7, wherein the display device is a head-mounted device.

15. A prompting display device, comprising: a display module configured to display a target boundary in a screen in response to a change in a degree of immersion satisfying a preset condition; the degree of immersion is related to a proportion of a virtual picture in a currently displayed picture, and the target boundary is used to represent a predefined spatial range. a processor and a memory; 16. An electronic device comprising: the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory, so that the processor performs the prompting display method according to any one of claims 1 to 14.

17. A computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when a processor executes the computer-executable instructions, the prompting display method according to any one of claims 1 to 14 is implemented.

18. A computer program product, comprising a computer program, wherein the computer program is executed by a processor to implement the prompting display method according to any one of claims 1 to 14. ​

Images