Man-machine interaction method, display method, device, and equipment

Abstract

[0010] The present disclosure relates to a man-machine interaction method, a display method, an apparatus, and a device, the man-machine interaction method including: upon receiving a command to open a first application, displaying a first application interface, the first application interface including a main interface display area and an associated display area, the associated display area being used to display a plurality of candidate function entries, and the main interface display area being used to display a display page of a currently invoked function (301); and, in response to a command to open a target function entry in the associated display area, reducing the display page of the currently invoked function and displaying the function entry of the currently invoked function in the associated display area (302); and displaying the display page of the target function in the main interface display area (303). [0010] The present disclosure provides a method for quickly switching between function pages of different functions by triggering the function entries, thereby realizing the effect of switching between different functions in the form of "tiles," and improving the smoothness and efficiency of switching between different functions.

Description

[Technical Field]

[0001] This application claims priority from Chinese Patent Application No. 202211138171.1 filed on September 19, 2022, and Chinese Patent Application No. 202211160521.4 filed on September 22, 2022, the entire contents of which are incorporated by introduction as part of this application.

[0002] The present disclosure relates to the technical field of virtual reality, and in particular to a man-machine interaction method, a display method, a device, and an apparatus. [Background technology]

[0003] Virtual reality (VR) technology, also known as virtual environment, virtual reality, or artificial environment, refers to technology that uses computers to generate a virtual world that directly gives participants visual, auditory, and tactile sensations and allows them to interactively observe and manipulate. Improving the operating experience of VR has become mainstream.

[0004] In related technology, application operations can be realized in a virtual reality space based on virtual reality technology, where an application interface is displayed in the virtual reality space in the form of a spatial virtual screen, and the user operates the application on the application interface using a virtual control device (e.g., a joystick, etc.). When multiple functional services are provided within the application, the user can close the current functional page using the virtual control device and then start other required functional services.

[0005] However, when switching between the multiple function services, the current function page needs to be manually closed and the next function service that needs to be started needs to be manually opened, which reduces the efficiency of switching between the function services. Summary of the Invention [Means for solving the problem]

[0006] In order to solve or at least partially solve the above technical problems, the present disclosure provides a man-machine interaction method, apparatus, and device, in which in the embodiments of the present disclosure, switching between different functions is performed in the form of "tiles," thereby improving the smoothness and efficiency of function switching.

[0007] An embodiment of the present disclosure provides a man-machine interaction method, the method including: a step of displaying a first application interface when receiving a command to open a first application, the first application interface including a main interface display area and an associated display area, the associated display area being used to display a plurality of candidate function entries, and the main interface display area being used to display a display page of a currently invoked function; a step of reducing the display page of the currently invoked function and displaying the function entry of the currently invoked function in the associated display area in response to a command to open a target function entry in the associated display area; and a step of displaying the display page of the target function in the main interface display area.

[0008] An embodiment of the present disclosure further provides a method for displaying prompt information, the method including: determining a target display area based on a user's field of view range in a display interface; and displaying a prompt information interface in the target display area, the prompt information interface including at least one functional control related to the display content of the display interface.

[0009] An embodiment of the present disclosure further provides a man-machine interaction device, the device comprising: The system includes: a first display module for displaying a first application interface when receiving a command to open a first application, the first application interface including a main interface display area and an associated display area, the associated display area being used to display a plurality of candidate function entries and the main interface display area being used to display a display page of a current invoked function; a second display module for reducing the display page of the current invoked function and displaying a function entry of the current invoked function in the associated display area in response to a command to open a target function entry in the associated display area; and a third display module for displaying the display page of the target function in the main interface display area.

[0010] An embodiment of the present disclosure further provides an electronic device, the electronic device including a processor and a memory for storing the processor-executable instructions, the processor being used to read the executable instructions from the memory and execute the instructions to realize the man-machine interaction method according to the embodiment of the present disclosure.

[0011] An embodiment of the present disclosure further provides a computer-readable storage medium, the storage medium storing a computer program, the computer program being used to perform the man-machine interaction method according to the embodiment of the present disclosure.

[0012] The technical solutions according to the embodiments of the present disclosure have the following advantages over the prior art:

[0013] A man-machine interaction method according to an embodiment of the present disclosure includes, upon receiving a command to open a first application, displaying a first application interface, the first application interface including a main interface display area and an associated display area, the associated display area being used to display a plurality of candidate function entries and the main interface display area being used to display a display page of a currently invoked function, and, in response to a command to open a target function entry in the associated display area, reducing the display page of the currently invoked function, and displaying the function entry of the currently invoked function in the associated display area, and displaying the display page of the target function in the main interface display area. In the embodiment of the present disclosure, quick switching between function pages of different functions can be realized by triggering the function entries, achieving the effect of switching between different functions in the form of "tiles," thereby improving the smoothness and efficiency of switching between different functions.

[0014] These and other features, advantages, and aspects of each embodiment of the present disclosure will become more apparent by reference to the following specific embodiments in conjunction with the drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are illustrative and that objects and elements are not necessarily drawn to scale. [Brief explanation of the drawings]

[0015] [Figure 1] FIG. 1 is a schematic diagram of an application scene of a virtual reality device according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a schematic diagram of a display scene of a first application according to an embodiment of the present disclosure. [Figure 3] FIG. 3 is a flowchart of a man-machine interaction method according to an embodiment of the present disclosure. [Figure 4] FIG. 4 is a schematic diagram of a display scene of a first application interface according to an embodiment of the present disclosure. [Figure 5]FIG. 5 is a schematic diagram of a man-machine interaction scene according to an embodiment of the present disclosure. [Figure 6] FIG. 6 is a schematic diagram of another man-machine interaction scene according to an embodiment of the present disclosure. [Figure 7] FIG. 7 is a schematic diagram of the layout of a related display area according to an embodiment of the present disclosure. [Figure 8] FIG. 8 is a schematic diagram of another man-machine interaction scene according to an embodiment of the present disclosure. [Figure 9] FIG. 9 is a flowchart of a method for displaying prompt information according to an embodiment of the present disclosure. [Figure 10A] FIG. 10A is a schematic diagram of the position of the target display area according to an embodiment of the present disclosure. [Figure 10B] FIG. 10B is a schematic diagram of the position of the target display area according to an embodiment of the present disclosure. [Figure 10C] FIG. 10C is a schematic diagram of the position of the target display area according to an embodiment of the present disclosure. [Figure 10D] FIG. 10D is a schematic diagram of the position of the target display area according to an embodiment of the present disclosure. [Figure 11A] FIG. 11A is a schematic diagram of function controls included in a prompt information interface according to an embodiment of the present disclosure. [Figure 11B] FIG. 11B is a schematic diagram of function controls included in a prompt information interface according to an embodiment of the present disclosure. [Figure 11C] FIG. 11C is a schematic diagram of function controls included in a prompt information interface according to an embodiment of the present disclosure. [Figure 12] FIG. 12 is a flowchart of another method for displaying prompt information according to an embodiment of the present disclosure. [Figure 13A] FIG. 13A is a schematic diagram of man-machine interaction using function controls in a prompt information interface according to an embodiment of the present disclosure. [Figure 13B]FIG. 13B is a schematic diagram of man-machine interaction using function controls in a prompt information interface according to an embodiment of the present disclosure. [Figure 13C] FIG. 13C is a schematic diagram of man-machine interaction using function controls in a prompt information interface according to an embodiment of the present disclosure. [Figure 13D] FIG. 13D is a schematic diagram of man-machine interaction using function controls in a prompt information interface according to an embodiment of the present disclosure. [Figure 13E] FIG. 13E is a schematic diagram of man-machine interaction using function controls in a prompt information interface according to an embodiment of the present disclosure. [Figure 13F] FIG. 13F is a schematic diagram of man-machine interaction using function controls in a prompt information interface according to an embodiment of the present disclosure. [Figure 14] FIG. 14 is a flowchart of yet another method for displaying prompt information according to an embodiment of the present disclosure. [Figure 15A] FIG. 15A is a schematic diagram of the position of a display control according to an embodiment of the present disclosure. [Figure 15B] FIG. 15B is a schematic diagram of the position of a display control according to an embodiment of the present disclosure. [Figure 15C] FIG. 15C is a schematic diagram of the position of a display control according to an embodiment of the present disclosure. [Figure 15D] FIG. 15D is a schematic diagram of the position of a display control according to an embodiment of the present disclosure. [Figure 15E] FIG. 15E is a schematic diagram of a reduced prompt information interface according to an embodiment of the present disclosure. [Figure 16] FIG. 16 is a flowchart of a method for displaying additional prompt information according to an embodiment of the present disclosure. [Figure 17] FIG. 17 is a schematic diagram of searching for and executing a target function using voice information according to an embodiment of the present disclosure. [Figure 18]FIG. 18 is a flowchart of a method for displaying additional prompt information according to an embodiment of the present disclosure. [Figure 19A] FIG. 19A is a schematic diagram of an information prompt interface configuration according to an embodiment of the present disclosure. [Figure 19B] FIG. 19B is a schematic diagram of an information prompt interface configuration according to an embodiment of the present disclosure. [Figure 20] FIG. 20 is a schematic block diagram of a man-machine interaction device according to an embodiment of the present disclosure. [Figure 21] FIG. 21 is a schematic block diagram of a prompt information display device according to an embodiment of the present disclosure. [Figure 22] FIG. 22 is a schematic block diagram of an electronic device according to an embodiment of the present disclosure. [Figure 23] FIG. 23 is a schematic block diagram of another electronic device according to an embodiment of the present disclosure. [Figure 24] FIG. 24 is a schematic block diagram of an electronic device that is an HMD according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0016] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the drawings. Although the drawings show several embodiments of the present disclosure, it should be understood that the present disclosure can be realized in various forms and should not be construed as being limited to the embodiments described herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are merely illustrative and are not intended to limit the scope of protection of the present disclosure.

[0017] It should be understood that the steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. Also, method embodiments may include additional steps and / or omit performing illustrated steps. The scope of the present disclosure is not limited in this respect.

[0018] As used herein, the term "comprises" and variations thereof are open inclusive, meaning "including, but not limited to." The term "based on" means "based at least in part on." The term "in one embodiment" refers to "at least one embodiment," the term "another embodiment" refers to "at least one other embodiment," and the term "some embodiments" refers to "at least some embodiments." Relevant definitions of other terms are provided in the description below.

[0019] It should be noted that concepts such as "first" and "second" referred to in this disclosure are merely intended to distinguish between different devices, modules or units, and are not intended to limit the order or interdependence of functions performed by these devices, modules or units.

[0020] As noted, the modifications "one" and "multiple" referred to in this disclosure are exemplary rather than limiting, and one of ordinary skill in the art should understand that they should be understood as "one or more" unless the context clearly dictates otherwise.

[0021] The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0022] Below, relevant explanations will be given for some technical concepts or noun concepts mentioned in this specification.

[0023] A virtual reality device is a terminal that realizes a virtual reality effect, and is usually provided in the form of glasses, a head mounted display (HMD), and contact lenses, and is used to realize visual perception and other forms of perception. Of course, the implementation form of a virtual reality device is not limited to these, and it can be made even smaller or larger as needed.

[0024] The virtual reality devices described in the embodiments of the present disclosure may include, but are not limited to, the following types:

[0025] For computer-based virtual reality (PCVR) devices, the PC side is used to perform calculations and output data related to virtual reality functions, and the externally connected computer-based virtual reality device uses the data output from the PC side to realize the virtual reality effect.

[0026] The mobile virtual reality device supports the installation of a mobile terminal (e.g., a smartphone) in various ways (e.g., a head-mounted display with a dedicated card slot), and through a wired or wireless connection with the mobile terminal, the mobile terminal performs calculations related to the virtual reality function and outputs the data to the mobile virtual reality device, for example, to watch virtual reality videos through the mobile terminal's APP.

[0027] All-in-one virtual reality devices are equipped with a processor for performing calculations related to virtual functions, so they have independent virtual reality input / output functions and do not need to be connected to a PC or mobile device, allowing for high flexibility in use.

[0028] A virtual reality object is an object that interacts in a virtual scene, is controlled by a user or a robot program (e.g., a robot program based on artificial intelligence), and can remain still, move, and perform various actions in the virtual scene, such as a virtual person corresponding to a user in a live streaming scene.

[0029] As shown in Figure 1, an HMD is lightweight, ergonomically comfortable, and provides high-resolution content with low latency. Virtual reality devices are equipped with a posture detection sensor (e.g., a 9-axis sensor) for detecting posture changes in real time. When a user wears the virtual reality device, the processor calculates the user's gaze point in the virtual environment as the user's head posture changes. Based on the gaze point, the processor calculates an image within the user's gaze range (i.e., virtual field of view) in a three-dimensional model of the virtual environment and displays it on a display screen, giving users a sense of immersion as if they were viewing something in a real environment.

[0030] In this embodiment, when a user wears an HMD device and opens a predetermined application program, such as a live video streaming application program, the HMD device executes a corresponding virtual scene. The virtual scene may be a simulated environment for the real world, a semi-simulated, semi-fictional virtual scene, or even a purely fictional virtual scene. The virtual scene may be any one of a 2D virtual scene, a 2.5D virtual scene, and a 3D virtual scene. The embodiments of the present disclosure do not limit the dimensions of the virtual scene. For example, the virtual scene may include people, sky, land, and ocean, and the land may include environmental elements such as deserts and cities. The user can control the movement of virtual objects in the virtual scene and can also interact with controls, models, display content, and people in the virtual scene using a joystick device, bare hand gestures, and the like.

[0031] In the man-machine interaction method proposed in the present disclosure, when a user wears an HMD device in a virtual reality space, an application interface of the virtual application is displayed in the virtual reality space in response to the user's opening operation for the corresponding virtual application. As shown in FIG. 2, the application interface of the virtual application makes full use of the depth information in the virtual reality space, and the corresponding application interface is displayed in the form of an "aerial virtual screen."

[0032] In order to solve the problem of low switching efficiency of function services related to virtual applications mentioned in the above technology, the present disclosure proposes a method for quickly switching function services, realizing the concept of multitasking windows, allowing for quick switching between function pages corresponding to different function services, and realizing a "smooth" switching effect of switching in the form of "tiles", thereby improving the smoothness and switching efficiency of function switching.

[0033] The man-machine interaction method will be described below with reference to specific examples.

[0034] 3 is a flowchart of a man-machine interaction method according to an embodiment of the present disclosure, which may be performed by a man-machine interaction device, which may be realized in software and / or hardware, or may generally be integrated into electronic equipment. As shown in FIG. 3, the method includes the following steps 301 to 303.

[0035] Step 301: displaying a first application interface when receiving a command to open a first application; The first application interface includes a main interface display area and an associated display area, the associated display area being used to display a plurality of candidate function entries, and the main interface display area being used to display a display page of a currently invoked function.

[0036] The first application may be understood as a virtual application or the like that can be viewed based on the HMD device when the user wears the HMD device, and functional services corresponding to the first application may be realized by an associated server, and rendering related to the displayed interface content may be realized based on the Unity engine.

[0037] In one embodiment of the present disclosure, when a command to open a first application is received, a first application interface of the first application is displayed, for example, a first display layer is rendered in a virtual reality space, and the first application interface of the first application is displayed on the first display layer, the first application interface includes a main interface display area and an associated display area, the associated display area is used to display a plurality of candidate function entries, the candidate function entries may be function entries of commonly used functions, for example, in some possible embodiments, the function entries of commonly used functions may include "video application entry", "virtual room entry", "my avatar management entry", etc., and the commonly used functions corresponding to the candidate function entries may be pre-calibrated by the system or pre-customized by the user according to personal needs.

[0038] The main interface display area is typically used to display the display page of the currently invoked function entry, which may be the current function page of the corresponding function, and the related display area is typically used to display multiple candidate function entries, which are typically located outside the right edge of the main interface display area. The display style of the candidate function entries may include text and icons, etc.

[0039] In some possible embodiments, when the candidate function entries include A, B, and C, the related display area includes the right area of ​​the main interface display area, and the first application interface is laid out in a "1+3" card combination manner, with the three function entries displayed in the related display area in the form of cards, as shown in Figure 4. In actual execution, when a virtual application is opened, the main interface display area first displays the application homepage of the first application by default.

[0040] Step 302: In response to a command to open a target function entry in the related display area, reduce the display page of the current called function, and display the function entry of the current called function in the related display area.

[0041] In an embodiment of the present disclosure, when a first application interface of a first application is displayed in a virtual reality space, in response to obtaining a call operation for a target function entry among a plurality of candidate function entries, in some possible examples, the call operation may be performed by a virtual operation control device (e.g., a joystick), i.e., by displaying an operation control position indication model corresponding to the virtual operation control device in the virtual reality space, and the operation control position indication model is used to indicate a current operation control position of the virtual operation control device, and the current operation control position can be moved by moving the virtual operation control device, etc., and when the current operation control position corresponding to the virtual operation control device is in the target function entry, if a user's input judgment operation is detected, it is determined that a call operation for the target function entry has been obtained, and the input judgment operation may be realized by triggering a preset confirmation control of the virtual operation control device, or by inputting a preset voice command, or by performing a preset gesture action, etc., and is not limited thereto.

[0042] In some possible embodiments, a gesture action can be invoked in response to a user executing a preset interaction component, and multiple interaction components can be displayed in the virtual reality space, each interaction component corresponding to a respective candidate function entry. When a preset trigger operation is executed for a corresponding interaction component, it is determined that a call operation for a target function entry corresponding to the corresponding interaction component has been obtained. Executing the preset trigger operation for the corresponding interaction component can be performed by a virtual operation control device. When a current operation control position corresponding to the virtual operation control device is located on the corresponding interaction component, if a user's trigger determination operation is detected, it is determined that a trigger operation for the corresponding interaction component has been obtained. The trigger determination operation can be realized by triggering a preset confirmation control of the virtual operation control device, or by inputting a preset voice command or executing a preset gesture action, etc.

[0043] Furthermore, when responding to a call operation on a target function entry among the plurality of candidate function entries, the display page of the currently called function is reduced, and the function entry of the currently called function is displayed in the related display area.

[0044] In one embodiment of the present disclosure, preset reduction prompt information is displayed from the display page of the current function to the function entry of the current function, and when the display of the reduction prompt information is finished, the display page of the current function is reduced to display the function entry of the current function in the related display area. The reduction prompt information is used to instruct the reduction of the current function page to the corresponding function entry, and the display style of the reduction prompt information is different in different application scenarios, and may include one or more combinations of text, animation, pattern, etc. After the display of the reduction prompt information is finished, the function entry corresponding to the current function page is displayed, visually instructing the user to reduce the current function page to the corresponding function entry.

[0045] For example, as shown in FIG. 5, when the currently displayed page is page A1, if the function entry corresponding to A1 is a1, the related display area is located to the right of the main interface display area, and displays the reduction prompt information of the currently displayed page A1 to a1, and the reduction prompt information may be such that the position of a1 is the end point, the position of A1 is the start point, and A1 is displayed as a1 when A1 is gradually reduced until it reaches the position of a1.

[0046] In this embodiment, the reduced prompt information is used as a transition to indicate the smoothness of switching from the current display page to the corresponding function entry, improving the user's visual experience.

[0047] Step 303: Display the display page of the target function in the main interface display area.

[0048] In one embodiment of the present disclosure, by displaying a display page of a target function in the main interface display area, based on a trigger operation on a target function entry, the function page of the corresponding function can be displayed in the main interface display area, thereby realizing quick expansion from an entry to a page.

[0049] In order to achieve the effect of executing multi-window tasks in parallel, in some possible embodiments, the historical function page of the target function entry when it was last reduced is determined, and the historical function page is determined to be the display page of the target function, that is, the last displayed page of the function service corresponding to the target function entry is obtained as the display page of the target function. For example, if the function service corresponding to the target function entry is a movie search function service, when the user last invoked it, input "search for action movies" on the movie search page and displayed the corresponding action movie page, the search result page will be maintained, and the corresponding action movie page will be directly displayed the next time the target function entry is invoked.

[0050] In one embodiment of the present disclosure, enlargement prompt information is displayed from a target function entry to a display page of the target function, and when the display of the enlargement prompt information is finished, the target function entry is enlarged as a display page of the target function displayed in the main interface display area, and the enlargement prompt information may include one or more combinations of text, animation, pattern, etc., and when the display of the enlargement prompt information is finished, the display page of the target function is displayed, visually instructing the user to enlarge the target function entry as the corresponding display page.

[0051] For example, as shown in FIG. 6, when the display page corresponding to the target function entry a2 is page A2, the related display area is located to the right of the main interface display area, and displays the enlargement prompt information of the target function entry a2~A2, and the enlargement prompt information may be such that a2 is displayed as A2 when a2 is gradually enlarged from the position of a2 as the start point to the position of A2 as the end point until it reaches the position of the main interface display area.

[0052] In this embodiment, the magnification prompt information is used as a transition to indicate the smoothness of switching from the target function entry to the display page, improving the user's visual experience.

[0053] It should be emphasized that the process of reducing the current display page and the process of expanding the target function entry mentioned in steps 302 to 303 above may be performed simultaneously or successively, i.e., the processes of Figures 5 and 6 may be performed separately and successively or simultaneously.

[0054] As a result, in the first application interface provided by the embodiment of the present disclosure, the display pages of function services corresponding to related function entries can be combined and switched in the form of "tiles", and when function tasks corresponding to multiple function services are not displayed, they can be paused based on the corresponding threads without being terminated, thereby providing the user with a multi-tasking window parallel user experience, making full use of the advantages of VR space, realizing fast switching of multiple function services, and improving the efficiency of switching function services.

[0055]

[0013] In summary, a man-machine interaction method provided by an embodiment of the present disclosure displays a first application interface upon receiving a command to open a first application, the first application interface including a main interface display area and an associated display area, the associated display area being used to display a plurality of candidate function entries, the main interface display area being used to display a display page of a currently called function, and in response to a command to open a target function entry in the associated display area, reducing the display page of the currently called function, and displaying the function entry of the currently called function in the associated display area, and displaying the display page of the target function in the main interface display area. In the embodiment of the present disclosure, quick switching between function pages of different functions can be realized by triggering the function entries, and the effect of switching between different functions in the form of "tiles" is realized, thereby improving the smoothness and efficiency of switching between different functions.

[0056] It is necessary to explain that in the actual implementation process, the manner of shrinking the display page of the currently called function and displaying the function entries of the currently called function in the relevant display area may be different, as shown in the following example:

[0057] In some possible embodiments, when the first application is opened, the application home page content of the first application is displayed in the main interface display area by default, and the application home page may be frequently invoked and displayed as the "home page" of the first application; therefore, to facilitate invoking the application home page, if the current display page is the application home page of the first application, upon completion of displaying the diminishing prompt information, the current display page is diminished to display the function entries of the application home page in the first related display sub-area.

[0058] If the current display page is not the application homepage of the first application, when the display of the reduced prompt information is finished, the current display page is reduced to display the function entry corresponding to the second related display sub-area, and the first related display sub-area and the second related display sub-area are located at different orientations of the main interface display area, that is, by distinguishing the display position of the function entry of the application homepage corresponding to the application homepage from that of other function entries, it is easy for the user to quickly distinguish the display position of the function entry corresponding to the application homepage and realize quick access to the application homepage.

[0059] As should be explained, the first related display sub-region and the second related display sub-region are located at different orientations of the main interface display region, and the different orientations may correspond to any two orientations of the top, bottom, left, right, etc. of the main interface display region, for example, as shown in FIG. 7, the first related display sub-region is located at the upper left corner of the main interface display region, and the second related display sub-region is located at the right side of the main interface display region, etc.

[0060] Of course, in other possible implementations, the display parameters may distinguish between the function entries corresponding to the application homepage and the function entries corresponding to other function services, visually distinguishing between the function entries corresponding to the application homepage and the function entries corresponding to other function services, for example by distinguishing between the color of the display background area of ​​the function entries corresponding to the application homepage and the color of the display background area of ​​the function entries corresponding to other function services.

[0061] In addition, in some possible embodiments, when the display of the shrinking prompt information is completed, when the current display page is shrinked to display the function entry corresponding to the second related display sub-area, an initial display position in the second related display sub-area of ​​the function entry corresponding to the current display page can be determined, and the initial display position can be understood as the display position of the function entry corresponding to the current display page when the first application is opened, and when the playback of the shrinking animation is completed, the current display page is shrinked to display the function entry corresponding to the initial display position, i.e., when each display page displayed in the second related display sub-area is shrinked, the corresponding function entry is shrinked to the initial display position at which it was first displayed, in order to facilitate the user to quickly locate the required function entry.

[0062] In some possible embodiments, the display direction of the function entries in the second related display sub-area can also be set. For example, when multiple function entries are displayed in the second display sub-area in order from top to bottom, the display position of the next function entry in the second related display sub-area is determined according to the display direction, and the function entry corresponding to the current display page is displayed in the next display position.

[0063] From the above, the man-machine interaction method of the embodiment of the present disclosure reduces the corresponding display page to the corresponding related display area according to the needs of the scene, displays the corresponding function entries in the related display area, realizes smooth switching between multiple function services, and provides the user with the experience of performing multi-window tasks.

[0064] Based on the above embodiment, the preset levels of function entries provided in the first application interface may, in addition to including the first preset level, further include a second preset level of function entries lower than the first preset level, and the function entries of the first preset level can realize the smooth switching mentioned in the above embodiment, that is, in the embodiment of the present disclosure, different function entries are pre-divided into different levels based on the service type of the function service, and the function entries of the same entry level as the application homepage corresponding to the first application are at the first preset level, and the function entries of the same level as the application homepage can be combined in the form of tiles and quickly switched between them.

[0065] In order to realize the switching experience of function services corresponding to different levels of function entry and improve the flexibility of function services, for function services corresponding to the second preset level, function services can be provided based on the original function service logic of the function services.

[0066] In one embodiment of the present disclosure, when the entry level of the target function entry is the second preset level, a second application corresponding to the target function entry is determined. For example, as shown in FIG. 8, when the target function entry is the video a3 entry at the second preset level, it is determined that the second application corresponding to the target function entry is video application C. The second application is opened, and the first application interface is visually replaced with and displayed as a second application interface corresponding to the function application. A second display layer is rendered on the first application interface in the virtual reality space, and the second application interface of the second application is displayed on the second display layer. That is, still referring to FIG. 8, the first application interface is replaced with and displayed as a video interface of C, and the video interface is the second application interface corresponding to C. This provides the user with a visual experience of accessing function services at different levels, and visually makes the user feel that the format of the function services at the second preset level is different from that of the first preset level.

[0067] In an embodiment of the present disclosure, in order to further improve the smoothness of switching from the second application interface to the first application interface, a switching animation from the first application interface to the second application interface can be displayed, and when the switching animation finishes playing, the first application interface can be switched to the second application interface, which is the current real-time service interface of the corresponding functional application, for example, the second application interface is the real-time video interface currently pushed by the short video application, etc.

[0068] In one embodiment of the present disclosure, a logout path from the second application interface to the first application interface is further provided, i.e., in response to a logout operation on the function application interface, the function application is closed and the second application interface is replaced to display the first application interface corresponding to the first application. In different application scenarios, the logout operation method for the function application is different. For example, still referring to FIG. 8, a logout control can be displayed at the bottom of the second application interface, and the logout operation can be a trigger operation on the logout control, etc. In other optional embodiments, the logout operation can be performed in the form of gesture, voice, etc., which will not be listed one by one here.

[0069] From the above, the man-machine interaction method of the embodiment of the present disclosure can also provide an application function entry of a second application, and when the second application function entry is triggered, render a second display layer and display the second application interface on the second display layer, thereby providing a richer switching display experience from the function entry to the display page.

[0070] The embodiments of the present disclosure are applied to man-machine interaction scenarios, taking into consideration that the operating systems and installed application programs of electronic devices such as extended reality (XR) devices are continuously upgraded and updated. However, due to being unfamiliar with the updated operating systems or application programs, it is difficult for users to discover some functions or operations by themselves, and it costs a lot of money for users to learn how to use the updated operating systems or application programs. Therefore, how to enable users to quickly understand the updated operating systems or application programs is currently an urgent problem to be solved. To address this problem, at least one embodiment of the present disclosure further provides a display method that displays multiple function controls related to display content, allowing the user to interact with the electronic device based on the displayed function controls, thereby improving man-machine interaction efficiency.

[0071] Hereinafter, a method for displaying prompt information provided by an embodiment of the present disclosure will be described in detail with reference to the accompanying drawings.

[0072] 9 is a flowchart of a method for displaying prompt information according to an embodiment of the present disclosure. The embodiment of the present disclosure can be applied to a man-machine interaction scenario, and the method for displaying prompt information can be performed by a device for displaying prompt information. The device for displaying prompt information can be configured by hardware and / or software and can be integrated into an electronic device.

[0073] In an embodiment of the present disclosure, the electronic device may be any hardware device having a man-machine interaction function. In an embodiment of the present disclosure, the electronic device may be, but is not limited to, an XR device, a tablet computer, a desktop computer, or the like. The XR device may be a VR device, an AR device, an MR device, or the like, and the present disclosure does not specifically limit the same. In an embodiment of the present disclosure, the electronic device is preferably an XR device.

[0074] As shown in FIG. 9, the method may include the following steps S901 to S902.

[0075] S901, determining a target display area based on a user's viewing range in a display interface.

[0076] In some embodiments of the present disclosure, the display interface may refer to an interface corresponding to an application program currently running on the electronic device, such as the first application interface or the second application interface. In some other embodiments of the present disclosure, the display interface may refer to a display area (e.g., a main display area) in an application program interface currently running on the electronic device, such as a main interface display area in the first application interface. In some other embodiments of the present disclosure, the display interface may refer to an interface corresponding to an operating system currently running on the electronic device. The display interface may be a virtual scene interface, another scene interface, or the like, and is not specifically limited herein.

[0077] As should be explained, if the interface corresponding to the currently running application program or the display area in the application program interface is a full-screen display, or if the interface corresponding to the currently running operating system is a full-screen display, the display interface can overlap the display screen of the electronic device.

[0078] Considering that the visual field of the human eye is wide, most of the vision that can cause optic nerve excitation is concentrated in the central region of the visual field. In particular, after wearing a device that can provide virtual scenes, when comparing the user's visual field range with that when not wearing a device that provides virtual scenes, the vision is more concentrated in the central region of the visual field, and this central region is about 55 degrees to the left, about 55 degrees to the right, about 60 degrees up, and about 40 degrees down, centered on the astigmatism axis of the human eye. Of course, this central region can be adaptively adjusted based on the type of device, etc., and is not specifically limited here.

[0079] Therefore, the present disclosure utilizes the principle that the human eye is not sensitive to the edge of the field of view when determining a target display area, and can determine a field of view range of a user's display interface. Then, an edge area of ​​the field of view range is determined as the target display area. This can ensure that the user can normally view the displayed content, while actively displaying some functional operations related to the displayed content to the user, thereby providing conditions for improving the user's operation efficiency.

[0080] In other words, the present disclosure uses the edge region of a user's field of view as a target display region, and then displays function controls related to the displayed content in the target display region, thereby actively displaying several related function controls to the user while reducing interference with the user's viewing of the displayed content.

[0081] The embodiments of the present disclosure may be implemented in different ways when determining the viewing range of the user's display interface, for example, in the following manner.

[0082] Method 1: According to a preset calculation method, the user's visual field is calculated at a first angle to the left, a second angle to the right, a third angle up, and a fourth angle down, with the user's axial direction (i.e., the astigmatism axis of the human eye) as the center point. The first, second, third, and fourth angles can be adaptively set based on the type of electronic device, etc., and are not specifically limited herein.

[0083] For example, taking a VR device as an example, the first angle may be set to 55 degrees, the second angle may be set to 55 degrees, the third angle may be set to 60 degrees, and the fourth angle may be set to 40 degrees, etc.

[0084] Method 2: A preset viewing range is used as the viewing range in the user's display interface.

[0085] The preset field of view range is a fixed range set by an electronic device (e.g., an XR device) based on the characteristics of the human eye. For example, the preset field of view range may be approximately 55 degrees to the left, approximately 55 degrees to the right, approximately 60 degrees up, and approximately 40 degrees down.

[0086] That is, the embodiment of the present disclosure can determine the preset field of view of the electronic device as the field of view of the user's display interface.

[0087] After determining the viewing range of the user's display interface, the embodiment of the present disclosure can determine an edge region from the viewing range and determine the edge region as a target display region. For example, in the viewing range, the axial direction is the center point, and an area consisting of approximately 30 degrees to the left, approximately 30 degrees to the right, approximately 20 degrees up, and approximately 12 degrees down is used as the central area, and the remaining area is used as the target display region.

[0088] To take into account that the edge region of the field of view range may be located around the central region, embodiments of the present disclosure may include the following cases 1 to 4 when determining the edge region of the field of view range as the target display region.

[0089] Case 1 The upper edge region of the field of view is used as the target display region.

[0090] For example, as shown in FIG. 10A, the target display area is located in the upper edge region of the viewing range.

[0091] Case 2 The left edge area of ​​the field of view is used as the target display area.

[0092] For example, as shown in FIG. 10B, the target display area is located in the left edge area of ​​the viewing range.

[0093] Case 3 The right edge area of ​​the field of view is used as the target display area.

[0094] For example, as shown in FIG. 10C, the target display area is located in the right edge area of ​​the viewing range.

[0095] Case 4 The lower edge region of the field of view is used as the target display region.

[0096] For example, as shown in FIG. 10D, the target display area is located in the lower edge region of the viewing range.

[0097] As should be explained, the above four cases are merely for illustrative purposes of describing embodiments of the present disclosure, and are not intended to specifically limit the present disclosure.

[0098] S902, displaying a prompt information interface in a target display area, the prompt information interface including at least one function control related to the display content of the display interface;

[0099] In the embodiments of the present disclosure, the function control in the prompt information interface may be determined based on the relevance of the displayed content, or based on the user's operation preferences, and is not specifically limited thereto. The user's operation preferences may be determined by collecting and analyzing the user's operation data, or by investigating the operation preferences, etc.

[0100] Illustratively, after determining the target display area, the embodiment of the present disclosure can display one or more function controls related to the display content in the target display area in the form of display elements in a prompt information interface, so that the user can easily perform a desired function operation by triggering any function control in the prompt information interface to perform man-machine interaction with the electronic device, thereby improving the user's usage satisfaction.

[0101] To more clearly describe the embodiments of the present disclosure, the following provides an illustrative description of the displayed function controls using different display contents as examples.

[0102] For example, when the display content is video content such as a TV drama, a movie, or a variety show, the prompt information interface displayed in the target display area includes at least one function control such as a download control, a projection control, a recording control, and a screenshot control, as shown in FIG. 11A.

[0103] When the display content is picture content such as a photo, the prompt information interface displayed in the target display area includes at least one function control, such as an edit control, a save control, a photo edit control, and a share control, as shown in FIG. 11B.

[0104] When the display content is document content such as a table or text, the prompt information interface displayed in the target display area includes at least one function control such as a cut control, a copy control, and an insert control, as shown in FIG. 11C.

[0105] Of course, in addition to the above exemplary descriptions, the present disclosure may also display at least one functional control related to other types of display content in the prompt information interface based on the display content, and the present disclosure is not specifically limited thereto.

[0106] As can be understood, the embodiments of the present disclosure determine a target display area in a display interface, and display a prompt information interface in the target display area, including at least one function control related to the display content, so that a user can easily and efficiently perform human-machine interaction with an electronic device based on the displayed function control, thereby reducing the user's learning cost, shortening the step length of human-machine interaction, and improving the user's operation efficiency.

[0107] The prompt information display method provided by the embodiments of the present disclosure determines a target display area based on a user's field of view of the display interface, and displays a prompt information interface in the target display area, where the prompt information interface includes at least one function control related to the display content of the display interface. By displaying the prompt information within the field of view, the embodiments of the present disclosure allow the user to quickly grasp the updated operating system or application program based on the prompt information, thereby effectively improving the efficiency of man-machine interaction and improving the user's user experience.

[0108] As can be seen from the above description, the embodiments of the present disclosure display at least one function control related to the display content on the display interface, thereby allowing the user to perform man-machine interaction with the electronic device based on the displayed function control, thereby improving the efficiency of man-machine interaction.

[0109] As one possible implementation form, after displaying at least one function control related to the display content in the target display area, considering that the user may need to use any function control to achieve the desired operation purpose, the prompt information display method provided by the embodiment of the present disclosure will be further interpreted and described below with reference to Figure 12.

[0110] As shown in FIG. 12, the method may include the following steps S1201 to S1203.

[0111] S1201, determining a target display area based on a user's field of view in a display interface.

[0112] S1202, displaying a prompt information interface including at least one function control related to the display content of the display interface in the target display area.

[0113] S1203, in response to a trigger operation on a function control in the prompt information interface, control the function control to perform a corresponding function operation.

[0114] Considering that when a user views screen content displayed on an electronic device, the user may need to perform operations on the displayed content, such as saving, sharing, or taking a screenshot. In addition, one or more function controls related to the displayed content are displayed in the target display area of ​​the display interface. Depending on the operation needs, the user can use a peripheral device or gesture operation to trigger (e.g., click or select) a function control located in the prompt information interface and perform a corresponding operation on the displayed content using the triggered function control. Alternatively, when the electronic device has an eye-tracking function, the function control located in the prompt information interface can be triggered based on the eye-tracking function, and other examples are not specifically limited herein.

[0115] The peripheral device may be any device worn on the user's hand, such as a joystick, a glove, a bracelet, a ring, a wristband or a handheld controller, and is not specifically limited herein.

[0116] That is, the embodiment of the present disclosure can realize man-machine interaction by receiving a control command sent by a user and controlling a function control corresponding to the function control identifier based on the function control identifier carried in the control command to perform a corresponding function operation. The function control identifier may refer to position information of the function control, etc., and is not specifically limited herein.

[0117] For example, when the displayed content is video content such as a TV drama or a movie, when the user needs to perform a screenshot operation on the displayed video content, as shown in FIG. 13A, the user can trigger a screenshot control in the prompt information interface by using a peripheral device or a gesture operation, and use the screenshot control to perform a screenshot operation on the currently displayed video content.

[0118] When the display content is video content such as a television drama or a movie, if the user needs to perform a projection operation on the displayed video content, the user can trigger the projection control in the prompt information interface by using a peripheral device or a gesture operation, as shown in Fig. 13B, and use the projection control to project the displayed video content onto another display device. During projection, the user can select a projection target device from multiple devices connected in communication and project the video content onto the projection device. The specific implementation process is conventional and will not be described in detail here.

[0119] When the displayed content is video content such as a television drama or a movie, if the user needs to perform a recording operation on the displayed video content, as shown in FIG. 13C, the recording control in the prompt information interface can be triggered by a peripheral device or a gesture operation, and the recording control can be used to perform a recording operation on the displayed video content.

[0120] If the display content is picture content such as a photograph, when the user needs to save the displayed picture, as shown in FIG. 13D, the user can trigger a save control in the prompt information interface by using a peripheral device or a gesture operation, and use the save control to save the picture.

[0121] If the illustrated content is a picture content such as a photo, when a user needs to share the displayed picture, the user can trigger a share control in the prompt information interface by using a peripheral device or a gesture operation, as shown in FIG. 13E, and use the share control to share the image with a friend, etc. When sharing, the user can select the friend information to share with and select the friend to share the picture with. Of course, the picture may also be shared with people other than friends. Specific details can be flexibly adjusted according to actual application needs, and are not specifically limited herein.

[0122] If the display content is, for example, a picture content such as a photograph, when the user needs to edit the displayed picture, as shown in FIG. 13F, the user can trigger an edit control in the prompt information interface by using a peripheral device or a gesture operation, and use the edit control to perform an edit operation on the image.

[0123] Of course, in addition to the above exemplary descriptions, the embodiments of the present disclosure can also trigger function controls in the prompt information interface based on other display content, and perform corresponding function operations through the function controls, and the present disclosure is not specifically limited thereto.

[0124] The prompt information display method provided by the embodiments of the present disclosure determines a target display area based on the user's field of view of the display interface, and then displays a prompt information interface in the target display area, where the prompt information interface includes at least one function control related to the display content of the display interface. By displaying the prompt information within the field of view, the embodiments of the present disclosure enable the user to quickly grasp the updated operating system or application program based on the prompt information, thereby effectively improving man-machine interaction efficiency and enhancing the user experience. Furthermore, by triggering any function control in the prompt information interface to perform the corresponding function operation, the user's operating needs can be met while shortening the step length of man-machine interaction and improving operation efficiency.

[0125]

[0062] As another possible implementation form of the embodiment of the present disclosure, considering that the prompt information interface displayed in the target display area may have a greater or lesser effect on the user's viewing of the display content in the display interface, the embodiment of the present disclosure provides a display control in the prompt information interface, so that the user can trigger the display control to adjust the display state of the prompt information interface, thereby reducing the interference of the prompt information interface with the user's viewing of the display content. Hereinafter, the prompt information display method provided by the embodiment of the present disclosure will be further interpreted and described with reference to FIG. 14.

[0126] As shown in FIG. 14, the method may include the following steps S1401 to S1403.

[0127] S1401, determining a target display area based on a user's viewing range in a display interface.

[0128] S1402, displaying a prompt information interface including at least one function control and a display control related to the display content of the display interface in the target display area.

[0129] S1403, in response to a first trigger operation on the display control, display a prompt information interface in a minimized form in the target display area.

[0130] The display control may be located at any upper corner of the prompt information interface, as specifically shown in Figures 15A to 15D. That is, by placing the display control at the upper corner of the prompt information interface, the display control will not obscure the normal display of the function control, and the function control will always be visible to the user.

[0131] Considering that the prompt information interface displayed in the target display area may interfere with and affect the user's viewing of the display content, the user can trigger a display control located on the prompt information interface through a peripheral device or a gesture operation, etc., and use the display control to minimize the prompt information interface, and then display the minimized prompt information interface in the target display area, thereby reducing the interference with the user's viewing of the display content. A specific implementation process is shown in Figure 15E.

[0132] As an optional implementation, the embodiment of the present disclosure can also set a timer in the prompt information interface. When the timer reaches a preset time length and the user has not triggered any function control, the display control automatically triggers the prompt information interface to be minimized by the display control. In addition, displaying the prompt information interface in the minimized state in the target display area is not specifically limited herein.

[0133] The preset time length may be a default value set by the device, or may be manually set by the user as needed, and is not specifically limited here, for example, 5 minutes (min) or 10 minutes.

[0134] Furthermore, after the prompt information interface is reduced to the minimum state, if the user wants to use any function control in the prompt information interface, he can trigger the display control located in the minimum state prompt information interface again by a peripheral device, a gesture operation, etc. Then, the display control can restore the minimum state prompt information interface to the normal state and display it in the target display area based on the user's trigger operation. Furthermore, the user can select a desired function control in the normally displayed prompt information interface as needed, and perform a corresponding function operation through the function control.

[0135] That is, the embodiment of the present disclosure further includes displaying a prompt information interface in a normal state in the target display area in response to a second trigger operation on the display control.

[0136] The present disclosure provides a prompt information display method that determines a target display area based on a user's field of view of a display interface, and then displays a prompt information interface in the target display area, where the prompt information interface includes at least one function control related to the display content of the display interface. By displaying the prompt information within the field of view, the present disclosure allows the user to quickly understand the updated operating system or application program based on the prompt information, thereby effectively improving man-machine interaction efficiency and enhancing the user experience. Furthermore, the display state of the prompt information interface is adjusted in response to the user's trigger operation on the display control, thereby reducing the interference of the display of the prompt information interface with the user's viewing of the display content, thereby better meeting the user's usage needs.

[0137] As another possible implementation, considering that all the function controls displayed in the prompt information interface may not be the function controls desired by the user, in order to meet the user's operation needs, the embodiment of the present disclosure can also set a voice control in the prompt information interface, and when all the function controls in the prompt information interface do not meet the user's usage needs, the user can trigger the voice control to perform a voice search and find the desired target function. Hereinafter, the above-mentioned solution provided by the embodiment of the present disclosure will be specifically described with reference to FIG. 16.

[0138] As shown in FIG. 16, the method may include the following steps S1601 to S1603.

[0139] S1601, determining a target display area based on a user's field of view range in a display interface.

[0140] S1602, displaying a prompt information interface in the target display area, the prompt information interface including at least one function control and a voice control related to the display content of the display interface.

[0141] S1603, in response to a trigger operation on the voice control, search for a target function based on the voice information acquired by the voice control, and control the target function to perform a corresponding function operation.

[0142] When a user needs to operate the display content but the prompt information interface located in the target display area does not have the desired function control, the user can trigger the voice control located in the prompt information interface using a peripheral device, gesture operation, etc., and use the voice control to obtain the user's voice information. The electronic device then performs voice recognition based on the voice information collected by the voice control and finds a corresponding target function from all functions based on the voice recognition result. After finding the target function, the target function can be activated and controlled to perform the corresponding function operation. In this way, the voice control located in the prompt information interface avoids the user from manually finding the desired function, simplifies the operation steps, and ensures that the user can always obtain any desired function, further improving the efficiency of human-machine interaction.

[0143] Performing voice recognition based on the voice information collected by voice control and finding the corresponding target function from all functions based on the voice recognition result is a common technique in the field, and detailed description is omitted here.

[0144] The above implementation process can be seen in Figure 17. As is necessary to explain, while controlling the target function to perform the corresponding function operation, the present disclosure performs a reset operation on the display interface to resolve the situation where the display content is shifted due to the calculation deviation and is not within the user's field of view.

[0145] The prompt information display method provided by the embodiments of the present disclosure determines a target display area based on the user's field of view of the display interface, and then displays a prompt information interface in the target display area, where the prompt information interface includes at least one function control related to the display content of the display interface. By displaying the prompt information within the field of view, the embodiments of the present disclosure enable the user to quickly find an updated operating system or application program based on the prompt information, thereby effectively improving man-machine interaction efficiency and enhancing the user experience. Furthermore, the voice control located in the prompt information interface prevents the user from manually finding the desired function, thereby simplifying the operation steps and shortening the search step length. This also ensures that the user can always obtain the desired function, further improving man-machine interaction efficiency.

[0146] As another possible implementation form of the embodiments of the present disclosure, the embodiments of the present disclosure can also set an information display area in the prompt information interface to display dynamic information to the user through the information display area, allowing the user to view important dynamic information without logging out of the current interface and re-accessing the corresponding application program. Hereinafter, the above solution provided by the embodiments of the present disclosure will be described in detail with reference to FIG. 18.

[0147] As shown in FIG. 18, the method may include the following steps S1801 to S1803.

[0148] S1801, determining a target display area based on a user's field of view range in a display interface.

[0149] S1802, displaying a prompt information interface in a target display area, the prompt information interface including at least one function control and an information display area related to the display content of the display interface.

[0150] S1803, displaying dynamic information in the information display area;

[0151] The information display area may be flexibly configured in the information prompt interface according to actual application needs, such as the configuration shown in FIGS. 19A to 19B.

[0152] Considering that, during the process of a user using an electronic device, other application programs may be running in the background, and other application programs may receive or generate new dynamic information from time to time, such as new messages received by an instant messaging application, new popular news pushed by a news application, or weather information, the embodiments of the present disclosure may also set an information display area in the prompt information interface to display dynamic information to the user through the information display area, thereby allowing the user to view important dynamic information without logging out of the current interface and re-accessing the corresponding application program.

[0153] As one possible implementation, the embodiment of the present disclosure may also display recommended information related to the displayed content in the information display area based on the displayed content of the display interface.

[0154] For example, if the displayed content is video content such as a movie, information on other movies or TV dramas starring the actor in the movie is acquired based on the lead actor in the movie, and the acquired information, such as the names and icons of the other movies or TV dramas, is then displayed in the information display area, allowing the user to quickly acquire movies or TV dramas starring their favorite actor based on the recommended information, thereby increasing user engagement.

[0155] Furthermore, for example, if the displayed content is a gourmet program, information such as the name of the gourmet restaurant, its address, and the necessary ingredients is obtained based on the gourmet program, and then the obtained information such as the name of the gourmet restaurant, its address, and the necessary ingredients is displayed in the information display area, allowing the user to quickly obtain gourmet food, gourmet restaurant, ingredients, and cooking methods that suit their preferences based on the recommended information, thereby improving user retention.

[0156] The prompt information display method provided by the embodiments of the present disclosure determines a target display area based on a user's field of view in a display interface, and then displays a prompt information interface in the target display area, where the prompt information interface includes at least one function control related to the display content of the display interface. By displaying the prompt information within the field of view, the embodiments of the present disclosure enable the user to quickly grasp the updated operating system or application program based on the prompt information, thereby effectively improving man-machine interaction efficiency and enhancing the user experience. Furthermore, by setting an information display area in the prompt information interface and displaying dynamic information to the user through the information display area, the user can view important dynamic information without having to log out of the current display interface and access another application program again, thereby shortening the user's operation steps and improving user stickiness.

[0157] To realize the above embodiment, the embodiment of the present disclosure further proposes a man-machine interaction device.

[0158] 20 is a schematic block diagram of a human-machine interaction device according to an embodiment of the present disclosure, which may be implemented by software and / or hardware and is generally integrated into an electronic device to perform human-machine interaction. As shown in FIG. 20, the device includes a first display module 2010, a second display module 2020, and a third display module 2030; the first display module 2010 is used to display a first application interface when receiving a command to open a first application; the first application interface includes a main interface display area and an associated display area, the associated display area being used to display a plurality of candidate function entries, and the main interface display area being used to display a display page of a currently invoked function; the second display module 2020 is used to reduce the display page of the currently called function and display the function entry of the currently called function in the related display area in response to a command to open the target function entry in the related display area; The third display module 2030 is used to display the display page of the target function in the main interface display area.

[0159] The man-machine interaction device provided by the embodiments of the present disclosure can execute the man-machine interaction method provided by any embodiment of the present disclosure, and can have corresponding functional modules and beneficial effects of the executing method.

[0160] An embodiment of the present disclosure further proposes a display device for prompt information.

[0161] Hereinafter, a prompt information display device proposed in an embodiment of the present disclosure will be described with reference to Fig. 21. Fig. 21 is a schematic block diagram of a prompt information display device according to an embodiment of the present disclosure.

[0162] The prompt information display device 2100 includes a region determination module 2110 and a display module 2120 .

[0163] The region determination module 2110 is used to determine a target display region based on a user's field of view of the display interface; The display module 2120 is used to display a prompt information interface in the target display area, the prompt information interface including at least one function control related to the display content of the display interface.

[0164] In one alternative implementation of the embodiment of the present disclosure, the region determining module 2110 includes a first determining unit and a second determining unit; The first determining unit is used for determining a viewing range of a user's display interface; The second determining unit is used to determine the edge area of ​​the field of view range as the target display area.

[0165] In one alternative implementation of the embodiment of the present disclosure, the prompt information display device 2100 further includes a first response module: The first response module is used to control the function control in the prompt information interface to perform a corresponding function operation in response to a trigger operation on the function control.

[0166] In one alternative implementation of the embodiment of the present disclosure, the prompt information interface further includes a display control; Correspondingly, the prompt information display device 2100 further includes a second response module: A second response module is used to display the prompt information interface in a minimized form in a target display area in response to a first trigger operation on the display control.

[0167] In one alternative implementation of the disclosed embodiment, The second response module is further used to display the prompt information interface in a normal format in the target display area in response to a second trigger operation on the display control.

[0168] In one alternative implementation of the embodiment of the present disclosure, the prompt information interface further includes a voice control; Correspondingly, the prompt information display device 2100 further includes a third response module: The third response module is used to search for a target function based on the voice information acquired by the voice control in response to a trigger operation on the voice control, and control the target function to perform a corresponding function operation.

[0169] In one alternative implementation of the embodiment of the present disclosure, the prompt information interface further includes an information display area; Correspondingly, the prompt information display device 2100 further includes a second display module: The second display module is used for displaying dynamic information in the information display area, or displaying recommended information related to the display content in the information display area based on the display content of the display interface.

[0170] The prompt information display device provided by the present disclosure determines a target display area based on a user's field of view in the display interface, and displays a prompt information interface in the target display area, where the prompt information interface includes at least one function control related to the display content of the display interface. By displaying the prompt information within the field of view, the embodiment of the present disclosure allows the user to quickly grasp the updated operating system or application program based on the prompt information, thereby effectively improving man-machine interaction efficiency and improving the user's usage experience.

[0171] It should be understood that the apparatus embodiments and the above-mentioned method embodiments can correspond to each other, and similar descriptions can be found in the method embodiments. Detailed descriptions will be omitted here to avoid repetition. Specifically, the apparatus 2100 shown in FIG. 21 can execute the method embodiments corresponding to FIG. 9, and the above and other operations and / or functions of each module in the apparatus 2100 are for implementing the corresponding processes of each method in FIG. 9, and detailed descriptions will be omitted here for the sake of brevity.

[0172] The above description of the device 2100 of the embodiments of the present disclosure has been made in terms of functional modules, with reference to the drawings. It should be understood that the functional modules may be implemented in the form of hardware, software instructions, or a combination of hardware and software modules. Specifically, each step of the method embodiments of the present disclosure may be completed by a hardware integrated logic circuit and / or software instructions in a processor. The steps of the method for displaying prompt information disclosed in the combination of the embodiments of the present disclosure may be directly implemented to be executed and completed by a hardware decoding processor or by a combination of hardware and software modules in a decoding processor. Optionally, the software modules may be located in a storage medium well-established in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, or a register. The storage medium is located in the memory, and the processor reads information from the memory and completes the steps of the method for displaying prompt information in combination with the hardware.

[0173] To realize the above embodiments, the present disclosure further proposes a computer program product, which includes computer programs / instructions, and when the computer programs / instructions are executed by a processor, realizes the man-machine interaction method and / or the display method in the above embodiments.

[0174] 22 is a schematic block diagram of an electronic device according to an embodiment of the present disclosure. As shown in FIG. 22, the electronic device 700 may include a memory 2210 and a processor 2220. The memory 2210 stores a computer program and transmits the program code to the processor 2220. In other words, the processor 2220 can call and execute the computer program from the memory 2210 to implement the man-machine interaction method and / or the prompt information display method according to the embodiment of the present disclosure.

[0175] For example, the processor 2220 may be used to execute embodiments of the man-machine interaction method and / or the method for displaying prompt information based on instructions in the computer program.

[0176] In some embodiments of the present disclosure, the processor 2220 may include, but is not limited to, a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, or the like.

[0177] In some embodiments of the present disclosure, memory 2210 may include, but is not limited to, volatile and / or non-volatile memory. Non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory may be random access memory (RAM), which acts as external cache memory. By way of example and not limitation, many forms of RAM are available, including static random access memory (Static RAM, SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (Synch link DRAM, SLDRAM), and direct Rambus random access memory (Direct Rambus RAM, DR RAM).

[0178] In some embodiments of the present disclosure, the computer program may be divided into one or more modules, which are stored in the memory 2210 and executed by the processor 2220 to complete the man-machine interaction method and / or the prompt information display method provided by the embodiments of the present disclosure. The one or more modules may be a series of computer program instruction segments that can complete a specific function, and the instruction segments are used to explain the execution process of the computer program in the electronic device.

[0179] As shown in FIG. 22, the electronic device may further include a transceiver 2230 that may be connected to the processor 2220 or the memory 2210.

[0180] The processor 2220 can control the transceiver 2230 to communicate with other devices, specifically to transmit information or data to other devices or receive information or data transmitted by other devices. The transceiver 2230 may include a transmitter and a receiver. The transceiver 2230 may further include an antenna, and the number of antennas may be one or more.

[0181] As will be understood, each component in the electronic device is connected via a bus system, which in addition to including a data bus, further includes a power bus, a control bus, and a status signal bus.

[0182] FIG. 23 is a schematic block diagram of another electronic device according to an embodiment of the present disclosure.

[0183] 23 , a structural schematic diagram of an electronic device 2300 configured to realize an embodiment of the present disclosure is shown. The electronic device 2300 in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG. 23 is merely an example and does not limit the functionality or scope of use of the embodiment of the present disclosure.

[0184] 23, electronic device 2300 may include a processor (e.g., a central processor, a graphics processor, etc.) 2301 that can perform various appropriate operations and processes based on programs stored in read-only memory (ROM) 2302 or programs loaded from memory 2308 into random access memory (RAM) 2303. RAM 2303 further stores various programs and data necessary for the operation of electronic device 2300. Processor 2301, ROM 2302, and RAM 2303 are interconnected via bus 2304. Input / output (I / O) interface 2305 is also connected to bus 2304.

[0185] Typically, devices such as input devices 2306, including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, and gyroscope; output devices 2307, including, for example, a liquid crystal display (LCD), speakers, and oscillators; memory 2308, including, for example, a magnetic tape and hard disk; and communication devices 2309 may be connected to the I / O interface 2305. The communication devices 2309 may enable the electronic device 2300 to communicate wirelessly or via wires with other devices to exchange data. While FIG. 23 shows the electronic device 2300 with various devices, it should be understood that it is not required to implement or include all of the devices shown. More or fewer devices may alternatively be implemented or included.

[0186] In particular, according to an embodiment of the present disclosure, the processes described with reference to the flowcharts may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program including program code for performing the methods shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 2309, or may be installed from the memory 2308, or may be installed from the ROM 2302. When the computer program is executed by the processor 2301, it performs the functions defined in the man-machine interaction method and / or the method for displaying prompt information according to an embodiment of the present disclosure.

[0187] As should be explained, the computer-readable medium of the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the above. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to, an electrical connection having one or more conductors, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact magnetic disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take several forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which is capable of transmitting, propagating, or transmitting a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied in a computer-readable medium may be transmitted over any suitable medium, including, but not limited to, wire, cable, RF (radio frequency), etc., or any suitable combination of the above.

[0188] In some embodiments, clients and servers may communicate using any now known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the World Wide Web (e.g., the Internet), and an end-to-end network (e.g., an ad hoc end-to-end network), and any now known or later developed network.

[0189] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated in the electronic device.

[0190] The computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the man-machine interaction method and / or the method for displaying prompt information according to an embodiment of the present disclosure.

[0191] The electronic device can generate computer program code for performing operations of embodiments of the present disclosure in one or more programming languages ​​or combinations thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may run entirely on the user computer, partially on the user computer, as a separate software package, partially on the user computer and partially on a remote computer, or entirely on a remote computer or server. When referring to a remote computer, the remote computer may be connected to the user computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0192] The flowcharts and block diagrams in the drawings illustrate possible system architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing a given logical function. It should be noted that in some alternative implementations, the functions marked in the blocks may occur in an order different from the order marked in the drawings. For example, two blocks shown in succession may actually be executed substantially in parallel, or may even be executed in the opposite order, depending on the functionality involved. It should be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs a given function or operation, or may be implemented using a combination of dedicated hardware and computer instructions.

[0193] The units described and mentioned in the embodiments of the present disclosure may be implemented in the form of software or hardware, and in some cases, the names of the units do not limit the units themselves.

[0194] As used herein, the functions described above may be performed, at least in part, by one or more hardware logic elements. For example, non-limiting example hardware logic elements that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0195] In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain or store a program used by or in connection with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include one or more wire-based electrical connections, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0196] In an embodiment of the present disclosure, when the electronic device is an HMD, the embodiment of the present disclosure provides a schematic block diagram of the HMD, as shown in FIG.

[0197] As shown in FIG. 24, the main functional modules of the HMD 2400 may include, but are not limited to, a detection module 2410, a feedback module 2420, sensors 2430, a control module 2440, and a modeling module 2450.

[0198] The detection module 2410 is configured to detect user control commands using various sensors and act on the virtual environment, for example, tracking the user's gaze to continuously update the image displayed on the display screen, thereby enabling the user to interact with the virtual scene.

[0199] The feedback module 2420 is configured to receive data from the sensors and provide real-time feedback to the user, for example, to generate a feedback command based on the user's operation data and output the feedback command.

[0200] The sensors 2430 are configured, on the one hand, to receive manipulation commands from the user and act on the virtual environment, and, on the other hand, to provide the results generated after manipulation to the user in various forms of feedback.

[0201] The control module 2440 is configured to control sensors and various input / output devices to interact with the user, the virtual environment, and the real world, such as acquiring user data such as motion and voice, and outputting sensory data such as images, vibrations, temperature, and sound. For example, the control module 2440 can acquire user gestures, voice, and the like.

[0202] The modeling module 2450 is configured to build a three-dimensional model of the virtual environment, and may further include various feedback mechanisms such as sound and touch in the three-dimensional model.

[0203] As will be understood, the functional modules in the HMD 2400 are connected via a bus system, which in addition to including a data bus, further includes a power bus, a control bus, a status signal bus, and the like.

[0204] The above description merely describes preferred embodiments of the present disclosure and the applied technical principles. As will be understood by those skilled in the art, the scope of the disclosure referred to in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also include other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the concept of the above disclosure. For example, technical solutions formed by mutually replacing the above features with technical features having similar functions disclosed in the present disclosure (but not limited to these).

[0205] Also, although operations are described in a particular order, this should not be understood as requiring these operations to be performed in the particular order shown or in any sequential order. In some cases, multitasking and parallel processing may be advantageous. Similarly, although the above description includes several specific implementation details, these should not be construed as limiting the scope of the present disclosure. Some features that are described in the context of a single embodiment may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may also be implemented in multiple embodiments alone or in any suitable subcombination.

[0206] Although the present subject matter has been described in language specific to structural features and / or method logic operations, it should be understood that the subject matter defined in the appended claims is not limited to the specific features or operations described above. Rather, the specific features and operations described above are merely example forms of implementing the claims.

Claims

1. A man-machine interaction method, comprising: displaying a first application interface upon receiving a command to open a first application, the first application interface including a main interface display area and an associated display area, the associated display area being used to display a plurality of candidate function entries, and the main interface display area being used to display a display page of a currently invoked function; in response to a command to open a target function entry in the association display area, reducing the display page of the currently invoked function and displaying a function entry of the currently invoked function in the association display area; and displaying a display page of the target function in the main interface display area.

2. The step of displaying the first application interface includes:

2. The method of claim 1, further comprising generating a first display layer in a virtual reality space and rendering and displaying the first application interface on the first display layer.

3. The step of reducing the display page of the currently invoked function and displaying a function entry of the currently invoked function in the associated display area includes:

3. The method according to claim 1, further comprising the step of: displaying preset reduced prompt information from the display page of the current calling function to a function entry of the current calling function; and, upon completion of displaying the reduced prompt information, reducing the display page of the current calling function as the function entry of the current calling function displayed in the associated display area.

4. The step of displaying a display page of the target function in the main interface display area includes: A method according to any one of claims 1 to 3, characterized in that it includes a step of displaying prompt information for expanding the target function entry to a display page of the target function, and when the display of the prompt information is completed, expanding the target function entry as a display page of the target function displayed in the main interface display area.

5. before the step of displaying the display page of the target function in the main interface display area, determining a historical feature page of the target feature when it was last reduced; The method according to any one of claims 1 to 4, further comprising the step of determining that the history function page is a display page of the target function.

6. The step of reducing the display page of the currently invoked function and displaying a function entry of the currently invoked function in the associated display area includes: If the display page of the currently called function is an application home page of the first application, reducing the display page of the currently called function as a function entry of the currently called function displayed in a first related display sub-area; 6. The method of claim 1, further comprising: if the display page of the current called function is not the application homepage of the first application, reducing the display page of the current called function as a function entry of the current called function displayed in a second related display sub-area, wherein the first related display sub-area and the second related display sub-area are located at different orientations of the main interface display area.

7. The step of reducing the display page of the currently invoked function as a function entry of the currently invoked function displayed in a second related display sub-area includes: determining an initial display position in the second related display sub-area of ​​a function entry for the currently invoked function; 7. The method of claim 6, further comprising the step of: reducing the display page of the currently invoked function as a function entry of the currently invoked function displayed in the initial display position.

8. 8. The method of claim 1, further comprising the step of generating a second display layer in the first application interface in response to an instruction to open an application entry corresponding to a second application in the associated display area, and rendering and displaying a second application interface of the second application on the second display layer.

9. A method for displaying prompt information, comprising: determining a target display area based on a user's field of view of a display interface; and displaying a prompt information interface in the target display area, the prompt information interface including at least one functional control related to the display content of the display interface.

10. determining a target display area based on a user's field of view of the display interface, determining a user's field of view of the display interface; and determining an edge region of the field of view as a target display region.

11. The method according to claim 9 or 10, further comprising the step of controlling a function control in the prompt information interface to perform a corresponding function operation in response to a trigger operation on the function control.

12. the prompt information interface further includes a display control; The method comprises: The method of any one of claims 9 to 11, further comprising the step of displaying the prompt information interface in a minimized form in the target display area in response to a first trigger operation on the display control.

13. 13. The method of claim 12, further comprising displaying the prompt information interface in a normal format in the target display area in response to a second trigger operation on the display control.

14. the prompt information interface further includes a voice control; The method comprises: The method according to any one of claims 9 to 11, further comprising the step of searching for a target function based on voice information acquired by the voice control in response to a trigger operation on the voice control, and controlling the target function to perform a corresponding function operation.

15. the prompt information interface further includes an information display area; The method comprises: displaying dynamic information in the information display area; Or, The method according to any one of claims 9 to 11, further comprising the step of displaying recommended information related to the display interface in the information display area based on the display content of the display interface.

16. A man-machine interaction device, comprising: a first display module for displaying a first application interface upon receiving a command to open a first application, the first application interface including a main interface display area and an associated display area, the associated display area being used to display a plurality of candidate function entries, and the main interface display area being used to display a display page of a currently invoked function; a second display module for reducing the display page of the currently invoked function and displaying a function entry of the currently invoked function in the association display area in response to a command to open a target function entry in the association display area; a third display module for displaying a display page of a target function in the main interface display area.

17. An electronic device, a processor; a memory for storing said processor-executable instructions; The electronic device is characterized in that the processor is used to read the executable instructions from the memory and execute the executable instructions to implement the method of any one of claims 1 to 15.

18. A computer-readable storage medium having a computer program stored therein, the computer program being used to execute the method according to any one of claims 1 to 15.

Images