Window mode switching method, head-mounted display device and medium

Abstract

The embodiment of the invention discloses a window mode switching method, head-mounted display equipment and a medium. A specific embodiment of the method comprises the steps of determining a to-be-switched window mode according to at least one window mode in response to a detected window mode switching operation of a target user and existence of at least one window mode in a field angle of the head-mounted display device; according to window mode switching request information represented by the window mode switching operation, switching processing is carried out on the window mode to be switched, and the window mode switching request information represents that the window mode to be switched is switched into a first window mode, a second window mode or a third window mode; the window mode detail information of the first window mode, the second window mode and the third window mode is different. According to the embodiment, the diversity of the window modes is improved, the limitation of window mode switching is reduced, the degree of freedom of window mode switching is improved, and the experience feeling of a user is further improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of virtual vision technology, and in particular to a window mode switching method, a head-mounted display device, and a medium. Background Art

[0002] The diversity of displayed window modes allows users to switch between window modes, which can enhance the user experience. Currently, when switching between window modes, the commonly used method is: when the head-mounted display device is detected to be started, a window mode is randomly displayed in the head-mounted display device, and only the currently displayed window mode can be zoomed in and out to switch the currently displayed window mode.

[0003] However, in practice, when the above method is used to switch the window mode, the following technical problems often occur:

[0004] The window mode can only be switched by enlarging or reducing the displayed window, resulting in a relatively single method for switching the window mode, which leads to greater limitations and lower freedom for users to switch the window mode, resulting in a poor user experience; and the types of window modes are relatively single, resulting in a poor user experience.

[0005] The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known to a person of ordinary skill in the art. Summary of the invention

[0006] The content of this disclosure is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this disclosure is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

[0007] Some embodiments of the present disclosure propose a window mode switching method, a head-mounted display device, and a computer-readable medium to solve one or more of the technical problems mentioned in the above background technology section.

[0008] In a first aspect, some embodiments of the present disclosure provide a window mode switching method, the method comprising: in response to detecting a window mode switching operation of a target user, and there being at least one window mode in the field of view of the head-mounted display device, determining a window mode to be switched according to the at least one window mode; switching the window mode to be switched according to window mode switching request information represented by the window mode switching operation, wherein the window mode switching request information represents switching the window mode to be switched to a first window mode, a second window mode or a third window mode, and the window mode detail information of the first window mode, the second window mode and the third window mode are different.

[0009] Optionally, the method further includes: in response to determining that the window mode switching operation is a touch switching operation, selecting a window mode that meets a preset window mode condition from the at least one window mode as the window mode to be switched.

[0010] Optionally, the method further includes: in response to determining that the window mode switching operation is a virtual ray switching operation, determining the window mode selected by the target user from the at least one window mode as the window mode to be switched.

[0011] Optionally, the method further includes: determining whether the window mode to be switched satisfies a preset window mode switching condition according to the window mode switching request information; and switching the window mode to be switched in response to determining that the window mode to be switched satisfies the preset window mode switching condition.

[0012] Optionally, the method also includes: in response to determining that the above-mentioned window mode switching operation is a touch switching operation, and the above-mentioned window mode switching request information satisfies the preset large window switching condition, determining whether the above-mentioned window mode to be switched is the above-mentioned third window mode; in response to determining that the above-mentioned window mode to be switched is not the above-mentioned third window mode, determining that the above-mentioned window mode to be switched satisfies the above-mentioned preset window mode switching condition.

[0013] Optionally, the method also includes: in response to determining that the above-mentioned window mode switching operation is a touch switching operation, and the above-mentioned window mode switching request information satisfies the preset small window switching condition, determining whether the above-mentioned window mode to be switched is the above-mentioned first window mode; in response to determining that the above-mentioned window mode to be switched is not the above-mentioned first window mode, determining that the above-mentioned window mode to be switched satisfies the above-mentioned preset window mode switching condition.

[0014] Optionally, the method also includes: in response to determining that the above-mentioned window mode switching operation is a virtual ray switching operation, determining whether the window mode selected by the above-mentioned target user is the same as the above-mentioned window mode to be switched; in response to determining that the window mode selected by the above-mentioned window mode switching operation is different from the above-mentioned window mode to be switched, determining that the above-mentioned window mode to be switched satisfies the above-mentioned preset window mode switching condition.

[0015] Optionally, the method further includes: in response to determining that the window mode switching operation is a virtual ray switching operation, switching the window mode to be switched to the window mode selected by the target user.

[0016] In a second aspect, some embodiments of the present disclosure provide a head-mounted display device, comprising: one or more processors; a storage device on which one or more programs are stored; a display screen for displaying a virtual interface; when the one or more programs are executed by one or more processors, the one or more processors implement the method described in any implementation manner of the above-mentioned first aspect.

[0017] In a third aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the method described in any implementation manner of the first aspect is implemented.

[0018] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the window mode switching method of some embodiments of the present disclosure, the diversity of window modes is provided, the user experience is further improved, the limitations of window switching are reduced and the freedom of window mode switching is improved. Specifically, the reasons for the singleness of the window mode, the poor user experience, the large limitations of window switching and the low freedom of window mode switching are: only the displayed window can be enlarged or reduced to switch the window mode, resulting in a relatively single method for switching the window mode, resulting in large limitations and low freedom for the user to switch the window mode, resulting in a poor user experience; and the type of window mode is relatively single, resulting in a poor user experience. Based on this, the window mode switching method of some embodiments of the present disclosure, first, in response to detecting the window mode switching operation of the target user, and there is at least one window mode in the field of view of the head-mounted display device, according to the at least one window mode, the window mode to be switched is determined. Thus, the window mode to be switched can be determined for switching the window mode. Then, according to the window mode switching request information represented by the above-mentioned window mode switching operation, the above-mentioned window mode to be switched is switched, wherein the above-mentioned window mode switching request information represents that the above-mentioned window mode to be switched is switched to the first window mode, the second window mode or the third window mode, and the window mode detail information of the above-mentioned first window mode, the above-mentioned second window mode and the above-mentioned third window mode is different. Thus, the window mode can be switched. Also because the window model to be switched can be switched to the first window mode, the second window mode or the third window mode, therefore, the window mode can be the first window mode, the second window mode or the third window mode, thereby reflecting the diversity of the window mode, increasing the types of window modes, and thus further improving the user's experience. Also because the window is not switched by zooming in and out of the finger, but the window mode switching operation of the user is detected, and the window mode is switched, the user's window mode switching operation can be a touch switching operation or a virtual ray switching operation, thereby enriching the user's window mode switching method, reducing the limitations of the user's window mode switching and improving the user's freedom of window mode switching, thereby further improving the user's experience. In this way, the diversity of window modes can be improved, the limitations on window mode switching can be reduced, and the user's freedom in switching window modes can be improved, thereby further improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0020] Figure 1 is an exemplary system architecture diagram of a window mode switching method applying some embodiments of the present disclosure;

[0021] Figure 2 is a flow chart of some embodiments of the window mode switching method according to the present disclosure;

[0022] Figure 3 is a flowchart of other embodiments of the window mode switching method according to the present disclosure;

[0023] Figure 4 It is a schematic diagram of the hardware structure of a head-mounted display device suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION

[0024] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0025] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0026] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0027] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0028] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0029] Figure 1 An exemplary system architecture 100 that can be applied to an embodiment of the window mode switching method applied to a head mounted display device of the present disclosure is shown.

[0030] like Figure 1As shown, the exemplary system architecture 100 may include a head mounted display device 11 and a terminal device 12 .

[0031] The head-mounted display device 11 may include one or two display screens 111. The above-mentioned display screens are used to display a virtual interface. In addition, the head-mounted display device 11 also includes a frame 112. In some embodiments, the sensor, processing unit, memory and battery of the head-mounted display device 11 may be placed inside the frame 112. In some optional implementations of some embodiments, one or more components of the sensor, processing unit, memory and battery may also be integrated into another independent accessory (not shown), and connected to the frame 112 via a data cable 13. In some optional implementations of some embodiments, the head-mounted display device 11 may only have a display function and some sensors, and the terminal device 12 provides data processing, data storage, power supply and other capabilities.

[0032] The terminal device 12 may include a touch screen 121 , which may be used to display content. In some embodiments, the head mounted display device 11 and the terminal device 12 may be connected via a data cable 13 .

[0033] It should be understood that Figure 1 The number of head mounted display devices and terminal devices in the embodiment is only for illustration. According to the implementation requirements, any suitable number of head mounted display devices and terminal devices may be provided.

[0034] Further references Figure 2 , shows a process 200 of some embodiments of the window mode switching method according to the present disclosure. The window mode switching method comprises the following steps:

[0035] Step 201: In response to detecting a window mode switching operation of a target user, and at least one window mode exists in the field of view of a head mounted display device, a window mode to be switched is determined according to the at least one window mode.

[0036] In some embodiments, in response to detecting a window mode switching operation of a target user, and at least one window mode exists in the field of view of the head-mounted display device, the execution subject of the window mode switching method (e.g., the head-mounted display device) can determine the window mode to be switched according to the at least one window mode. The window mode to be switched can represent the window mode to be switched. The window mode switching operation can be a touch switching operation or a virtual ray switching operation. The virtual ray switching operation can be an operation of selecting a window mode through a virtual ray. The touch switching operation can be an operation of sliding a preset number of fingers upward by a distance greater than a preset distance or an operation of sliding a preset number of fingers downward by a distance greater than a preset distance. Here, the value of the preset number is not specifically limited. The value of the preset distance is not specifically limited. The at least one window mode and the window mode to be switched can both be the first window mode, the second window mode, or the third window mode. The first window mode can be a reading mode. The size range of the first window mode can be 0.2X to 0.4X (1X = 1920 × 1080). For example, the size of the first window mode can be 0.3X. The angle between the first window mode and fov may range from 35 to 50 degrees. For example, the angle between the first window mode and fov may be 45 degrees. The distance between the first window mode and the target user in the head-mounted display device may range from 0.3m to 0.6m. For example, the distance between the first window mode and the target user in the head-mounted display device may be 0.5m. The second window mode may be a desktop mode. The size of the second window mode may range from 0.8X to 1.2X (1X = 1920 × 1080). For example, the size of the second window mode may be 1X. The angle between the second window mode and fov may range from 85 to 95 degrees. For example, the angle between the second window mode and fov may be 90 degrees. The distance between the second window mode and the target user in the head-mounted display device may range from 1.4m to 1.8m. For example, the distance between the second window mode and the target user in the head-mounted display device may be 1.6m. The third window mode may be a giant screen mode. The size range of the third window mode may be 5X to 8X (1X = 1920 × 1080). For example, the size of the third window mode may be 7X. The angle range between the third window mode and the fov may be 85 to 95 degrees. For example, the angle between the third window mode and the fov may be 90 degrees. The distance range between the third window mode and the target user in the head-mounted display device may be 6m to 9m. For example, the distance between the third window mode and the target user in the head-mounted display device may be 8m.

[0037] However, it is found in practice that when the window mode is switched by the method disclosed in the present invention, the following technical problems often occur:

[0038] When a user turns on a head-mounted display device, a window mode is randomly displayed in the head-mounted display device, causing the user to switch the currently displayed window mode every time the head-mounted display device is turned on, resulting in a large amount of computing resources consumed in window mode switching and a long time consumption.

[0039] Faced with the above technical problems, we decided to adopt the following solutions:

[0040] Optionally, before step 201, first, in response to detecting the target user's startup operation on the head-mounted display device, the execution entity may obtain each historical window mode switching request information corresponding to the target user. The each historical window mode switching request information may represent each historical request of the target user to switch the window mode. For example, the historical window mode switching request information may represent a request to switch the window mode to be switched to the large window mode. In practice, the execution entity may obtain each historical window mode switching request information corresponding to the target user from a database storing the historical window mode switching request information.

[0041] Then, the above-mentioned historical window mode switching request information can be deduplicated to obtain the historical window mode switching request information after deduplication. In practice, first, the above-mentioned execution subject can deduplicated the above-mentioned historical window mode switching request information through a distributed deduplication algorithm to obtain the historical window mode switching request information after deduplication.

[0042] Secondly, the missing value detection can be performed on each historical window mode switching request information after the above redundant processing to obtain the missing value detection result information. In practice, the above execution subject can perform missing value detection on each historical window mode switching request information after the above redundant processing through the is.na() function to obtain the missing value detection result information.

[0043] Afterwards, in response to determining that the missing value detection result information satisfies the preset missing value condition, the missing value filling process can be performed on each historical window mode switching request information after the redundant elimination process, and each historical window mode switching request information after the missing value filling process is obtained as each historical window mode switching request information. Among them, the preset missing value condition can be that the missing value detection result information represents that there are missing values ​​in each historical window mode switching request information. In practice, first, the execution subject can perform missing value filling process on each historical window mode switching request information after the redundant elimination process by interpolation method.

[0044] Secondly, feature extraction processing can be performed on each of the above historical window mode switching request information to obtain each request feature information corresponding to the above each historical window mode switching request information, wherein the historical window mode switching request information in the above each historical window mode switching request information corresponds to the request feature information in the above each request feature information. The request feature information in the above each request feature information can characterize the features of the historical window mode switching request information. In practice, the above execution subject can perform feature extraction processing on each of the above historical window mode switching request information through a bag of words model to obtain each request feature information.

[0045] Afterwards, according to the above-mentioned request feature information, the window mode that meets the preset window mode condition in each window mode can be determined as the target window mode. Among them, the above-mentioned window modes can include a first window mode, a second window mode and a third window mode. In practice, first, the above-mentioned execution subject can input the above-mentioned request feature information and the above-mentioned window modes into a pre-trained window mode switching probability information generation model to obtain the window mode switching probability information corresponding to the above-mentioned request feature information. The above-mentioned window mode switching probability information can characterize the probability of each window mode being switched in the above-mentioned window modes. Then, the window mode with the smallest corresponding window mode switching probability information in the above-mentioned window modes can be determined as the target window mode. Among them, the window mode switching probability information in the above-mentioned window mode switching probability information corresponds to the window mode in the above-mentioned window modes. The above-mentioned window mode switching probability information generation model can be a model that takes the request feature information and each window mode as input and the window mode switching probability information of each window mode as output. For example, the window mode switching probability information generation model can be a probabilistic neural network model.

[0046] Finally, the determined target window mode is displayed in the head mounted display device.

[0047] The above technical solution, as an inventive point of an embodiment of the present disclosure, solves the technical problem: "When a user turns on a head-mounted display device, a window mode is randomly displayed in the head-mounted display device, causing the user to switch the currently displayed window mode every time the head-mounted display device is turned on, resulting in more computing resources consumed in window mode switching and a longer time consumption". The factors that cause more computing resources consumed and a longer time consumption in window mode switching are often as follows: When a user turns on a head-mounted display device, a window mode is randomly displayed in the head-mounted display device. If the above factors are solved, the effect of reducing the computing resources consumed and the time consumption in window mode switching can be achieved. In order to achieve this effect, when the window mode is switched, after the head-mounted display device is turned on, the present disclosure does not randomly select any window mode to be displayed in the head-mounted display device, but determines the window mode with the lowest probability of being switched among the various window modes based on the user's various historical window mode switching request information. Then, when the user turns on the head-mounted display device, the window mode with the lowest probability of being switched will be displayed on the head-mounted display device, so that the probability of the user switching the currently displayed window mode is low, thereby reducing the number of times the currently displayed window mode needs to be switched after each start-up of the head-mounted display device, thereby reducing the computing resources consumed by window mode switching and reducing the time consumed by window mode switching.

[0048] Step 202: Perform switching processing on the window mode to be switched according to the window mode switching request information represented by the window mode switching operation.

[0049] In some embodiments, the execution subject may perform a switching process on the window mode to be switched according to the window mode switching request information represented by the window mode switching operation. The window mode switching request information may represent the target user's request to switch the window mode. For example, the window mode switching request information may represent the switching of the window mode to be switched to the large window mode. The window mode switching request information represents the switching of the window mode to be switched to the first window mode, the second window mode or the third window mode. The window mode detail information of the first window mode, the second window mode and the third window mode are different. The window mode detail information may represent the size range of the window mode, the angle range between the window mode and the fov and the distance range between the window mode and the target user in the head mounted display device.

[0050] It should be noted that when the above-mentioned window mode switching operation is a touch switching operation, the switching of the window mode by the touch switching operation can be switched step by step. For example, the touch switching operation can be to switch the window mode to be switched to the large window mode step by step or to switch the window mode to be switched to the small window mode step by step. Here, the operation of sliding a preset number of fingers upward can be characterized as the operation of switching to a large window, and the operation of sliding a preset number of fingers downward can be characterized as the operation of switching to a small window; the operation of sliding a preset number of fingers upward can also be characterized as the operation of switching to a small window, and the operation of sliding a preset number of fingers downward can be characterized as the operation of switching to a large window. No specific limitation is made here. For example: "When the window mode to be switched is the first window mode, and the touch switching operation is detected as a preset number of fingers sliding upward, the first window mode can be switched to the second window mode instead of directly switching the first window mode to the third window mode". The size of the first window mode can be smaller than the size of the second window mode, and the size of the second window mode can be smaller than the size of the third window mode.

[0051] In some optional implementations of some embodiments, the execution subject may perform a switching process on the window mode to be switched according to the window mode switching request information represented by the window mode switching operation through the following steps:

[0052] The first step is to determine whether the window mode to be switched satisfies a preset window mode switching condition according to the window mode switching request information.

[0053] The second step is to switch the window mode to be switched in response to determining that the window mode to be switched meets the preset window mode switching condition. In practice, the execution subject may switch the window mode to be switched according to the window mode switching request information.

[0054] In some optional implementations of some embodiments, the execution subject may determine whether the window mode to be switched meets a preset window mode switching condition according to the window mode switching request information through the following steps:

[0055] The first step is to determine whether the window mode to be switched is the third window mode in response to determining that the window mode switching operation is a touch switching operation and the window mode switching request information satisfies the preset large window switching condition. The preset large window switching condition may be that the window mode switching request information is to switch the window mode to be switched to a large window. It should be noted that when the window mode to be switched is the third window mode, the window mode to be switched is the largest window mode. If the window mode switching request information is to switch the window mode to be switched to a large window mode, the window mode switching request information does not meet the preset large window switching condition.

[0056] In a second step, in response to determining that the window mode to be switched is not the third window mode, determining that the window mode to be switched satisfies the preset window mode switching condition.

[0057] Optionally, after step 202, first, in response to determining that the window mode switching operation is a touch switching operation and the window mode switching request information satisfies a preset small window switching condition, the execution subject may also determine whether the window mode to be switched is the first window mode. The preset small window switching condition may be that the window mode switching request information is to switch the window mode to be switched to the small window mode.

[0058] Then, in response to determining that the window mode to be switched is not the first window mode, it may be determined that the window mode to be switched satisfies the preset window mode switching condition.

[0059] Optionally, after step 202, first, in response to determining that the window mode switching operation is a virtual ray switching operation, the execution subject may determine whether the window mode selected by the target user is the same as the window mode to be switched.

[0060] Then, in response to determining that the window mode selected by the window mode switching operation is different from the window mode to be switched, it can be determined that the window mode to be switched satisfies the preset window mode switching condition. The preset window mode switching condition may be that when the window mode switching request information satisfies the preset large window switching condition, the window mode to be switched is not the third window mode, when the window mode switching request information satisfies the preset small window switching condition, the window mode to be switched is not the first window mode, or the window mode selected by the virtual ray switching operation is different from the window mode to be switched.

[0061] Optionally, after step 202, in response to determining that the window mode switching operation is a virtual ray switching operation, the execution subject may switch the window mode to be switched to the window mode selected by the target user.

[0062] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the window mode switching method of some embodiments of the present disclosure, the diversity of window modes is provided, the user experience is further improved, the limitations of window switching are reduced and the freedom of window mode switching is improved. Specifically, the reasons for the singleness of the window mode, the poor user experience, the large limitations of window switching and the low freedom of window mode switching are: only the displayed window can be enlarged or reduced to switch the window mode, resulting in a relatively single method for switching the window mode, resulting in large limitations and low freedom for the user to switch the window mode, resulting in a poor user experience; and the type of window mode is relatively single, resulting in a poor user experience. Based on this, the window mode switching method of some embodiments of the present disclosure, first, in response to detecting the window mode switching operation of the target user, and there is at least one window mode in the field of view of the head-mounted display device, according to the at least one window mode, the window mode to be switched is determined. Thus, the window mode to be switched can be determined for switching the window mode. Then, according to the window mode switching request information represented by the above-mentioned window mode switching operation, the above-mentioned window mode to be switched is switched, wherein the above-mentioned window mode switching request information represents that the above-mentioned window mode to be switched is switched to the first window mode, the second window mode or the third window mode, and the window mode detail information of the above-mentioned first window mode, the above-mentioned second window mode and the above-mentioned third window mode is different. Thus, the window mode can be switched. Also because the window model to be switched can be switched to the first window mode, the second window mode or the third window mode, therefore, the window mode can be the first window mode, the second window mode or the third window mode, thereby reflecting the diversity of the window mode, increasing the types of window modes, and thus further improving the user's experience. Also because the window is not switched by zooming in and out of the finger, but the window mode switching operation of the user is detected, and the window mode is switched, the user's window mode switching operation can be a touch switching operation or a virtual ray switching operation, thereby enriching the user's window mode switching method, reducing the limitations of the user's window mode switching and improving the user's freedom of window mode switching, thereby further improving the user's experience. In this way, the diversity of window modes can be improved, the limitations on window mode switching can be reduced, and the user's freedom in switching window modes can be improved, thereby further improving the user experience.

[0063] Further references Figure 3 , which shows a process 300 of another embodiment of the window mode switching method. The process 300 of the window mode switching method includes the following steps:

[0064] Step 301: In response to detecting a window mode switching operation of a target user, and at least one window mode exists in the field of view of the head mounted display device, the following steps are performed:

[0065] Step 3011: In response to determining that the window mode switching operation is a touch switching operation, a window mode that meets a preset window mode condition is selected from at least one window mode as a window mode to be switched.

[0066] In some embodiments, in response to determining that the window mode switching operation is a touch switching operation, the execution subject of the window mode switching method (e.g., a head mounted display device) may select a window mode that satisfies a preset window mode condition from the at least one window mode as the window mode to be switched. The preset window mode condition may be the window mode with the largest area displayed in the head mounted display device among the at least one window mode.

[0067] Step 3012: In response to determining that the window mode switching operation is a virtual ray switching operation, determining the window mode selected by the target user from at least one window mode as the window mode to be switched.

[0068] In some embodiments, in response to determining that the window mode switching operation is a virtual ray switching operation, the execution subject may determine the window mode selected by the target user from the at least one window mode as the window mode to be switched. The window mode selected by the target user from the at least one window mode may be a window mode selected by the target user in a virtual ray manner.

[0069] Step 302: Perform switching processing on the window mode to be switched according to the window mode switching request information represented by the window mode switching operation.

[0070] In some embodiments, the specific implementation of step 302 and the technical effects brought about can be referred to Figure 2 The corresponding step 202 in the embodiments will not be described in detail here.

[0071] from Figure 3 It can be seen that Figure 2 Compared with the description of some corresponding embodiments, Figure 3The process 300 of the window mode switching method in some corresponding embodiments reflects the switching of window modes by different switching methods. The window mode can be switched not only by finger sliding method, but also by virtual ray switching operation method, so as to improve the user experience, reduce the limitation of switching the window mode by zooming in and out in AR scene, reduce the limitation of switching the window mode, so as to further improve the user experience, and select the window mode with the largest display area from various window modes displayed by the head-mounted display device as the window mode to be switched, so as to improve the user's operation and the accuracy of the window mode displayed in the head-mounted display device, so as to facilitate the user to switch the window mode to be switched, so as to improve the user experience.

[0072] Reference below Figure 4 , which shows a schematic diagram of the hardware structure of a head-mounted display device 400 with display function.

[0073] As shown in FIG. 4 , the head mounted display device 400 includes a processing device (CPU) 401, a memory (ROM) 402, an input unit 403, and an output unit 404, wherein the processing device 401, the memory 402, the input unit 403, and the output unit 404 are connected to each other via a bus 405. Here, the method according to some embodiments of the present disclosure may be implemented as a computer program and stored in the memory 402. The processing device 401 in the head mounted display device 400 specifically implements the window mode switching function defined in the method of some embodiments of the present disclosure by calling the above-mentioned computer program stored in the memory 402. In some implementations, the input unit 403 may include devices such as a camera, a microphone, a gyroscope, an accelerometer, a magnetometer, and the like, and the output unit 404 may be a device such as a display screen that can be used to display content. The above-mentioned display screen may be a micro display screen. Therefore, when the processing device 401 calls the above-mentioned computer program to execute the window mode switching function, it may control the input unit 403 to obtain the user's gesture, voice, and other operation instructions, and control the output unit 404 to display the display content.

[0074] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0075] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0076] The computer-readable medium may be included in the head-mounted display device; or it may exist independently without being assembled into the head-mounted display device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the head-mounted display device, the head-mounted display device: in response to detecting the window mode switching operation of the target user, and at least one window mode exists in the field of view of the head-mounted display device, the window mode to be switched is determined according to the at least one window mode; according to the window mode switching request information represented by the window mode switching operation, the window mode to be switched is switched, wherein the window mode switching request information represents switching the window mode to be switched to the first window mode, the second window mode or the third window mode, and the window mode detail information of the first window mode, the second window mode and the third window mode are different.

[0077] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0078] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0079] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0080] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, the above-mentioned features are replaced with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to) and the technical solutions formed.

Claims

1. A window mode switching method, applied to a head mounted display device, comprising: In response to detecting a window mode switching operation of a target user, and at least one window mode exists in the field of view of the head mounted display device, determining a window mode to be switched according to the at least one window mode; The window mode to be switched is switched according to the window mode switching request information represented by the window mode switching operation, wherein the window mode switching request information represents switching the window mode to be switched to a first window mode, a second window mode or a third window mode, and the window mode detail information of the first window mode, the second window mode and the third window mode are different.

2. The method according to claim 1, wherein: The determining the window mode to be switched according to the at least one window mode includes: In response to determining that the window mode switching operation is a touch switching operation, a window mode that meets a preset window mode condition is selected from the at least one window mode as the window mode to be switched.

3. The method according to claim 1, wherein: The method further comprises: In response to determining that the window mode switching operation is a virtual ray switching operation, the window mode selected by the target user from the at least one window mode is determined as the window mode to be switched.

4. The method according to claim 1, wherein: The step of switching the window mode to be switched according to the window mode switching request information represented by the window mode switching operation comprises: Determining, according to the window mode switching request information, whether the window mode to be switched meets a preset window mode switching condition; In response to determining that the window mode to be switched meets the preset window mode switching condition, switching processing is performed on the window mode to be switched.

5. The method according to claim 1, wherein: The determining, according to the window mode switching request information, whether the window mode to be switched satisfies a preset window mode switching condition includes: In response to determining that the window mode switching operation is a touch switching operation and the window mode switching request information satisfies a preset large window switching condition, determining whether the window mode to be switched is the third window mode; In response to determining that the window mode to be switched is not the third window mode, it is determined that the window mode to be switched satisfies the preset window mode switching condition.

6. The method according to claim 4, wherein: The method further comprises: In response to determining that the window mode switching operation is a touch switching operation and the window mode switching request information satisfies a preset small window switching condition, determining whether the window mode to be switched is the first window mode; In response to determining that the window mode to be switched is not the first window mode, it is determined that the window mode to be switched satisfies the preset window mode switching condition.

7. The method according to claim 4, wherein: The method further comprises: In response to determining that the window mode switching operation is a virtual ray switching operation, determining whether the window mode selected by the target user is the same as the window mode to be switched; In response to determining that the window mode selected by the window mode switching operation is different from the window mode to be switched, determining that the window mode to be switched satisfies the preset window mode switching condition.

8. The method according to claim 1, wherein: The method further comprises: In response to determining that the window mode switching operation is a virtual ray switching operation, the window mode to be switched is switched to the window mode selected by the target user.

9. A head mounted display device, comprising: one or more processors; A storage device for storing one or more programs; A display screen for forming an image in front of the user's eyes; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 8.

10. A computer-readable storage medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images