Display method and head-mounted display device

Abstract

The invention discloses a display method and head-mounted display equipment, and belongs to the technical field of head-mounted display equipment, and the method comprises the steps: obtaining personalized visual feature parameters of a user; a target object containing characters is displayed in a display area, the display area comprises a first rendering area and a second rendering area, and the first rendering area and the second rendering area are divided based on the personalized visual feature parameters; the first rendering area comprises the characters, and the resolution ratio of the first rendering area is higher than that of the second rendering area.

Description

Technical Field

[0001] This application belongs to the field of head-mounted display technology, specifically relating to a display method and a head-mounted display device. Background Technology

[0002] In recent years, head-mounted displays have achieved large-scale application in fields such as gaming, education, healthcare, and industry due to their immersive experience. To balance the demands of high-resolution displays with the limitations of device computing resources, foveated rendering has become a core solution. This technology tracks the user's gaze, using high-resolution rendering for the central concave area near the user's gaze point to ensure the clarity of key information, while using low-resolution rendering for the peripheral areas to reduce computational load, thus achieving a balance between visual experience and device performance.

[0003] Currently, the implementation methods of foveated rendering technology are mainly divided into two categories: static foveated rendering technology and dynamic foveated rendering technology. Static foveated rendering technology fixes the high-resolution area at the center of the viewport, forming a rendering effect with a resolution gradient decreasing from the center to the periphery. Dynamic foveated rendering technology uses eye-tracking technology to capture the user's gaze direction in real time and dynamically adjusts the position of the high-resolution area to match the current foveated point.

[0004] However, both static and dynamic foveated rendering technologies suffer from a mismatch between rendering effects and individual perceptual abilities, resulting in blurred key details in images for some users and poor visual effects and experience. Summary of the Invention

[0005] The purpose of this application is to provide a display method and a head-mounted display device that can solve the technical problem of the mismatch between the rendering effect and the individual's perception ability in related technologies.

[0006] In a first aspect, embodiments of this application provide a display method, the method comprising:

[0007] Obtain the user's personalized visual feature parameters;

[0008] The target object containing characters is displayed in a display area, which includes a first rendering area and a second rendering area. The first rendering area and the second rendering area are divided based on the personalized visual feature parameters. The first rendering area contains the characters, and the resolution of the first rendering area is higher than that of the second rendering area.

[0009] Secondly, embodiments of this application provide a head-mounted display device, including:

[0010] The eye-tracking detection module is used to acquire the user's personalized visual feature parameters;

[0011] A display module is used to display a target object containing characters in the display area of ​​the head-mounted display device. The display area includes a first rendering area and a second rendering area, which are divided based on the personalized visual feature parameters. The first rendering area contains the characters, and the resolution of the first rendering area is higher than that of the second rendering area.

[0012] Thirdly, embodiments of this application provide a head-mounted display device, the head-mounted display device including a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein when the program or instructions are executed by the processor, the steps of the display method as described in the first aspect are implemented.

[0013] Fourthly, embodiments of this application provide a readable storage medium storing a program or instructions that, when executed by a processor, implement the steps of the display method as described in the first aspect.

[0014] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the steps of the display method as described in the first aspect.

[0015] In this embodiment, the head-mounted display device can acquire the user's personalized visual feature parameters; display a target object containing characters in the display area of ​​the head-mounted display device, the display area including a first rendering area and a second rendering area, the first rendering area and the second rendering area being divided based on the personalized visual feature parameters; the first rendering area contains the aforementioned characters, and the resolution of the first rendering area is higher than the resolution of the second rendering area.

[0016] As can be seen, compared with the design approach based on a general human eye model in related technologies, which does not consider the user's unique visual feature parameters, resulting in a mismatch between the rendering effect and the individual's perception ability, the embodiments of this application obtain the user's personalized visual feature parameters and accurately divide the high-resolution first rendering area and the low-resolution second rendering area to ensure that key information such as characters are always located in the area where the user's visual perception is clearest. This eliminates the problem of blurring, ghosting, or loss of detail caused by individual differences, which leads to a mismatch between the rendering effect and the individual's perception ability, thereby improving the visual effect of the displayed content and the user's visual comfort, immersion, and other visual experiences. Attached Figure Description

[0017] Figure 1A This is a visual field distribution map of the human right eye provided in an embodiment of this application;

[0018] Figure 1B This is a binocular visual field distribution map of the human eye provided in an embodiment of this application;

[0019] Figure 2A This is a distribution map of the clearly visible range in the vertical plane provided in the embodiments of this application;

[0020] Figure 2B This is a map showing the distribution of the clearly visible range within the horizontal plane provided in the embodiments of this application;

[0021] Figure 3 This is a flowchart of a display method provided in an embodiment of this application;

[0022] Figure 4A This is one of the example diagrams of the display area of ​​the head-mounted display device provided in the embodiments of this application;

[0023] Figure 4B This is a second example diagram of the display area of ​​the head-mounted display device provided in the embodiments of this application;

[0024] Figure 4C This is the third example diagram of the display area of ​​the head-mounted display device provided in the embodiments of this application;

[0025] Figure 4D This is the fourth example diagram of the display area of ​​the head-mounted display device provided in the embodiments of this application;

[0026] Figure 4E This is the fifth example diagram of the display area of ​​the head-mounted display device provided in the embodiments of this application;

[0027] Figure 5A This is a flowchart illustrating the process of determining the natural field of view as provided in the embodiments of this application;

[0028] Figure 5B This is an example diagram of the natural field of view provided in the embodiments of this application;

[0029] Figure 6 This is a flowchart of the process for determining the first gaze range provided in the embodiments of this application;

[0030] Figure 7 This is a flowchart illustrating the process of determining the second gaze range provided in the embodiments of this application;

[0031] Figure 8 This is a structural block diagram of a head-mounted display device provided in an embodiment of this application;

[0032] Figure 9 This is a schematic diagram of the structure of a head-mounted display device provided in an embodiment of this application;

[0033] Figure 10 This is a schematic diagram of the hardware structure of a head-mounted display device that implements an embodiment of this application. Detailed Implementation

[0034] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0035] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0036] In related technologies, both static and dynamic foveated rendering share a common drawback: for all users, the high-resolution rendering area is fixed (generally a circular area of ​​approximately ±30° from the viewport center), while each user's field of vision and clear viewing range for characters are not entirely the same. Individual differences result in varying field of vision and viewing ranges. For the human eye, from... Figure 1A The monocular visual field distribution diagram and Figure 1B The binocular visual field distribution diagram shows that the maximum horizontal visual field of a normal single eye can reach 160°, and the maximum horizontal visual field of both eyes can reach 200°. The horizontal overlap area between the two eyes is approximately 120°. This overlap area is not a regular shape, nor is it perfectly symmetrical around a central point; this is mainly due to various factors such as the distance between the eyes, the height of the brow bone, the thickness of the eyelids, and the height of the cheekbones. Therefore, the natural visual field distribution will be completely different for each individual. Furthermore, from... Figure 2A The diagram showing the distribution of the clearly visible field of vision in the vertical plane and Figure 2B The diagram showing the distribution of the clear gaze range visible to the human eye in the horizontal plane reveals that the range of human eye rotation, the optimal area for recognizing characters such as words, letters, and colors are all different. Combined with the previous diagram of the distribution of the natural field of vision, it can be seen that the natural field of vision and the clear gaze range will vary from person to person.

[0037] In related technologies, since foveated rendering technology uses a fixed high-resolution rendering area for all users, and this fixed high-resolution rendering area is designed based on a universal human eye model, it ignores the differences in natural field of vision and clear gaze range between individual users. Therefore, it is not suitable for all scenarios and all groups of people. This leads to a problem where some users may see blurry key details in the image due to the mismatch between the high-resolution rendering area and their actual optimal field of vision. This results in a poor visual effect and visual experience.

[0038] To address the aforementioned technical issues, this application provides a display method and a head-mounted display device that can perform differentiated rendering based on specific scenarios and the visual characteristics of each user, thereby improving the visual effects of the content displayed on the head-mounted display device and enhancing the user's visual comfort, immersion, and other visual experiences when viewing the content.

[0039] The display method provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0040] It should be noted that the display method provided in this application embodiment is applicable to head-mounted display devices. In practical applications, the head-mounted display device may include: virtual reality devices, mixed reality devices, augmented reality devices, etc., and this application embodiment does not limit it.

[0041] Figure 3 This is a flowchart of a display method provided in an embodiment of this application. The method is executed by a head-mounted display device, such as... Figure 3 As shown, the method may include the following steps: step 301 and step 302.

[0042] In step 301, the user's personalized visual feature parameters are obtained.

[0043] In this embodiment of the application, when a user is wearing a head-mounted display device, the user's personalized visual feature parameters can be obtained. These parameters are used to characterize the user's visual differences and provide a basis for differentiated rendering.

[0044] Considering that personalized visual feature parameters are used to characterize a user's visual perception ability and habits, reflecting the visual differences among users, and that different users have different visual perception abilities and habits, this application embodiment obtains the user's personalized visual feature parameters. This helps the head-mounted display device to perform personalized gaze point rendering for different users, enabling different users to obtain a clear and comfortable visual experience when viewing the content displayed on the head-mounted display device, reducing eye fatigue and discomfort. Furthermore, personalized visual feature parameters also help the head-mounted display device better understand the user's visual abilities and habits, thereby providing more user-friendly feedback and guidance in interaction design, improving the interaction effect and naturalness between the user and the head-mounted display device.

[0045] In some embodiments, the personalized visual feature parameters mentioned above may include at least one of the following: natural field of vision, a first gaze range in which the user can distinguish a first type of character, and a second gaze range in which the user can distinguish a second type of character; wherein the natural field of vision is greater than the first gaze range, the natural field of vision is greater than the second gaze range, and the second gaze range is greater than the first gaze range.

[0046] In this embodiment, the natural field of view is the maximum visual field that a user can observe naturally by moving their eyes while keeping their head fixed, such as a horizontal angle of 160° or a vertical angle of 130°. This range determines the boundary between the central field of view (requiring high resolution) and the peripheral field of view (which can have lower resolution) in the rendering strategy. For example, a 5° range from the center of the human eye's gaze point is the area requiring high definition; beyond this range, the definition decreases as the angle increases. By defining the natural field of view, head-mounted display devices can employ differentiated rendering strategies for different local areas within their display area, reducing computational load while ensuring a good visual experience.

[0047] In this embodiment, the first gaze range is the maximum gaze range that a user can distinguish for the first type of characters while keeping their head fixed, such as ±20° horizontally or ±15° vertically. This range corresponds to the area of ​​high sensitivity of the human eye to the first type of characters, and the edge sharpness, stroke integrity, and contrast of the first type of characters must be fully preserved. The head-mounted display device can lock this range using eye-tracking technology, using it as the core rendering area in the first type of character scene, optimizing the rendering accuracy of the first type of characters within this area, thereby ensuring the readability of the first type of characters.

[0048] In the embodiments of the present application, the second fixation range is the maximum fixation range within which the user can distinguish the second type of characters while keeping the head fixed, such as horizontal ±30°, vertical ±20°, etc. This range corresponds to the high-sensitivity area of the human eye for the second type of characters. The head-mounted display device can lock this range through eye tracking technology and use it as the core rendering area in the scenario of the second type of characters to optimize the rendering accuracy of the second type of characters within this area, thereby ensuring the readability of the second type of characters.

[0049] In the embodiments of the present application, by setting the hierarchical relationship of natural visual field range > second fixation range > first fixation range, and combining the visual characteristics of the head-mounted display device with the user behavior pattern, the user experience and device performance can be significantly improved.

[0050] In some embodiments, the first type of characters is the user's native language characters, and the second type of characters is non-native language characters.

[0051] Considering that the user's perception sensitivity to native language characters is significantly higher than that to non-native language characters, therefore, in the embodiments of the present application, the native language priority principle is adopted. By distinguishing native language characters from non-native language characters, the head-mounted display device can allocate a higher resolution to the core rendering area for the native language character scenario to ensure the readability of native language characters; for the non-native language scenario, the resolution can be appropriately reduced to balance performance and experience. For the user, native language characters are clearer and non-native language characters are smoother, reducing eye fatigue and achieving precise adaptation to the user's visual habits and enhancing the personalized rendering effect.

[0052] In some embodiments, the first type of characters is Chinese characters, and the second type of characters is English characters.

[0053] Considering that Chinese characters require higher clarity in terms of stroke complexity and structural symmetry to avoid ambiguity such as "未" and "末", while the letter forms of English characters are simple and have a higher tolerance for resolution, therefore, in the embodiments of the present application, the head-mounted display device can allocate a higher resolution to the core rendering area for the Chinese character scenario to ensure the readability of Chinese characters; for the English character scenario, the resolution can be appropriately reduced to balance performance and experience, achieving precise adaptation to the user's visual habits and enhancing the personalized rendering effect.

[0054] In the embodiments of the present application, considering that for Chinese characters and English characters, the user has their respective clear fixation ranges, the head-mounted display device can perform personalized display optimization for different types of characters, enabling the user to obtain a clear and comfortable visual experience when viewing Chinese and English images, reducing eye fatigue and discomfort.

[0055] As can be seen, in this embodiment of the application, considering the differences in the natural field of vision and the clear gaze range when viewing different types of characters among different users, by acquiring these personalized visual feature parameters, the head-mounted display device can adjust the rendering resolution of the displayed content according to the user's specific situation and the characteristics of the displayed content, ensuring that key information is always within the user's clear gaze range, thereby improving the efficiency and accuracy of the user's information acquisition.

[0056] In this embodiment, personalized visual feature parameters of the user can be generated in advance and stored locally on the head-mounted display device. When the user wears the head-mounted display device to view content, the personalized visual feature parameters of the user can be directly obtained from the local device, thereby improving the efficiency of personalized gaze point rendering.

[0057] In step 302, the target object containing the characters is displayed in the display area; wherein, the display area includes a first rendering area and a second rendering area, the first rendering area and the second rendering area are divided based on personalized visual feature parameters; the first rendering area contains the aforementioned characters, and the resolution of the first rendering area is higher than the resolution of the second rendering area.

[0058] In this embodiment of the application, in a head-mounted display device, the display area is the range of virtual visual space that a user can perceive through the device's optical system or screen, and it is the basis for rendering and presenting all content (including characters, images, 3D models, etc.).

[0059] In this embodiment, the target object refers to an entity containing characters or other visual elements that needs to be generated and visualized by a rendering engine within the display area of ​​the head-mounted display device. Target objects typically include the following categories: interactive character objects, readable character objects, and auxiliary character objects. Interactive character objects may include button labels, input box text, menu options, etc.; readable character objects may include e-book text, document paragraphs, code snippets, etc.; and auxiliary character objects may include system notifications, time displays, battery icons, etc.

[0060] In this embodiment, the first rendering area typically refers to the user's current gaze point and its adjacent area, usually corresponding to the clear gaze range of the fovea. The second rendering area refers to the area beyond the user's clear gaze range, typically the area surrounding the first rendering area.

[0061] In this embodiment, the first rendering area contains characters, and the resolution of the first rendering area is higher than that of the second rendering area. This achieves precise matching between the first rendering area and the user's actual visual gaze point area, adapting to the differences between individual users. High-resolution rendering is used for the first rendering area to ensure that key information such as characters is always located in the area where the user's visual perception is clearest. Low-resolution rendering is used for the second rendering area to reduce visual interference in the edge areas. This ensures that key details of the image seen by any group of people are clear, thereby significantly improving the visual effect of the displayed content and the user's visual comfort, immersion, and other visual experiences.

[0062] In some embodiments, to ensure a more layered display, the display area of ​​the head-mounted display device can be divided into three rendering areas with different resolutions: a first rendering area, a second rendering area, and a third rendering area. In this case, the display area of ​​the head-mounted display device may include not only the first and second rendering areas but also the third rendering area; wherein the third rendering area is a region surrounding the second rendering area and is adjacent to the second rendering area; the resolution of the second rendering area is higher than the resolution of the third rendering area.

[0063] In this embodiment of the application, by using different resolutions to render and display the first rendering area, the second rendering area, and the third rendering area, the displayed content can be made more layered and the visual effect of the displayed content can be improved while ensuring the clarity of the content displayed in the user's main viewing area.

[0064] As can be seen from the above embodiments, compared with the design method based on a general human eye model in related technologies, which does not consider the user's unique visual feature parameters, resulting in a mismatch between the rendering effect and individual perception ability, the embodiments of this application obtain the user's personalized visual feature parameters and accurately divide the high-resolution first rendering area and the low-resolution second rendering area. This ensures that key information such as characters is always located in the area where the user's visual perception is clearest, eliminating the problem of blurring, ghosting, or loss of detail caused by individual differences, which leads to a mismatch between the rendering effect and individual perception ability. This improves the visual effect of the displayed content and the user's visual comfort, immersion, and other visual experiences. In addition, through the above-mentioned differentiated rendering method, the resources of the head-mounted display device can be reasonably allocated, ensuring that the first rendering area receives more computing and graphics processing resources, thereby presenting a higher quality visual effect.

[0065] In some embodiments provided in this application, step 301 may include at least one of the following steps: sub-step 3011, sub-step 3012, sub-step 3013 and sub-step 3014.

[0066] In sub-step 3011, when the user is in a static gaze state and the gazed target is a first type of character, the natural field of vision and the first gaze range are obtained as the user's personalized visual feature parameters.

[0067] In this embodiment of the application, the static gaze state refers to the state in which the user's head and eyes remain relatively still while wearing the head-mounted display device, focusing on a specific object within the display area of ​​the head-mounted display device.

[0068] In this embodiment, since the natural field of vision is the maximum field of vision that a user can observe by naturally rotating their eyes while keeping their head fixed, and the first gaze range is the maximum gaze range that a user can distinguish the first type of characters while keeping their head fixed, using the natural field of vision and the first gaze range as personalized visual feature parameters for the user when the user is in a static gaze state and the target object being gazed at is the first type of characters can ensure that the key information of the first type of characters is always located in the area where the user's visual perception is clearest.

[0069] In sub-step 3012, when the user is in a static gaze state and the target object being gazed at is a second type of character, the natural field of vision and the second gaze range are obtained as the user's personalized visual feature parameters.

[0070] In this embodiment, since the natural field of vision is the maximum field of vision that a user can observe by naturally rotating their eyes while keeping their head fixed, and the second gaze range is the maximum gaze range that a user can distinguish the second type of characters while keeping their head fixed, using the natural field of vision and the second gaze range as personalized visual feature parameters for the user when the user is in a static gaze state and the target object of gaze is the second type of characters can ensure that the key information of the second type of characters is always located in the area where the user's visual perception is clearest.

[0071] In sub-step 3013, when the user is in a static gaze state and the gazed target object contains first-type characters and second-type characters, the natural field of view is obtained as the user's personalized visual feature parameter.

[0072] In this embodiment, since users have different visual perceptions of the first type of characters and the second type of characters, such as the different font structures and stroke complexities of the first type of characters and the second type of characters, users have different requirements for a clear gaze range when reading. The natural field of vision is the maximum field of vision that a user can observe by naturally rotating their eyes while keeping their head fixed. Therefore, when the user is in a static gaze state and the target object being gazed at contains the first type of characters and the second type of characters, using the natural field of vision as the user's personalized visual feature parameter can ensure that key information such as the first type of characters and the second type of characters is always located in the area where the user's visual perception is clearest.

[0073] In sub-step 3014, when the user is in a dynamic gaze state, the first gaze range is obtained as the user's personalized visual feature parameter.

[0074] In this embodiment of the application, dynamic gaze state refers to the state in which the user's head and eyes are in motion and the line of sight is constantly changing while wearing the head-mounted display device, so as to browse the content of different areas within the display area of ​​the head-mounted display device.

[0075] Considering that the user's visual focus and clear gaze range will change significantly under static and dynamic gaze states, in this embodiment of the application, the first gaze range is obtained under dynamic gaze state. This can take into account the user's visual characteristics when browsing dynamic content, so that the head-mounted display device can better adapt to the user's visual ability when processing dynamic scenes, thereby improving the visual effect and user experience in dynamic scenes.

[0076] As can be seen, in this embodiment, by obtaining accurate personalized visual feature parameters based on the user's gaze state and the content being gazed at, it is possible to ensure clear and sharp content display within the user's most focused gaze area. Whether statically reading first-type or second-type character content, or dynamically browsing scenes, users can obtain a clearer and more comfortable visual experience, reducing fatigue and discomfort caused by visual blurring or unclear images.

[0077] In some embodiments provided in this application, when the user is in a static gaze state and the target object of gaze is a first type of character, the user's personalized visual feature parameters may only include a first gaze range, a first rendering area is the area in the display area of ​​the head-mounted display device corresponding to the first gaze range, and a second rendering area is the area surrounding the first rendering area, adjacent to the first rendering area.

[0078] For example, if the first character is a Chinese character, and the user is in a static gaze state and the gaze target is a Chinese character, then... Figure 4AAs shown, the areas in the left and right display areas 41 of the head-mounted display device 40 that correspond to the first gaze range are designated as the first rendering areas, denoted as the main gaze area 1. The areas in the display areas 41 other than the main gaze area 1 are designated as the second rendering areas. Figure 4A As can be seen, the second rendering area is located outside the main viewing area 1 and adjacent to the main viewing area 1. The resolution of the main viewing area 1 is greater than the resolution of the second rendering area, thus generating different resolution ranges.

[0079] As can be seen, in this embodiment, the display area of ​​the head-mounted display device can be divided into two rendering areas according to the user's first gaze range. The first rendering area precisely corresponds to the first gaze range, ensuring that the first type of characters that the user is most concerned about and needs to clearly identify are presented with the highest quality. For example, the stroke details and color saturation of the first type of characters can be rendered optimally, bringing the user a clear and realistic visual experience and improving the comfort of reading and interaction. The second rendering area is the area surrounding the first rendering area, which uses a lower resolution. This reduces the resource investment in areas that the user is not concerned about, and avoids the user's attention being distracted by unimportant details, thereby effectively reducing visual fatigue and allowing the user to use the head-mounted display device for a longer period of time and more comfortably.

[0080] In some embodiments provided in this application, when the user is in a static gaze state and the target object being gazed at is a first type of character, the user's personalized visual feature parameters may include a natural field of view and a first gaze range. The first rendering area is the area in the display area of ​​the head-mounted display device that corresponds to the first gaze range, and the second rendering area is the area surrounding the first rendering area, which is adjacent to the first rendering area.

[0081] Specifically, the display area of ​​the head-mounted display device may include a first rendering area, a second rendering area, and a third rendering area; wherein, the first rendering area is the area in the display area of ​​the head-mounted display device that corresponds to the first gaze range, the second rendering area is the area in the display area of ​​the head-mounted display device that corresponds to the range between the boundary of the first gaze range and the boundary of the natural field of vision, and the third rendering area is the remaining area in the display area of ​​the head-mounted display device other than the first and second rendering areas.

[0082] For example, if the first character is a Chinese character, and the user is in a static gaze state and the gaze target is a Chinese character, then... Figure 4B As shown, the areas in the left and right display areas 41 of the head-mounted display device 40 that correspond to the first gaze range are designated as the first rendering area, denoted as the main gaze area 1; the area surrounding the main gaze area 1 is designated as the second rendering area, denoted as the main gaze area 2; and the area in the display area 41 other than the main gaze area 1 and the main gaze area 2 is designated as the third rendering area. Figure 4B As can be seen, the third rendering area is located outside the main viewing area 2 and adjacent to the main viewing area 2. The resolution of the main viewing area 1 is greater than the resolution of the main viewing area 2, which is greater than the resolution of the third rendering area, thus generating different resolution ranges.

[0083] As can be seen, in this embodiment, the display area of ​​the head-mounted display device can be divided into three rendering areas based on the user's first gaze range and natural field of vision. The first rendering area precisely corresponds to the first gaze range, ensuring that the first type of characters that the user is most concerned about and needs to clearly identify are presented with the highest quality. For example, the stroke details and color saturation of the first type of characters can be rendered optimally, bringing the user a clear and realistic visual experience and improving the comfort of reading and interaction. The second rendering area corresponds to the gaze range between the boundary of the first gaze range and the boundary of the natural field of vision, and adopts a medium resolution. This ensures that the user has a certain degree of recognition of the surrounding content within the natural field of vision, while avoiding the waste of resources and potential visual interference caused by over-rendering. The third rendering area adopts a lower resolution, reducing the resource investment in areas that the user is not concerned about, and preventing the user's attention from being distracted by unimportant details, thereby effectively reducing visual fatigue and allowing the user to use the head-mounted display device for a longer period of time and more comfortably. Furthermore, through this meticulous division of rendering areas and resolution settings, the content of the entire display area presents a natural sense of hierarchy. The clarity of the first rendering area, the transition of the second rendering area, and the simplicity of the third rendering area together create a realistic virtual environment, making it easier for users to immerse themselves in it and enhancing the sense of immersion and engagement when using head-mounted display devices.

[0084] In some embodiments provided in this application, when the user is in a static gaze state and the target object of the gaze is a second type of character, the user's personalized visual feature parameters may only include the second gaze range.

[0085] For example, if the second character is an English character, and the user is in a static gaze state and the target object of the gaze is an English character, such as Figure 4C As shown, the areas in the left and right display areas 41 of the head-mounted display device 40 that correspond to the second gaze range are designated as the first rendering area, denoted as the main gaze area 3. The areas in the display area 41 other than the main gaze area 3 are designated as the second rendering area. Figure 4C As can be seen, the second rendering area is located outside the main viewing area 3 and adjacent to the main viewing area 3. The resolution of the main viewing area 3 is greater than the resolution of the second rendering area, thus generating different resolution ranges.

[0086] As can be seen, in this embodiment, the display area of ​​the head-mounted display device can be divided into two rendering areas according to the user's second gaze range. The first rendering area precisely corresponds to the second gaze range, ensuring that the second type of characters that the user is most concerned about and needs to clearly identify are presented with the highest quality. For example, the character structure, spacing, and layout of the second type of characters can be rendered optimally, bringing the user a clear and realistic visual experience and improving the comfort of reading and interaction. The second rendering area is the area surrounding the first rendering area, using a lower resolution to reduce resource investment in areas that the user does not pay attention to, avoiding the user's attention being distracted by unimportant details, thereby effectively reducing visual fatigue and allowing the user to use the head-mounted display device for a longer period of time and more comfortably.

[0087] In some embodiments provided in this application, when the user is in a static gaze state and the target object being gazed at is a second type of character, the personalized visual feature parameters include the natural field of view and the second gaze range. The first rendering area is the area in the display area of ​​the head-mounted display device that corresponds to the second gaze range, and the second rendering area is the area surrounding the first rendering area. The second rendering area is adjacent to the first rendering area.

[0088] Specifically, the display area of ​​the head-mounted display device may include a first rendering area, a second rendering area, and a third rendering area; wherein, the first rendering area is the area in the display area of ​​the head-mounted display device that corresponds to the second gaze range, the second rendering area is the area in the display area of ​​the head-mounted display device that corresponds to the range between the boundary of the second gaze range and the boundary of the natural field of vision, and the third rendering area is the remaining area in the display area of ​​the head-mounted display device other than the first and second rendering areas.

[0089] For example, if the second character is an English character, and the user is in a static gaze state and the target object of the gaze is an English character, such as Figure 4D As shown, the area corresponding to the second gaze range in the left and right display areas 41 of the head-mounted display device 40 is the first rendering area, denoted as the main gaze area 3; the area surrounding the main gaze area 3 is the second rendering area, denoted as the main gaze area 2; and the area in the display area 41 other than the main gaze area 3 and the main gaze area 2 is the third rendering area. Figure 4D As can be seen, the third rendering area is located outside the main viewing area 2 and adjacent to the main viewing area 2. The resolution of the main viewing area 3 is greater than the resolution of the main viewing area 2, which is greater than the resolution of the third rendering area, thus generating different resolution ranges.

[0090] As can be seen, in this embodiment, the display area of ​​the head-mounted display device can be divided into three rendering areas based on the user's second gaze range and natural field of vision. The first rendering area precisely corresponds to the second gaze range, ensuring that the second type of characters, which the user is most concerned with and needs to clearly identify, are presented with the highest quality. For example, the character structure, spacing, and layout of the second type of characters can be rendered optimally, bringing the user a clear and realistic visual experience and improving the comfort of reading and interaction. The second rendering area corresponds to the gaze range between the boundary of the second gaze range and the boundary of the natural field of vision, and adopts a medium resolution. This ensures that the user has a certain degree of recognition of surrounding content within the natural field of vision, while avoiding resource waste and potential visual interference caused by over-rendering. The third rendering area adopts a lower resolution, reducing resource investment in areas that the user does not pay attention to, and preventing the user's attention from being distracted by unimportant details, thereby effectively reducing visual fatigue and allowing the user to use the head-mounted display device for a longer period of time and more comfortably. Furthermore, through this meticulous division of rendering areas and resolution settings, the content of the entire display area presents a natural sense of hierarchy. The clarity of the first rendering area, the transition of the second rendering area, and the simplicity of the third rendering area together create a realistic virtual environment, making it easier for users to immerse themselves in it and enhancing the sense of immersion and engagement when using head-mounted display devices.

[0091] In some embodiments provided in this application, when the user is in a static gaze state and the gazed target object contains a first type of character and a second type of character, the personalized visual feature parameters include the natural field of view, the first rendering area is the area in the display area of ​​the head-mounted display device that corresponds to the natural field of view, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

[0092] For example, the first type of characters are Chinese characters, and the second type of characters are English characters. When the user is in a static gaze state and the gazed target object contains both Chinese and English characters, such as... Figure 4E As shown, the areas in the left and right display areas 41 of the head-mounted display device 40 that correspond to the natural field of vision are the first rendering areas, denoted as the main gaze area 2. The areas in the display areas 41 other than the main gaze area 2 are the second rendering areas. Figure 4E As can be seen, the second rendering area is located outside the main viewing area 2 and adjacent to the main viewing area 2. The resolution of the main viewing area 2 is greater than the resolution of the second rendering area, thus generating different resolution ranges.

[0093] As can be seen, in this embodiment, the area corresponding to the natural field of vision in the display area of ​​the head-mounted display device is defined as the first rendering area. This conforms to the natural visual habits of humans in a static gaze state. In a content screen with a mixture of first and second types of characters, the user can directly see the aforementioned mixed character content within the natural field of vision without deliberately adjusting their gaze. This content is presented at a high resolution, ensuring that the user can quickly and accurately obtain key information, improving the smoothness and comfort of reading and interaction. The second rendering area uses a relatively low resolution, reducing the display of details in areas that the user does not pay attention to, avoiding excessive interference from irrelevant information on the user's vision, and allowing the user to focus more on the content of the first rendering area. In particular, in scenarios with mixed Chinese and English characters, users may need to pay attention to both Chinese and English information simultaneously. The high-quality presentation of the first rendering area makes the structure of Chinese characters, the strokes of English letters, and the layout of mixed Chinese and English characters clearly distinguishable, helping users quickly locate and understand important information and improving the efficiency of information acquisition.

[0094] In some embodiments provided in this application, when the user is in a dynamic gaze state, the personalized visual feature parameters include a first gaze range, a first rendering area which is the area in the display area of ​​the head-mounted display device that corresponds to the first gaze range, and a second rendering area which is the area surrounding the first rendering area and is adjacent to the first rendering area.

[0095] For example, when the user is in a dynamic gaze state, such as Figure 4A As shown, the areas in the left and right display areas 41 of the head-mounted display device 40 that correspond to the first gaze range are designated as the first rendering areas, denoted as the main gaze area 1. The areas in the display areas 41 other than the main gaze area 1 are designated as the second rendering areas. Figure 4A As can be seen, the second rendering area is located outside the main viewing area 1 and adjacent to the main viewing area 1. The resolution of the main viewing area 1 is greater than the resolution of the second rendering area, thus generating different resolution ranges.

[0096] As can be seen, in this embodiment, when a user is in a dynamic gaze state, their gaze moves quickly and frequently within the display area of ​​the head-mounted display device. The area within the display area of ​​the head-mounted display device corresponding to the first gaze range is defined as the first rendering area. This area closely follows the user's gaze focus, ensuring that the content in this area is presented in high quality regardless of where the user's gaze falls during dynamic browsing. The second rendering area uses a relatively low resolution, reducing the rendering of details in areas the user doesn't focus on, avoiding the visual burden caused by frequent switching between different rendering areas, and reducing visual fatigue. Because the first rendering area focuses on the area the user is currently focusing on, the head-mounted display device can render the content in that area more quickly to respond to changes in the user's dynamic gaze. This makes interactive operations more sensitive; when the user performs clicks, swipes, selections, etc., they can immediately see the corresponding feedback effects, enhancing the immediacy and fun of the interaction and improving user satisfaction with the device.

[0097] In summary, in this embodiment of the application, a personalized primary gaze area can be formed based on the user's individual eye movement range and the character type of the current gaze object. Then, the resolution rendering is performed based on the primary gaze area to maximize the adaptation to the user's own eye characteristics and achieve differentiated rendering.

[0098] In some embodiments provided in this application, such as Figure 5A As shown, the user's natural field of vision can be determined through the following steps: steps 501, 502, 503, and 504.

[0099] In step 501, a first gray background test interface is displayed in the display area; wherein, the first gray background test interface includes a gray background image.

[0100] In this embodiment, the gray background image has neutral and non-distracting visual characteristics, providing a stable and interference-free basic environment for subsequent eye movement and image acquisition. Thus, when the user moves their eyes, they are not affected by complex colors or patterns on the interface, and the natural range of eye movement is more accurately reflected.

[0101] In this embodiment of the application, in addition to the gray background image, the first gray background test interface may also include some simple guiding signs or prompts, such as a fixed small dot in the center of the interface, to help users better understand the starting point and direction of eye movement. However, these signs should not be too prominent so as not to affect the determination of the natural field of vision.

[0102] In step 502, the user is guided to perform an eye-rolling operation; wherein the eye-rolling operation includes multiple clockwise eye-rolling operations and / or multiple counterclockwise eye-rolling operations.

[0103] In some embodiments of this application, the eye-rolling operation includes at least one of N clockwise eye-rolling operations and N counterclockwise eye-rolling operations, where N is an integer greater than 1. The design of multiple clockwise and multiple counterclockwise eye-rolling operations is to comprehensively acquire information about the user's visual field range under different rotation directions. Since there may be subtle differences in muscle movement and visual field coverage of the human eye in different rotation directions, multiple rotations can more accurately determine the natural visual field range.

[0104] In this embodiment, the value of N can be determined based on experimental and research needs. Generally, a larger N value results in richer data, but it also increases the user's workload and testing time. Typically, N can be set to 10, which ensures data reliability without causing excessive user fatigue.

[0105] In this embodiment of the application, when guiding the user to perform eye-rolling operations, various methods such as voice prompts, text prompts, or animation demonstrations can be used.

[0106] For example, the system can provide a voice prompt to the user, "Next, there will be two steps to determine the natural range of your eye movement. First, rotate your eyeballs clockwise 10 times, and then rotate them counterclockwise 10 times. Please rotate your eyes naturally during the process; there is no need to deliberately look at the edge areas." At the same time, an arrow animation of clockwise or counterclockwise rotation can be displayed on the interface to help the user better understand the operation requirements.

[0107] For example, before displaying the first gray-background test interface, the text instruction "The following two steps will determine the natural range of your eye movement. First, rotate your eyeballs clockwise 10 times, and then rotate them counterclockwise 10 times. Please rotate your eyes naturally during the process; there is no need to deliberately look at the edge areas." After displaying the first gray-background test interface, the voice prompt to the user "Begin slowly rotating your eyeballs clockwise 10 times." After rotating their eyeballs clockwise 10 times, the user can be allowed to close their eyes and rest for a few minutes, after which the voice prompt to the user again reads: "Begin slowly rotating your eyeballs counterclockwise 10 times."

[0108] In step 503, during the user's eye movement, eye images of the user are acquired at preset time intervals to obtain a first set of eye images.

[0109] In this embodiment, images of the user's eyeballs are acquired at preset time intervals. The selection of the time interval needs to comprehensively consider the speed and frequency of eyeball movement. If the time interval is too long, some key eyeball position information may be missed; if the time interval is too short, it will increase the burden of data processing. Generally, the time interval can be set to 0.01 seconds.

[0110] In this embodiment, the camera of the head-mounted display device has high resolution and frame rate to ensure that it can clearly capture subtle movements and positional changes of the eyeballs. Simultaneously, the camera's focus and exposure parameters can be reasonably set to ensure that high-quality eye images are acquired under different lighting conditions.

[0111] In this embodiment, to reduce the impact of ambient light and other interference factors on image acquisition, the environment around the camera can be shaded during eye image acquisition. Furthermore, the acquired images can be preprocessed in real time, such as removing noise and adjusting contrast, to improve the accuracy of subsequent image analysis.

[0112] In step 504, the user's natural field of vision is determined based on the first set of eye images.

[0113] In this embodiment, by analyzing a set of first eyeball images, image processing and computer vision algorithms are used to track the position of the eyeball in different images. For example, a feature point detection method can be used to identify feature points such as the pupil and iris of the eyeball, and the rotation angle and visual field range of the eyeball are determined based on the positional changes of these feature points. Then, based on the positional information of the eyeball in different rotation directions, the trajectory of the eyeball rotation is drawn, thereby determining the boundary of the natural visual field range. Figure 5B As shown in the figure, the area formed by the broken lines represents the user's natural field of vision.

[0114] In this embodiment, to ensure the accuracy of the determined natural field of view, multiple repeated tests can be conducted, and the differences between different test results can be compared. If the differences are significant, it may be necessary to reanalyze the image data or adjust the testing method. Furthermore, after the test is completed, users can be asked about their experience during the test and their perception of the field of view. Based on user feedback, the determined natural field of view can be further optimized and adjusted.

[0115] As can be seen, in this embodiment, the gray-background test interface constructed with a gray background image can effectively shield against interference from complex factors, creating a stable testing environment and providing conditions for accurately determining the visual field range. By guiding the user to perform multiple clockwise and counterclockwise eye rotations, visual field range information can be comprehensively collected from different rotation directions, ensuring the completeness of information acquisition. Furthermore, collecting eye images at preset time intervals can meticulously and clearly record the entire eye rotation process, accurately capturing the dynamic changes of the eye at every moment, providing high-precision data support for determining the visual field range. Finally, based on the collected set of eye images, the user's natural visual field range is accurately determined.

[0116] In some embodiments provided in this application, step 504 may specifically include the following steps: sub-step 5041, sub-step 5042, sub-step 5043 and sub-step 5044.

[0117] In sub-step 5041, eye features are extracted from each eye image in the first set of eye images.

[0118] In this embodiment, each eye image in the first eye image set can be preprocessed, including noise reduction, contrast enhancement, and other operations, to improve image quality and reduce the interference of noise and uneven lighting on feature extraction.

[0119] Subsequently, image processing algorithms and computer vision techniques, such as convolutional neural network (CNN) models based on deep learning, are used to extract key eye features from the preprocessed eye images. These eye features include, but are not limited to, pupil features, iris features, and corneal reflector features. Pupil features include, but are not limited to, the center coordinates, diameter, and shape of the pupil. The pupil center coordinates are crucial for determining the fixation point, while the diameter and shape can help determine the eye's state and lighting conditions. Iris features include, but are not limited to, the texture, color distribution, and edge contours of the iris. Iris features are unique and stable, and can be used to identify different users while also providing some reference information for fixation point calculation. If corneal reflectors exist in the eye image (e.g., due to the reflection of camera light on the cornea), their location information is extracted. Corneal reflectors are closely related to the position of the light source and the eye, and can be used to assist in correcting and optimizing fixation point calculation.

[0120] In sub-step 5042, the position of each gaze point on the display area of ​​the head-mounted display device is determined based on the eye features of each eye image.

[0121] In this embodiment, a simplified eyeball model can be established in advance based on the physiological structure and geometric relationship of the eyeball. This model is usually based on the center of the eyeball as the origin and takes into account the influence of the rotation angle of the eyeball and the change in the pupil position on the gaze direction.

[0122] Subsequently, using information such as the pupil center coordinates from the eye features of each eye image, combined with an eye model, specific fixation point calculation algorithms, such as the pupil-corneal reflection method and deep learning-based fixation point estimation methods, are employed to determine the position coordinates of the fixation point corresponding to each eye image within the display area. For example, the pupil-corneal reflection method calculates the vector relationship between the pupil center and the corneal reflection point, and, combined with camera parameters and display area position information, converts the eye rotation angle into two-dimensional coordinates within the display area.

[0123] Furthermore, considering that the calculated gaze point position may be deviated due to individual differences, equipment errors, and other factors in practical applications, a calibration operation is required. This involves having the user gaze at a calibration point at a known location within the display area of ​​the head-mounted display device, and adjusting and optimizing the calculation algorithm and parameters based on the actual gaze situation reported by the user to improve the accuracy of the gaze point position.

[0124] Finally, the set of position coordinates of the gaze point corresponding to each eye image in the first eye image set within the display area of ​​the head-mounted display device is obtained. This is usually represented in the form of two-dimensional coordinates (x, y), where x and y represent the position of the gaze point in the horizontal and vertical directions, respectively.

[0125] In sub-step 5043, angular coordinate mapping is performed on each fixation point position, the average position of the fixation point in each angular direction is calculated, and a 360° field of view distribution map is generated.

[0126] In this embodiment, a polar coordinate system is first established with the center of the user's head as the origin. The coordinates (x, y) of each gaze point within the display area of ​​the head-mounted display device are converted into polar coordinates (r, θ), where r is the distance from the gaze point to the origin, and θ is the angle between the gaze point and the polar axis (usually set as the horizontal center line of the display area). The angle θ ranges from 0° to 360°, thus realizing the mapping from two-dimensional coordinates to angular coordinates.

[0127] Next, the 360° range is grouped according to certain angular intervals (such as 5°, 10°, etc.), and the number and location information of all fixation points within each angular group are counted. For each angular group, the average position coordinates of all fixation points within that group are calculated, that is, the average value of r among all polar coordinates (r, θ) within the same angular group is taken to obtain the average fixation distance and angle in that angular direction.

[0128] Next, based on the calculated average gaze position information in each angle direction, a 360° field of vision distribution map is drawn. This map can be displayed in the form of a polar coordinate graph, with the angle as the horizontal axis and the average gaze distance as the vertical axis. Different colors or line thicknesses are used to intuitively represent the user's visual attention and field of vision in each angle direction.

[0129] Finally, a 360° field of view distribution map is generated, which is stored in the form of an image file or data structure, clearly showing the distribution of the user's field of view in different angles and directions.

[0130] In sub-step 5044, the user's natural field of vision is determined based on the field of vision distribution map.

[0131] In this embodiment, a suitable visual field threshold can be set according to actual application needs and research objectives. This threshold can be determined based on the distribution density of fixation points, the average fixation distance, or other relevant indicators. For example, a fixation point distribution density threshold can be set. When the fixation point distribution density in a certain angular direction exceeds this threshold, that angular direction is considered to be within the user's natural visual field.

[0132] In this embodiment, a set threshold is first used to search for boundary angles that meet the criteria in the visual field distribution map. Starting from 0°, the index in each angular direction is checked step by step in a clockwise or counterclockwise direction to see if it exceeds the threshold. The first angle that exceeds the threshold is recorded as the starting boundary angle of the natural visual field range. This process continues until the last angle that exceeds the threshold is found, which is then taken as the ending boundary angle. In this way, the boundary angles of the user's natural visual field range in the horizontal direction are determined. If a more comprehensive determination of the user's natural visual field range is required, a similar analysis can be performed in the vertical direction. By analyzing the distribution of fixation points in the vertical direction of the visual field distribution map, the boundary angles of the user's natural visual field range in the vertical direction are determined.

[0133] Next, by combining the boundary angle information in the horizontal and vertical directions, the user's natural field of vision is determined, typically expressed as an angular range (e.g., [α,β] in the horizontal direction, [γ,δ] in the vertical direction). To ensure the accuracy of the determined natural field of vision, a verification process can be performed, such as having the user perform an eye movement test again, comparing the new test results with the previously determined natural field of vision, and adjusting the threshold and boundary determination method appropriately based on the verification results.

[0134] Ultimately, the user's natural field of vision is determined and presented in the form of a clear angular range or a visual chart, providing accurate user field of vision information for subsequent related applications.

[0135] As can be seen, in this embodiment of the application, the specific location of the user's visual focus within the display area can be determined based on the user's eye characteristics. Based on the specific location of the user's visual focus within the display area, the 360° field of view distribution can be presented intuitively, clearly showing the angle and range of visual focus, thereby accurately determining the user's natural field of view.

[0136] In some embodiments provided in this application, such as Figure 6 As shown, the user's first gaze range can be determined by the following steps: steps 601, 602, 603 and 604.

[0137] In step 601, a second gray background test interface is displayed in the display area; wherein the second gray background test interface includes a gray background image and a plurality of first-class characters evenly distributed on the gray background image.

[0138] In this embodiment of the application, a standardized visual testing environment is provided for the user by displaying a second gray-background test interface within the display area of ​​the head-mounted display device, so as to accurately measure the user's clear gaze range when viewing the first type of characters, i.e., the first gaze range.

[0139] In this embodiment, the gray background image of the second gray background test interface is selected to reduce external light interference, provide a relatively neutral visual background, make the first type of characters stand out more, and facilitate user recognition.

[0140] In this embodiment, the first type of characters on the gray background image should have an appropriate font size, font, and color. For example, the first type of characters are Chinese characters with a font size of 16px to ensure good contrast and readability on the gray background. The content of the characters can be common first type characters, and their distribution should be uniform and cover a large area of ​​the display area of ​​the head-mounted display device to comprehensively test the user's clear gaze in different positions.

[0141] In step 602, the user is guided to perform an eye-rolling operation; wherein the eye-rolling operation includes multiple clockwise eye-rolling operations and / or multiple counterclockwise eye-rolling operations.

[0142] In some embodiments of this application, the eye-rolling operation includes at least one of N clockwise eye-rolling operations and N counterclockwise eye-rolling operations, where N is an integer greater than 1. By guiding the user to perform eye-rolling operations, the user's line of sight can cover different positions within the display area of ​​the head-mounted display device, thereby comprehensively detecting the user's clear gaze range in all directions.

[0143] In this embodiment of the application, the value of N can be set according to actual testing needs and accuracy requirements. For example, the value of N can be 10.

[0144] In this embodiment, users can be guided to rotate their eyes through voice prompts, text prompts, or animation demonstrations. For example, a voice prompt may be played saying, "Please rotate your eyes clockwise 10 times, pausing briefly after each rotation," while a corresponding animated arrow is displayed in the display area of ​​the head-mounted display device to indicate the direction of rotation. Furthermore, sufficient time should be given for the user to complete the eye rotation and maintain a stable gaze to accurately record the user's visual information.

[0145] In step 603, if a first confirmation input triggered by the user is received during the user's eye movement, the user's eye image is acquired to obtain a second set of eye images; wherein, the first confirmation input is triggered when the user moves their eyes to the point where they can distinguish the first type of characters.

[0146] In this embodiment of the application, during the process of the user moving their eyeballs, an eyeball image is collected when the user can clearly see the first type of characters, providing a data basis for subsequently determining the first gaze range.

[0147] In this embodiment, the system monitors in real time whether the user has triggered a first confirmation input while the user is moving their eyes. The first confirmation input is triggered whenever the user moves their eyes to a position where they can clearly see the first type of characters. This triggering method can be the user pressing a specific button (such as a button on the head-mounted display device's handle), issuing a specific voice command (such as "clear"), or through other preset interaction methods. Once the first confirmation input is received, the system immediately controls the head-mounted display device's camera to capture images of the user's eyes and stores these images to form a second set of eye images. The captured eye images contain sufficient information, such as pupil position and eye rotation angle, for subsequent analysis.

[0148] In step 604, the user's first gaze range is determined based on the second eye image set.

[0149] In this embodiment of the application, the user's first gaze range under the second gray background test interface can be determined by using specific algorithms and analysis methods based on the collected set of second eye images.

[0150] In this embodiment, each eye image in the second eye image set can be analyzed first to extract eye feature information, such as pupil center coordinates and eye rotation angle. By analyzing this feature information, the user's gaze direction and position when triggering the first confirmation input can be determined. Based on the extracted gaze direction and position information, combined with the distribution of the first type of characters within the display area of ​​the head-mounted display device, the first gaze range in which the user can clearly see the first type of characters in various directions can be calculated.

[0151] In practical applications, geometric or statistical methods can be used to calculate the boundary of the first gaze range. For example, a region within a certain angular range can be defined as the first gaze range, centered on the user's line of sight. The determined first gaze range can then be output visually, such as displaying the outline of a region covering the first gaze range within the display area of ​​the head-mounted display device, or providing parameters such as the angular range and area of ​​the first gaze range in the form of a data table.

[0152] In addition, in this embodiment, the implementation of each sub-step of step 504 above can also be used to determine the user's first gaze range, which will not be elaborated here.

[0153] In some embodiments provided in this application, such as Figure 7As shown, the user's second gaze range can be determined by the following steps: steps 701, 702, 703 and 704.

[0154] In step 701, a third gray background test interface is displayed in the display area; wherein, the third gray background test interface includes a gray background image and a plurality of second-type characters evenly distributed on the gray background image.

[0155] Because users have different sensitivity ranges for the second type of characters compared to the first type of characters—for example, the first type of characters are Chinese characters, while the second type of characters are English characters— Figure 2B As shown, the human eye can perceive English characters clearly within ±30°, while it can perceive Chinese characters within ±20°. Therefore, it is necessary to distinguish between them. Figure 6 In the illustrated embodiment, the first type of characters on the gray background image are replaced with the second type of characters.

[0156] In this embodiment of the application, a standardized visual testing environment is provided for the user by displaying a third gray-background test interface within the display area of ​​the head-mounted display device, so as to accurately measure the user's clear gaze range when viewing the second type of characters, i.e., the second gaze range.

[0157] In this embodiment, the gray background image of the third gray background test interface is selected to reduce external light interference, provide a relatively neutral visual background, make the second type of characters stand out more, and facilitate user recognition.

[0158] In step 702, the user is guided to perform an eye-rolling operation; wherein the eye-rolling operation includes multiple clockwise eye-rolling operations and / or multiple counterclockwise eye-rolling operations.

[0159] In some embodiments of this application, the eye-rolling operation includes at least one of N clockwise eye-rolling operations and N counterclockwise eye-rolling operations, where N is an integer greater than 1. By guiding the user to perform eye-rolling operations, the user's line of sight can cover different positions within the display area of ​​the head-mounted display device, thereby comprehensively detecting the user's clear gaze range in all directions.

[0160] In this embodiment of the application, the value of N can be set according to actual testing needs and accuracy requirements. For example, the value of N can be 10.

[0161] In this embodiment, users can be guided to rotate their eyes through voice prompts, text prompts, or animation demonstrations. For example, a voice prompt may be played saying, "Please rotate your eyes clockwise 10 times, pausing briefly after each rotation," while a corresponding animated arrow is displayed in the display area of ​​the head-mounted display device to indicate the direction of rotation. Furthermore, sufficient time should be given for the user to complete the eye rotation and maintain a stable gaze to accurately record the user's visual information.

[0162] In step 703, if a second confirmation input triggered by the user is received during the user's eye movement, the user's eye image is acquired to obtain a third set of eye images; wherein, the second confirmation input is triggered when the user moves their eyes to the point where they can distinguish the second type of characters.

[0163] In this embodiment of the application, during the process of the user moving their eyeballs, an eyeball image is collected when the user can clearly see the second type of characters, providing a data basis for subsequently determining the second gaze range.

[0164] In this embodiment, the system monitors in real time whether the user triggers a second confirmation input while the user moves their eyes. The second confirmation input is triggered whenever the user moves their eyes to a position where they can clearly see the second type of characters. This triggering method can be the user pressing a specific button (such as a button on the head-mounted display device's handle), issuing a specific voice command (such as "clear"), or through other preset interaction methods. Once the second confirmation input is received, the system immediately controls the head-mounted display device's camera to capture images of the user's eyes and stores these images to form a third set of eye images. The captured eye images contain sufficient information, such as pupil position and eye rotation angle, for subsequent analysis.

[0165] In step 704, the user's second gaze range is determined based on the third eye image set.

[0166] In this embodiment, the second gaze range of the user under the third gray background test interface can be determined based on the acquired set of third eye images using specific algorithms and analysis methods. The specific determination method is as follows... Figure 6 The content of step 604 in the illustrated embodiment is similar and will not be repeated here.

[0167] In this embodiment, a gray-background test interface containing a gray background image and evenly distributed characters is displayed within the display area of ​​the head-mounted display device. The gray background effectively reduces external light interference, creating a stable visual environment, while the evenly distributed characters serve as a clear visual stimulus, providing a standardized reference for determining the first or second fixation range, ensuring the accuracy and reliability of the test. The user is guided to perform multiple clockwise and counterclockwise eye movements. This multi-directional and multi-times rotation guidance fully covers the user's potential fixation area, comprehensively collecting visual information from different rotation directions. This avoids incomplete fixation range detection due to a single rotation direction or insufficient number of rotations, making the test results more representative. During the user's eye movement, when the user rotates to a position where the characters are clearly visible, a confirmation input is triggered to control the head-mounted display device's camera to capture eye images, forming an eye image set. This method of combining the user's subjective clear visual experience with objective image acquisition improves the accuracy and relevance of the data. Based on an eye image set, this study uses professional algorithms and analysis methods to determine the user's gaze range. It can comprehensively consider key information in the eye image, such as pupil position and gaze direction, and accurately delineate the gaze range in which the user can clearly see various characters. This provides an accurate and reliable basis for subsequent visual research and human-computer interaction optimization.

[0168] Figure 8 This is a structural block diagram of a head-mounted display device provided in an embodiment of this application, such as... Figure 8 As shown, the head-mounted display device 800 may include: an eye-tracking detection module 801 and a display module 802;

[0169] The eye-tracking detection module 801 is used to acquire the user's personalized visual feature parameters;

[0170] The display module 802 is used to display a target object containing characters in the display area of ​​the head-mounted display device. The display area includes a first rendering area and a second rendering area, which are divided based on the personalized visual feature parameters. The first rendering area contains the characters, and the resolution of the first rendering area is higher than that of the second rendering area.

[0171] As can be seen from the above embodiments, compared with the design method based on the general human eye model in related technologies, which does not consider the user's unique visual feature parameters, resulting in a mismatch between the rendering effect and the individual's perception ability, the embodiments of this application obtain the user's personalized visual feature parameters and accurately divide the high-resolution first rendering area and the low-resolution second rendering area to ensure that key information such as characters are always located in the area where the user's visual perception is clearest. This eliminates the problem of blurring, ghosting, or loss of detail caused by individual differences, which leads to a mismatch between the rendering effect and the individual's perception ability, thereby improving the visual effect of the displayed content and the user's visual comfort, immersion, and other visual experiences.

[0172] Optionally, as an embodiment, the personalized visual feature parameters include at least one of the following: a natural field of vision, a first gaze range that the user can distinguish a first type of character, and a second gaze range that the user can distinguish a second type of character; wherein, the natural field of vision is the maximum field of vision that the user can observe by naturally rotating their eyes while keeping their head fixed; the first gaze range is the maximum gaze range that the user can distinguish the first type of character while keeping their head fixed; the second gaze range is the maximum gaze range that the user can distinguish the second type of character while keeping their head fixed; the natural field of vision is greater than the first gaze range, the natural field of vision is greater than the second gaze range, and the second gaze range is greater than the first gaze range.

[0173] Optionally, as an embodiment, when the user is in a static gaze state and the target object being gazed at is a first type of character, the personalized visual feature parameters include the natural field of view and the first gaze range, the first rendering area is the area in the display area corresponding to the first gaze range, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

[0174] Optionally, as an embodiment, when the user is in a static gaze state and the target object being gazed at is a second type of character, the personalized visual feature parameters include the natural field of view and the second gaze range, the first rendering area is the area in the display area corresponding to the second gaze range, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

[0175] Optionally, as an embodiment, when the user is in a static gaze state and the gazed target includes the first type of characters and the second type of characters, the personalized visual feature parameters include the natural field of view, the first rendering area is the area in the display area corresponding to the natural field of view, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

[0176] Optionally, as an embodiment, when the user is in a dynamic gaze state, the personalized visual feature parameters include the first gaze range, the first rendering area is the area in the display area corresponding to the first gaze range, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

[0177] Optionally, as an embodiment, the first type of characters are the user's native language characters, and the second type of characters are non-native language characters; and / or, the first type of characters are Chinese characters, and the second type of characters are English characters.

[0178] Optionally, as an embodiment, the display module 802 is further configured to display a first gray background test interface in the display area; wherein the first gray background test interface includes a gray background image;

[0179] The eye movement detection module 801 is also used to guide the user to perform eye movement operations; wherein, the eye movement operations include multiple clockwise eye movement operations and / or multiple counterclockwise eye movement operations; during the user's eye movement, eye images of the user are acquired at preset time intervals to obtain a first set of eye images; and the user's natural field of vision is determined based on the first set of eye images.

[0180] Optionally, as an embodiment, the display module 802 is further configured to display a second gray background test interface in the display area; wherein the second gray background test interface includes a gray background image and a plurality of first-type characters evenly distributed on the gray background image;

[0181] The eye-tracking detection module 801 is further configured to guide the user to perform eye-rolling operations; wherein the eye-rolling operations include multiple clockwise eye-rolling operations and / or multiple counterclockwise eye-rolling operations; during the user's eye-rolling process, if a first confirmation input triggered by the user is received, the user's eye images are acquired to obtain a second set of eye images; wherein the first confirmation input is triggered when the user rolls their eyes to the point where they can distinguish the first type of characters; and the user's first gaze range is determined based on the second set of eye images.

[0182] The display device provided in this application embodiment can achieve... Figure 3 To avoid repetition, the various processes implemented in the method embodiment shown will not be described again here.

[0183] Optionally, such as Figure 9 As shown, this application embodiment also provides a head-mounted display device 900, including a processor 901, a memory 902, and a program or instructions stored in the memory 902 and executable on the processor 901. When the program or instructions are executed by the processor 901, they implement the various processes of the above-described display method embodiments and achieve the same technical effects. To avoid repetition, they will not be described again here.

[0184] Figure 10 This is a schematic diagram of the hardware structure of a head-mounted display device implementing an embodiment of this application. The head-mounted display device 1000 includes, but is not limited to, components such as: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010.

[0185] Those skilled in the art will understand that the head-mounted display device 1000 may also include a power supply (such as a battery) for powering various components. The power supply may be logically connected to the processor 1010 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 10 The head-mounted display device structure shown in the figure does not constitute a limitation on the head-mounted display device. The head-mounted display device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be described in detail here.

[0186] The processor 1010 is used to acquire the user's personalized visual feature parameters.

[0187] Display unit 1006 is used to display a target object containing characters in the display area. The display area includes a first rendering area and a second rendering area, which are divided based on the personalized visual feature parameters. The first rendering area contains the characters, and the resolution of the first rendering area is higher than that of the second rendering area.

[0188] Optionally, as an embodiment, the personalized visual feature parameters include at least one of the following: a natural field of vision, a first gaze range that the user can distinguish a first type of character, and a second gaze range that the user can distinguish a second type of character; wherein, the natural field of vision is the maximum field of vision that the user can observe by naturally rotating their eyes while keeping their head fixed; the first gaze range is the maximum gaze range that the user can distinguish the first type of character while keeping their head fixed; the second gaze range is the maximum gaze range that the user can distinguish the second type of character while keeping their head fixed; the natural field of vision is greater than the first gaze range, the natural field of vision is greater than the second gaze range, and the second gaze range is greater than the first gaze range.

[0189] Optionally, as an embodiment, when the user is in a static gaze state and the target object being gazed at is a first type of character, the personalized visual feature parameters include the natural field of view and the first gaze range, the first rendering area is the area in the display area corresponding to the first gaze range, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

[0190] Optionally, as an embodiment, when the user is in a static gaze state and the target object being gazed at is a second type of character, the personalized visual feature parameters include the natural field of view and the second gaze range, the first rendering area is the area in the display area corresponding to the second gaze range, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

[0191] Optionally, as an embodiment, when the user is in a static gaze state and the gazed target includes the first type of characters and the second type of characters, the personalized visual feature parameters include the natural field of view, the first rendering area is the area in the display area corresponding to the natural field of view, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

[0192] Optionally, as an embodiment, when the user is in a dynamic gaze state, the personalized visual feature parameters include the first gaze range, the first rendering area is the area in the display area corresponding to the first gaze range, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

[0193] Optionally, as an embodiment, the first type of characters are the user's native language characters, and the second type of characters are non-native language characters; and / or, the first type of characters are Chinese characters, and the second type of characters are English characters.

[0194] Optionally, as an embodiment, the display unit 1006 is further configured to display a first gray background test interface in the display area; wherein the first gray background test interface includes a gray background image.

[0195] The processor 1010 is also configured to guide the user to perform an eye-rolling operation; wherein the eye-rolling operation includes multiple clockwise eye-rolling operations and / or multiple counterclockwise eye-rolling operations; during the user's eye-rolling process, eye images of the user are acquired at preset time intervals to obtain a first set of eye images; and the user's natural field of vision is determined based on the first set of eye images.

[0196] Optionally, as an embodiment, the display unit 1006 is further configured to display a second gray background test interface in the display area; wherein the second gray background test interface includes a gray background image and a plurality of first-type characters evenly distributed on the gray background image;

[0197] The processor 1010 is further configured to guide the user to perform an eye-rolling operation; wherein the eye-rolling operation includes multiple clockwise eye-rolling operations and / or multiple counterclockwise eye-rolling operations; during the user's eye-rolling process, if a first confirmation input triggered by the user is received, the user's eye images are acquired to obtain a second set of eye images; wherein the first confirmation input is triggered when the user rolls their eyes to the point where they can distinguish the first type of characters; and the user's first gaze range is determined based on the second set of eye images.

[0198] It should be understood that, in this embodiment, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042. The GPU 10041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1006 may include a display panel 10061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, joysticks, etc., which will not be described in detail here. The memory 1009 can be used to store software programs and various data, including but not limited to applications and operating systems. Processor 1010 can integrate an application processor and a modem processor. The application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may also not be integrated into processor 1010.

[0199] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0200] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0201] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A display method, characterized in that, The method includes: Obtain the user's personalized visual feature parameters; Displaying a target object containing characters in a display area, the display area including a first rendering area and a second rendering area, the first rendering area and the second rendering area being divided based on the personalized visual feature parameters; The first rendering area contains the character, and the resolution of the first rendering area is higher than the resolution of the second rendering area.

2. The method according to claim 1, characterized in that, The personalized visual feature parameters include at least one of the following: natural field of vision, a first gaze range in which the user can distinguish first-class characters, and a second gaze range in which the user can distinguish second-class characters. The natural field of vision is the maximum field of vision that the user can observe by naturally rotating their eyes while keeping their head fixed. The first gaze range is the maximum gaze range that the user can distinguish the first type of characters while keeping their head fixed. The second gaze range is the maximum gaze range that the user can distinguish for the second type of characters while keeping their head fixed. The natural field of vision is greater than the first gaze range, the natural field of vision is greater than the second gaze range, and the second gaze range is greater than the first gaze range.

3. The method according to claim 2, characterized in that, When the user is in a static gaze state and the target object being gazed at is a first type of character, the personalized visual feature parameters include the natural field of view and the first gaze range, the first rendering area is the area in the display area corresponding to the first gaze range, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

4. The method according to claim 2, characterized in that, When the user is in a static gaze state and the target object being gazed at is a second type of character, the personalized visual feature parameters include the natural field of view and the second gaze range. The first rendering area is the area in the display area that corresponds to the second gaze range, and the second rendering area is the area surrounding the first rendering area. The second rendering area is adjacent to the first rendering area.

5. The method according to claim 2, characterized in that, When the user is in a static gaze state and the target object being gazed at includes the first type of characters and the second type of characters, the personalized visual feature parameters include the natural field of view, the first rendering area is the area in the display area corresponding to the natural field of view, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

6. The method according to claim 2, characterized in that, When the user is in a dynamic gaze state, the personalized visual feature parameters include the first gaze range, the first rendering area is the area in the display area corresponding to the first gaze range, the second rendering area is the area surrounding the first rendering area, and the second rendering area is adjacent to the first rendering area.

7. The method according to claim 2, characterized in that, The first type of characters are characters in the user's native language, and the second type of characters are characters in a non-native language; and / or, The first type of characters are Chinese characters, and the second type of characters are English characters.

8. The method according to claim 2, characterized in that, Before the step of obtaining the user's personalized visual feature parameters, the method further includes: A first gray-background test interface is displayed in the display area; wherein, the first gray-background test interface includes a gray background image; Guide the user to perform eye movement operations; wherein, the eye movement operations include multiple clockwise eye movement operations and / or multiple counterclockwise eye movement operations; During the user's eye movement, eye images of the user are acquired at preset time intervals to obtain a first set of eye images; The user's natural field of vision is determined based on the first set of eye images.

9. The method according to claim 2, characterized in that, Before the step of obtaining the user's personalized visual feature parameters, the method further includes: A second gray background test interface is displayed in the display area; wherein, the second gray background test interface includes a gray background image and a plurality of first-class characters evenly distributed on the gray background image; Guide the user to perform eye movement operations; wherein, the eye movement operations include multiple clockwise eye movement operations and / or multiple counterclockwise eye movement operations; During the process of the user moving their eyes, if a first confirmation input triggered by the user is received, then the user's eye image is acquired to obtain a second set of eye images; wherein, the first confirmation input is triggered when the user moves their eyes to the point where they can distinguish the first type of characters; The user's first gaze range is determined based on the second set of eye images.

10. A head-mounted display device, characterized in that, include: The eye-tracking detection module is used to acquire the user's personalized visual feature parameters; A display module is used to display a target object containing characters in the display area of ​​the head-mounted display device. The display area includes a first rendering area and a second rendering area, which are divided based on the personalized visual feature parameters. The first rendering area contains the character, and the resolution of the first rendering area is higher than the resolution of the second rendering area.

11. A head-mounted display device, characterized in that, The head-mounted display device includes a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the display method as described in any one of claims 1-9.

Images