AR / VR / MR glasses function interface proportion control method and device, medium and equipment

Abstract

The invention relates to an AR / VR / MR glasses function interface proportion control method and device, a medium and equipment, and the method comprises the steps: determining the visual angle range information of corresponding eye characteristics of a user, generating a preset initial proportion control interface in a corresponding display region according to the visual angle range information, and carrying out the control of the proportion of an AR / VR / MR glasses function interface from the initial proportion control interface, determining a display sequence of function icons corresponding to each set function in a sight line range corresponding to the visual angle range information, determining a first visual attention function icon corresponding to the visual attention point position information according to the display sequence, the function icons, the visual attention point position information and a target function icon, and determining a second visual attention function icon corresponding to the visual attention point position information based on the visual attention point position information. And determining a second visual attention function icon, generating a display proportion locking instruction to lock the display content and the display proportion of the corresponding visual attention function icon in the current preset initial proportion control interface, and generating a target proportion control interface. Therefore, the operation efficiency of the multifunctional operation interface is improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of smart glasses, and in particular, to a method, device, medium and equipment for controlling the proportion of functional interfaces of AR / VR / MR glasses. Background Art

[0002] The working principle of AR / VR / MR glasses is that the projection device in the glasses projects the image to be presented onto the lens on the side of the glasses facing the wearer's eyes, and uses the reflection function of the lens to reflect the above image light into the wearer's eyes, thereby forming an overlap of the real scene and the virtual image on the wearer's retina to achieve an augmented reality perception. Since the lenses of AR / VR / MR glasses are transparent, when the ratio between the light incident on the lens from the front of the wearer (incident light) and the light formed by the virtual image reflected by the lens (reflected light) is not coordinated, the virtual image presented to the wearer's eyes will become too dim or too bright relative to the real scene, affecting the wearer's perception. In addition, when wearing AR glasses for mechanical or other operations, it is also necessary to flexibly adjust the brightness relationship between the real scene and the virtual image on the lens according to the actual working conditions. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides a method for controlling the proportion of the functional interface of AR / VR / MR glasses.

[0004] According to a first aspect of an embodiment of the present disclosure, a method for controlling the proportion of an AR / VR / MR glasses functional interface is provided, which is applied to a wearable device, wherein the wearable device includes augmented reality AR glasses, virtual reality VR glasses, or mixed reality MR glasses, and the method includes: In response to the wearable device identifying the eye features of the user, determining the viewing angle range information of the user corresponding to the eye features, and generating a preset initial proportion control interface in the corresponding display area according to the viewing angle range information; According to the function display order of the wearable device, from the initial proportion control interface, determine the display order of the function icons corresponding to each set function within the visual range corresponding to the viewing angle range information, and display the target function icons in the preset initial proportion control interface one by one according to the display order and the function icons; Based on the wearable device, the user's eye features during the display process are identified, and the visual attention point information of the user within the viewing angle range is determined according to the user's eye features; according to the visual attention point information and the target function icon, a first visual attention function icon corresponding to the visual attention point information is determined, and the first visual attention function icon is enlarged and displayed in the preset initial proportion control interface; The position of the visual attention point information in the preset initial proportion control interface is monitored in real time, and in response to the point corresponding to the visual attention point information leaving the visual area corresponding to the first visual attention function icon in the preset initial proportion control interface, the first visual attention function icon is displayed in a reduced size in the preset initial proportion control interface, and based on the position of the visual attention point information in the preset initial proportion control interface, a second visual attention function icon is determined, and the second visual attention function icon is displayed in an enlarged size; When it is determined that the visual residence time of the user's eye features in the second visual attention function icon is greater than the set time threshold, a display ratio locking instruction is generated to lock the display content and display ratio of the corresponding visual attention function icon in the current preset initial ratio control interface, and a target ratio control interface is generated.

[0005] Optionally, the method further comprises: Acquire display position information of each visual attention function icon and target position information of the second visual attention function icon in the target proportion control interface; When it is determined that the visual position corresponding to the user's eye feature stays at the corresponding position of other visual attention function icons outside the target position information for a time greater than a set time threshold, a display ratio unlock instruction is generated. The display ratio unlock instruction is used to restore the display ratio of the visual attention function icons in the target ratio control interface to the set display ratio, and display subsequent function icons one by one according to the target function icons in the preset initial ratio control interface.

[0006] Optionally, determining, according to the visual attention point information and the target function icon, a first visual attention function icon corresponding to the visual attention point information includes: Determine the dwell time of the user's corresponding viewing angle on each target function icon according to the position of the target function icon in the initial proportion control interface and the visual attention point corresponding to the user's eye feature; If the dwell time is greater than the set time threshold, the user's corresponding pupil attention magnification image is determined based on the user's eye features. When the pupil attention magnification image matches the preset pupil focus image, the first visual attention function icon corresponding to the visual attention point information under the current preset initial proportion control interface is obtained.

[0007] Optionally, the method further comprises: Extracting pupil proportion features of the pupil attention magnification image based on a preset feature convolutional network to generate pupil proportion features corresponding to the pupil attention magnification image; Obtaining a set pupil ratio feature corresponding to the preset pupil focusing image; When the pupil ratio feature matches the set pupil ratio feature, generating a ratio enlargement locking instruction, the ratio enlargement locking instruction is used to enlarge the first visual attention function icon and lock the currently displayed preset initial proportion control interface; When the pupil ratio feature does not match the set pupil ratio feature, the target function icons of the preset initial proportion control interface are displayed one by one.

[0008] Optionally, the method further comprises: In response to displaying a target proportion control interface in a display area corresponding to the viewing angle range information, determining a plurality of function icons selected by a user in the target proportion control interface according to the user's eye characteristics; A target ratio interface is generated based on the multiple function icons and non-attention function icons. The target ratio interface is used to display the multiple function icons based on a preset display ratio and hide the non-attention function icons. The non-attention function icons are one or more function icons that are not selected.

[0009] Optionally, generating a target ratio interface according to the plurality of function icons and non-attention function icons includes: Determining the display ratio and display area of ​​the plurality of function icons in the target ratio interface; Acquire a target scene matching the plurality of function icons from the preset scene library; According to the target scene and the plurality of function icons, the target ratio interface is generated in the target scene based on the display ratio and the display area.

[0010] According to a second aspect of an embodiment of the present disclosure, a device for controlling the proportion of an AR / VR / MR glasses functional interface is provided, which is applied to a wearable device, wherein the wearable device includes augmented reality AR glasses, virtual reality glasses, or mixed reality glasses, and the method includes: A generating module, configured to determine, in response to the eye features of the user recognized by the wearable device, the viewing angle range information corresponding to the eye features of the user, and generate a preset initial proportion control interface in the corresponding display area according to the viewing angle range information; A display module is used to determine, from the initial proportion control interface, a display order of function icons corresponding to each set function within the visual range corresponding to the viewing angle range information according to the function display order of the wearable device, and display the target function icons in the preset initial proportion control interface one by one according to the display order and the function icons; A first determination module is used to identify the user's eye features during the display process based on the wearable device, determine the user's visual attention point information within the viewing angle range according to the user's eye features, determine the first visual attention function icon corresponding to the visual attention point information according to the visual attention point information and the target function icon, and enlarge and display the first visual attention function icon in the preset initial proportion control interface; A second determination module is used to monitor the position of the visual attention point information in the preset initial proportion control interface in real time, and in response to the point corresponding to the visual attention point information leaving the visual area corresponding to the first visual attention function icon in the preset initial proportion control interface, the first visual attention function icon is displayed in a reduced size in the preset initial proportion control interface, and based on the position of the visual attention point information in the preset initial proportion control interface, a second visual attention function icon is determined, and the second visual attention function icon is displayed in an enlarged size; The execution module is used to generate a display ratio locking instruction to lock the display content and display ratio of the corresponding visual attention function icon in the current preset initial ratio control interface when it is determined that the visual residence time of the user's eye features in the second visual attention function icon is greater than a set time threshold, and generate a target ratio control interface.

[0011] Optionally, the device further includes a determination module, wherein the determination module is configured to: Acquire display position information of each visual attention function icon and target position information of the second visual attention function icon in the target proportion control interface; When it is determined that the visual position corresponding to the user's eye feature stays at the corresponding position of other visual attention function icons outside the target position information for a time greater than a set time threshold, a display ratio unlock instruction is generated. The display ratio unlock instruction is used to restore the display ratio of the visual attention function icons in the target ratio control interface to the set display ratio, and display subsequent function icons one by one according to the target function icons in the preset initial ratio control interface.

[0012] According to a third aspect of an embodiment of the present disclosure, there is provided a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of any one of the methods described in the first aspect of the present disclosure are implemented.

[0013] According to a fourth aspect of an embodiment of the present disclosure, there is provided an electronic device, including: processor; a memory for storing processor-executable instructions; The processor is configured to execute executable instructions in the memory to implement any one of the methods described in the first aspect of the present disclosure.

[0014] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects: Through the above-mentioned method, in response to the wearable device identifying the user's eye features, determining the viewing angle range information of the user's corresponding eye features, and generating a preset initial proportion control interface in the corresponding display area according to the viewing angle range information; according to the function display order of the wearable device, determining the display order of the function icons corresponding to each set function in the visual range corresponding to the viewing angle range information from the initial proportion control interface, and displaying the target function icons in the preset initial proportion control interface one by one according to the display order and the function icons; based on the wearable device identifying the user's eye features during the display process, determining the user's visual attention point information within the viewing angle range according to the user's eye features, determining the first visual attention function icon corresponding to the visual attention point information according to the visual attention point information and the target function icon, and displaying the target function icon in the preset initial proportion control interface. In the preset initial proportion control interface, the first visual attention function icon is enlarged and displayed; the position of the visual attention point information in the preset initial proportion control interface is monitored in real time, and in response to the point corresponding to the visual attention point information leaving the visual area corresponding to the first visual attention function icon in the preset initial proportion control interface, the first visual attention function icon is reduced and displayed in the preset initial proportion control interface, and based on the position of the visual attention point information in the preset initial proportion control interface, the second visual attention function icon is determined and enlarged and displayed; when it is determined that the visual stay time of the user's eye feature in the second visual attention function icon is greater than the set time threshold, a display proportion locking instruction is generated to lock the display content and display ratio of the corresponding visual attention function icon in the current preset initial proportion control interface, and a target proportion control interface is generated. In this way, the display ratio of the wearable device can be adjusted based on the visual attention point to adapt to the visual control requirements of the wearable device and improve the operation efficiency of the multi-function operation interface.

[0015] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0017] Figure 1It is a flow chart of a method for controlling the proportion of AR / VR / MR glasses functional interfaces according to an exemplary embodiment.

[0018] Figure 2 It is a block diagram of a control device for a functional interface ratio of AR / VR / MR glasses according to an exemplary embodiment. DETAILED DESCRIPTION

[0019] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0020] It should be noted that all actions of acquiring signals, information or data in this application are carried out in compliance with the relevant data protection laws and policies of the country where they are located, and with the authorization given by the owner of the corresponding device.

[0021] Figure 1 is a flow chart of a method for controlling the proportion of functional interfaces of AR / VR / MR glasses according to an exemplary embodiment. Figure 1 As shown, the method includes: In step S11, in response to the display device starting the anti-peeping driving mode, the front camera device is used to determine whether there is an unauthorized user within the set viewing angle of the display device. If there is an unauthorized user, the head image features of the unauthorized user are obtained based on the front camera device.

[0022] For example, this embodiment is applied to a wearable device, wherein the wearable device may be smart glasses such as AR glasses, VR glasses or MR glasses, for realizing a virtual reality function. In this embodiment, the proportion of the display interface of the smart glasses during the display process is controlled. When the wearable device recognizes the eye features of the user, that is, when the wearable device is used by the user, the eye features of the corresponding eyes of the current user and the viewing angle range information are determined, and a preset initial proportion control interface is generated in the display area of ​​the corresponding smart glasses according to the viewing angle range.

[0023] In step S12, according to the function display order of the wearable device, the display order of the function icons corresponding to each set function within the line of sight corresponding to the viewing angle range information is determined from the initial proportion control interface, and according to the display order and the function icons, the target function icons in the preset initial proportion control interface are displayed one by one.

[0024] For example, in this embodiment, the function area display in the proportion control interface is displayed one by one in the function display order, so as to avoid too many function icons, which leads to an excessively large display area, and increase the operability of the function display. In this embodiment, the corresponding function display order can be set based on the number of clicks on the corresponding icon. From the initial proportion control interface, the display order of the function icons corresponding to each set function within the visual range corresponding to the viewing angle range information is determined, and according to the display order and the function icons, the target function icons in the preset initial proportion control interface are displayed one by one.

[0025] In step S13, the user's eye features during the display process are identified based on the wearable device, the user's visual attention point information within the viewing angle is determined according to the user's eye features, and the first visual attention function icon corresponding to the visual attention point information is determined according to the visual attention point information and the target function icon, and the first visual attention function icon is enlarged and displayed in the preset initial occupancy control interface.

[0026] For example, in this embodiment, after the wearable device recognizes the user's eye features, the viewing angle range of the eye features is monitored in real time, the user's eye features during the display process are recognized, and the user's visual attention point information within the viewing angle range is determined according to the user's eye features. According to the visual attention point information and the target function icon, the first visual attention function icon corresponding to the visual attention point information is determined, and the first visual attention function icon is enlarged and displayed in the preset initial proportion control interface. Different proportions of each display icon in the smart glasses are displayed through visual tracking, thereby realizing intelligent display control of the wearable device to ensure the control performance of the wearable device.

[0027] In step S14, the position of the visual attention point information in the preset initial proportion control interface is monitored in real time, and in response to the point corresponding to the visual attention point information leaving the visual area corresponding to the first visual attention function icon in the preset initial proportion control interface, the first visual attention function icon is displayed in a reduced size in the preset initial proportion control interface, and based on the position of the visual attention point information in the preset initial proportion control interface, the second visual attention function icon is determined and displayed in an enlarged size.

[0028] For example, in this embodiment, the visual attention point corresponding to the user during the use of the wearable device is identified. After the visual attention function icon is enlarged and displayed, the position of the visual attention point in the preset initial proportion control interface is monitored in real time. When the point corresponding to the visual attention point leaves the visual area corresponding to the visual attention function icon in the preset initial proportion control interface, the visual attention function icon is reduced and displayed in the preset initial proportion control interface, and based on the position of the visual attention point in the preset initial proportion control interface, the second visual attention function icon is determined, and the visual attention function icon is enlarged and displayed.

[0029] In step S15, when it is determined that the visual residence time of the user's eye features in the second visual attention function icon is greater than the set time threshold, a display ratio lock instruction is generated to lock the display content and display ratio of the corresponding visual attention function icon in the current preset initial ratio control interface, and a target ratio control interface is generated.

[0030] For example, in this embodiment, the visual attention points corresponding to the user's eye features are detected in real time during the user's use of the wearable device. When it is determined that the visual residence time of the user's eye features in the second visual attention function icon is greater than the set time threshold, a display ratio lock instruction is generated to lock the display content and display ratio of the corresponding visual attention function icon in the current preset initial ratio control interface, and generate a target ratio control interface.

[0031] Through the above-mentioned method, in response to the wearable device identifying the user's eye features, determining the viewing angle range information of the user's corresponding eye features, and generating a preset initial proportion control interface in the corresponding display area according to the viewing angle range information; according to the function display order of the wearable device, determining the display order of the function icons corresponding to each set function in the visual range corresponding to the viewing angle range information from the initial proportion control interface, and displaying the target function icons in the preset initial proportion control interface one by one according to the display order and the function icons; based on the wearable device identifying the user's eye features during the display process, determining the user's visual attention point information within the viewing angle range according to the user's eye features, determining the first visual attention function icon corresponding to the visual attention point information according to the visual attention point information and the target function icon, and displaying the target function icon in the preset initial proportion control interface. In the preset initial proportion control interface, the first visual attention function icon is enlarged and displayed; the position of the visual attention point information in the preset initial proportion control interface is monitored in real time, and in response to the point corresponding to the visual attention point information leaving the visual area corresponding to the first visual attention function icon in the preset initial proportion control interface, the first visual attention function icon is reduced and displayed in the preset initial proportion control interface, and based on the position of the visual attention point information in the preset initial proportion control interface, the second visual attention function icon is determined and enlarged and displayed; when it is determined that the visual stay time of the user's eye feature in the second visual attention function icon is greater than the set time threshold, a display proportion locking instruction is generated to lock the display content and display ratio of the corresponding visual attention function icon in the current preset initial proportion control interface, and a target proportion control interface is generated. In this way, the display ratio of the wearable device can be adjusted based on the visual attention point to adapt to the visual control requirements of the wearable device and improve the operation efficiency of the multi-function operation interface.

[0032] Optionally, in some embodiments, the method further comprises: Obtain display position information of each visual attention function icon and target position information of the second visual attention function icon in the target proportion control interface; When it is determined that the visual position corresponding to the user's eye feature stays at the corresponding position of other visual attention function icons outside the target position information for a time greater than a set time threshold, a display ratio unlock instruction is generated. The display ratio unlock instruction is used to restore the display ratio of the visual attention function icons in the target ratio control interface to the set display ratio, and display subsequent function icons one by one according to the target function icons in the preset initial ratio control interface.

[0033] For example, in this embodiment, after the target proportion control interface is generated and displayed in the wearable device, the display position information of each visual attention function icon and the target position information of the second visual attention function icon under the target proportion control interface are obtained. When it is determined that the visual position corresponding to the user's eye feature stays at the corresponding position of other visual attention function icons other than the target position information for a time greater than a set time threshold, a display proportion unlocking instruction is generated, and the display proportion unlocking instruction is used to restore the display ratio of the visual attention function icons in the target proportion control interface to the set display ratio, and display the subsequent function icons one by one according to the target function icons in the preset initial proportion control interface.

[0034] Optionally, in some embodiments, the above step S13 includes: According to the position of the target function icon in the initial proportion control interface and the visual attention point corresponding to the user's eye characteristics, determine the dwell time of the user's corresponding perspective on each target function icon; If the dwell time is greater than the set time threshold, the user's corresponding pupil attention magnification image is determined based on the user's eye characteristics. When the pupil attention magnification image matches the preset pupil focus image, the first visual attention function icon corresponding to the visual attention point information under the current preset initial proportion control interface is obtained.

[0035] For example, in this embodiment, the dwell time of the user's corresponding perspective on each target function icon is determined according to the position of the target function icon in the initial share control interface and the visual attention point corresponding to the user's eye features. If the dwell time is greater than the set time threshold, the user's corresponding pupil attention magnification image is determined according to the user's eye features. When the pupil attention magnification image matches the preset pupil focus image, the first visual attention function icon corresponding to the visual attention point information under the current preset initial share control interface is obtained.

[0036] Optionally, in some embodiments, the method further comprises: The pupil ratio feature of the pupil attention magnification image is extracted based on a preset feature convolutional network to generate the pupil ratio feature corresponding to the pupil attention magnification image; Obtaining a set pupil ratio feature corresponding to a preset pupil focus image; When the pupil ratio feature matches the set pupil ratio feature, a ratio enlargement locking instruction is generated, where the ratio enlargement locking instruction is used to enlarge the first visual attention function icon and lock the currently displayed preset initial proportion control interface; When the pupil ratio feature does not match the set pupil ratio feature, the target function icons of the preset initial proportion control interface are displayed one by one.

[0037] For example, in this embodiment, the pupil ratio feature of the pupil attention magnification image is extracted based on the preset feature convolutional network, the pupil proportion feature corresponding to the pupil attention magnification image is generated, and the set pupil proportion feature corresponding to the preset pupil focus image is obtained. When the pupil proportion feature matches the set pupil proportion feature, a proportional magnification lock instruction is generated. The proportional magnification lock instruction is used to magnify the first visual attention function icon and lock the currently displayed preset initial proportion control interface. When the pupil proportion feature does not match the set pupil proportion feature, the target function icons of the preset initial proportion control interface are displayed one by one.

[0038] Optionally, in some embodiments, the method further comprises: In response to displaying a target proportion control interface in a display area corresponding to the viewing angle range information, determining a plurality of function icons selected by a user in the target proportion control interface according to eye characteristics of the user; A target ratio interface is generated based on multiple function icons and non-attention function icons. The target ratio interface is used to display multiple function icons based on a preset display ratio and hide non-attention function icons. The non-attention function icons are one or more function icons that are not selected.

[0039] For example, in this embodiment, in response to displaying a target proportion control interface in a display area corresponding to the viewing angle range information, multiple function icons selected by the user in the target proportion control interface are determined according to the user's eye characteristics, and a target proportion interface is generated based on the multiple function icons and non-attention function icons. The target proportion interface is used to display multiple function icons based on a preset display ratio and hide the non-attention function icons. The non-attention function icons are one or more function icons that are not selected.

[0040] Optionally, in some embodiments, the method further comprises: Determining the display ratio and display area of ​​the plurality of function icons in the target ratio interface; Acquire a target scene matching the plurality of function icons from the preset scene library; According to the target scene and the plurality of function icons, a target ratio interface is generated in the target scene based on the display ratio and the display area.

[0041] For example, in this embodiment, the wearable device determines the display ratio and display area of ​​multiple function icons in the target ratio interface, obtains the target scene matching the multiple function icons from the preset scene library, and generates the target ratio interface based on the display ratio and display area in the target scene according to the target scene and multiple function icons.

[0042] Figure 2is a block diagram of a control device for the functional interface ratio of AR / VR / MR glasses according to an embodiment of the present disclosure. Figure 2 As shown, the device 100 includes: A generating module 110, configured to determine, in response to the wearable device identifying the user's eye features, the viewing angle range information corresponding to the user's eye features, and generate a preset initial proportion control interface in the corresponding display area according to the viewing angle range information; The display module 120 is used to determine, from the initial proportion control interface, the display order of the function icons corresponding to each set function within the visual range corresponding to the viewing angle range information according to the function display order of the wearable device, and display the target function icons in the preset initial proportion control interface one by one according to the display order and the function icons; A first determination module 130 is used to identify the user's eye features during the display process based on the wearable device, determine the user's visual attention point information within the viewing angle range according to the user's eye features, determine the first visual attention function icon corresponding to the visual attention point information according to the visual attention point information and the target function icon, and enlarge and display the first visual attention function icon in the preset initial proportion control interface; A second determination module 140 is used to monitor the position of the visual attention point information in the preset initial proportion control interface in real time, and in response to the point corresponding to the visual attention point information leaving the visual area corresponding to the first visual attention function icon in the preset initial proportion control interface, reduce the first visual attention function icon in the preset initial proportion control interface, and determine the second visual attention function icon based on the position of the visual attention point information in the preset initial proportion control interface, and enlarge the second visual attention function icon; The execution module 150 is used to generate a display ratio locking instruction to lock the display content and display ratio of the corresponding visual attention function icon in the current preset initial ratio control interface when it is determined that the visual residence time of the user's eye features in the second visual attention function icon is greater than a set time threshold, and generate a target ratio control interface.

[0043] Through the above-mentioned method, in response to the wearable device identifying the user's eye features, determining the viewing angle range information of the user's corresponding eye features, and generating a preset initial proportion control interface in the corresponding display area according to the viewing angle range information; according to the function display order of the wearable device, determining the display order of the function icons corresponding to each set function in the visual range corresponding to the viewing angle range information from the initial proportion control interface, and displaying the target function icons in the preset initial proportion control interface one by one according to the display order and the function icons; based on the wearable device identifying the user's eye features during the display process, determining the user's visual attention point information within the viewing angle range according to the user's eye features, determining the first visual attention function icon corresponding to the visual attention point information according to the visual attention point information and the target function icon, and displaying the target function icon in the preset initial proportion control interface. In the preset initial proportion control interface, the first visual attention function icon is enlarged and displayed; the position of the visual attention point information in the preset initial proportion control interface is monitored in real time, and in response to the point corresponding to the visual attention point information leaving the visual area corresponding to the first visual attention function icon in the preset initial proportion control interface, the first visual attention function icon is reduced and displayed in the preset initial proportion control interface, and based on the position of the visual attention point information in the preset initial proportion control interface, the second visual attention function icon is determined and enlarged and displayed; when it is determined that the visual stay time of the user's eye feature in the second visual attention function icon is greater than the set time threshold, a display proportion locking instruction is generated to lock the display content and display ratio of the corresponding visual attention function icon in the current preset initial proportion control interface, and a target proportion control interface is generated. In this way, the display ratio of the wearable device can be adjusted based on the visual attention point to adapt to the visual control requirements of the wearable device and improve the operation efficiency of the multi-function operation interface.

[0044] The present disclosure also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the method described in any one of the aforementioned embodiments are implemented.

[0045] The present disclosure also provides an electronic device, including: processor; a memory for storing processor-executable instructions; The processor is configured to execute executable instructions in the memory to implement the method described in any one of the aforementioned embodiments.

[0046] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. This application is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0047] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for controlling the proportion of functional interfaces of AR / VR / MR glasses, characterized in that: Applied to a wearable device, the wearable device includes augmented reality (AR) glasses, virtual reality (VR) glasses, or mixed reality (MR) glasses, the method includes: In response to the wearable device identifying the eye features of the user, determining the viewing angle range information of the user corresponding to the eye features, and generating a preset initial proportion control interface in the corresponding display area according to the viewing angle range information; According to the function display order of the wearable device, from the initial proportion control interface, determine the display order of the function icons corresponding to each set function within the visual range corresponding to the viewing angle range information, and display the target function icons in the preset initial proportion control interface one by one according to the display order and the function icons; Based on the wearable device, the user's eye features during the display process are identified, and the visual attention point information of the user within the viewing angle range is determined according to the user's eye features; according to the visual attention point information and the target function icon, a first visual attention function icon corresponding to the visual attention point information is determined, and the first visual attention function icon is enlarged and displayed in the preset initial proportion control interface; The position of the visual attention point information in the preset initial proportion control interface is monitored in real time, and in response to the point corresponding to the visual attention point information leaving the visual area corresponding to the first visual attention function icon in the preset initial proportion control interface, the first visual attention function icon is displayed in a reduced size in the preset initial proportion control interface, and based on the position of the visual attention point information in the preset initial proportion control interface, a second visual attention function icon is determined, and the second visual attention function icon is displayed in an enlarged size; When it is determined that the visual residence time of the user's eye features in the second visual attention function icon is greater than the set time threshold, a display ratio locking instruction is generated to lock the display content and display ratio of the corresponding visual attention function icon in the current preset initial ratio control interface, and a target ratio control interface is generated.

2. The method for controlling the proportion of the functional interface of AR / VR / MR glasses according to claim 1, characterized in that: The method further comprises: Acquire display position information of each visual attention function icon and target position information of the second visual attention function icon in the target proportion control interface; When it is determined that the visual position corresponding to the user's eye feature stays at the corresponding position of other visual attention function icons outside the target position information for a time greater than a set time threshold, a display ratio unlock instruction is generated. The display ratio unlock instruction is used to restore the display ratio of the visual attention function icons in the target ratio control interface to the set display ratio, and display subsequent function icons one by one according to the target function icons in the preset initial ratio control interface.

3. The method for controlling the proportion of the functional interface of AR / VR / MR glasses according to claim 1, characterized in that: The step of determining, according to the visual attention point information and the target function icon, a first visual attention function icon corresponding to the visual attention point information comprises: Determine the dwell time of the user's corresponding viewing angle on each target function icon according to the position of the target function icon in the initial proportion control interface and the visual attention point corresponding to the user's eye feature; If the dwell time is greater than the set time threshold, the user's corresponding pupil attention magnification image is determined based on the user's eye features. When the pupil attention magnification image matches the preset pupil focus image, the first visual attention function icon corresponding to the visual attention point information under the current preset initial proportion control interface is obtained.

4. The method for controlling the proportion of the functional interface of AR / VR / MR glasses according to claim 3, characterized in that: The method further comprises: Extracting pupil proportion features of the pupil attention magnification image based on a preset feature convolutional network to generate pupil proportion features corresponding to the pupil attention magnification image; Obtaining a set pupil ratio feature corresponding to the preset pupil focusing image; When the pupil ratio feature matches the set pupil ratio feature, generating a ratio enlargement locking instruction, the ratio enlargement locking instruction is used to enlarge the first visual attention function icon and lock the currently displayed preset initial proportion control interface; When the pupil ratio feature does not match the set pupil ratio feature, the target function icons of the preset initial proportion control interface are displayed one by one.

5. The method for controlling the proportion of the functional interface of AR / VR / MR glasses according to claim 1, characterized in that: The method further comprises: In response to displaying a target proportion control interface in a display area corresponding to the viewing angle range information, determining a plurality of function icons selected by a user in the target proportion control interface according to the user's eye characteristics; A target ratio interface is generated based on the multiple function icons and non-attention function icons. The target ratio interface is used to display the multiple function icons based on a preset display ratio and hide the non-attention function icons. The non-attention function icons are one or more function icons that are not selected.

6. The method for controlling the proportion of the functional interface of AR / VR / MR glasses according to claim 1, characterized in that: Generating a target ratio interface according to the plurality of function icons and non-attention function icons includes: Determining the display ratio and display area of ​​the plurality of function icons in the target ratio interface; Acquire a target scene matching the plurality of function icons from the preset scene library; According to the target scene and the plurality of function icons, the target ratio interface is generated in the target scene based on the display ratio and the display area.

7. A device for controlling the proportion of functional interfaces of AR / VR / MR glasses, characterized in that: Applied to a wearable device, the wearable device includes augmented reality (AR) glasses, virtual reality (VR) glasses, or mixed reality (MR) glasses, the method includes: A generating module, configured to determine, in response to the eye features of the user recognized by the wearable device, the viewing angle range information corresponding to the eye features of the user, and generate a preset initial proportion control interface in the corresponding display area according to the viewing angle range information; A display module is used to determine, from the initial proportion control interface, a display order of function icons corresponding to each set function within the visual range corresponding to the viewing angle range information according to the function display order of the wearable device, and display the target function icons in the preset initial proportion control interface one by one according to the display order and the function icons; A first determination module is used to identify the user's eye features during the display process based on the wearable device, determine the user's visual attention point information within the viewing angle range according to the user's eye features, determine the first visual attention function icon corresponding to the visual attention point information according to the visual attention point information and the target function icon, and enlarge and display the first visual attention function icon in the preset initial proportion control interface; A second determination module is used to monitor the position of the visual attention point information in the preset initial proportion control interface in real time, and in response to the point corresponding to the visual attention point information leaving the visual area corresponding to the first visual attention function icon in the preset initial proportion control interface, the first visual attention function icon is displayed in a reduced size in the preset initial proportion control interface, and based on the position of the visual attention point information in the preset initial proportion control interface, a second visual attention function icon is determined, and the second visual attention function icon is displayed in an enlarged size; The execution module is used to generate a display ratio locking instruction to lock the display content and display ratio of the corresponding visual attention function icon in the current preset initial ratio control interface when it is determined that the visual residence time of the user's eye features in the second visual attention function icon is greater than a set time threshold, and generate a target ratio control interface.

8. The device for controlling the proportion of the functional interface of AR / VR / MR glasses according to claim 7, characterized in that: The device further comprises a determination module, wherein the determination module is configured to: Acquire display position information of each visual attention function icon and target position information of the second visual attention function icon in the target proportion control interface; When it is determined that the visual position corresponding to the user's eye feature stays at the corresponding position of other visual attention function icons outside the target position information for a time greater than a set time threshold, a display ratio unlock instruction is generated. The display ratio unlock instruction is used to restore the display ratio of the visual attention function icons in the target ratio control interface to the set display ratio, and display subsequent function icons one by one according to the target function icons in the preset initial ratio control interface.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method described in any one of claims 1 to 6 are implemented.

10. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute executable instructions in the memory to implement the method described in any one of claims 1 to 6.

Images