Display adjustment method and device, electronic equipment and computer readable storage medium

Abstract

The embodiment of the invention discloses a display adjusting method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of augmented reality, and the method comprises the steps: collecting pupil center information of a target user and exit pupil center information of the augmented reality equipment if the augmented reality equipment detects that the augmented reality equipment is in a wearing state, and calculating position offset information according to the pupil center information and the exit pupil center information, and adjusting an emergent angle of an optical machine module of the augmented reality equipment according to the position offset information, so that the pupil center information is matched with the adjusted exit pupil center information of the augmented reality equipment. The pupil center information of the user and the exit pupil center information of the augmented reality device are collected, the position offset information is calculated, and the exit angle of the ray machine module is adjusted according to the position offset information, so that the exit pupil display area can be adjusted based on the individual difference of the user; and the purpose of properly displaying the picture when individual differences are met is facilitated.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of extended reality, and in particular to a display adjustment method and device, an electronic device, and a computer readable storage medium. BACKGROUND

[0002] Extended reality (XR) is a comprehensive term that covers virtual reality (VR), augmented reality (AR), and mixed reality (MR). Extended reality technology expands human perception and interaction, and through digital technology, it interacts with the real world to create virtual, augmented, and mixed reality experiences. Extended reality devices are widely used in navigation, information display, augmented reality experience, and other scene applications.

[0003] The current mainstream extended reality device adopts an optical engine and a waveguide structure, and the position, size, and angle of the exit pupil area (i.e., the display range of the virtual image in the user's field of view) are fixed and cannot be dynamically adjusted according to individual differences of users, which has significant experience defects.

[0004] Currently, although there is a design to achieve the effect of "pseudo adjustment" of the exit pupil area by cropping the display image, this way of cropping the display image will result in a decrease in display resolution and a poor browsing experience, and cannot fundamentally solve the problem of mismatching and adapting the display area to individual differences of users. SUMMARY

[0005] Embodiments of the present application provide a display adjustment method and device, an electronic device, and a computer readable storage medium, which can dynamically adjust the exit pupil area so that the exit pupil display matches individual users and improves the user experience.

[0006] In a first aspect, embodiments of the present application provide a display adjustment method applied to an extended reality device, the extended reality device comprising an optical engine module, and the method comprising: If it is detected that the extended reality device is in a wearing state, the pupil center information of a target user and the exit pupil center information of the extended reality device are collected; The position offset information is calculated according to the pupil center information and the exit pupil center information; The exit angle of the optical engine module is adjusted according to the position offset information, so that the pupil center information matches the adjusted exit pupil center information of the extended reality device.

[0007] In a second aspect, embodiments of the present application also provide a display adjustment device applied to an extended reality device, the extended reality device comprising an optical engine module, and the device comprising: The collection module is configured to collect pupil center information of a target user and exit pupil center information of the extended reality device if it is detected that the extended reality device is in a wearing state; The calculation module is configured to calculate position offset information according to the pupil center information and the exit pupil center information. The adjustment module is configured to adjust an exit angle of the light machine module according to the position offset information, so that the pupil center information matches adjusted exit pupil center information of the extended reality device.

[0008] Optionally, in some embodiments of the present application, the device further comprises: The body of the extended reality device is further provided with a control module, a driving module and a waveguide module. The control module is electrically connected with the driving module, the waveguide module and the light machine module respectively. The driving module is rigidly connected with the light machine module. The light exit surface of the light machine module is oppositely arranged with the light entrance surface of the waveguide module. The waveguide module transmits light to the eyes of the target user through the light exit surface. The exit pupil center information includes the center of the area projected by the light.

[0009] Optionally, in some embodiments of the present application, the adjustment of the exit angle of the light machine according to the position offset information comprises: The control module drives the driving module to adjust the exit angle of the light machine module based on the position offset information.

[0010] Optionally, in some embodiments of the present application, the driving module comprises a MEMS motor.

[0011] Optionally, in some embodiments of the present application, the extended reality device comprises AR glasses. The MEMS motor comprises a fixed base and a rotating assembly. One side of the fixed base is integrally connected with a frame of the AR glasses. The other side of the fixed base is connected with the light machine module. The control module drives the driving module to adjust the exit angle of the light machine module based on the position offset information, comprising: The control module drives the rotating assembly to rotate based on the position offset information. After the rotating assembly rotates, the light machine module is driven to rotate. The exit angle is changed after the light machine module rotates.

[0012] Optionally, in some embodiments of the present application, the rotating assembly comprises a rotor frame. An angle sensor is integrated on the rotor frame. The angle sensor detects the rotation angle of the rotor frame. The angle sensor is electrically connected with the control module. The angle sensor transmits the rotation angle to the control module. The fixed base is internally provided with a PCB circuit board and a drive coil, the PCB circuit board is electrically connected with the control module, the drive coil is electrically connected with the PCB circuit board, and the angle sensor is electrically connected with the control module. The mover frame is connected with the fixed base through a flexible hinge, and the mover frame is connected with the optical mechanical module. The mover frame is internally provided with a permanent magnet, and the permanent magnet is oppositely arranged with the drive coil. After the drive coil is energized through the PCB circuit board, the magnetic field generated by the drive coil interacts with the permanent magnet to drive the rotation of the mover frame, and the rotation of the mover frame drives the rotation of the optical mechanical module.

[0013] Optionally, in some embodiments of the present application, the body of the extended reality device is further provided with a collection module, and the collection module is electrically connected with the control module. The collection target user's pupil center information and the exit pupil center information of the extended reality device include: The pupil position information of the target user is collected through the collection module, the interpupillary distance information is calculated according to the pupil position information, and the pupil center information is calculated based on the pupil position information and the interpupillary distance information. And the imaging picture projected by the waveguide module is collected through the collection module, and the exit pupil center information is calculated based on the imaging picture.

[0014] In a third aspect, the embodiments of the present application further provide an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the computer program is executed by the processor to implement the steps in the display adjustment method.

[0015] In a fourth aspect, the embodiments of the present application further provide a computer readable storage medium, and the computer readable storage medium stores a computer program, and the computer program is executed by the processor to implement the steps in the display adjustment method.

[0016] In a fifth aspect, the embodiments of the present application further provide a computer program product or a computer program, which includes computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to make the computer device execute the method provided in the various optional implementation manners of the embodiments of the present application.

[0017] To sum up, if the extended reality device in the wearing state is detected, the pupil center information of the target user and the exit pupil center information of the extended reality device are collected, the position offset information is calculated according to the pupil center information and the exit pupil center information, and the exit angle of the optical-mechanical module of the extended reality device is adjusted according to the position offset information, so that the pupil center information matches the adjusted exit pupil center information of the extended reality device.

[0018] In the embodiment of the application, the pupil center information of the user and the exit pupil center information of the extended reality device are collected, the position offset information is calculated, and the exit angle of the optical-mechanical module is adjusted according to the position offset information, so that the exit pupil display area can be adjusted based on the individual differences of the user, which helps to achieve the purpose of proper display of the picture when the individual differences are met. BRIEF DESCRIPTION OF DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the application, the following will briefly introduce the drawings needed to be used in the embodiments. Obviously, the drawings in the following description are only some embodiments of the application, and other drawings can be obtained by those skilled in the art without creative labor.

[0020] Figure 1 is a scene schematic diagram of the extended reality device provided by the embodiment of the application executing the display adjustment method; Figure 2 is a flowchart of the display adjustment method provided by the embodiment of the application; Figure 3 is a structural schematic diagram of the display adjustment device provided by the embodiment of the application; Figure 4 is a structural schematic diagram of the electronic device provided by the embodiment of the application.

[0021] Explanation of the drawing reference numerals: 101-extended reality device; 301-acquisition module; 302-computation module; 303-adjustment module; 401-processor; 402-memory; 403-power supply; 404-input unit. DETAILED DESCRIPTION

[0022] The technical solutions in the application will be described in detail below with reference to the drawings in the application. Obviously, the described embodiments are only some of the embodiments of the application, not all. Based on the embodiments in the application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the application.

[0023] In the description of the embodiments of the present application, it needs to be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer" and the like indicate the orientation or positional relationship shown in the drawings, which are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first", "second", "third", "fourth" are only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the technical features indicated. Therefore, the features defined with "first", "second", "third", "fourth" can explicitly or implicitly include one or more features. In the description of the present application, the meaning of "a plurality of" is two or more, unless otherwise clearly limited.

[0024] In the present application, the word "exemplary" is used to mean "serving as an example, instance, or illustration." Any implementation described as "exemplary" in the present application is not necessarily to be construed as preferred or advantageous over other implementations. The following description is presented to enable any person skilled in the art to make and use the application. In the following description, for purposes of explanation, specific details are set forth. It will be apparent to those skilled in the art that the present application can be practiced without the specific details. In other instances, well-known structures and processes are not shown in detail to avoid obscuring the present application. Thus, the present application is not intended to be limited to the implementations shown, but is to be accorded the widest scope consistent with the principles and features presented herein.

[0025] The embodiments of the present application provide a display adjustment method and device, electronic equipment and computer readable storage medium. Specifically, the embodiments of the present application provide a display adjustment device suitable for electronic equipment, which includes an extended reality device, including but not limited to a head-mounted display, wearable glasses, and the terminal device can also be an integrated terminal device with a built-in computing processing unit, or a split terminal device with an external computing processing unit. Wherein, the terminal device includes but is not limited to an onboard optical display system, i.e. a head-up display system, applied to aircraft, automobile, ship and other vehicles, such as AR-HUD (Augmented reality head-up display) carried on intelligent networked vehicles, extended reality applications (such as extended reality games, virtual travel, remote medical treatment or virtual experiments, etc.) applied to mobile handheld devices such as mobile phones, notebook computers and tablets, and near-eye display systems applied to wearable devices such as head-mounted displays and smart glasses.

[0026] For example, please see Figure 1 , Figure 1 This is a schematic diagram illustrating a scenario where an extended reality device, according to an embodiment of this application, executes the display adjustment method. Specifically, the execution process of the extended reality device executing the display adjustment method is as follows: If the extended reality device 101 detects that the device is being worn, it collects the pupil center information of the target user and the exit pupil center information of the extended reality device. Based on the pupil center information and the exit pupil center information, it calculates the position offset information and adjusts the emission angle of the optical engine module of the extended reality device according to the position offset information, so that the pupil center information matches the adjusted exit pupil center information of the extended reality device.

[0027] For example, when a user wears the augmented reality device, the device collects the user's pupil center information and the device's exit pupil center information. Based on this pupil center information and exit pupil center information, the device adjusts the emission angle of the optical engine to match the user's pupil viewing angle. When other users wear the device, the device collects their pupil center information and adjusts the emission angle of the optical engine module to ensure that the device always meets the different pupil viewing angle requirements of different wearers.

[0028] In summary, the embodiments of this application collect the user's pupil center information and the extended reality device's exit pupil center information, calculate the position offset information, and adjust the exit angle of the optical engine module according to the position offset information. This enables the adjustment of the exit pupil display area based on individual user differences, which helps to meet the purpose of proper image display when individual differences exist.

[0029] The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the priority of the embodiments.

[0030] Please see Figure 2 , Figure 2 This is a flowchart illustrating a display adjustment method provided in an embodiment of this application. Although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than that shown in the flowchart. Specifically, this display adjustment method is applied to an extended reality device, and the specific flow of the display adjustment method is as follows: S201. If the extended reality device is detected to be in a wearing state, the pupil center information of the target user and the exit pupil center information of the extended reality device are collected.

[0031] The extended reality device being in the wearing state or not can be detected by a distance sensor. For example, a distance sensor is arranged on the temple of the smart glasses as the extended reality device, and if an occlusion object is detected between the temples and the distance between the occlusion object and the temple is less than a set value, it is determined that the extended reality device is currently in the wearing state.

[0032] The pupil center information refers to the center between the two pupils of the target user, i.e., the position center between the two pupils. In the embodiments of the present application, the pupil image can be captured by a camera, the position coordinates of each pupil are calculated, and then the pupil center information is obtained by the mean value method.

[0033] The exit pupil center information refers to the center of the exit pupil region. The exit pupil or exit pupil region refers to a virtual aperture formed after light passes through an optical system (such as a waveguide or lens of AR glasses), i.e., a region in which the user's eye can see a complete image. It can be understood that the exit pupil center is generally considered to be the theoretically best observation position. For example, when the pupil center of the user corresponds to the exit pupil center, it is considered that the image region is displayed at the best viewing position.

[0034] In the embodiments of the present application, the exit pupil center information can be calculated by capturing the exit pupil spot by a camera. For example, the body of the extended reality device is also provided with a collection module, which is electrically connected to the control module. The step of "collecting the pupil center information of the target user and the exit pupil center information of the extended reality device" includes: collecting the pupil position information of the target user by the collection module, calculating the interpupillary distance information according to the pupil position information, and calculating the pupil center information based on the pupil position information and the interpupillary distance information; and collecting the imaging picture projected by the waveguide module by the collection module, and calculating the exit pupil center information based on the imaging picture.

[0035] It can be understood that the imaging picture includes the picture corresponding to the exit pupil spot of the extended reality device. The collection module includes a camera (such as an iris camera) and other shooting devices.

[0036] It can be understood that by collecting the pupil center information and the exit pupil center information when it is detected that it is in the wearing state, it is helpful to adjust the display based on the pupil center information and the exit pupil center information, so that the display effect reaches the expectation.

[0037] S202, calculating the position offset information according to the pupil center information and the exit pupil center information.

[0038] It can be understood that the position offset information reflects the difference between the pupil center information and the exit pupil center information, that is, the reference for the display optimization of the present application. The position offset information can be calculated by the position difference between the pupil center information and the exit pupil center information.

[0039] S203, adjusting the exit angle of the optical mechanical module according to the position offset information, so that the pupil center information matches the adjusted exit pupil center information of the extended reality device.

[0040] For example, the exit angle of the optical mechanical module is adjusted with reference to the position offset information, so that the pupil center information corresponds to the exit pupil center information of the extended reality device, so that the output display area of the extended reality device is in the best observation position.

[0041] In summary, the present application embodiment can adjust the exit pupil display area based on the individual differences of the user by collecting the pupil center information of the user and the exit pupil center information of the extended reality device, calculating the position offset information, and adjusting the exit angle of the optical mechanical module according to the position offset information, which helps to meet the purpose of proper display of the picture when the individual differences are met.

[0042] At present, the optical system or optical module of the extended reality device generally includes an optical mechanical module and a waveguide module, the light exit surface of the optical mechanical module corresponds to the light entrance surface of the waveguide module, and the waveguide module transmits the light to the user's eyes after receiving the light. Therefore, by changing the exit angle of the light of the optical mechanical module, the angle of the light transmitted to the user's eyes can be changed, so as to adjust the position of the real area.

[0043] In the present application embodiment, a driving module can be provided to adjust the optical mechanical module, so as to change the exit angle of the optical mechanical module. That is, in some embodiments of the present application, the body of the extended reality device is also provided with a control module, a driving module and a waveguide module, the control module is electrically connected with the driving module, the waveguide module and the optical mechanical module, the driving module is rigidly connected with the optical mechanical module, the light exit surface of the optical mechanical module is arranged opposite to the light entrance surface of the waveguide module, the waveguide module transmits light to the eyes of the target user through the light exit surface, and the exit pupil center information includes the center of the area projected by the light.

[0044] The control module includes a processor for data analysis and decision making, for example, based on the position offset information, the rotation angles of the optical mechanical module around the X and Y axes are calculated, so as to control the adjustment of the exit angle of the optical mechanical module. That is, in the present application embodiment, the step of "adjusting the exit angle of the optical mechanical module according to the position offset information" includes: The control module drives the driving module to adjust the exit angle of the light machine module based on the position offset information.

[0045] In the embodiments of the present application, the driving module includes a MEMS motor, such as a double-axis MEMS motor. Compared with adjusting the position of the light machine through a mechanical slide rail, using the MEMS motor to adjust the position of the light machine can reduce the mechanical structure and improve the adjustment accuracy. In addition, by directly changing the exit angle to change the display position, compared with the way of cropping the display picture through software, the embodiments of the present application do not need to make a trade-off in display effect, for example, without reducing the display resolution, the interface content can be effectively and comprehensively displayed, and without additional picture recognition operation, the overhead is reduced.

[0046] In the embodiments of the present application, the light machine module includes two light machine modules respectively located at the left and right sides of the extended reality device, and correspondingly, the waveguide module also includes two waveguide modules. Therefore, the control module, the driving module and the acquisition module can be configured for each light machine module to adjust each light machine module, for example, by calculating the position offset information corresponding to each light machine module to adjust each light machine module, so that the focal points of the exit light rays of the light machine modules on the left and right sides are aligned with the user's pupil.

[0047] It can be understood that after adjusting the exit angle of the light machine module, the position, range and angle of the exit pupil display area are actually adjusted and controlled, which adapts to individual differences of different people and improves the wearing comfort of the user.

[0048] It can be understood that a rotating component can be arranged on the MEMS motor to drive the position adjustment of the light machine module through the rotation of the rotating component. In some embodiments of the present application, the extended reality device includes AR glasses, the MEMS motor includes a fixed base and a rotating component, one side of the fixed base is integrally connected with a frame of the AR glasses, and the other side of the fixed base is connected with the light machine module. The control module drives the driving module to adjust the exit angle of the light machine module based on the position offset information. The control module drives the rotating component to rotate based on the position offset information, and the rotating component drives the light machine module to rotate after rotating, wherein the light machine module changes the exit angle after rotating.

[0049] For example, the fixed base of the MEMS motor is fixedly arranged inside the temple of the AR glasses, and the rotating component is connected with the light machine module to form linkage between the rotating component and the light machine module. When the rotating component rotates, the light machine module is driven to rotate to adjust the position of the light machine module, and then change the exit angle of the light machine module relative to the waveguide module.

[0050] In the embodiment of the present application, the rotating assembly can be a permanent magnet and a drive coil, which drives the rotation of the permanent magnet through the magnetic field generated when the drive coil is energized, and then changes the position of the light engine module through the permanent magnet, that is, in some embodiments of the present application, the rotating assembly includes a rotor frame, the rotor frame is integrated with an angle sensor, the angle sensor detects the rotation angle of the rotor frame, the angle sensor is electrically connected with the control module, and the angle sensor transmits the rotation angle to the control module. The fixed base is internally provided with a PCB and a drive coil, the PCB is electrically connected with the control module, the drive coil is electrically connected with the PCB, and the angle sensor is electrically connected with the control module. The rotor frame is connected with the fixed base through a flexible hinge, and the rotor frame is connected with the light engine module. The rotor frame is internally provided with a permanent magnet, and the permanent magnet is oppositely arranged with the drive coil. After the drive coil is energized through the PCB, the magnetic field generated by the drive coil interacts with the permanent magnet to drive the rotation of the rotor frame, and the rotation of the rotor frame drives the rotation of the light engine module.

[0051] It can be understood that the rotor frame is a structure that can rotate relative to the fixed base, which connects the light engine module, and when the permanent magnet is driven to rotate by the magnetic field generated by the energization of the drive coil, the rotor frame is driven to rotate, and the rotation of the rotor frame drives the rotation of the light engine module.

[0052] It can be understood that the rotation of the rotor frame is controlled by the magnetic field generated by the drive coil, and then the light engine module is driven to rotate, so that the rotation of the light engine module is more easily quantitatively controlled by the magnetic field strength, and the rotation control of the light engine module is more refined, and the accuracy of the exit angle adjustment of the light engine module is improved.

[0053] In summary, if the extended reality device detects that it is in a wearing state, the pupil center information of the target user and the exit pupil center information of the extended reality device are collected, the position offset information is calculated according to the pupil center information and the exit pupil center information, and the exit angle of the light engine module of the extended reality device is adjusted according to the position offset information, so that the pupil center information matches the adjusted exit pupil center information of the extended reality device.

[0054] Wherein, the embodiment of the application collects the pupil center information of the user and the exit pupil center information of the extended reality device, calculates the position offset information, and adjusts the exit angle of the light engine module according to the position offset information, so that the exit pupil display area can be adjusted based on the individual differences of the user, which helps to meet the purpose of proper display of the picture when the individual differences are met.

[0055] In order to better implement the display adjustment method of the application, the application also provides an application processing device based on the above display adjustment method. The meanings of the terms are the same as in the above display adjustment method, and the specific implementation details can be referred to the description in the method embodiment.

[0056] Please refer to Figure 3 , Figure 3 is a structural schematic diagram of a display adjustment device provided by the embodiment of the application, wherein the display adjustment device is applied to an extended reality device, the extended reality device includes a light engine module, and the display adjustment device can be specifically as follows: The acquisition module 301 is configured to, if it is detected that the extended reality device is in a wearing state, acquire pupil center information of a target user and exit pupil center information of the extended reality device. The calculation module 302 is configured to calculate position offset information according to the pupil center information and the exit pupil center information. The adjustment module 303 is configured to adjust an exit angle of the light engine module according to the position offset information, so that the pupil center information matches the adjusted exit pupil center information of the extended reality device.

[0057] Optionally, in some embodiments of the application, the device further includes: The body of the extended reality device is further provided with a control module, a driving module and a waveguide module, the control module is electrically connected with the driving module, the waveguide module and the light engine module respectively, the driving module is rigidly connected with the light engine module, the light exit surface of the light engine module is oppositely arranged with the light entrance surface of the waveguide module, the waveguide module transmits light to the eyes of the target user through the light exit surface, and the exit pupil center information includes the center of the area projected by the light.

[0058] Optionally, in some embodiments of the application, the exit angle of the light engine is adjusted according to the position offset information, including: The control module drives the driving module to adjust the exit angle of the light engine module based on the position offset information.

[0059] Optionally, in some embodiments of the application, the driving module includes a MEMS motor.

[0060] Optionally, in some embodiments of the present application, the extended reality device comprises AR glasses, the MEMS motor comprises a fixed base and a rotating assembly, one side of the fixed base is integrally connected with the frame of the AR glasses, and the other side of the fixed base is connected with the optical machine module. The control module drives the driving module to adjust the exit angle of the optical machine module based on the position offset information. The rotating assembly is driven to rotate by the control module based on the position offset information, and the optical machine module is driven to rotate after the rotating assembly rotates.

[0061] Optionally, in some embodiments of the present application, the rotating assembly comprises a rotor frame, an angle sensor is integrated on the rotor frame, the angle sensor detects the rotation angle of the rotor frame, the angle sensor is electrically connected with the control module, and the angle sensor transmits the rotation angle to the control module. The fixed base is internally provided with a PCB and a driving coil, the PCB is electrically connected with the control module, the driving coil is electrically connected with the PCB, and the angle sensor is electrically connected with the control module. The rotor frame is connected with the fixed base through a flexible hinge, and the rotor frame is connected with the optical machine module. The rotor frame is internally provided with a permanent magnet, and the permanent magnet is oppositely arranged with the driving coil. After the driving coil is energized through the PCB, the magnetic field generated by the driving coil interacts with the permanent magnet to drive the rotor frame to rotate, and the optical machine module is driven to rotate after the rotor frame rotates.

[0062] Optionally, in some embodiments of the present application, the body of the extended reality device is further provided with a collection module, and the collection module is electrically connected with the control module. The collection module collects the pupil center information of the target user and the exit pupil center information of the extended reality device. The collection module collects the pupil position information of the target user, calculates the interpupillary distance information according to the pupil position information, and calculates the pupil center information based on the pupil position information and the interpupillary distance information. And the collection module collects the imaging picture projected by the waveguide module, and calculates the exit pupil center information based on the imaging picture.

[0063] In this embodiment, if the acquisition module 301 detects that the extended reality device is being worn, it acquires the pupil center information of the target user and the exit pupil center information of the extended reality device. The calculation module 302 calculates the position offset information based on the pupil center information and the exit pupil center information. The adjustment module 303 adjusts the emission angle of the optical engine module based on the position offset information, so that the pupil center information matches the adjusted exit pupil center information of the extended reality device.

[0064] In summary, the embodiments of this application collect the user's pupil center information and the extended reality device's exit pupil center information, calculate the position offset information, and adjust the exit angle of the optical engine module according to the position offset information. This enables the adjustment of the exit pupil display area based on individual user differences, which helps to meet the purpose of proper image display when individual differences exist.

[0065] In addition, this application also provides an electronic device, such as Figure 4 As shown, it illustrates a structural schematic diagram of the electronic device provided in an embodiment of this application. Specifically: The electronic device may include components such as a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will understand that... Figure 4 The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The processor 401 is the control center of the electronic device. It connects various parts of the electronic device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 402, and by calling data stored in the memory 402, it performs various functions and processes data, thereby providing overall monitoring of the electronic device. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 401.

[0066] The memory 402 can be used to store software programs and modules, and the processor 401 executes various function applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, application programs required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; and the data storage area can store data created according to the use of the electronic device, etc. In addition, the memory 402 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. Accordingly, the memory 402 can also include a memory controller to provide access for the processor 401 to the memory 402.

[0067] The electronic device also includes a power supply 403 for powering the various components. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The power supply 403 can also include one or more direct current or alternating current power supplies, a recharging system, a power supply device debugging circuit, a power supply converter or inverter, a power supply state indicator, and the like.

[0068] The electronic device can also include an input unit 404, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.

[0069] Although not shown, the electronic device can also include a display unit and the like, which will not be described here. Specifically, in the present embodiment, the processor 401 in the electronic device loads the executable file corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and runs the application programs stored in the memory 402 by the processor 401, thereby realizing the steps in any of the display adjustment methods provided in the present application.

[0070] If the extended reality device detects that it is in a wearing state, the pupil center information of the target user and the exit pupil center information of the extended reality device are collected, the position offset information is calculated according to the pupil center information and the exit pupil center information, and the exit angle of the optical-mechanical module of the extended reality device is adjusted according to the position offset information, so that the pupil center information matches the adjusted exit pupil center information of the extended reality device.

[0071] Wherein, the embodiment of the present application collects the pupil center information of the user and the exit pupil center information of the extended reality device, and calculates the position offset information and adjusts the exit angle of the light engine module according to the position offset information, so that the exit pupil display area can be adjusted based on the individual differences of the user, which helps to meet the purpose of proper display of the picture when the individual differences are met.

[0072] The specific implementation of the above operations can be referred to the previous embodiments, which will not be repeated here.

[0073] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or by instructions controlling related hardware, which can be stored in a computer readable storage medium and loaded and executed by a processor.

[0074] To this end, the present application provides a computer readable storage medium, which stores a computer program capable of being loaded by a processor to execute the steps in any of the display adjustment methods provided by the present application.

[0075] The specific implementation of the above operations can be referred to the previous embodiments, which will not be repeated here.

[0076] The computer readable storage medium can include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0077] Due to the instructions stored in the computer readable storage medium, the steps in any of the display adjustment methods provided by the present application can be executed, so the beneficial effects of any of the display adjustment methods provided by the present application can be achieved, which will be described in detail in the previous embodiments, and will not be repeated here.

[0078] The above provides a detailed description of the display adjustment method, device, electronic equipment and computer readable storage medium provided by the present application. The principle and implementation mode of the present application are described by applying specific examples in this paper. The above embodiment is only used to help understand the method and core idea of the present application. Meanwhile, for those skilled in the art, according to the idea of the present application, the specific implementation mode and application range will be changed. In conclusion, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A display adjustment method characterized by, The application is applied to an extended reality device including a light machine module, and the method comprises the following steps: If it is detected that the extended reality device is in a wearing state, the pupil center information of a target user and the exit pupil center information of the extended reality device are collected; The position offset information is calculated according to the pupil center information and the exit pupil center information; The exit angle of the light machine module is adjusted according to the position offset information, so that the pupil center information matches the adjusted exit pupil center information of the extended reality device.

2. The display adjustment method according to claim 1, wherein, The body of the extended reality device is further provided with a control module, a driving module and a waveguide module, the control module is electrically connected with the driving module, the waveguide module and the light machine module respectively, the driving module is rigidly connected with the light machine module, the light exit surface of the light machine module is oppositely arranged with the light entrance surface of the waveguide module, the waveguide module transmits light to the eyes of the target user through the light exit surface, and the exit pupil center information includes the center of the area projected by the light.

3. The display adjustment method according to claim 2, wherein, The exit angle of the light machine is adjusted according to the position offset information, which comprises the following steps: The exit angle of the light machine module is adjusted by driving the driving module based on the position offset information through the control module.

4. The display adjustment method according to claim 2, wherein The driving module comprises a MEMS motor.

5. The display adjustment method according to claim 4, wherein The extended reality device comprises AR glasses, the MEMS motor comprises a fixed base and a rotating component, one side of the fixed base is integrally connected with the frame of the AR glasses, and the other side of the fixed base is connected with the light machine module. The exit angle of the light machine module is adjusted by driving the driving module based on the position offset information through the control module, which comprises the following steps: The rotating component is driven to rotate based on the position offset information through the control module, and the light machine module is driven to rotate after the rotating component rotates, wherein the exit angle is changed after the light machine module rotates.

6. The display adjustment method according to claim 5, wherein The rotating component comprises a rotor frame, an angle sensor is integrated on the rotor frame, the angle sensor detects the rotation angle of the rotor frame, the angle sensor is electrically connected with the control module, and the angle sensor transmits the rotation angle to the control module; The fixed base is internally provided with a PCB circuit board and a driving coil, the PCB circuit board is electrically connected with the control module, the driving coil is electrically connected with the PCB circuit board, and the angle sensor is electrically connected with the; The rotor frame is connected with the fixed base through a flexible hinge, and the rotor frame is connected with the light machine module; A permanent magnet is arranged on the inner side of the rotor frame, and the permanent magnet is oppositely arranged with the driving coil; After the driving coil is electrified through the PCB circuit board, the magnetic field generated by the driving coil interacts with the permanent magnet to drive the rotor frame to rotate, and the light machine module is driven to rotate after the rotor frame rotates.

7. The display adjustment method of claim 2, wherein, The body of the extended reality device is further provided with a collection module, and the collection module is electrically connected with the control module; The pupil center information of the target user and the exit pupil center information of the extended reality device are collected, which comprises the following steps: The pupil position information of the target user is collected by the collection module, pupil distance information is calculated according to the pupil position information, and the pupil center information is calculated based on the pupil position information and the pupil distance information; And the imaging picture projected by the waveguide module is collected by the collection module, and the exit pupil center information is calculated based on the imaging picture.

8. A display adjustment apparatus, characterized by comprising: The device is applied to an extended reality device, and the extended reality device comprises an optical-mechanical module. The device comprises: A collection module, configured to collect pupil center information of a target user and exit pupil center information of the extended reality device if it is detected that the extended reality device is in a wearing state; A calculation module, configured to calculate position offset information according to the pupil center information and the exit pupil center information; 9. An electronic device, comprising: An adjustment module, configured to adjust an exit angle of the optical-mechanical module according to the position offset information, so that the pupil center information matches the adjusted exit pupil center information of the extended reality device.

10. A computer-readable storage medium, characterized in that, The computer program is stored on the computer readable storage medium and is executable on the processor, and the processor implements the steps in the display adjustment method according to any one of claims 1-7 when executing the computer program. The computer program is stored on the computer readable storage medium and is executable on the processor, and the processor implements the steps in the display adjustment method according to any one of claims 1-7 when executing the computer program.

Images