Frame rate adjustment method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a frame rate adjustment method and device, electronic equipment and a storage medium, the method is applied to wearable display equipment provided with one or more displays for projecting video information to human eyes, and the method comprises the following steps: obtaining motion information of the wearable display equipment; the motion information comprises first motion state information, and the first motion state information is a motion state of the wearable display device under a first motion freedom degree; determining a motion state of the wearable display device according to the motion information; and based on a preset condition, adjusting the picture frame rate of the display, so that the change trend of the picture frame rate is at least partially consistent with the change trend of the motion state of the wearable display equipment. According to the method, the deviation angle of the two adjacent video frames displayed by the wearable display device is monitored in real time, the frame rate of the video frames is dynamically adjusted according to the deviation angle, and the frame rate does not need to be kept at a high frame rate all the time, so that the power consumption is reduced, the heat productivity is reduced, and the endurance time is prolonged.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of display technology, and in particular to a frame rate adjustment method, device, electronic device, and storage medium. Background Art

[0002] Before the rise of wearable display devices, such as AR, VR, and MR devices, the display positions of display devices were mostly in a relatively static state (relative to the earth's reference system). At this time, when the human eye views the image displayed on the display, as long as the frame rate reaches 30 frames, the human eye will not feel the freeze of the displayed content. After the rise of wearable display devices, the display position of wearable display devices is no longer in a relatively static state, but moves with the movement of the user's head. At this time, if the frame rate is still maintained at 30 frames, a ghosting phenomenon will occur (similar to the effect of shooting a waterfall with a long exposure time), making the display image unclear, resulting in poor viewing effect for users, and in severe cases, dizziness, affecting consumers' acceptance of wearable display devices.

[0003] In the related art, the frame rate of the wearable display device is set to a high frame rate. However, enabling the high frame rate for a long time will increase the power consumption of the wearable display device, causing the wearable display device to generate a lot of heat and shortening the battery life of the wearable display device. Summary of the Invention

[0004] In order to overcome the problems existing in the related art, the present application provides a frame rate adjustment method, device, electronic device and storage medium, which can reduce the power consumption of wearable display devices, reduce heat generation and improve battery life.

[0005] According to a first aspect of an embodiment of the present application, a frame rate adjustment method is provided, which is applied to a wearable display device having one or more displays for projecting video information to a human eye, comprising the following steps:

[0006] Obtaining motion information of the wearable display device; the motion information includes first motion state information, where the first motion state information is a motion state of the wearable display device in a first degree of freedom of motion;

[0007] According to the motion information, the motion state of the wearable display device is determined; based on preset conditions, the frame rate of the display is adjusted so that the frame rate change trend is at least partially consistent with the motion state change trend of the wearable display device.

[0008] According to a second aspect of an embodiment of the present application, a frame rate adjustment device is provided, including:

[0009] A motion information acquisition module is used to acquire motion information of the wearable display device; the motion information includes first motion state information, and the first motion state information is the motion state of the wearable display device in a first degree of freedom of motion;

[0010] The frame rate adjustment module is used to determine the motion state of the wearable display device based on the motion information; based on preset conditions, adjust the display frame rate so that the frame rate change trend is at least partially consistent with the motion state change trend of the wearable display device.

[0011] According to a third aspect of an embodiment of the present application, an electronic device is provided, including a display, a processor and a memory; the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the frame rate adjustment method as described above.

[0012] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the frame rate adjustment method as described above is implemented.

[0013] The embodiment of the present application obtains motion information of the wearable display device; the motion information includes first motion state information, which is the motion state of the wearable display device in the first degree of freedom of motion; determines the motion state of the wearable display device based on the motion information; and adjusts the image frame rate of the display based on preset conditions so that the trend of the image frame rate change is at least partially consistent with the trend of the motion state change of the wearable display device. The embodiment of the present application determines the motion state of the wearable display device based on the motion information of the wearable display device, and dynamically adjusts the image frame rate of the display based on preset conditions, without having to maintain the image frame rate of the display at a high frame rate, thereby reducing the power consumption of the wearable display device, reducing the heat generated by the wearable display device, and improving the battery life of the wearable display device.

[0014] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application.

[0015] For better understanding and implementation, the present invention is described in detail below with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is a flow chart of a frame rate adjustment method according to one embodiment of the present application;

[0017] Figure 2 This is a flowchart of step S20 in the frame rate adjustment method according to one embodiment of the present application;

[0018] Figure 3 This is a schematic block diagram of the structure of a frame rate adjustment device according to one embodiment of the present application;

[0019] Figure 4 This is a schematic block diagram of the structure of an electronic device shown in one embodiment of the present application. DETAILED DESCRIPTION

[0020] In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

[0021] It should be clear that the embodiments described are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the embodiments of the present application.

[0022] When the following description relates to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. In the description of this application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to the specific circumstances. The singular forms "a", "" and "the" used in this application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. The words "if" / "if" used herein can be interpreted as "at the time of" or "when" or "in response to determination".

[0023] In addition, in this application, unless otherwise specified, "plurality" refers to two or more. "And / or" describes the relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, or B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0024] The application environment of the frame rate adjustment method provided in the embodiment of the present application includes a wearable display device. The wearable display device includes at least one of an inertial measurement unit, a camera, and an environmental information measurement device, and the inertial measurement unit, the camera, and the environmental information measurement device are all communicatively connected to the processor of the wearable display device. Among them, the inertial measurement unit includes a gyroscope and / or an accelerometer, the gyroscope can measure the angular velocity of the wearable display device, and the accelerometer can measure the acceleration of the wearable display device. The camera can capture an environmental image of the environment in which the wearable display device is located, and the environmental information measurement device includes but is not limited to a binocular camera, a lidar, a millimeter-wave radar, and an ultrasonic radar.

[0025] The frame rate adjustment method provided in the embodiments of the present application can be performed by a frame rate adjustment device. The frame rate adjustment device can be implemented through software and / or hardware. The frame rate adjustment device can be composed of two or more physical entities or a single physical entity. The frame rate adjustment device can be any electronic device that has a frame rate adjustment application installed. The electronic device can be a wearable display device such as an AR, VR, or MR device.

[0026] A wearable display device is equipped with at least one display that projects video information to the human eye. When a user wears the wearable display device, the wearable display device moves with the user's head movement, causing the display position of the wearable display device to be in motion. The motion state of a wearable display device is mainly divided into two categories. One is the slight movement of the head when the user is still. At this time, the user's head movement is unconscious and the movement amplitude is small. The low frame rate of the display does not affect the user's experience. The other is the large-scale movement of the head under the subjective movement of the user. At this time, if the frame rate of the display is low, it will produce a ghosting phenomenon (similar to the effect of shooting a waterfall with a long exposure time), making the display picture unclear, resulting in poor viewing effect for the user and causing obvious dizziness.

[0027] In the related art, the frame rate of the wearable display device is set to a high frame rate. However, enabling a high frame rate for a long time will increase the power consumption of the wearable display device, causing the wearable display device to generate a lot of heat and shorten the battery life of the wearable display device.

[0028] To this end, the embodiment of the present application obtains motion information of the wearable display device; the motion information includes first motion state information, which is the motion state of the wearable display device in the first degree of freedom of motion; based on the motion information, the motion state of the wearable display device is determined; based on preset conditions, the frame rate of the display is adjusted so that the frame rate change trend is at least partially consistent with the motion state change trend of the wearable display device. The embodiment of the present application determines the motion state of the wearable display device based on the motion information of the wearable display device, and dynamically adjusts the frame rate of the display based on preset conditions. There is no need to keep the frame rate of the display at a high frame rate, thereby reducing the power consumption of the wearable display device, reducing the heat generated by the wearable display device, and improving the battery life of the wearable display device.

[0029] Based on this, the present application proposes a frame rate adjustment method, device, electronic device and storage medium.

[0030] See also Figure 1 The frame rate adjustment method provided in the embodiments of the present application is applied to a wearable display device having one or more displays for projecting video information to the human eye, and includes the following steps:

[0031] S10: Obtain motion information of the wearable display device; the motion information includes first motion state information, and the first motion state information is the motion state of the wearable display device in a first degree of freedom of motion.

[0032] Among them, the first degree of freedom of motion can be selected as one of the rotational degree of freedom and the translational degree of freedom; if the first degree of freedom of motion is the rotational degree of freedom, the first motion state information is the angle change information of the wearable display device under the rotational degree of freedom; if the first degree of freedom of motion is the translational degree of freedom, the first motion state information is the position change information of the wearable display device under the translational degree of freedom.

[0033] Taking the 3DOF (three degrees of freedom) scenario as an example, the embodiment of the present application uses the rotational degree of freedom as the first degree of freedom of motion, and obtains the angle change information of the wearable display device displaying adjacent video frames. Specifically, the angle information of the wearable display device displaying the current video frame and the angle information of the previous video frame displayed by the wearable display device are obtained, and the offset angle of the angle information of the current video frame relative to the angle information of the previous video frame of the current video frame is calculated. Among them, the angle information refers to the rotation angle of the wearable display device.

[0034] Among them, the user wears a wearable display device, and the display of the wearable display device renders the video screen corresponding to the video frame so that the user can watch the video screen. In the process of the user watching the video screen, the user's head moves, causing the posture of the wearable display device to change with the user's head. The posture of the wearable display device includes the position and rotation angle of the wearable display device. The rotation angle of the wearable display device is relative to the initial posture of the wearable display device. The initial posture of the wearable display device includes the initial position and the initial angle. The initial position can be the position when the wearable display device is started, or it can be the position when the wearable display device starts to display the video screen. The initial angle can be the angle when the wearable display device is started, or it can be the angle when the wearable display device starts to display the video screen.

[0035] In an embodiment of the first aspect of the present application, an environmental image of the environment in which the wearable display device is located, corresponding to two adjacent video frames displayed by the wearable display device, can be captured by a camera. Based on the environmental image corresponding to the two adjacent video frames, an offset angle of the wearable display device displaying the current video frame relative to the previous video frame displaying the current video frame is obtained. Environmental information of the environment in which the wearable display device is located, corresponding to two adjacent video frames displayed by the wearable display device, can also be captured by an environmental information measuring device. Based on the environmental information, an offset angle of the wearable display device displaying the current video frame relative to the previous video frame displaying the current video frame is obtained.

[0036] The rotation angle of the wearable display device can be obtained in real time when the wearable display device displays each video frame. Specifically, the rotation angle of the wearable display device displaying the current video frame is obtained through the camera, and the rotation angle of the previous video frame displayed by the wearable display device before the current video frame is monitored, and the offset angle of the wearable display device displaying the current video frame relative to the previous video frame displayed before the current video frame is obtained.

[0037] S20: Determine the motion state of the wearable display device based on the motion information; adjust the frame rate of the display based on preset conditions so that the frame rate change trend is at least partially consistent with the motion state change trend of the wearable display device.

[0038] The preconditions include:

[0039] a first motion domain and a second motion domain, wherein a motion state of the wearable display device in the second motion domain is stronger than a motion state of the wearable display device in the first motion domain;

[0040] Among them, taking the first degree of freedom of movement as the rotational degree of freedom as an example, the first motion domain is the first offset angle range, or the first motion domain is the first offset angular velocity range; the second motion domain is the second offset angle range, or the second motion domain is the second offset angular velocity range.

[0041] Taking the example that the first motion domain and the second motion domain are both offset angle ranges, the motion state of the wearable display device in the second motion domain includes the offset angle in the second offset angle range, and the motion state of the wearable display device in the first motion domain includes the offset angle in the first offset angle range. The motion state in the second motion domain is stronger than the motion state of the wearable display device in the first motion domain, which means that the offset angle in the second offset angle range is greater than the offset angle in the first offset angle range.

[0042] Taking the example that the first motion domain and the second motion domain are both within the offset angular velocity range, the motion state of the wearable display device in the second motion domain includes the offset angular velocity within the second offset angular velocity range, and the motion state of the wearable display device in the first motion domain includes the offset angular velocity within the first offset angular velocity range. The motion state in the second motion domain is stronger than the motion state of the wearable display device in the first motion domain, which means that the offset angular velocity within the second offset angular velocity range is greater than the offset angular velocity within the first offset angular velocity range.

[0043] The picture frame rate includes at least a first frame rate setting domain and a second frame rate setting domain, and the frame rate upper limit of the second frame rate setting domain is higher than the frame rate upper limit of the first frame rate setting domain.

[0044] Among them, since the frame rate itself is affected by the processing workload required for the device display, it cannot be stabilized at a fixed frame rate value, but is in a frame rate range (if the processing workload is huge, the frame rate will be unstable and decrease; if the processing workload is small, the frame rate will stabilize in a smaller range of variation). For this reason, the embodiment of the present application sets a first frame rate setting domain and a second frame rate setting domain, and the frame rate upper limit of the second frame rate setting domain is higher than the frame rate upper limit of the first frame rate setting domain, that is, when processing the same workload, the frame rate value of the wearable display device's picture frame rate in the second frame rate setting domain is higher than the frame rate value of the wearable display device's picture frame rate in the first frame rate setting domain.

[0045] If the current motion information is in the first motion range, the frame rate of the current display is controlled to be in the first frame rate setting range.

[0046] In the embodiment of the present application, the current motion information is the offset angle of the wearable display device displaying adjacent video frames. If the current motion information is within the first offset angle range, the frame rate of the current display is controlled to be within the first frame rate setting domain, that is, a smaller offset angle, matching a lower frame rate range; or

[0047] The current motion information is the offset angular velocity of adjacent video frames displayed by the wearable display device. If the current motion information is within the first offset angular velocity range, the frame rate of the current display is controlled to be within the first frame rate setting domain, that is, low offset angular velocity, to match the lower frame rate range; wherein the offset angular velocity is the ratio of the offset angle of adjacent video frames to the time interval between adjacent video frames.

[0048] If the current motion information is in the second motion range, the frame rate of the current display is controlled to be in the second frame rate setting range.

[0049] In this embodiment of the present application, the current motion information is the offset angle of adjacent video frames displayed by the wearable display device. If the current motion information is within the second offset angle range, the frame rate of the current display is controlled to be within the second frame rate setting range. That is, a larger offset angle matches a higher frame rate range, thereby reducing the sense of image freeze and alleviating the user's dizziness. Or,

[0050] The current motion information is the offset angular velocity of adjacent video frames displayed by the wearable display device. If the current motion information is within the second offset angular velocity range, the current display frame rate is controlled to be within the second frame rate setting range. In other words, a higher offset angular velocity matches a higher frame rate range, thereby reducing the perception of image lag and alleviating user motion sickness.

[0051] Optionally, the motion state change trend of the embodiment of the second aspect of the present invention is specifically a motion state change trend perpendicular to the direction of human eye observation. Specifically, if the human eye observation direction is looking straight ahead, the motion state change trend is a motion state change trend perpendicular to the direction of the front.

[0052] In an embodiment of the present application, if the offset angle or offset angular velocity of the wearable display device is large, the frame rate of the wearable display device is adjusted to a high frame rate. If the offset angle or offset angular velocity of the wearable display device is small, the frame rate of the wearable display device is adjusted to a low frame rate. Before the frame rate is adjusted, the frame rate of the current video frame may be a preset frame rate. Specifically, the preset frame rate may be a minimum frame rate.

[0053] The embodiments of the above-mentioned aspects of the present application are applied, by obtaining motion information of the wearable display device; the motion information includes first motion state information, and the first motion state information is the motion state of the wearable display device in the first degree of freedom of motion; according to the motion information, the motion state of the wearable display device is determined; based on preset conditions, the frame rate of the display is adjusted so that the trend of the frame rate change is at least partially consistent with the trend of the motion state change of the wearable display device. The embodiments of the present application determine the motion state of the wearable display device based on the motion information of the wearable display device, and dynamically adjust the frame rate of the display based on preset conditions. There is no need to keep the frame rate of the display at a high frame rate all the time, thereby reducing the power consumption of the wearable display device, reducing the heat generated by the wearable display device, and improving the battery life of the wearable display device.

[0054] In an optional embodiment, the step of obtaining the motion information of the wearable display device in step S10 includes step S101, which is specifically as follows:

[0055] S101: Obtain a change in the motion state of a wearable display device or a wearer of the wearable display device in space, and determine motion information of the wearable display device.

[0056] Among them, the motion information of the wearable display device can be determined by the following three solutions:

[0057] Solution 1: Obtain the inertial measurement unit data of the wearable display device and use an inertial measurement unit such as an IMU to detect changes in the motion state of the wearable display device, thereby determining the motion information of the wearable display device.

[0058] The inertial measurement unit data includes the angular velocity and acceleration of the wearable display device. Using a built-in algorithm, the angular velocity and acceleration of the wearable display device can be converted into the rotation angle of the wearable display device.

[0059] In an embodiment of the present application, by obtaining a first rotation angle of the wearable display device displaying the current video frame and a second rotation angle of the previous video frame displayed by the wearable display device, an offset angle of the first rotation angle relative to the second rotation angle can be obtained. The offset angle is divided by the time interval between adjacent video frames to obtain the offset angular velocity.

[0060] Through the inertial measurement unit data of the wearable display device, the offset angle or offset angular velocity of the wearable display device can be automatically and quickly obtained.

[0061] Solution 2: Obtain several continuous environmental images taken by the wearable display device, use the wearable display device's own camera to shoot the environment, and determine the motion information of the wearable display device through the image changes of adjacent frames.

[0062] The wearable display device is provided with a camera that can capture images of the environment in which the wearable display device is located, including images of objects in front of and around the wearable display device. The camera includes but is not limited to a monocular camera and a binocular camera.

[0063] In an embodiment of the present application, when the wearable display device displays the current video frame, the camera captures an image of the environment in which the wearable display device is located to obtain a first environment image. When the wearable display device displays the video frame previous to the current video frame, the camera captures an image of the environment in which the wearable display device is located to obtain a second environment image.

[0064] The overlapping images of the first environment image and the second environment image can be obtained, and matrix operations such as stretching and rotation can be performed on the overlapping images to calculate the offset angle or offset angular velocity of the current video frame displayed by the wearable display device relative to the previous video frame displayed by the current video frame. An object in front of the wearable display device can also be selected as the target object. During the movement of the wearable display device, the camera follows the movement of the wearable display device and shoots the target object from different positions and angles to obtain several target object images. The overlapping images of several target object images are obtained, and matrix operations such as stretching and rotation can be performed on the overlapping images to calculate the offset angle or offset angular velocity of the current video frame displayed by the wearable display device relative to the previous video frame displayed by the current video frame.

[0065] By collecting the environmental image of the environment where the wearable display device is located, the offset angle or offset angular velocity of the wearable display device can be automatically and quickly determined.

[0066] Solution 3: Based on inertial measurement unit data and / or several continuous environmental images, obtain environmental information, use SLAM and other technologies to build an environmental space model, and determine the motion information of the wearable display device based on the inertial measurement unit data and / or several continuous environmental images.

[0067] The environmental information includes but is not limited to binocular camera image data, lidar point cloud data, millimeter wave radar point cloud data, and ultrasonic point cloud data.

[0068] In an embodiment of the present application, the wearable display device may be equipped with one or more of a binocular camera, a laser radar, a millimeter-wave radar, and an ultrasonic radar. By scanning the environment in which the wearable display device is located using the binocular camera, the laser radar, the millimeter-wave radar, and the ultrasonic radar, environmental information of the environment in which the wearable display device is located can be obtained. The environmental information is input into a built-in spatial model algorithm to generate an environmental space model. The position and rotation angle of the wearable display device are obtained from the environmental space model, thereby obtaining the angle information of the wearable display device displaying the current video frame.

[0069] Based on the environmental information of the environment in which the wearable display device is located, the offset angle or offset angular velocity of the wearable display device can be automatically and quickly determined.

[0070] In an optional embodiment, the motion information further includes second motion state information, where the second motion state information is a motion change of the wearable display device in a second degree of freedom of motion;

[0071] Furthermore, taking the 6DOF scenario as an example, the wearable display device obtains motion changes in rotational freedom and translational freedom.

[0072] The first degree of freedom of motion is a rotational degree of freedom, and the first motion state information is angle change information of the wearable display device under the rotational degree of freedom; the second degree of freedom of motion is a translational degree of freedom, and the second motion state information is motion change information of the wearable display device under the translational degree of freedom;

[0073] See also Figure 2 Step S20 includes steps S201 to S203, which are specifically as follows:

[0074] S201: Acquire first motion state information and second motion state information, and determine a motion state of the wearable display device based on the first motion state information and the second motion state information;

[0075] S202: If the motion state of the wearable display device increases and meets a preset condition, increasing the current picture frame rate so that a trend of the picture frame rate change is at least partially consistent with a trend of the motion state change of the wearable display device;

[0076] When the motion state is enhanced, if the frame rate is low, the changes in the image content and the changes in motion felt by the human body will be significantly different, which can easily cause dizziness. Therefore, it is necessary to increase the frame rate (reduce the sense of stuttering) to reduce the occurrence of dizziness.

[0077] S203: If the motion state of the wearable display device weakens and meets the preset conditions, reduce the current picture frame rate so that the picture frame rate change trend is at least partially consistent with the motion state change trend of the wearable display device.

[0078] When the motion state weakens, the human body perceives less motion change, so a high frame rate is not needed to reduce dizziness. If the frame rate is high at this time, there will be frame rate waste, resulting in excessive power consumption and reduced battery life. Therefore, the frame rate needs to be reduced to match the change in motion state.

[0079] The embodiment of the present application realizes the motion state recognition of the wearable display device 6DOF by collecting the first motion state information and the second motion state information, better determines the motion state of the wearable display device, and then matches the frame rate change trend of the wearable display device with the motion state of the wearable device.

[0080] See also Figure 3 , a frame rate adjustment device 3 disclosed in an embodiment of the present application includes:

[0081] A motion information acquisition module 31 is configured to acquire motion information of the wearable display device; the motion information includes first motion state information, where the first motion state information is the motion state of the wearable display device in a first degree of freedom of motion;

[0082] Taking the first motion state information as angle information as an example, the motion information acquisition module is specifically an angle information acquisition module 31, which is used to obtain the angle information of the current video frame displayed by the wearable display device; the angle information is used to indicate the offset angle of the wearable display device displaying the current video frame relative to the previous video frame displaying the current video frame;

[0083] The frame rate adjustment module 32 is used to determine the motion state of the wearable display device based on the motion information; based on preset conditions, adjust the frame rate of the display so that the trend of the frame rate change is at least partially consistent with the trend of the motion state change of the wearable display device.

[0084] When the first motion state information is angle information, the frame rate adjustment module 32 is configured to adjust the frame rate of the current video frame based on the angle information. If the offset angle of the current video frame relative to the previous video frame displayed before the current video frame increases and meets a preset condition, the frame rate of the current video frame is increased.

[0085] The frame rate adjustment device provided in the above embodiment and the frame rate adjustment method provided in the embodiment of the present application belong to the same concept. For details on the implementation process, please refer to steps S10 to S20 of the method embodiment, which will not be repeated here.

[0086] This application also provides a device embodiment that can be used to implement the content of the frame rate adjustment method in the embodiment of this application. For details not disclosed in the device embodiment of this application, please refer to the content of the frame rate adjustment method in the embodiment of this application.

[0087] See also Figure 4 The present application further provides an electronic device 300, which can be a computer, a frame rate adjustment device, etc. In an exemplary embodiment of the present application, the electronic device 300 is a frame rate adjustment device, which includes: at least one processor 301, at least one memory 302, at least one display, at least one network interface 303, a user interface 304, and at least one communication bus 305.

[0088] The user interface 304 is mainly used to provide an input interface for the user and obtain data input by the user. Optionally, the user interface can also include a standard wired interface or a wireless interface.

[0089] The network interface 303 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0090] The communication bus 305 is used to realize the connection and communication between these components.

[0091] Among them, the processor 301 may include one or more processing cores. The processor uses various interfaces and lines to connect the various parts of the entire electronic device, and performs various functions of the electronic device and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory, and calling data stored in the memory. Optionally, the processor can be implemented in the form of at least one hardware of digital signal processing (DSP), field programmable gate array (FPGA), and programmable logic array (PLA). The processor can integrate one or more combinations of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing the content to be displayed by the display layer; and the modem is used to handle wireless communications. It is understandable that the above-mentioned modem may not be integrated into the processor and may be implemented separately through a chip.

[0092] Among them, the memory 302 may include a random access memory (RAM) or a read-only memory (Read-Only Memory). Optionally, the memory includes a non-transitory computer-readable storage medium. The memory can be used to store instructions, programs, codes, code sets or instruction sets. The memory may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory may also be optionally at least one storage device located away from the aforementioned processor. As Figure 4 As shown, the memory as a computer storage medium may include an operating system, a network communication module, a user interface module, and an operating application program.

[0093] The processor can be used to call the application of the frame rate adjustment method of the frame rate adjustment device stored in the memory, and specifically execute the method steps of the above-mentioned embodiment. The specific execution process can be referred to the specific description shown in the method embodiment, which will not be repeated here.

[0094] This application also provides a computer-readable storage medium having a computer program stored thereon, with instructions suitable for being loaded by a processor and executing the method steps of the above-described embodiments. The specific execution process can be referred to the specific description of the embodiments and is not described in detail here. The device where the storage medium is located can be a personal computer, laptop computer, smartphone, tablet computer, screen director device, or other electronic device.

[0095] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to the partial description of the method embodiments. The device embodiments described above are merely illustrative, wherein the components described as separate parts may or may not be physically separated, and the parts shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the present application scheme. A person of ordinary skill in the art can understand and implement it without paying any creative work.

[0096] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0097] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the function selected in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 function selected in a box or multiple boxes.

[0098] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 steps for the function selected in a box or multiple boxes.

[0099] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0100] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0101] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0102] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0103] The above are merely embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should all be included within the scope of the claims of the present application.

Claims

1. A frame rate adjustment method, characterized in that: The invention is applied to a wearable display device having one or more displays for projecting video information to a human eye, comprising the following steps: Acquire motion information of the wearable display device; the motion information includes first motion state information, where the first motion state information is a motion state of the wearable display device in a first degree of freedom of motion; Determining a motion state of the wearable display device according to the motion information; Based on preset conditions, the frame rate of the display is adjusted so that the frame rate change trend is at least partially consistent with the motion state change trend of the wearable display device.

2. The frame rate adjustment method according to claim 1, wherein: The acquiring of the motion information of the wearable display device includes: Obtain a change in the motion state of the wearable display device or a wearer of the wearable display device in space, and determine motion information of the wearable display device.

3. The frame rate adjustment method according to claim 2, wherein: The acquiring of a change in the motion state of the wearable display device or a wearer of the wearable display device in space and determining motion information of the wearable display device includes: Acquiring inertial measurement unit data of the wearable display device and / or a plurality of continuous environment images captured by the wearable display device; Based on the inertial measurement unit data and / or the plurality of continuous environmental images, motion information of the wearable display device is determined.

4. The frame rate adjustment method according to claim 1, wherein: The motion state change trend is specifically a motion state change trend perpendicular to the direction of human eye observation.

5. The frame rate adjustment method according to any one of claims 1 to 4, characterized in that: The preset conditions include: a first motion domain and a second motion domain, wherein a motion state of the wearable display device in the second motion domain is stronger than a motion state of the wearable display device in the first motion domain; The picture frame rate includes at least a first frame rate setting domain and a second frame rate setting domain, wherein the frame rate upper limit of the second frame rate setting domain is higher than the frame rate upper limit of the first frame rate setting domain; If the current motion information is in the first motion range, the frame rate of the current display is controlled to be in the first frame rate setting range; If the current motion information is in the second motion range, the frame rate of the current display is controlled to be in the second frame rate setting range.

6. The frame rate adjustment method according to any one of claims 1 to 4, characterized in that: The first degree of freedom of movement is one of a rotational degree of freedom and a translational degree of freedom; If the first motion degree of freedom is a rotational degree of freedom, the first motion state information is angle change information of the wearable display device under the rotational degree of freedom; If the first degree of motion freedom is a translational degree of freedom, the first motion state information is position change information of the wearable display device under the translational degree of freedom.

7. The frame rate adjustment method according to claim 6, wherein: The motion information further includes second motion state information, where the second motion state information is a motion change of the wearable display device in a second degree of freedom of motion; The first motion degree of freedom is a rotational degree of freedom, and the first motion state information is angle change information of the wearable display device under the rotational degree of freedom; The second motion degree of freedom is a translational degree of freedom, and the second motion state information is motion change information of the wearable display device under the translational degree of freedom; determining a motion state change trend of the wearable display device based on the motion information; Based on a preset condition, adjusting the frame rate of at least one of the displays so that a trend of the frame rate change is at least partially consistent with a trend of the motion state change of the wearable display device, comprising: Acquire first motion state information and second motion state information, and determine the motion state of the wearable display device based on the first motion state information and the second motion state information; If the motion state of the wearable display device is enhanced and meets a preset condition, the current picture frame rate is increased so that the picture frame rate change trend is at least partially consistent with the motion state change trend of the wearable display device; If the motion state of the wearable display device weakens and meets the preset conditions, the current picture frame rate is reduced so that the picture frame rate change trend is at least partially consistent with the motion state change trend of the wearable display device.

8. A frame rate adjustment device, characterized in that: include: A motion information acquisition module, configured to acquire motion information of the wearable display device; the motion information includes first motion state information, where the first motion state information is the motion state of the wearable display device in a first degree of freedom of motion; a frame rate adjustment module, configured to determine a motion state of the wearable display device based on the motion information; Based on preset conditions, the frame rate of the display is adjusted so that the frame rate change trend is at least partially consistent with the motion state change trend of the wearable display device.

9. An electronic device comprising a display, a processor, and a memory; characterized in that: The memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the frame rate adjustment method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the frame rate adjustment method according to any one of claims 1 to 7 is implemented.

Images