Screen display method and device, electronic equipment and computer readable storage medium

Abstract

The embodiment of the invention discloses a screen display method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of augmented reality, and the method comprises the following steps: displaying target content through a virtual display screen; if the motion information meeting the preset condition is detected, frame insertion parameter information is determined according to the motion information; and performing frame insertion display processing on the display of the target content based on the frame insertion parameter information to obtain a content display result. When the motion information meeting the preset condition is detected, the color ribbon color difference of the target content during the motion of the augmented reality equipment is reduced through the frame insertion display processing, the perception degree of a user on color separation in the motion process is reduced, and the user experience is improved. The frame insertion parameter information is determined on the basis of the motion information, so that frame insertion display processing is matched with the motion information, the relieving effect of the color difference of the colored ribbon is further improved, and the perception of the user on color separation generated in the motion process is further reduced.

Description

Technical Field

[0001] This application relates to the field of extended reality technology, specifically to a screen display method, apparatus, electronic device, and computer-readable storage medium. Background Technology

[0002] Extended Reality (XR) is a comprehensive term encompassing Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). Extended Reality technology expands human perception and interaction, allowing interaction with the real world through digital technology to create virtual, augmented, and mixed reality experiences. Extended Reality devices are widely used in navigation, information display, and augmented reality experiences, among other applications.

[0003] Currently, the virtual display portion of extended reality (such as augmented reality, AR) primarily utilizes a full-color diffractive waveguide micLED display solution. This solution can only achieve normal white balance by combining RGB colors through a cube prism. However, the display content of each RGB channel cannot be completely consistent during scanning. For example, during screen refresh, the RGB channel data cannot be refreshed in real time at the same point in time. This is because the image decoding data cannot be released all at once and needs to be sent serially via SPI, resulting in the same color block displaying red first, then green, then blue, and so on in a polling sequence.

[0004] However, this method of not refreshing the display at the same time point is prone to causing ghosting and trailing effects in dynamic scenes due to visual persistence, leading to color separation. For example, please refer to... Figure 1 , Figure 1 This is a schematic diagram illustrating the effect before frame interpolation display processing provided in this application embodiment. When the head-mounted extended reality device rotates, the white color block changes from position a to position b due to the head rotation. During this transformation and movement, the red, green, and blue components that make up the white color block appear to be displayed independently in sequence, forming a color band composed of red, green, and blue color blocks, resulting in color separation. As the head rotation speed increases, the color separation phenomenon becomes more severe, directly leading to image distortion and even causing dizziness in the user, thus affecting the user experience.

[0005] Currently, there are designs that display red, green, and blue simultaneously, such as in the same frame, to eliminate this color separation phenomenon. However, this method has high hardware requirements and is correspondingly more expensive. Summary of the Invention

[0006] This application provides a screen display method, apparatus, electronic device, and computer-readable storage medium that can reduce the user's perception of color separation during movement and improve the user experience.

[0007] In a first aspect, embodiments of this application provide a screen display method applied to an extended reality device, the method comprising:

[0008] Display the target content using a virtual display screen;

[0009] If motion information that meets preset conditions is detected, then the interpolation parameter information is determined based on the motion information;

[0010] The target content is displayed using frame interpolation based on the interpolation parameter information to obtain the content display result.

[0011] Secondly, embodiments of this application also provide a screen display device for use in an extended reality device, the device comprising:

[0012] The initial display module is used to display the target content via a virtual display screen;

[0013] The information determination module is used to determine interpolation parameter information based on motion information that meets preset conditions if motion information that meets preset conditions is detected.

[0014] The display control module is used to perform frame interpolation display processing on the target content based on the frame interpolation parameter information to obtain the content display result.

[0015] Optionally, in some embodiments of this application, the motion information includes acceleration;

[0016] If motion information that meets preset conditions is detected, then determining interpolation parameter information based on the motion information includes:

[0017] Determine the screen refresh rate of the virtual display screen;

[0018] The frame interpolation parameter information is determined based on the acceleration and the screen refresh rate.

[0019] Optionally, in some embodiments of this application, the interpolation parameter information includes the number of interpolated frames per unit time;

[0020] The step of performing frame interpolation display processing on the target content based on the interpolation parameter information to obtain the content display result includes:

[0021] During the motion process that meets the preset conditions, preset frames are inserted according to the number of frames to be inserted during the display of the target content, thereby obtaining the content display result.

[0022] Optionally, in some embodiments of this application, the step of inserting preset frames according to the number of interpolated frames during the display of the target content in the motion process that satisfies the preset conditions, to obtain the content display result, includes:

[0023] Calculate the display brightness information based on the number of interpolated frames and the ambient brightness.

[0024] During the movement process that meets the preset conditions, preset frames are inserted according to the number of frames to be inserted during the display of the target content, and the display brightness of the target content and the preset frames is adjusted according to the display brightness information to obtain the content display result.

[0025] Optionally, in some embodiments of this application, the virtual display screen includes a first screen refresh rate for a first region and a second screen refresh rate for a second region, and the interpolation parameter information includes first interpolation parameter information for the first region and second interpolation parameter information for the second region;

[0026] If motion information that meets preset conditions is detected, then determining interpolation parameter information based on the motion information includes:

[0027] If motion information that meets preset conditions is detected, then a first interpolation parameter information for the first region is determined based on the acceleration and the first screen refresh rate, and a second interpolation parameter information for the second region is determined based on the acceleration and the second screen refresh rate.

[0028] Optionally, in some embodiments of this application, the target content is obtained by combining the luminance data of at least one color channel, the luminance data of each color channel is output serially, and the interpolation parameter information includes channel interpolation parameter information for each color channel.

[0029] If motion information that meets preset conditions is detected, then determining interpolation parameter information based on the motion information includes:

[0030] If motion information that meets preset conditions is detected, the interpolation parameter information of each color channel is determined based on the motion information;

[0031] The step of performing frame interpolation display processing on the target content based on the interpolation parameter information to obtain the content display result includes:

[0032] During the motion process that meets the preset conditions, the serial output display of the target content is processed by interpolation according to the interpolation parameter information of each color channel to obtain the content display result.

[0033] Optionally, in some embodiments of this application, the motion information includes angular velocity and acceleration, and the method further includes:

[0034] The angular velocity is acquired using a gyroscope, and the acceleration is acquired using an accelerometer.

[0035] If the angular velocity represents the rotation of the extended reality device, and the acceleration exceeds the velocity threshold, then the motion information is determined to meet the preset condition.

[0036] Furthermore, after obtaining the content display result, if the real-time obtained motion information does not meet the preset conditions, the display will revert to being only for the target content, without performing the frame interpolation display process.

[0037] Thirdly, embodiments of this application also provide an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, it implements the steps in the screen display method described above.

[0038] Fourthly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps in the screen display method described above.

[0039] Fifthly, embodiments of this application also provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various optional implementations described in embodiments of this application.

[0040] In summary, the extended reality device of this application displays target content through a virtual display screen. If motion information that meets preset conditions is detected, interpolation parameter information is determined based on the motion information, and the display of the target content is processed by interpolation based on the interpolation parameter information to obtain the content display result.

[0041] Specifically, when motion information meeting preset conditions is detected, frame interpolation is used to reduce the color difference of the target content during motion on the extended reality device, thereby reducing the user's perception of color separation during motion and improving the user experience. Furthermore, by determining the frame interpolation parameters based on this motion information, the frame interpolation display processing is matched with the motion information, further enhancing the mitigation effect of color difference and further reducing the user's perception of color separation during motion. Attached Figure Description

[0042] To more clearly illustrate the technical solutions in this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0043] Figure 1 This is a schematic diagram illustrating the effect before frame interpolation display processing provided in the embodiments of this application;

[0044] Figure 2 This is a schematic diagram of a scenario in which an extended reality device, as provided in an embodiment of this application, performs the screen display method;

[0045] Figure 3 This is a flowchart illustrating the screen display method provided in an embodiment of this application;

[0046] Figure 4 This is a schematic diagram illustrating the effect of frame interpolation display processing provided in the embodiments of this application;

[0047] Figure 5 This is a schematic diagram of the structure of the screen display device provided in the embodiments of this application;

[0048] Figure 6 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0049] The technical solutions of this application will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0050] This application provides a screen display method, apparatus, electronic device, and computer-readable storage medium. Specifically, this application provides a screen display apparatus suitable for electronic devices, including extended reality devices. These extended reality devices include, but are not limited to, head-mounted displays and wearable glasses. The extended reality device can also be an integrated extended reality device built into a computing processing unit, or a separate extended reality device external to the computing processing unit. These extended reality devices include, but are not limited to, airborne optical display systems (i.e., head-up display systems) used in vehicles such as aircraft, automobiles, and ships. Examples include AR-HUD (Augmented Reality Hud-up Display) mounted on intelligent connected vehicles; extended reality applications (such as extended reality games, virtual tourism, telemedicine, or virtual experiments) used in handheld mobile devices such as mobile phones, laptops, and tablets; and near-eye display systems used in wearable devices such as head-mounted displays and smart glasses.

[0051] For example, please see Figure 2 , Figure 2 This is a schematic diagram illustrating a scenario where an extended reality device, according to an embodiment of this application, executes the screen display method. Specifically, the execution process of the extended reality device executing the screen display method is as follows:

[0052] The extended reality device 201 displays target content through a virtual display screen. If motion information that meets preset conditions is detected, the interpolation parameter information is determined based on the motion information, and the display of the target content is processed by interpolation based on the interpolation parameter information to obtain the content display result.

[0053] For example, when a user wears an extended reality device, the device first displays the target content on a virtual screen. Then, when the user turns their head while using the device, the device detects this head movement and analyzes the motion information to determine the frame interpolation parameters based on the motion information. Based on these parameters, the device performs frame interpolation on the target content to obtain the content display result after frame extraction.

[0054] In summary, this application embodiment reduces the color difference of the target content in the extended reality device during motion by using frame interpolation display processing when motion information meeting preset conditions is detected. This reduces the user's perception of color separation during motion and improves the user experience. Specifically, by determining the frame interpolation parameters based on the motion information, the frame interpolation display processing is matched with the motion information, further enhancing the mitigation effect of color difference and further reducing the user's perception of color separation during motion.

[0055] The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the priority of the embodiments.

[0056] Please see Figure 3 , Figure 3 This is a flowchart illustrating a screen display method provided in an embodiment of this application. Although the flowchart shows a logical order, in some cases, the steps shown or described may be executed in a different order than that shown in the flowchart. Specifically, the execution entity of this screen display method includes an extended reality device, and the specific flow of the screen display method is as follows:

[0057] 301. Display the target content via a virtual display screen.

[0058] The virtual display screen is not the physical screen of the augmented reality device. The physical screen is the actual lens of the augmented reality device; for example, when the augmented reality device is in the form of smart glasses, the physical screen is the lens of the smart glasses. The virtual display screen is a screen with a certain resolution (e.g., 1280*960) that the user can see at a certain distance (e.g., 4m) in front of their eyes after wearing the corresponding smart glasses. This screen with a certain resolution is the virtual display screen. This virtual display screen is formed by the propagation and conversion of the actual micro-display screen set in the augmented reality device through numerous optical components.

[0059] The target content is the content displayed based on display requirements. This target content is displayed on a virtual display screen and is also called virtual content. For example, the target content can be an image or a user interface.

[0060] 302. If motion information that meets preset conditions is detected, then the interpolation parameter information is determined based on the motion information.

[0061] Among them, motion information includes motion-related information, such as angular velocity and acceleration generated by head rotation when wearing an augmented reality device.

[0062] The preset condition refers to whether the motion meets the triggering conditions for frame interpolation display processing, as set in this embodiment. That is, when the motion information meets the preset condition, the calculation of the frame interpolation parameter information is triggered. For example, the preset condition includes rotation and acceleration exceeding a set speed threshold.

[0063] Among them, the interpolation parameter information is determined by motion information, so that the interpolation parameter information is matched with the motion information of the extended reality device, thereby improving the accuracy and effectiveness of the interpolation parameter information.

[0064] 303. Based on the interpolation parameter information, perform frame interpolation display processing on the target content to obtain the content display result.

[0065] Frame interpolation refers to inserting a certain number of preset frames during the display of the target content. For example, inserting 30 black frames into the original 60 image frames displayed per second results in a frame sequence of 30 image frames and 30 black frames per second. This frame sequence is then displayed in place of the original 60 image frames. A black frame refers to a completely black image frame, which can be achieved by turning off the micro LED display.

[0066] It should be noted that in this embodiment, the RGB values ​​of the color blocks are not refreshed at the same time, resulting in a time difference in the display of red, green, and blue. Because color bands appear in the virtual display during movement, causing users to perceive color separation, this embodiment reduces the color difference between the color blocks in the color bands by inserting a set frame (such as a black frame), thus reducing the user's perception of color separation.

[0067] For example, please see Figure 4 , Figure 4 This is a schematic diagram illustrating the effect of frame interpolation display processing provided in this application embodiment. During the movement of the extended reality device, the original red, green, and blue blocks in the color band generated when the white block is moved from position a to position b are adjusted to darker, lighter-colored blocks, reducing color difference.

[0068] In summary, this application embodiment reduces the color difference of the target content in the extended reality device during motion by using frame interpolation display processing when motion information meeting preset conditions is detected. This reduces the user's perception of color separation during motion and improves the user experience. Specifically, by determining the frame interpolation parameters based on the motion information, the frame interpolation display processing is matched with the motion information, further enhancing the mitigation effect of color difference and further reducing the user's perception of color separation during motion.

[0069] In this embodiment, the color separation effect of the color blocks and ribbons is also related to the screen refresh rate. Therefore, in this embodiment, the interpolation parameter information is calculated in conjunction with the screen refresh rate. That is, optionally, in some embodiments of this application, the motion information includes acceleration. The step "if motion information that meets preset conditions is detected, then the interpolation parameter information is determined based on the motion information" includes:

[0070] Determine the screen refresh rate of the virtual display screen;

[0071] The frame interpolation parameter information is determined based on the acceleration and the screen refresh rate.

[0072] It is understandable that by combining motion acceleration and screen refresh rate to determine interpolation parameter information, the matching degree between interpolation parameter information and motion and virtual reality refresh rate can be improved, thereby enhancing the accuracy and effectiveness of interpolation parameter information.

[0073] For example, in the embodiments of this application, the frame interpolation parameter information includes the number of interpolated frames to be inserted, and the number of interpolated frames x can be expressed as: x = FPS * a / m. Where, a is the acceleration value, FPS is the screen refresh rate of the virtual display, which is generally 60Hz and 120Hz, and m is an adjustment parameter, which is an empirical value used to balance the number of interpolated frames and avoid it being too small or too large.

[0074] Correspondingly, during the motion, a set number of frames (e.g., black frames) are inserted into the display process of the target content. That is, optionally, in some embodiments of this application, the frame insertion parameter information includes the number of frames inserted per unit time. The step "perform frame insertion display processing on the target content based on the frame insertion parameter information to obtain the content display result" includes:

[0075] During the motion process that meets the preset conditions, preset frames are inserted according to the number of frames to be inserted during the display of the target content, thereby obtaining the content display result.

[0076] For example, during the user's head movement, the specified number of black frames can be inserted. These black frames can be inserted into the display of the target content at fixed frame intervals.

[0077] It is understandable that the display brightness of the target content during motion will be affected after inserting a set frame. Therefore, in this embodiment, the display brightness is adjusted based on the ambient brightness and the number of frames inserted to reduce the problem of poor user experience caused by brightness changes. That is, optionally, in some embodiments of this application, the step "inserting a preset frame according to the number of frames inserted during the display of the target content in motion that meets the preset conditions, to obtain the content display result" includes:

[0078] Calculate the display brightness information based on the number of interpolated frames and the ambient brightness.

[0079] During the movement process that meets the preset conditions, preset frames are inserted according to the number of frames to be inserted during the display of the target content, and the display brightness of the target content and the preset frames is adjusted according to the display brightness information to obtain the content display result.

[0080] This method balances the impact of color adjustment on brightness by adjusting display brightness based on ambient light and the number of interpolated frames. For example, the faster the extended reality device accelerates, the more interpolated frames (e.g., black frames) are used, which in turn reduces display brightness and further reduces the perception of color separation caused by motion.

[0081] In this embodiment, the display brightness information P can be expressed as: p = n / x, where x is the number of interpolated frames corresponding to the set frame, and n is an adjustment parameter. This adjustment parameter n is affected by the ambient brightness; that is, the value of the adjustment parameter n is different for different ambient brightness levels. The adjustment parameter n corresponding to each ambient brightness can be pre-established as a mapping relationship, through which the adjustment parameter n corresponding to the current ambient brightness can be quickly obtained. The display brightness information p can correspond to a brightness level, which can correspond to a brightness range or a range of brightness values. For example, the brightness value can be divided into ten brightness ranges, each corresponding to a range of brightness values.

[0082] In this embodiment of the application, this frame interpolation display processing based on screen refresh rate is also applicable to screen designs in which a virtual display screen simultaneously contains multiple screen refresh rates. Specifically, in some embodiments of this application, the virtual display screen includes a first screen refresh rate for a first region and a second screen refresh rate for a second region. The frame interpolation parameter information includes first frame interpolation parameter information for the first region and second frame interpolation parameter information for the second region. The step "If motion information satisfying preset conditions is detected, then determine the frame interpolation parameter information based on the motion information" includes:

[0083] If motion information that meets preset conditions is detected, then a first interpolation parameter information for the first region is determined based on the acceleration and the first screen refresh rate, and a second interpolation parameter information for the second region is determined based on the acceleration and the second screen refresh rate.

[0084] For example, the first screen has a refresh rate of 60Hz and the second screen has a refresh rate of 120Hz, or the first screen has a refresh rate of 120Hz and the second screen has a refresh rate of 60Hz, etc.

[0085] By configuring different frame interpolation parameters for different areas of the virtual display screen according to their varying refresh rates, separate frame interpolation processing can be applied to the corresponding first and second areas. This allows high-frequency black frame insertion (e.g., 120Hz) to be used in high-motion areas and low-frequency insertion (e.g., 60Hz) to be used in low-motion areas, thus reducing overall power consumption.

[0086] It is understandable that the visual impact of displaying red, green, and blue colors on users differs for each color block. Therefore, for the separate display of red, green, and blue color blocks, different degrees of frame interpolation display processing can be applied to different colors. That is, the corresponding channel frame interpolation parameter information is calculated for each color, and the color of each channel is processed by frame interpolation display using the channel frame interpolation parameter information. Optionally, in some embodiments of this application, the target content is obtained by combining the luminance data of at least one color channel, and the luminance data of each color channel is output serially. The frame interpolation parameter information includes channel frame interpolation parameter information for each color channel. The step "if motion information that meets the preset conditions is detected, then the frame interpolation parameter information is determined according to the motion information" includes:

[0087] If motion information that meets preset conditions is detected, the interpolation parameter information of each color channel is determined based on the motion information;

[0088] The step of performing frame interpolation display processing on the target content based on the interpolation parameter information to obtain the content display result includes:

[0089] During the motion process that meets the preset conditions, the serial output display of the target content is processed by interpolation according to the interpolation parameter information of each color channel to obtain the content display result.

[0090] For example, for red, green, and blue, adjustment parameters are determined based on their respective perceived brightness. These adjustment parameters, along with motion information, are then used to determine the interpolation parameters for each color channel. For instance, under the same physical intensity: green light has the highest perceived brightness (approximately 60%), followed by red light (approximately 30%), and blue light has the lowest (approximately 10%). After obtaining the frame extraction parameters through motion information, these interpolation parameters are used as the interpolation parameters for green light. Then, based on the 6:3:1 relationship corresponding to perceived brightness, the interpolation parameters for red and blue are determined.

[0091] In summary, in this embodiment, when the user's head rotates, based on the display characteristics of red, green, and blue in each color block of the virtual display screen, frame interpolation is used to reduce the color difference of the color bands in the color blocks, thereby reducing the user's perception of color changes and improving the user experience. When the user's head stops rotating, the initial target content display scheme is restored; that is, frame interpolation is not performed when the head rotation is slight or stationary. Optionally, in some embodiments of this application, the motion information includes angular velocity and acceleration. The method further includes:

[0092] The angular velocity is acquired using a gyroscope, and the acceleration is acquired using an accelerometer.

[0093] If the angular velocity represents the rotation of the extended reality device, and the acceleration exceeds the velocity threshold, then the motion information is determined to meet the preset condition.

[0094] Furthermore, after obtaining the content display result, if the real-time obtained motion information does not meet the preset conditions, the display will revert to being only for the target content, without performing the frame interpolation display process.

[0095] For example, when the angular velocity changes significantly, it is assumed that the augmented reality device is rotating, such as the head movement of the user wearing the augmented reality device.

[0096] An acceleration exceeding a speed threshold indicates rapid rotation. In this embodiment, when the acceleration is zero or negative, the frame interpolation display process is stopped.

[0097] In summary, this application embodiment reduces the color difference of the target content in the extended reality device during motion by using frame interpolation display processing when motion information meeting preset conditions is detected. This reduces the user's perception of color separation during motion and improves the user experience. Specifically, by determining the frame interpolation parameters based on the motion information, the frame interpolation display processing is matched with the motion information, further enhancing the mitigation effect of color difference and further reducing the user's perception of color separation during motion.

[0098] Specifically, by combining the screen refresh rate to determine the interpolation parameter information, the accuracy and effectiveness of the interpolation display processing are improved. By adjusting the display brightness based on the ambient brightness and the number of interpolated frames, a balance is achieved in the brightness impact of the interpolation display processing.

[0099] To facilitate better implementation of the screen display method of this application, this application also provides a screen display device based on the above-described screen display method. The meanings of the terms used are the same as in the screen display method described above, and specific implementation details can be found in the descriptions of the method embodiments.

[0100] Please see Figure 5 , Figure 5 This is a schematic diagram of the structure of a screen display device provided in an embodiment of this application. The screen display device is applied to an extended reality device, and the screen display device can specifically be as follows:

[0101] Initial display module 501 is used to display target content through a virtual display screen;

[0102] The information determination module 502 is used to determine interpolation parameter information based on motion information that meets preset conditions if motion information that meets preset conditions is detected.

[0103] The display control module 503 is used to perform frame interpolation display processing on the target content based on the frame interpolation parameter information to obtain the content display result.

[0104] Optionally, in some embodiments of this application, the motion information includes acceleration;

[0105] If motion information that meets preset conditions is detected, then determining interpolation parameter information based on the motion information includes:

[0106] Determine the screen refresh rate of the virtual display screen;

[0107] The frame interpolation parameter information is determined based on the acceleration and the screen refresh rate.

[0108] Optionally, in some embodiments of this application, the interpolation parameter information includes the number of interpolated frames per unit time;

[0109] The step of performing frame interpolation display processing on the target content based on the interpolation parameter information to obtain the content display result includes:

[0110] During the motion process that meets the preset conditions, preset frames are inserted according to the number of frames to be inserted during the display of the target content, thereby obtaining the content display result.

[0111] Optionally, in some embodiments of this application, the step of inserting preset frames according to the number of interpolated frames during the display of the target content in the motion process that satisfies the preset conditions, to obtain the content display result, includes:

[0112] Calculate the display brightness information based on the number of interpolated frames and the ambient brightness.

[0113] During the movement process that meets the preset conditions, preset frames are inserted according to the number of frames to be inserted during the display of the target content, and the display brightness of the target content and the preset frames is adjusted according to the display brightness information to obtain the content display result.

[0114] Optionally, in some embodiments of this application, the virtual display screen includes a first screen refresh rate for a first region and a second screen refresh rate for a second region, and the interpolation parameter information includes first interpolation parameter information for the first region and second interpolation parameter information for the second region;

[0115] If motion information that meets preset conditions is detected, then determining interpolation parameter information based on the motion information includes:

[0116] If motion information that meets preset conditions is detected, then a first interpolation parameter information for the first region is determined based on the acceleration and the first screen refresh rate, and a second interpolation parameter information for the second region is determined based on the acceleration and the second screen refresh rate.

[0117] Optionally, in some embodiments of this application, the target content is obtained by combining the luminance data of at least one color channel, the luminance data of each color channel is output serially, and the interpolation parameter information includes channel interpolation parameter information for each color channel.

[0118] If motion information that meets preset conditions is detected, then determining interpolation parameter information based on the motion information includes:

[0119] If motion information that meets preset conditions is detected, the interpolation parameter information of each color channel is determined based on the motion information;

[0120] The step of performing frame interpolation display processing on the target content based on the interpolation parameter information to obtain the content display result includes:

[0121] During the motion process that meets the preset conditions, the serial output display of the target content is processed by interpolation according to the interpolation parameter information of each color channel to obtain the content display result.

[0122] Optionally, in some embodiments of this application, the motion information includes angular velocity and acceleration, and the method further includes:

[0123] The angular velocity is acquired using a gyroscope, and the acceleration is acquired using an accelerometer.

[0124] If the angular velocity represents the rotation of the extended reality device, and the acceleration exceeds the velocity threshold, then the motion information is determined to meet the preset condition.

[0125] Furthermore, after obtaining the content display result, if the real-time obtained motion information does not meet the preset conditions, the display will revert to being only for the target content, without performing the frame interpolation display process.

[0126] In this embodiment, the initial display module 501 first displays the target content through a virtual display screen. If the information determination module 502 detects motion information that meets preset conditions, it determines the interpolation parameter information based on the motion information. The display control module 503 then performs interpolation display processing on the target content based on the interpolation parameter information to obtain the content display result.

[0127] In this embodiment, when motion information meeting preset conditions is detected, frame interpolation display processing is used to reduce the color difference of the target content during motion on the extended reality device, thereby reducing the user's perception of color separation during motion and improving the user experience. Specifically, by determining the frame interpolation parameters based on the motion information, the frame interpolation display processing is matched with the motion information, further enhancing the mitigation effect of color difference and further reducing the user's perception of color separation during motion.

[0128] In addition, this application also provides an electronic device, such as Figure 6 As shown, it illustrates a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Specifically:

[0129] The electronic device may include components such as a processor 601 with one or more processing cores, a memory 602 with one or more computer-readable storage media, a power supply 603, and an input unit 604. Those skilled in the art will understand that... Figure 6 The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:

[0130] The processor 601 is the control center of the electronic device. It connects various parts of the electronic device via various interfaces and lines, and performs various functions and processes data by running or executing software programs and / or modules stored in the memory 602, and by calling data stored in the memory 602, thereby providing overall monitoring of the electronic device. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 601.

[0131] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0132] The electronic device also includes a power supply 603 that supplies power to the various components. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 603 may also include one or more DC or AC power supplies, recharging systems, power equipment debugging circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0133] The electronic device may also include an input unit 604, which can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0134] Although not shown, the electronic device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 601 in the electronic device loads the executable files corresponding to the processes of one or more applications into the memory 602 according to the following instructions, and the processor 601 runs the applications stored in the memory 602, thereby implementing the steps in any of the screen display methods provided in the embodiments of this application.

[0135] The extended reality device in this application displays target content through a virtual display screen. If motion information that meets preset conditions is detected, interpolation parameter information is determined based on the motion information, and the display of the target content is processed by interpolation based on the interpolation parameter information to obtain the content display result.

[0136] Specifically, when motion information meeting preset conditions is detected, frame interpolation is used to reduce the color difference of the target content during motion on the extended reality device, thereby reducing the user's perception of color separation during motion and improving the user experience. Furthermore, by determining the frame interpolation parameters based on this motion information, the frame interpolation display processing is matched with the motion information, further enhancing the mitigation effect of color difference and further reducing the user's perception of color separation during motion.

[0137] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0138] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0139] Therefore, this application provides a computer-readable storage medium storing a computer program that can be loaded by a processor to perform the steps in any of the screen display methods provided in this application.

[0140] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0141] The computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0142] Since the instructions stored in the computer-readable storage medium can execute the steps of any of the screen display methods provided in this application, the beneficial effects that any of the screen display methods provided in this application can achieve can be realized, as detailed in the preceding embodiments, and will not be repeated here.

[0143] The foregoing has provided a detailed description of a screen display method, apparatus, electronic device, and computer-readable storage medium provided in this application. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, those skilled in the art will recognize that there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A screen display method, characterized in that, Applied to extended reality devices, the method includes: Display the target content using a virtual display screen; If motion information that meets preset conditions is detected, then the interpolation parameter information is determined based on the motion information; The target content is displayed using frame interpolation based on the interpolation parameter information to obtain the content display result.

2. The screen display method according to claim 1, characterized in that, The motion information includes acceleration; If motion information that meets preset conditions is detected, then determining interpolation parameter information based on the motion information includes: Determine the screen refresh rate of the virtual display screen; The frame interpolation parameter information is determined based on the acceleration and the screen refresh rate.

3. The screen display method according to claim 1, characterized in that, The interpolation parameter information includes the number of interpolated frames per unit time; The step of performing frame interpolation display processing on the target content based on the interpolation parameter information to obtain the content display result includes: During the motion process that meets the preset conditions, preset frames are inserted according to the number of frames to be inserted during the display of the target content, thereby obtaining the content display result.

4. The screen display method according to claim 3, characterized in that, The step of inserting preset frames into the display process of the target content according to the preset frame number during the motion process that meets the preset conditions, to obtain the content display result, includes: Calculate the display brightness information based on the number of interpolated frames and the ambient brightness. During the movement process that meets the preset conditions, preset frames are inserted according to the number of frames to be inserted during the display of the target content, and the display brightness of the target content and the preset frames is adjusted according to the display brightness information to obtain the content display result.

5. The screen display method according to claim 2, characterized in that, The virtual display screen includes a first screen refresh rate for a first region and a second screen refresh rate for a second region, and the interpolation parameter information includes a first interpolation parameter information for the first region and a second interpolation parameter information for the second region. If motion information that meets preset conditions is detected, then determining interpolation parameter information based on the motion information includes: If motion information that meets preset conditions is detected, then a first interpolation parameter information for the first region is determined based on the acceleration and the first screen refresh rate, and a second interpolation parameter information for the second region is determined based on the acceleration and the second screen refresh rate.

6. The screen display method according to claim 1, characterized in that, The target content is obtained by combining the luminance data of at least one color channel, and the luminance data of each color channel is output serially. The interpolation parameter information includes channel interpolation parameter information for each color channel. If motion information that meets preset conditions is detected, then determining interpolation parameter information based on the motion information includes: If motion information that meets preset conditions is detected, the interpolation parameter information of each color channel is determined based on the motion information; The step of performing frame interpolation display processing on the target content based on the interpolation parameter information to obtain the content display result includes: During the motion process that meets the preset conditions, the serial output display of the target content is processed by interpolation according to the interpolation parameter information of each color channel to obtain the content display result.

7. The screen display method according to claim 1, characterized in that, The motion information includes angular velocity and acceleration, and the method further includes: The angular velocity is acquired using a gyroscope, and the acceleration is acquired using an accelerometer. If the angular velocity represents the rotation of the extended reality device, and the acceleration exceeds the velocity threshold, then the motion information is determined to meet the preset condition. Furthermore, after obtaining the content display result, if the real-time obtained motion information does not meet the preset conditions, the display will revert to being only for the target content, without performing the frame interpolation display process.

8. A screen display device, characterized in that, Applied to an extended reality device, the device includes: The initial display module is used to display the target content via a virtual display screen; The information determination module is used to determine interpolation parameter information based on motion information that meets preset conditions if motion information that meets preset conditions is detected. The display control module is used to perform frame interpolation display processing on the target content based on the frame interpolation parameter information to obtain the content display result.

9. An electronic device, characterized in that, It includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the screen display method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the screen display method as described in any one of claims 1-7.

Images