Image rendering method and apparatus for interface display, display device, and storage medium
By receiving interface update signals to obtain the rendered image sequence and adjust parameters, the problem of low flexibility in image rendering of display devices is solved and the user experience is improved.
Patent Information
- Application Number
- PCT/CN2025/084353
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-29
- Filing Date
- 2025-03-24
- Publication Date
- 2025-10-02
AI Technical Summary
Display devices in the prior art have low flexibility during image rendering, resulting in a poor user experience.
By receiving the interface update signal, obtaining the application's rendered image sequence, determining the image rendering time and interface update time, adjusting the parameters of the target rendered image to meet the preset display conditions, and improving the timeliness and adaptability of image rendering.
The display effect of the display device is improved and the user's visual experience is enhanced.
Smart Images

Figure CN2025084353_02102025_PF_FP_ABST
Abstract
Description
Image rendering method, device, display device and storage medium for interface display
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on March 29, 2024, with application number 2024103829532, and invention name “Image rendering method, device, display device and storage medium for interface display”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of visual processing, and in particular to an image rendering method, apparatus, display device and storage medium for interface display. Background Art
[0003] The display device in the related technology can obtain the rendered images rendered by each application based on the interface update signal, and update the display interface according to the rendered image. However, the application usually renders the image based on pre-set parameters, resulting in low flexibility in image rendering and poor user experience. Therefore, there is an urgent need for an image rendering method that can improve the display effect.
[0004] Application Contents
[0005] The main purpose of this application is to provide an image rendering method, device, display device and computer storage medium for interface display, aiming to improve the display effect of the display device.
[0006] In a first aspect, the present application provides an image rendering method for an interface display, the image rendering method for an interface display comprising the following steps:
[0007] Receiving an interface update signal, and acquiring, in response to the interface update signal, a rendered image sequence corresponding to each application on the target interface, wherein the rendered image sequence includes at least one frame of rendered image;
[0008] Determining the image rendering time corresponding to each rendered image and the interface update time corresponding to the received interface update signal;
[0009] Determining a target rendering image corresponding to each of the applications from each of the rendering images according to the image rendering time and the interface update time, and displaying the target rendering image on the target interface;
[0010] When the display effect of the target rendered image does not meet the preset display conditions, the image rendering parameters of the target rendered image are adjusted, and the rendered image adapted by the application is rendered according to the adjusted image rendering parameters.
[0011] In a second aspect, the present application further provides an image rendering device for an interface display, the image rendering device for an interface display comprising:
[0012] An image acquisition module, configured to receive an interface update signal and acquire, in response to the interface update signal, a rendered image sequence corresponding to each application on the target interface, wherein the rendered image sequence includes at least one frame of rendered image;
[0013] An information determination module, configured to determine an image rendering time corresponding to each rendered image and an interface update time corresponding to the received interface update signal;
[0014] An interface update signal, configured to determine a target rendered image corresponding to each of the applications from each of the rendered images according to the image rendering time and the interface update time, and to display the target rendered image on the target interface;
[0015] The parameter adjustment module is used to adjust the image rendering parameters of the target rendered image when the display effect of the target rendered image does not meet the preset display conditions, and render the rendered image adapted to the application according to the adjusted image rendering parameters.
[0016] In a third aspect, the present application also provides a display device, comprising a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, an image rendering method for interface display as described above is implemented.
[0017] In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the image rendering method for the interface display as described above is implemented.
[0018] The present application provides an image rendering method, apparatus, display device and computer storage medium for interface display. The present application receives an interface update signal and obtains a rendering image sequence corresponding to each application on a target interface in response to the interface update signal, wherein the rendering image sequence includes at least one frame of rendering image; determines the image rendering time corresponding to each rendering image and the interface update time corresponding to the interface update signal received; determines the target rendering image corresponding to each application from each rendering image according to the image rendering time and the interface update time, and displays the target rendering image on the target interface; when the display effect of the target rendering image does not meet the preset display conditions, adjusts the image rendering parameters of the target rendering image, and renders the rendering image adapted to the application according to the adjusted image rendering parameters. By feedback-adjusting the image rendering parameters of the application, the display effect of the interface display is improved, thereby improving the user's visual experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0020] FIG1 is a schematic diagram of a flow chart of an image rendering method for an interface display provided by an embodiment of the present application;
[0021] FIG2 is a schematic diagram of a sub-step flow chart of adjusting graphics rendering parameters according to an embodiment of the present application;
[0022] FIG3 is a schematic block diagram of an image rendering device for interface display provided by an embodiment of the present application;
[0023] FIG4 is a schematic block diagram of the structure of a display device according to an embodiment of the present application. DETAILED DESCRIPTION
[0024] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0025] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, combined, or partially merged, so the actual execution order may vary depending on the actual situation.
[0026] Embodiments of the present application provide an image rendering method, apparatus, display device, and computer-readable storage medium for interface display.
[0027] The following describes some embodiments of the present application in detail with reference to the accompanying drawings. In the absence of conflict, the following embodiments and features therein may be combined with each other.
[0028] Please refer to Figure 1, which is a flow chart of an image rendering method for an interface display provided in an embodiment of the present application. The image rendering method for an interface display can be used in a terminal device to achieve an interface display effect of the terminal device. The terminal can be a mobile phone, tablet computer, laptop computer, desktop computer, personal digital assistant, or a display device such as a wearable device. The wearable device can be, for example, an electronic device such as smart glasses, which is used to render the content displayed on the smart glasses interface.
[0029] As shown in FIG. 1 , the image rendering method for interface display includes steps S101 to S104 .
[0030] The interface display method provided in the embodiment of the present application is applied to a display device, and the display device updates the images of each application displayed on the interface based on a certain frequency.
[0031] Step S101: receiving an interface update signal, and acquiring a rendering image sequence corresponding to each application on a target interface in response to the interface update signal, wherein the rendering image sequence includes at least one frame of rendering image.
[0032] For example, the operating system of a display device typically generates and displays content in the interface at two levels: the application layer and the composition layer. Taking the Android system as an example, the rendering and display of images on the interface are performed separately. The application renders the images that the application needs to display at the application layer, while the SurfaceFlinger module is responsible for obtaining the rendered images of each application at the composition layer and laying out, compositing, and displaying each rendered image, so that the windows corresponding to different applications are displayed in the target interface.
[0033] Exemplarily, the compositing layer updates the target interface based on an interface update signal. Upon receiving the interface update signal, the compositing layer obtains at least one burst of rendered images generated by image rendering operations performed by each application. The interface update signal is an electrical signal generated by hardware in the display device at a certain frequency. For example, the interface update signal may be a VSync signal.
[0034] The frequency of receiving the interface update signal is related to the frame rate of the interface display. If the frame rate of the interface display is 60 frames per second, the frequency of receiving the interface update signal is approximately 60 times per second. Of course, it is not limited to this. The frame rate of the interface display can also be 90 frames per second, 120 frames per second, etc., which is not limited here.
[0035] Exemplarily, each application program continues to perform image rendering operations to obtain a corresponding rendered image sequence, and each rendered image sequence includes at least one frame of rendered image that the application program needs to display.
[0036] The applications include various types of applications such as weather, email, video players, games, etc., which are not limited here.
[0037] Step S102: determining the image rendering time corresponding to each rendered image and the interface update time corresponding to the received interface update signal.
[0038] For example, events in an operating system typically carry a timestamp to indicate the time when the event occurred, thereby ensuring time consistency within the operating system. For example, an interface update signal includes the interface update time when the signal was issued, and each frame of an application's rendered image also includes the image rendering time of the rendered image.
[0039] For example, since the image rendering of the application is ongoing, each rendered image of the application obtained in response to the interface update signal is usually an image sequence containing at least one frame of rendered image. In order to determine the target rendered image with the best display effect from the image sequence, it is necessary to determine the image rendering time of the rendered image and the interface update time of the interface update signal, so as to determine that the target rendered image is a frame of image in the rendered image sequence whose image rendering time is closest to the interface update time, thereby reducing the delay in image display.
[0040] Step S103: determining a target rendering image corresponding to each of the applications from each of the rendering images according to the image rendering time and the interface update time, and displaying the target rendering image on the target interface.
[0041] Exemplarily, the rendered images of each application obtained in step S101 are a rendered image sequence including multiple frames of rendered images. In order to make the displayed target rendered image adapt to the time of updating the interface, it is necessary to determine the target rendered image corresponding to each application from the various rendered images of each application based on the image rendering time and the interface update time.
[0042] For example, the rendered image with the smallest time interval between its rendering time and the interface update time is determined as the target rendered image corresponding to the application. In this way, the rendering time of the target rendered image is made to correspond to the interface update time as closely as possible, thereby minimizing the delay in displaying each application on the target interface and improving the user's visual experience.
[0043] Step S104 : When the display effect of the target rendered image does not meet the preset display conditions, the image rendering parameters of the target rendered image are adjusted, and the rendered image adapted to the application is rendered according to the adjusted image rendering parameters.
[0044] For example, after determining the target rendering image used to represent the application in the display target interface, the image rendering parameters of the application corresponding to the target rendering image are adjusted according to the display effect of the target rendering image, so that the application can subsequently perform image rendering operations according to the adjusted image rendering parameters, thereby performing feedback adjustment on the image rendering parameters of the application to achieve better display effects.
[0045] In some embodiments, when the display effect of the target rendered image does not meet a preset display condition, adjusting the image rendering parameters of the target rendered image includes:
[0046] When the time interval between the image rendering time of the target rendering image and the interface update time is greater than a preset time interval, the image rendering parameters corresponding to the target rendering image are adjusted.
[0047] For example, the target rendered image is the rendered image in the application's corresponding image sequence that matches the interface update signal, i.e., the rendered image with the smallest delay. If there is still a large gap between the target rendered image and the interface update time, it indicates that the application's image rendering parameters cannot meet the current display requirements. Adjustments to the application's image rendering parameters are necessary to improve the timeliness of image rendering. For example, increasing the application's rendering frame rate or reducing the application's thread sleep time are necessary, but these are not detailed here.
[0048] Please refer to FIG. 2 , which is a schematic diagram of a sub-step flow chart of adjusting graphics rendering parameters provided by an embodiment of the present application.
[0049] As shown in FIG2 , in some embodiments, adjusting the image rendering parameters of the target rendered image includes:
[0050] Acquiring motion information of a display device, and updating posture data of the display device according to the motion information;
[0051] Image rendering parameters of the target rendered image are adjusted according to the pose data.
[0052] For example, the content displayed in the target interface of the display device changes with the user's head rotation, tilt, or other movements. For example, if the user turns their head to the right, the application displayed on the right side of the target interface will move to the center of the target interface as the user turns their head. If there is a delay in image rendering during the user's movement, it will cause a noticeable visual lag. Therefore, the image rendering parameters need to adapt to the motion information of the display device.
[0053] For example, the display device continuously updates the posture data based on the motion information collected by the sensor in real time. When it detects that the image rendering parameters need to be adjusted, it obtains the latest posture data in real time and adjusts the image rendering parameters based on the obtained posture data.
[0054] In some embodiments, the preset time interval is determined based on the motion information of the display device. It is understood that when the display device is moving at a faster speed, the delay requirement is higher, and a smaller preset time interval is set; conversely, when the display device is moving at a faster speed, a larger preset time interval is set. Therefore, a correspondence between the motion information and the preset time interval can be pre-set, and the corresponding preset time interval can be determined based on the motion information of the display device.
[0055] In some embodiments, adjusting image rendering parameters of the target rendered image according to the pose data includes:
[0056] According to the data range of the posture data, target rendering parameters corresponding to the posture data are determined based on a preset target correspondence relationship, and the image rendering parameters of the application are adjusted to the target rendering parameters.
[0057] Exemplarily, the rendering parameters corresponding to each data range of the posture data are pre-set, so that the target rendering parameters under the posture data can be determined according to the data range of each posture data, so that the image rendering parameters of the application are adapted to the motion state of the user of the display device.
[0058] In some implementations, after adjusting the image rendering parameters of the application to the target rendering parameters, the method further includes:
[0059] When the posture data is less than or equal to a preset threshold, the image rendering parameters of the application are adjusted from the target rendering parameters to historical rendering parameters before the target rendering parameters.
[0060] For example, when the posture data changes, the image rendering parameters of the application are adjusted from the historical rendering parameters to the target rendering parameters. When the posture data falls back to the level before the change, the image rendering parameters of the application are adjusted from the target rendering parameters back to the historical rendering parameters, so as to avoid the application from continuously performing image rendering operations according to the image rendering parameters in the motion state, thereby reducing the energy consumption of the display device for interface display.
[0061] In some embodiments, adjusting image rendering parameters of the target rendered image according to the pose data includes:
[0062] At least one of a rendering frame rate and a thread sleep time of an application corresponding to the target rendered image is adjusted according to at least one of a rotation acceleration, a yaw acceleration, and a tilt acceleration of the display device.
[0063] For example, the posture data of the display device may include one or more of the display device's rotational acceleration, yaw acceleration, and tilt acceleration. The rotational acceleration, yaw acceleration, and tilt acceleration respectively represent the acceleration of the user's head rotating along different coordinate axes of the spatial coordinate system. Of course, this is not limited to this. The posture data may also include at least one of the display device's rotational angular velocity, yaw angular velocity, and tilt angular velocity, which are not limited here.
[0064] Exemplarily, the rendering parameters of an application include a rendering frame rate and / or a thread sleep time. The rendering frame rate indicates the number of images rendered per second by the application, and the thread sleep time indicates the time the application's thread is put into a sleep state. Of course, this is not limiting, and the rendering parameters may also include other data, which are not limited here.
[0065] Exemplarily, for example, the correspondence between rotational acceleration and rendering frame rate and thread sleep time can be set separately, and the corresponding rendering frame rate and thread sleep time can be determined according to the magnitude of rotational acceleration; or corresponding weights can be set for rotational acceleration, tilt acceleration, and yaw acceleration respectively, and the acceleration weighted value can be obtained after weighting the three, and the correspondence between the acceleration weighted value and rendering frame rate and thread sleep time can be set in advance, and the corresponding rendering frame rate and thread sleep time can be determined according to the acceleration weighted value. Of course, it is not limited to this and is not limited here.
[0066] In some embodiments, obtaining motion information of a display device and updating posture data of the display device according to the motion information includes:
[0067] Acquiring motion information of the display device, and integrating the motion information based on a preset time step to obtain integrated motion information;
[0068] updating a quaternion used to represent a motion posture of the display device according to the integrated motion information;
[0069] The updated quaternion is normalized to obtain the pose data.
[0070] For example, the posture data of the display device is represented by quaternions. A quaternion is a number consisting of four parts, usually expressed as a+bi+cj+dk, where a, b, c and d are real numbers, and i, j and k are imaginary units, used to represent the rotation axis and angle in three-dimensional space. Among them, a is the real part of the quaternion, which represents the scale of the rotation (the size of the rotation angle), and bi+cj+dk is the imaginary part of the quaternion, which represents the direction of rotation (about which axis to rotate). Compared with Euler angles, representing posture data by quaternions can effectively avoid the gimbal lock phenomenon.
[0071] Exemplarily, the motion information is the information detected by sensors (such as gyroscopes, accelerometers, etc.) on the display device, usually the motion status at the current moment. In order to make the motion information able to reflect the user's motion status over a certain period of time, the motion information collected by the sensor within a certain time step is integrated to obtain motion integral information, and the motion integral information is updated to the quaternion, and the quaternion is normalized to obtain the posture data of the display device.
[0072] The image rendering method for interface display provided in the above embodiment receives an interface update signal and obtains a rendering image sequence corresponding to each application on the target interface in response to the interface update signal, wherein the rendering image sequence includes at least one frame of rendering image; determines the image rendering time corresponding to each rendering image and the interface update time corresponding to the interface update signal received; determines the target rendering image corresponding to each application from each rendering image according to the image rendering time and the interface update time, and displays the target rendering image on the target interface; when the display effect of the target rendering image does not meet the preset display conditions, adjusts the image rendering parameters of the target rendering image, and renders the rendering image adapted to the application according to the adjusted image rendering parameters. By feedback-adjusting the image rendering parameters of the application, the display effect of the interface display is improved, thereby improving the user's visual experience.
[0073] Please refer to Figure 3, which is a schematic diagram of an image rendering device for interface display provided by an embodiment of the present application. The image rendering device for interface display can be configured in a server or a terminal to execute the aforementioned image rendering method for interface display.
[0074] As shown in FIG3 , the image rendering device for interface display includes: an image acquisition module 110 , an information determination module 120 , an interface update signal 130 , and a parameter adjustment module 140 .
[0075] An image acquisition module 110 is configured to receive an interface update signal and acquire, in response to the interface update signal, a rendered image sequence corresponding to each application on a target interface, wherein the rendered image sequence includes at least one frame of rendered image;
[0076] An information determination module 120 is configured to determine an image rendering time corresponding to each rendered image and an interface update time corresponding to the received interface update signal;
[0077] An interface update signal 130 is used to determine a target rendered image corresponding to each of the applications from each of the rendered images according to the image rendering time and the interface update time, and to display the target rendered image on the target interface;
[0078] The parameter adjustment module 140 is configured to adjust the image rendering parameters of the target rendered image when the display effect of the target rendered image does not meet the preset display conditions, and render the rendered image adapted to the application according to the adjusted image rendering parameters.
[0079] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0080] The methods and apparatus of the present application can be used in a wide variety of general or specialized computing system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multi-processor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, and the like. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media, including storage devices.
[0081] Exemplarily, the above method and apparatus may be implemented in the form of a computer program, and the computer program may be run on a display device as shown in FIG. 4 .
[0082] Please refer to FIG. 4 , which is a schematic block diagram of the structure of a display device provided in an embodiment of the present application.
[0083] As shown in FIG4 , the display device includes a processor, a memory, and a network interface connected via a system bus, wherein the memory may include a storage medium and an internal memory.
[0084] The storage medium can store an operating system and a computer program. The computer program includes program instructions, which, when executed, can enable the processor to execute any image rendering method for interface display.
[0085] The processor is used to provide computing and control capabilities to support the operation of the entire display device.
[0086] The internal memory provides an environment for the operation of the computer program in the storage medium. When the computer program is executed by the processor, the processor can execute any image rendering method for interface display.
[0087] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art will understand that the structure shown in FIG4 is merely a block diagram of a portion of the structure related to the solution of the present application, and does not constitute a limitation on the display device to which the solution of the present application is applied. A specific display device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.
[0088] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.
[0089] In one embodiment, the processor is configured to execute a computer program stored in the memory to implement the following steps:
[0090] Receiving an interface update signal, and acquiring, in response to the interface update signal, a rendered image sequence corresponding to each application on the target interface, wherein the rendered image sequence includes at least one frame of rendered image;
[0091] Determining the image rendering time corresponding to each rendered image and the interface update time corresponding to the received interface update signal;
[0092] Determining a target rendering image corresponding to each of the applications from each of the rendering images according to the image rendering time and the interface update time, and displaying the target rendering image on the target interface;
[0093] When the display effect of the target rendered image does not meet the preset display conditions, the image rendering parameters of the target rendered image are adjusted, and the rendered image adapted by the application is rendered according to the adjusted image rendering parameters.
[0094] It should be noted that technical personnel in the relevant field can clearly understand that for the convenience and conciseness of description, the specific working process of image rendering displayed on the above-mentioned interface can refer to the corresponding process in the aforementioned embodiment of the image rendering control method for interface display, and will not be repeated here.
[0095] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions. The method implemented when the program instructions are executed can refer to the various embodiments of the image rendering method displayed on the interface of the present application.
[0096] The computer-readable storage medium may be an internal storage unit of the display device described in the aforementioned embodiment, such as a hard disk or memory of the display device. The computer-readable storage medium may also be an external storage device of the display device, such as a plug-in hard disk equipped on the display device, a smart media card (SMC), a secure digital (SD) card, a flash card, etc.
[0097] It should be understood that the terms used in this specification are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms unless the context clearly indicates otherwise.
[0098] It should also be understood that the term "and / or" used in this specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system that includes a series of elements includes not only those elements, but also other elements that are not explicitly listed, or also includes elements that are inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system that includes the element.
[0099] The serial numbers of the embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments. The above description is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A method for rendering an image for an interface display, wherein: The method comprises: Receiving an interface update signal, and acquiring, in response to the interface update signal, a rendered image sequence corresponding to each application on the target interface, wherein the rendered image sequence includes at least one frame of rendered image; Determining the image rendering time corresponding to each rendered image and the interface update time corresponding to the received interface update signal; Determining a target rendering image corresponding to each of the applications from each of the rendering images according to the image rendering time and the interface update time, and displaying the target rendering image on the target interface; When the display effect of the target rendered image does not meet the preset display conditions, the image rendering parameters of the target rendered image are adjusted, and the rendered image adapted by the application is rendered according to the adjusted image rendering parameters.
2. The image rendering method for interface display according to claim 1, wherein: When the display effect of the target rendered image does not meet the preset display condition, adjusting the image rendering parameters of the target rendered image includes: When the time interval between the image rendering time of the target rendering image and the interface update time is greater than a preset time interval, the image rendering parameters corresponding to the target rendering image are adjusted.
3. The image rendering method for interface display according to claim 1, wherein: The adjusting the image rendering parameters of the target rendered image includes: Acquiring motion information of a display device, and updating posture data of the display device according to the motion information; Image rendering parameters of the target rendered image are adjusted according to the pose data.
4. The image rendering method for interface display according to claim 3, wherein: The adjusting the image rendering parameters of the target rendered image according to the pose data includes: According to the data range of the posture data, target rendering parameters corresponding to the posture data are determined based on a preset target correspondence relationship, and the image rendering parameters of the application are adjusted to the target rendering parameters.
5. The image rendering method for interface display according to claim 4, wherein: After adjusting the image rendering parameters of the application to the target rendering parameters, the method further includes: When the posture data is less than or equal to a preset threshold, the image rendering parameters of the application are adjusted from the target rendering parameters to historical rendering parameters before the target rendering parameters.
6. The image rendering method for interface display according to claim 3, wherein: The adjusting the image rendering parameters of the target rendered image according to the pose data includes: At least one of a rendering frame rate and a thread sleep time of an application corresponding to the target rendered image is adjusted according to at least one of a rotation acceleration, a yaw acceleration, and a tilt acceleration of the display device.
7. The image rendering method for interface display according to any one of claims 3 to 6, wherein: The acquiring the motion information of the display device and updating the posture data of the display device according to the motion information includes: Acquiring motion information of the display device, and integrating the motion information based on a preset time step to obtain integrated motion information; updating a quaternion used to represent a motion posture of the display device according to the integrated motion information; The updated quaternion is normalized to obtain the pose data.
8. An image rendering device for interface display, wherein: The image rendering device comprises: An image acquisition module, configured to receive an interface update signal and acquire, in response to the interface update signal, a rendered image sequence corresponding to each application on the target interface, wherein the rendered image sequence includes at least one frame of rendered image; An information determination module, configured to determine an image rendering time corresponding to each rendered image and an interface update time corresponding to the received interface update signal; An interface update signal, configured to determine a target rendered image corresponding to each of the applications from each of the rendered images according to the image rendering time and the interface update time, and to display the target rendered image on the target interface; The parameter adjustment module is used to adjust the image rendering parameters of the target rendered image when the display effect of the target rendered image does not meet the preset display conditions, and render the rendered image adapted to the application according to the adjusted image rendering parameters.
9. The image rendering device for interface display according to claim 8, wherein: When the display effect of the target rendered image does not meet the preset display condition, the parameter adjustment module is further configured to: When the time interval between the image rendering time of the target rendering image and the interface update time is greater than a preset time interval, the image rendering parameters corresponding to the target rendering image are adjusted.
10. The image rendering device for interface display according to claim 8, wherein: When the parameter adjustment module is used to adjust the image rendering parameters of the target rendered image, the parameter adjustment module is further used to: Acquiring motion information of a display device, and updating posture data of the display device according to the motion information; Image rendering parameters of the target rendered image are adjusted according to the pose data.
11. The image rendering device for interface display according to claim 10, wherein: When the parameter adjustment module is used to adjust the image rendering parameters of the target rendered image according to the pose data, the parameter adjustment module is further used to: According to the data range of the posture data, target rendering parameters corresponding to the posture data are determined based on a preset target correspondence relationship, and the image rendering parameters of the application are adjusted to the target rendering parameters.
12. The image rendering device for interface display according to claim 11, wherein: After being used to adjust the image rendering parameters of the application to the target rendering parameters, the parameter adjustment module is further used to: When the posture data is less than or equal to a preset threshold, the image rendering parameters of the application are adjusted from the target rendering parameters to historical rendering parameters before the target rendering parameters.
13. The image rendering device for interface display according to claim 10, wherein: When the parameter adjustment module is used to adjust the image rendering parameters of the target rendered image according to the pose data, the parameter adjustment module is further used to: adjusting at least one of a rendering frame rate and a thread sleep time of an application corresponding to the target rendered image according to at least one of a rotation acceleration, a yaw acceleration, and a tilt acceleration of the display device; When the parameter adjustment module is used to obtain the motion information of the display device and update the posture data of the display device according to the motion information, it is further used to: Acquiring motion information of the display device, and integrating the motion information based on a preset time step to obtain integrated motion information; updating a quaternion used to represent a motion posture of the display device according to the integrated motion information; The updated quaternion is normalized to obtain the pose data.
14. A display device, wherein: The display device includes a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the computer program implements: Receiving an interface update signal, and acquiring, in response to the interface update signal, a rendered image sequence corresponding to each application on the target interface, wherein the rendered image sequence includes at least one frame of rendered image; Determining the image rendering time corresponding to each rendered image and the interface update time corresponding to the received interface update signal; Determining a target rendering image corresponding to each of the applications from each of the rendering images according to the image rendering time and the interface update time, and displaying the target rendering image on the target interface; When the display effect of the target rendered image does not meet the preset display conditions, the image rendering parameters of the target rendered image are adjusted, and the rendered image adapted by the application is rendered according to the adjusted image rendering parameters.
15. The display device according to claim 14, wherein The computer program is executed by the processor to adjust the image rendering parameters of the target rendered image when the display effect of the target rendered image does not meet the preset display condition, and is used to implement: When the time interval between the image rendering time of the target rendering image and the interface update time is greater than a preset time interval, the image rendering parameters corresponding to the target rendering image are adjusted.
16. The display device according to claim 14, wherein When the computer program is executed by the processor to adjust the image rendering parameters of the target rendered image, the computer program is used to implement: Acquire motion information of a display device, and update posture data of the display device according to the motion information; Image rendering parameters of the target rendered image are adjusted according to the pose data.
17. The display device according to claim 16, wherein When the computer program is executed by the processor to adjust the image rendering parameters of the target rendered image according to the pose data, the computer program is used to implement: According to the data range of the posture data, target rendering parameters corresponding to the posture data are determined based on a preset target correspondence relationship, and the image rendering parameters of the application are adjusted to the target rendering parameters.
18. The display device according to claim 17, wherein When the computer program is executed by the processor to adjust the image rendering parameters of the application to the target rendering parameters, the computer program is configured to: When the posture data is less than or equal to a preset threshold, the image rendering parameters of the application are adjusted from the target rendering parameters to historical rendering parameters before the target rendering parameters.
19. The display device according to claim 16, wherein When the computer program is executed by the processor to adjust the image rendering parameters of the target rendered image according to the pose data, the computer program is used to implement: adjusting at least one of a rendering frame rate and a thread sleep time of an application corresponding to the target rendered image according to at least one of a rotation acceleration, a yaw acceleration, and a tilt acceleration of the display device; The computer program is executed by the processor to implement the parameter adjustment module, when used to obtain motion information of the display device and update the posture data of the display device according to the motion information, to implement: Acquiring motion information of the display device, and integrating the motion information based on a preset time step to obtain integrated motion information; updating a quaternion used to represent a motion posture of the display device according to the integrated motion information; The updated quaternion is normalized to obtain the pose data.
20. A computer-readable storage medium, wherein: The computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the steps of the image rendering method for interface display according to any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Image display method and device
CN107786748A
Detection method and device of terminal equipment, terminal equipment and storage medium
CN114968712A
Image rendering method and device, equipment and storage medium
CN115423919A
Image display method and device, terminal equipment and storage medium
CN116700654A
Image rendering method and device, electronic equipment, storage medium and program product
CN116740256A