Display processing method and device, electronic device, storage medium

By adding diffuse noise processing to electronic devices, the problem that the prior art cannot simulate paper reading effects is solved, and a more natural display effect is achieved, reducing the stimulation to the human eye.

CN114564160BActive Publication Date: 2025-06-10BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011356419.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-11-27
Publication Date
2025-06-10
Estimated Expiration
2040-11-27

AI Technical Summary

Technical Problem

Existing electronic devices cannot fully simulate the effect of paper reading in the display mode, making it difficult to reduce stimulation to the human eye.

Method used

By obtaining the layer data of the area to be displayed, the intensity of the ambient light is determined, and the diffuse noise parameters are calculated based on the light source position information and the intensity of the ambient light, diffuse noise is added to the layer data, and combined and rendered to output.

Benefits of technology

It simulates diffuse noise, reduces the stimulation of screen tones to the human eye, improves the display effect, and makes it closer to the paper reading experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114564160B_ABST
    Figure CN114564160B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a display processing method and apparatus, an electronic device, and a storage medium. The method includes: obtaining layer data of a to-be-displayed area; determining the intensity of ambient light; calculating a diffuse reflection noise parameter according to the light source position information and the intensity of the ambient light; adding diffuse reflection noise to the layer data of the to-be-displayed area according to the diffuse reflection noise parameter, performing combined rendering on the layer data with the added diffuse reflection noise, and outputting. Since diffuse reflection processing is adopted in the present disclosure, when a user views a display screen, the effect is equivalent to viewing an actual object. In this way, for the user of the electronic device, the display of the display screen is more friendly. Embodiments of the present disclosure can also combine color parameters customized by the user of the electronic device and make the display effect of the display screen better through color conversion matrix processing, and finally obtain a display effect of a paper tone based on diffuse reflection particles, reducing the irritation of the screen tone to the human eye.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to display technologies in electronic devices, and in particular to a display processing method and apparatus, an electronic device, and a storage medium. Background Art

[0002] Currently, to meet the visual experience of users, e-books generally support display modes such as light backgrounds and dark backgrounds. When changing from the normal mode to the dark mode, the colors of text and system icons are optimized to ensure the consistency, comfort, and readability of the visual experience between the dark mode and the normal mode. Currently, e-books reduce the stimulation of colors to the human eye by lowering the screen brightness, making the color yellowish or lighter, or directly changing the system from color to black and white globally.

[0003] Regardless of the display mode adjusted, since e-books need to be displayed through a display screen, they cannot achieve the actual effect of paper, and the stimulation to the human eye is inevitable. Summary of the Invention

[0004] The present disclosure provides an image processing method and apparatus, an electronic device, and a storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a display processing method is provided, the method including:

[0006] Obtain layer data of a to-be-displayed area;

[0007] Determine the intensity of ambient light;

[0008] Calculate a diffuse reflection noise parameter according to the light source position information and the intensity of the ambient light;

[0009] Add diffuse reflection noise to the layer data of the to-be-displayed area according to the diffuse reflection noise parameter, perform combined rendering on the layer data added with the diffuse reflection noise, and output.

[0010] Optionally, the method further includes:

[0011] Obtain set display color parameters, and generate a color conversion matrix according to the display color parameters;

[0012] The performing combined rendering on the layer data added with the diffuse reflection noise and outputting includes:

[0013] Color the layer data added with the diffuse reflection noise through the color conversion matrix, perform combined rendering and output.

[0014] Optionally, the calculating a diffuse reflection noise parameter according to the light source position information and the intensity of the ambient light includes:

[0015] Obtain information on the light source position of the display unit, determine a diffuse reflection model that matches the light source position, and calculate the diffuse reflection parameters of each display area corresponding to the display screen based on the diffuse reflection model;

[0016] Measure the intensity of the ambient light, and add the intensity of the ambient light and the diffuse reflection parameters to the corresponding display parameters of each display area corresponding to the display screen.

[0017] Optionally, the obtaining of the layer data of the area to be displayed includes:

[0018] Obtain the layer data of all visible display areas, store the obtained layer data in an array, and draw the layer data in the array into the frame buffer object (FrameBufferObject) to be displayed in the way of layer painting (drawLayers).

[0019] Optionally, the determining of the intensity of the ambient light includes:

[0020] Collect the current ambient light, determine the light intensity based on the set distance and the collection area, and use the determined light intensity as the intensity of the ambient light.

[0021] Optionally, the determining of the diffuse reflection model that matches the light source position includes:

[0022] Normalize the vertex normal and the light source direction respectively;

[0023] Determine the intensity of the reflected light on the reflection surface, where the intensity of the reflected light on the reflection surface is proportional to the cosine value of the angle between the surface normal and the light source direction;

[0024] Generate a diffuse reflection model based on the correspondence between the intensity of the reflected light and the angle between the normal and the light source direction.

[0025] According to the second aspect of the embodiments of the present disclosure, there is provided a display processing device, including:

[0026] A first obtaining unit, configured to obtain the layer data of the area to be displayed;

[0027] A determining unit, configured to determine the intensity of the ambient light;

[0028] A calculating unit, configured to calculate diffuse reflection noise parameters according to the light source position information and the intensity of the ambient light;

[0029] A layer processing unit, configured to add diffuse reflection noise to the layer data of the area to be displayed according to the diffuse reflection noise parameters, perform combined rendering on the layer data added with diffuse reflection noise, and output the result.

[0030] Optionally, the device further includes:

[0031] A second acquisition unit, configured to acquire set display color parameters;

[0032] A generation unit, configured to generate a color conversion matrix according to the display color parameters;

[0033] The layer processing unit is further configured to color the layer data added with diffuse noise through the color conversion matrix, merge and render, and output.

[0034] Optionally, the calculation unit is further configured to acquire information about the light source position of the display unit, determine a diffuse reflection model matching the light source position, and calculate diffuse reflection parameters of respective display areas corresponding to the display screen based on the diffuse reflection model;

[0035] Measure the intensity of the ambient light, and add the intensity of the ambient light and the diffuse reflection parameters to corresponding display parameters of respective display areas corresponding to the display screen.

[0036] Optionally, the first acquisition unit is further configured to acquire layer data of all visible display areas, store the acquired layer data in an array, and draw the layer data in the array into a frame buffer object (FrameBufferObject) to be displayed in a drawLayers manner of layer painting.

[0037] Optionally, the determination unit is further configured to collect the current ambient light, determine the light intensity based on a set distance and a collection area, and use the determined light intensity as the intensity of the ambient light.

[0038] Optionally, the calculation unit is further configured to:

[0039] Normalize the vertex normal and the light source direction respectively;

[0040] Determine the intensity of the reflected light on the reflection surface, where the intensity of the reflected light on the reflection surface is proportional to the cosine value of the angle between the surface normal and the light source direction;

[0041] Generate a diffuse reflection model based on the correspondence between the intensity of the reflected light and the angle between the normal and the light source direction.

[0042] According to a third aspect of the embodiments of the present disclosure, an electronic device is provided, including: a processor and a memory for storing processor-executable instructions, where the processor is configured to be capable of executing the display processing method when calling the executable instructions in the memory.

[0043] According to a fourth aspect of the embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, which enables an electronic device to execute the display processing method when the instructions in the storage medium are executed by a processor of the electronic device.

[0044] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0045] In the embodiments of the present disclosure, before drawing a display on a display area, a specific semi-transparent layer is added to the top layer of the layers of all areas to be displayed. The semi-transparent layer combines the ambient light illumination parameters around the display device and adds diffuse reflection particles to simulate diffuse reflection noise, and fuses the semi-transparent layer with all the area layers to be displayed. In this way, due to the adoption of diffuse reflection processing, when a user views the display screen, the effect is equivalent to viewing an actual object. Thus, for the user of the electronic device, the display of the display screen is more affinity. The embodiments of the present disclosure can also combine the color parameters customized by the user of the electronic device and make the display effect of the display screen better through color conversion matrix processing, and finally obtain a display effect of a paper tone based on diffuse reflection particles, reducing the irritation of the screen tone to the human eye.

[0046] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure.

[0048] Figure 1 It is a schematic flowchart of a display processing method shown in an embodiment of the present disclosure;

[0049] Figure 2 It is a schematic structural diagram of a display processing device shown in an embodiment of the present disclosure;

[0050] Figure 3 It is a block diagram of an electronic device shown according to an exemplary embodiment. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0051] Here, the exemplary embodiments will be described in detail, and the examples are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are only examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0052] The display processing method described in the embodiments of the present disclosure is applicable to electronic devices such as mobile phone smart terminals, game consoles, laptop computers, and PADs, and can be applied to applications such as e-books, text file displays, and image displays. As long as display output is required, the display processing method of the embodiments of the present disclosure is applicable.

[0053] Figure 1 It is a schematic flowchart of a display processing method shown in the embodiments of the present disclosure. As Figure 1 shown, the display processing method of the embodiments of the present disclosure includes the following steps:

[0054] S11. Obtain the layer data of the area to be displayed.

[0055] In the display processing method of the embodiments of the present disclosure, it can be applied to electronic devices. The electronic device can be a mobile phone, a game console, a wearable device, a virtual reality device, a personal digital assistant, a laptop computer, a tablet computer, or a television terminal, etc. The applicable scenarios can be the display of e-books, text files, images, etc. of the electronic device. Through the display processing method of the embodiments of the present disclosure, a better display effect can be provided for users, which will not cause visual fatigue of the viewing users and enables users to have a better experience when viewing the screen.

[0056] In the embodiments of the present disclosure, before outputting the image to be displayed, it needs to be subjected to diffuse reflection processing, especially for e-books or text applications, etc. When the relevant processing settings or requests are selected using the display processing method of the embodiments of the present disclosure, it is necessary to obtain the display layer data and perform diffuse reflection processing on it. The embodiments of the present disclosure support both diffuse reflection processing of all layer data to be displayed and diffuse reflection processing of the display of corresponding applications. Specifically, obtain the layer data of all visible display areas, store the obtained layer data in an array, and draw the layer data in the array into the frame buffer object (FrameBufferObject) to be displayed in the form of layer painting (drawLayers). The embodiments of the present disclosure take the Android operating system as an example for illustration. Those skilled in the art should understand that the processing method of the embodiments of the present disclosure is also applicable to other operating systems such as Windows, except that the commands and code implementations for display processing are different. In the embodiments of the present disclosure, before performing the display area drawing calculation, SurfaceFlinger will obtain all the current visible display area Layers. These visible Layers are stored in an array of LayerSetting, and finally these visible Layers are drawn into the FrameBufferObject to be displayed through the drawLayers method, denoted as FBO 0 .

[0057] S12. Determine the intensity of the ambient light.

[0058] In an embodiment of the present disclosure, the detection and measurement of the ambient light intensity can be achieved by setting a light intensity detection sensor, or the collected ambient light can be converted into a corresponding electrical signal through a photoelectric converter, and a corresponding electrical signal detection program is set in the electronic device to calculate the intensity of the ambient light. In the embodiment of the present disclosure, after the display image is subjected to diffuse reflection processing, it is also necessary to consider the influence of the current ambient light on the display image to simulate the display effect of an actual object. In the embodiment of the present disclosure, the intensity of the ambient light, where the intensity of the ambient light is the same at each point of the object, can be considered to be uniformly superimposed on the brightness of the object. By considering the ambient light in the embodiment of the present disclosure for the display image to be displayed, the display image can be made closer to the feeling of a real object, and the viewing experience of the user is better. The intensity of the ambient light can be determined based on the intensity of the ambient light illumination within a set distance and collection area, and the determined intensity is used as the intensity of the ambient light.

[0059] S13. Calculate the diffuse reflection noise parameter according to the light source position information and the intensity of the ambient light.

[0060] In an embodiment of the present disclosure, information on the light source position of the display unit is obtained, a diffuse reflection model matching the light source position is determined, and the diffuse reflection parameters of each display area corresponding to the display screen are calculated based on the diffuse reflection model; specifically, diffuse reflection refers to the phenomenon that a rough object surface reflects light equally in all directions, that is, the phenomenon of equal scattering in all directions. For diffuse reflection, the reflection is completely random, so it can be considered that the distribution in any reflection direction is the same, but the intensity of the diffuse reflection light is positively correlated with the angle of the incident light, that is, the intensity of the reflected light is proportional to the cosine value of the angle between the surface normal and the light source direction. Based on this, when the electronic device sets the diffuse reflection model of the display screen, it is necessary to consider the specific position of the light source of the display screen. For example, the position of the light source on the back panel of the display screen and the angular relationship between the light source position and each area of the display screen can be determined to generate the diffuse reflection model of the display screen, and the intensity of the diffuse reflection light can be determined according to the display area corresponding to the layer to be displayed.

[0061] Measure the intensity of the ambient light, and add the intensity of the ambient light and the diffuse reflection parameter to the corresponding display parameters of each display area corresponding to the display screen.

[0062] Add diffuse reflection noise particles to the layer generated in the FBO using the diffuse reflection lighting model in the shader 0 For diffuse reflection, the position of the viewing angle is not important because the reflection is completely random, so it can be considered that the distribution in any reflection direction is the same, but the angle of the incident light is important.

[0063] In the embodiments of the present disclosure, the diffuse light reflection conforms to Lambert's law. The intensity of the reflected light is proportional to the cosine value of the angle between the surface normal and the light source direction, and its calculation method is as follows:

[0064]

[0065] Where C diffuse represents how much radiation the object surface scatters in each direction, and C light represents the radiation intensity of the light source, M diffuse represents the reflection coefficient. Different materials have different reflection coefficients. For a determined object to be displayed, its reflection coefficient is determined, that is, a constant. l is the vector from the vertex to the light source illumination direction, and n is the surface normal vector of the display area.

[0066] For the convenience of calculation, when calculating the diffuse light, the vertex normal vector and the light source illumination direction vector can be normalized respectively, and then the above formula is used to calculate the intensity of the diffuse light of each display area. And through the detected ambient light intensity, it is fused with the sum of the above diffuse light as the display parameter of the layer data of the area to be displayed.

[0067] S14. Add diffuse noise to the layer data of the area to be displayed according to the diffuse noise parameter, merge and render the layer data with added diffuse noise, and output.

[0068] In the embodiments of the present disclosure, taking the Android operating system as an example, by calling the SurfaceFinger instance, all layer data to be displayed can be obtained in real time by SurfaceFinger through the Surface instance; after adding the diffuse light intensity and ambient light intensity to the layer data in the FrameBufferObject, call the Media instance to perform rendering and merging and other processing on the layer data with added diffuse light intensity and ambient light, and generate and display the image data.

[0069] In the embodiments of the present disclosure, the user can also set color parameters for the corresponding application or set corresponding color parameters for the entire display screen. At this time, it is necessary to combine the user-defined color parameter α and use the color conversion matrix M*C to process all the layer data in the FBO 0 with added diffuse light intensity and ambient light intensity, and the paper tone display effect with diffuse noise particles based on the user's habit can be obtained as follows:

[0070] result = α*C diffuse *M*C

[0071] Among them, M is the color matrix. The first row determines red, the second row determines green, the third row determines blue, and the fourth row determines transparency. The fifth column is the color offset. The C matrix is the RGBA information contained in the current display area.

[0072]

[0073]

[0074] Process the FBO using the above shader 0 for all layer data in it to obtain the layer texture Texture with diffuse noise particles based on user habits. Finally, draw the FBO corresponding to this Texture 0 and display it through the display screen. It should be noted that the embodiments of the present disclosure also support adding diffuse reflection and custom colors only to the layer data of certain applications. At this time, only the layer data to be displayed of the corresponding application needs to be obtained, added to the FrameBufferObject, and then the diffuse reflection and custom color processing as in the foregoing embodiments can be performed.

[0075] The embodiments of the present disclosure use the diffuse reflection technology to simulate noise particles and perform a layer paper tone processing on the display area. At the same time, the color conversion matrix is used to complete the color customization display. This customization is a color parameter based on user habits, and the Lambert's law of diffuse illumination is used to perform corresponding color adjustment on the display area. Finally, the display area is made as close as possible to the actual effects of ordinary objects such as paper. Compared with the ordinary dark mode, it reduces the stimulation of the screen to the human eye's light source and color, improves the display effect, and provides a better physical experience.

[0076] Figure 2 is a schematic structural diagram of the composition of a display processing device shown in the embodiments of the present disclosure. As Figure 2 shown, the display processing device of the embodiments of the present disclosure includes:

[0077] The first acquisition unit 20 is used to acquire the layer data of the area to be displayed;

[0078] The determination unit 21 is used to determine the intensity of the ambient light;

[0079] The calculation unit 22 is used to calculate the diffuse reflection noise parameter according to the light source position information and the intensity of the ambient light;

[0080] The layer processing unit 23 is used to add diffuse reflection noise to the layer data of the area to be displayed according to the diffuse reflection noise parameter, perform combined rendering on the layer data with added diffuse reflection noise, and output it.

[0081] In Figure 2Based on the shown display processing device, the display processing device according to an embodiment of the present disclosure further includes:

[0082] A second acquisition unit ( Figure 2 not shown in the figure) for acquiring set display color parameters;

[0083] A generation unit ( Figure 2 not shown in the figure) for generating a color conversion matrix according to the display color parameters;

[0084] The layer processing unit 23 is further configured to color the layer data with added diffuse noise through the color conversion matrix, perform combined rendering and output.

[0085] Optionally, the calculation unit 22 is further configured to acquire information on the light source position of the display unit, determine a diffuse reflection model matching the light source position, and calculate diffuse reflection parameters of respective display areas corresponding to the display screen based on the diffuse reflection model;

[0086] Measure the intensity of the ambient light, and add the intensity of the ambient light and the diffuse reflection parameters to corresponding display parameters of respective display areas corresponding to the display screen.

[0087] Optionally, the first acquisition unit 20 is further configured to acquire layer data of all visible display areas, store the acquired layer data in an array, and draw the layer data in the array into a frame buffer object (FrameBufferObject) to be displayed in a drawLayers manner of layer painting.

[0088] Optionally, the determination unit 21 is further configured to collect the current ambient light, determine the light intensity based on a set distance and a collection area, and use the determined light intensity as the intensity of the ambient light.

[0089] Optionally, the calculation unit 22 is further configured to:

[0090] Normalize the vertex normal and the light source direction respectively;

[0091] Determine the intensity of the reflected light on the reflection surface, where the intensity of the reflected light on the reflection surface is proportional to the cosine value of the angle between the surface normal and the light source direction;

[0092] Generate a diffuse reflection model based on the correspondence between the intensity of the reflected light and the angle between the normal and the light source direction.

[0093] In an exemplary embodiment, the first acquisition unit 20, the determination unit 21, the calculation unit 22, the layer processing unit 23, the second acquisition unit, the generation unit, etc. may be implemented by one or more central processing units (CPUs, Central Processing Unit), graphics processing units (GPUs, Graphics Processing Unit), baseband processors (BPs, base processor), application specific integrated circuits (ASICs, Application Specific Integrated Circuit), digital signal processors (Digital Signal Processor, DSP), programmable logic devices (PLDs, Programmable Logic Device), complex programmable logic devices (CPLDs, Complex Programmable Logic Device), field programmable gate arrays (FPGAs, Field-Programmable Gate Array), general purpose processors, controllers, microcontroller units (MCUs, MicroController Unit), microprocessors (Microprocessor), or other electronic components, and may also be combined with one or more radio frequency (RF, Radio Frequency) antennas to perform the communication method of the foregoing embodiments.

[0094] In the embodiments of the present disclosure, Figure 2 The specific manner in which each unit in the illustrated display processing device performs operations has been described in detail in the embodiments related to the method, and will not be elaborated herein.

[0095] Figure 3 FIG. is a block diagram of an electronic device 800 shown according to an exemplary embodiment. As Figure 3 shown, the electronic device 800 supports multi-screen output. The electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0096] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-described methods. Additionally, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0097] The memory 804 is configured to store various types of data to support the operation of the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, and the like. The memory 804 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0098] The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

[0099] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operations. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each of the front camera and the rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0100] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 further includes a speaker for outputting audio signals.

[0101] The I / O interface 812 provides an interface between the processing component 802 and a peripheral interface module, and the peripheral interface module may be a keyboard, a click wheel, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a power button, and a lock button.

[0102] The sensor component 814 includes one or more sensors for providing an assessment of various aspects of the status of the electronic device 800. For example, the sensor component 814 can detect the on / off state of the device 800, the relative positioning of components, such as the display and keypad of the electronic device 800. The sensor component 814 can also detect a change in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and a change in the temperature of the electronic device 800. The sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 814 may further include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0103] The communication component 816 is configured to facilitate communication between the electronic device 800 and other devices in a wired or wireless manner. The electronic device 800 can access a wireless network based on communication standards, such as Wi-Fi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0104] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components, and is used to execute the display processing method of the above embodiment.

[0105] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is further provided, such as a memory 804 including instructions. The above instructions can be executed by a processor 820 of the electronic device 800 to complete the display processing method of the above embodiment. For example, the non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0106] The embodiments of the present disclosure also record a non-transitory computer-readable storage medium. When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute a control method, and the method includes:

[0107] Obtain the layer data of the area to be displayed;

[0108] Determine the intensity of the ambient light;

[0109] Calculate the diffuse reflection noise parameter according to the light source position information and the intensity of the ambient light;

[0110] Add diffuse reflection noise to the layer data of the area to be displayed according to the diffuse reflection noise parameter, perform combined rendering on the layer data with added diffuse reflection noise, and output.

[0111] The embodiments of the present disclosure also record a non-transitory computer-readable storage medium. When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute a control method, and the method includes:

[0112] Obtain the layer data of the area to be displayed;

[0113] Determine the intensity of the ambient light;

[0114] Calculate the diffuse reflection noise parameter according to the light source position information and the intensity of the ambient light;

[0115] Add diffuse reflection noise to the layer data of the area to be displayed according to the diffuse reflection noise parameter, perform combined rendering on the layer data with added diffuse reflection noise, and output.

[0116] Other embodiments of the present disclosure will be readily apparent to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common general knowledge or conventional technical means in the technical field not disclosed by the present disclosure. The specification and examples are only to be considered as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0117] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A display processing method, characterized in that, the method includes: obtaining layer data of a to-be-displayed area; determining the intensity of ambient light; calculating a diffuse reflection noise parameter according to the light source position information of a display unit and the intensity of the ambient light; adding diffuse reflection noise to the layer data of the to-be-displayed area according to the diffuse reflection noise parameter, performing combined rendering on the layer data with the added diffuse reflection noise, and outputting.

2. The method according to claim 1, characterized in that, the method further includes: obtaining set display color parameters, and generating a color conversion matrix according to the display color parameters; the performing combined rendering on the layer data with the added diffuse reflection noise and outputting includes: coloring the layer data with the added diffuse reflection noise through the color conversion matrix, performing combined rendering and outputting.

3. The method according to claim 1 or 2, characterized in that, the calculating a diffuse reflection noise parameter according to the light source position information of a display unit and the intensity of the ambient light includes: obtaining information on the light source position of a display unit, determining a diffuse reflection model matching the light source position, and calculating diffuse reflection parameters of respective display areas corresponding to a display screen based on the diffuse reflection model; measuring the intensity of the ambient light, and adding the intensity of the ambient light and the diffuse reflection parameters to corresponding display parameters of respective display areas corresponding to the display screen.

4. The method according to claim 1, characterized in that, the obtaining layer data of a to-be-displayed area includes: obtaining layer data of all visible display areas, storing the obtained layer data in an array, and drawing the layer data in the array into a to-be-displayed frame buffer object (FrameBufferObject) in a drawLayers manner of layer painting.

5. The method according to claim 1, characterized in that, the determining the intensity of ambient light includes: collecting current ambient light, determining the light intensity based on a set distance and a collected area, and using the determined light intensity as the intensity of the ambient light.

6. The method according to claim 3, characterized in that, the determining a diffuse reflection model matching the light source position includes: normalizing a vertex normal and a light source direction respectively; determining the intensity of a reflected light on a reflection surface, wherein the intensity of the reflected light on the reflection surface is proportional to a cosine value of an angle between a surface normal and the light source direction; generating a diffuse reflection model based on a corresponding relationship between the intensity of the reflected light and an angle between the normal and the light source direction.

7. A display processing device, characterized in that, the device includes: a first obtaining unit, configured to obtain layer data of a to-be-displayed area; a determining unit, configured to determine the intensity of ambient light; a calculating unit, configured to calculate a diffuse reflection noise parameter according to the light source position information of a display unit and the intensity of the ambient light; a layer processing unit, configured to add diffuse reflection noise to the layer data of the to-be-displayed area according to the diffuse reflection noise parameter, perform combined rendering on the layer data with the added diffuse reflection noise, and output.

8. The device according to claim 7, characterized in that, The device further includes: A second acquisition unit, configured to acquire set display color parameters; A generation unit, configured to generate a color conversion matrix according to the display color parameters; The layer processing unit is further configured to color the layer data added with diffuse noise through the color conversion matrix, perform combined rendering and output.

9. The device according to claim 7 or 8, wherein, The calculation unit is further configured to acquire information on the light source position of the display unit, determine a diffuse reflection model matching the light source position, and calculate diffuse reflection parameters of each display area corresponding to the display screen based on the diffuse reflection model; Measure the intensity of the ambient light, and add the intensity of the ambient light and the diffuse reflection parameters to the corresponding display parameters of each display area corresponding to the display screen.

10. The device according to claim 7, wherein, The first acquisition unit is further configured to acquire layer data of all visible display areas, store the acquired layer data in an array, and draw the layer data in the array into a frame buffer object (FrameBufferObject) to be displayed in a drawLayers manner.

11. The device according to claim 7, wherein, The determination unit is further configured to collect the current ambient light, determine the light intensity based on a set distance and a collection area, and use the determined light intensity as the intensity of the ambient light.

12. The device according to claim 9, wherein, The calculation unit is further configured to: Normalize the vertex normal and the light source direction respectively; Determine the intensity of the reflected light on the reflection surface, wherein the intensity of the reflected light on the reflection surface is proportional to the cosine value of the angle between the surface normal and the light source direction; Generate a diffuse reflection model based on the corresponding relationship between the intensity of the reflected light and the angle between the normal and the light source direction.

13. An electronic device, wherein, The electronic device includes: a processor and a memory for storing processor-executable instructions, wherein the processor is configured to be capable of executing the display processing method according to any one of claims 1 to 6 when calling the executable instructions in the memory.

14. A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by a processor of an electronic device, enabling the electronic device to execute the display processing method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Photorealistic sense generation method of mobile augmented reality type doodle picture book

    CN106127859A

  • Image displaying method and terminal

    CN106569763A