Display method of terminal equipment and related device

Abstract

The invention provides a display method of terminal equipment and a related device, which can be applied to the technical field of terminals. In the technical scheme provided by the invention, when the display area of the terminal device displays the to-be-displayed data, the densities of the illumination probes in different areas can be different, and / or the orders of the pixel points in different areas for performing ray tracing calculation can be different. According to the method, the calculation amount needed when the terminal equipment displays the to-be-displayed data can be reduced, and game performance and rendering efficiency can be improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminal, in particular to a display method of terminal device and related apparatus. BACKGROUND

[0002] At present, the terminal device can use light ray tracing technology to display game pictures to provide immersive experience for users. However, in actual use, it is found that when the terminal device displays game pictures using light ray tracing technology, high load, performance decline and even picture lag often occur. SUMMARY

[0003] The present application provides a display method of terminal device and related apparatus, which can improve game performance and rendering efficiency when the terminal device displays game pictures using light ray tracing technology.

[0004] In a first aspect, the present application provides a display method of terminal device, which comprises: acquiring to-be-displayed data of the terminal device; and displaying the to-be-displayed data in a display area of the terminal device, wherein the display area comprises a first area and a second area, and the first area and the second area correspond to different at least one of the following information: density of illumination probe, or order of pixel point for light ray tracing calculation.

[0005] In this method, the density of illumination probe corresponding to different display areas can be different, so that the terminal device can reduce the density of illumination probe in some unimportant areas, that is, the number of illumination probe in some unimportant areas, and the number of illumination probe needing to acquire illumination information is reduced, thereby reducing the calculation amount required when the illumination probe acquires illumination information, thereby reducing the load when the illumination probe acquires illumination information, which is conducive to improving game performance and rendering efficiency.

[0006] The order of light ray tracing calculation corresponding to different display areas can be different, so that the terminal device can reduce the order of light ray tracing calculation in some unimportant areas when performing light ray tracing calculation, thereby facilitating to reduce the calculation amount required when the terminal device performs light ray tracing calculation, thereby reducing the load when the terminal device performs light ray tracing calculation, which is conducive to improving game performance and rendering efficiency.

[0007] In some possible implementation manners, the density of illumination probe in the first area is less than the density of illumination probe in the second area; and / or, the order of pixel point for light ray tracing calculation in the first area is less than the order of pixel point for light ray tracing calculation in the second area.

[0008] In this implementation, when the density of the light probes in the first region is less than the density of the light probes in the second region, the density of the light probes in the first region can be reduced, that is, the number of the light probes in the first region can be reduced, so that the calculation amount required by the light probes in the first region for obtaining the light information can be reduced, thereby reducing the load of the light probes in the first region for obtaining the light information, and the game performance and the rendering efficiency are improved.

[0009] When the order of the ray tracing calculation of the pixel points in the first region is less than the order of the ray tracing calculation of the pixel points in the second region, the order of the ray tracing calculation of the pixel points in the first region can be reduced, so that the calculation amount required by the pixel points in the first region for performing the ray tracing calculation can be reduced, thereby reducing the load of the pixel points in the first region for performing the ray tracing calculation, and the game performance and the rendering efficiency are improved.

[0010] In some possible implementation, the density of the light probes in the first region is zero.

[0011] The density of the light probes in the first region can be zero, that is, no light probe is placed in the first region, and the calculation amount can be further reduced, and the game performance and the rendering efficiency are further improved.

[0012] In some possible implementation, the first region includes a screen edge region, and a distance between a pixel coordinate of a pixel point in the screen edge region and a pixel coordinate of a screen boundary pixel point is less than or equal to a first preset coordinate distance.

[0013] In this method, the terminal device can reduce the number of the light probes in the screen edge region and / or reduce the order of the ray tracing calculation of the pixel points in the screen edge region, so that when the terminal device displays the to-be-displayed data, the calculation amount required by the screen edge region for displaying the to-be-displayed data can be reduced, thereby reducing the load of the screen edge region for displaying the to-be-displayed data, and the game performance and the rendering efficiency are improved.

[0014] In some possible implementation, when the terminal device detects a user operation, the first region includes a screen occlusion region, the screen occlusion region includes a first sub-region and an overlapping region of a screen region of the terminal device, the first sub-region is a rectangular region established based on a user operation region and includes a screen boundary corner of the terminal device, and a volume of the user operation region is greater than or equal to a first volume.

[0015] Optionally, the screen occlusion region can not include the screen edge region.

[0016] In the method, the terminal device can reduce the number of light probes in the screen occlusion area and / or reduce the order of pixel point light tracing calculation in the occlusion edge area, so that the terminal device can reduce the calculation amount when displaying the to-be-displayed data in the screen occlusion area, thereby reducing the load when displaying the to-be-displayed data in the screen occlusion area, and improving the game performance and rendering efficiency.

[0017] In some possible implementation manners, the first area further includes a screen blur area, the screen blur area includes a second sub-area and an overlapping area of the screen area of the terminal device, the second sub-area is an area of a circle with a screen boundary angle of the terminal device as a center and a distance between the screen boundary angle of the terminal device and a center point of the user operation area as a radius, and the screen blur area does not include the screen occlusion area.

[0018] In the method, the terminal device can reduce the number of light probes in the screen blur area and / or reduce the order of pixel point light tracing calculation in the screen blur area, so that the terminal device can reduce the calculation amount when displaying the to-be-displayed data in the screen blur area, thereby reducing the load when displaying the to-be-displayed data in the screen blur area, and improving the game performance and rendering efficiency.

[0019] In a second aspect, a display apparatus of a terminal device is provided. The display apparatus can be used in the terminal device, and can be the terminal device, or a device (for example, a chip, a chip system, or a circuit) in the terminal device, or a logic module or software capable of realizing all or part of the functions of the terminal device. In a possible implementation, modules or units for implementing the method in the first aspect and any possible implementation manner of the first aspect are included. For example, modules or units corresponding to the method / operation / step / action described in the first aspect can be included, which can be hardware circuits, software, or a combination of hardware circuits and software. Optionally, each module or unit can realize corresponding functions by executing a computer program.

[0020] In a third aspect, a display apparatus of a terminal device is provided. The display apparatus includes a processor configured to cause the apparatus to perform the method in any possible implementation manner of the first aspect by executing a computer program (or computer executable instructions) stored in a memory and / or by a logic circuit.

[0021] In a possible implementation, the apparatus further includes a memory.

[0022] In a possible implementation, the processor and the memory are integrated together.

[0023] In another possible implementation, the memory is located outside the display apparatus.

[0024] In a possible implementation, the display apparatus further comprises a communication interface for the display apparatus to communicate with other apparatuses, such as transmitting or receiving data and / or signals. For example, the communication interface can be a transceiver, a circuit, a bus, a module or other types of communication interfaces.

[0025] In a fourth aspect, the present application provides a computer readable storage medium storing a computer program or instructions for a display apparatus of a terminal device to execute, which when run on the display apparatus of the terminal device, causes the method in any possible implementation of the first aspect to be implemented.

[0026] In a fifth aspect, the present application provides a computer program product containing instructions, which when run on the display apparatus of the terminal device, causes the method in any possible implementation of the first aspect to be implemented.

[0027] In a sixth aspect, the present application provides a chip having a computer program stored thereon, which when executed by the chip, causes the method in any possible implementation of the first aspect to be implemented.

[0028] It can be understood that the effects obtainable by the second aspect to the sixth aspect can refer to the description in the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0029] Figure 1 An application scenario suitable for an embodiment of the present application;

[0030] Figure 2 A hardware structure of a terminal device provided by an embodiment of the present application;

[0031] Figure 3 A software structure block diagram of a terminal device provided by an embodiment of the present application;

[0032] Figure 4 A display method flowchart of a terminal device provided by an embodiment of the present application;

[0033] Figure 5 A user interface provided by an embodiment of the present application;

[0034] Figure 6 A user interface provided by another embodiment of the present application;

[0035] Figure 7 A user interface provided by yet another embodiment of the present application;

[0036] Figure 8 A pixel coordinate diagram of a screen edge area of a terminal device according to an embodiment of the present application is shown in FIG. 1;

[0037] Figure 9 A capacitance diagram of a touch panel of a terminal device according to an embodiment of the present application is shown in FIG. 2;

[0038] Figure 10 A first coordinate system diagram according to another embodiment of the present application is shown in FIG. 3;

[0039] Figure 11 A pixel coordinate diagram of a screen pixel area of a terminal device according to an embodiment of the present application is shown in FIG. 4;

[0040] Figure 12 A user operation area diagram according to an embodiment of the present application is shown in FIG. 5;

[0041] Figure 13 A pixel coordinate diagram of a screen pixel area of a terminal device according to an embodiment of the present application is shown in FIG. 4;

[0042] Figure 14 A pixel coordinate diagram of a screen edge area of a terminal device according to another embodiment of the present application is shown in FIG. 6;

[0043] Figure 15 A line-of-sight concentration area, a screen edge area, a screen occlusion area and a screen blur area diagram according to an embodiment of the present application is shown in FIG. 7;

[0044] Figure 16 An illumination probe diagram of a first area and a second area according to an embodiment of the present application is shown in FIG. 8;

[0045] Figure 17 A display method flow diagram of a terminal device according to another embodiment of the present application is shown in FIG. 9;

[0046] Figure 18 A structure diagram of a display device of a terminal device according to an embodiment of the present application is shown in FIG. 10;

[0047] Figure 19 A structure diagram of a display device of a terminal device according to another embodiment of the present application is shown in FIG. 11. DETAILED DESCRIPTION

[0048] The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

[0049] For the convenience of clearly describing the technical solutions of the embodiments of the present application, in the embodiments of the present application, the terms "first", "second", etc. are used to distinguish the same or similar items with basically the same function and role. For example, the first information and the second information are only used to distinguish different information, and do not limit the order. Those skilled in the art can understand that the terms "first", "second", etc. do not limit the quantity and execution order, and the terms "first", "second", etc. also do not necessarily mean different.

[0050] In the embodiments of the present application, "at least one" means one or more, and "multiple" means two or more. The association relationship of the associated objects is described by "and / or", which means that there can be three kinds of relationships, for example, A and / or B can represent the following three cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the front and rear associated objects. "At least one of the following" or similar expressions means any combination of these items, including any combination of single item or multiple items. For example, at least one of a, b and (or) c can represent: a, b, c; a and b; a and c; b and c; or a and b and c. Where a, b, and c can be single or multiple.

[0051] In Figure 1 In the application scenario shown, the terminal device can display a game screen, and the user can operate based on the game screen displayed by the terminal device. Figure 1 In the

[0052] In the present application, the terminal device is a device with screen touch function, for example, the terminal device can be a mobile phone, a tablet computer, a smart screen, a car machine device, and a wearable terminal device such as a smart watch, and can also be various teaching aids (such as learning machines, early education machines), smart toys, portable robots, personal digital assistants (PDA), etc., and can also be a device with mobile office function, a device with smart home function, a device with audio-visual entertainment function, a device supporting smart travel, etc. It should be understood that the embodiments of the present application do not limit the specific technology and specific device form of the terminal device.

[0053] In order to better understand the embodiments of the present application, the hardware structure of the terminal device of the embodiments of the present application is introduced. Exemplarily, Figure 2 A hardware structure schematic diagram of a terminal device provided by the embodiments of the present application.

[0054] The terminal device can include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, a headset jack 270D, a sensor module 280, a key 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295, etc.

[0055] Optionally, the sensor module 280 described above can include a pressure sensor 280A, a gyroscope sensor 280B, a barometric pressure sensor 280C, a magnetic sensor 280D, an acceleration sensor 280E, a distance sensor 280F, a proximity light sensor 280G, a fingerprint sensor 280H, a temperature sensor 280J, a touch sensor 280K, an ambient light sensor 280L, a bone conduction sensor 280M, etc.

[0056] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the terminal device. In other embodiments of the present application, the terminal device can include more or fewer components than the illustration, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0057] The processor 210 can include one or more processing units. For example: the processor 210 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, etc. Different processing units can be independent devices, or can be integrated into one or more processors. The processor 110 can also be provided with a memory for storing instructions and data.

[0058] The USB interface 230 is an interface conforming to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 230 can be used to connect a charger to charge the terminal device, and can also be used to transmit data between the terminal device and a peripheral device. It can also be used to connect a headset to play audio through the headset. The interface can also be used to connect other terminal devices, such as AR devices, etc.

[0059] The charging management module 240 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. The charging management module 240 can charge the battery 242 while also charging the terminal device through the power management module 241.

[0060] The power management module 241 is configured to connect the battery 242, the charging management module 240, and the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240 to supply power to the processor 210, the internal memory 221, the external memory, the camera 293, the display screen 294, the audio module 270, and the wireless communication module 260, etc. In some embodiments, the power management module 241 can also be disposed in the processor 210. In other embodiments, the power management module 241 and the charging management module 240 can also be disposed in the same device.

[0061] Optionally, in some embodiments, the power management module 241 can also be referred to as a battery management unit (PMU). The PMU can be configured to obtain state information of the battery 242, such as the remaining capacity and temperature of the battery 242, etc.

[0062] The wireless communication function of the terminal device can be implemented through the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modem processor, and the baseband processor, etc.

[0063] The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. The antennas in the terminal device can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas.

[0064] The mobile communication module 250 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied on the terminal device. The mobile communication module 250 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 250 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit to the modem processor for demodulation. The mobile communication module 250 can also amplify the signal modulated by the modem processor, and radiate as electromagnetic waves by the antenna 1.

[0065] The wireless communication module 260 can provide a solution for wireless communication including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), etc. applied on the terminal device. The wireless communication module 260 can be one or more devices integrated with at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signal, and transmits the processed signal to the processor 210. The wireless communication module 260 can also receive a signal to be transmitted from the processor 210, perform frequency modulation and amplification, and radiate as electromagnetic waves by the antenna 2.

[0066] In some embodiments, the antenna 1 and the mobile communication module 250 of the terminal device are coupled, and the antenna 2 and the wireless communication module 260 are coupled, so that the terminal device can communicate with the network and other devices through wireless communication technology.

[0067] The camera 293 is used to capture still images or videos. In some embodiments, the terminal device can include one or N cameras 293, N being a positive integer greater than 1.

[0068] The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel. In some embodiments, the terminal device can include one or N display screens 294, N being a positive integer greater than 1.

[0069] In the embodiments of the present application, the interface of the preset application and the like can be displayed on the display screen 294. The interface of the preset application can include a video frame picture, a video duration, and the like.

[0070] In some embodiments of the present application, the preset application can include, but is not limited to, a video playing application, an audio playing application, a game application, a shopping application, and a social application, and the like, which can play audio or video.

[0071] The terminal device can realize the display function through a graphics processing unit (GPU), a display screen 294, and an application processor, etc. The GPU is a microprocessor for image processing, connected with the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The GPU can also be referred to as a display core, a visual processor, and a display chip, etc.

[0072] The terminal device can realize the shooting function through an ISP, a camera 293, a video codec, a GPU, a display screen 294, and an application processor, etc.

[0073] The video codec is used for compressing or decompressing digital video. The terminal device can support one or more video codecs. In this way, the terminal device can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc. In addition, the terminal device can realize the encapsulation and playing of audio and video data and screen recording data, etc.

[0074] In some embodiments, the display screen can also be referred to as a physical screen.

[0075] The external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to realize the expansion of the storage capacity of the terminal device. The external memory card communicates with the processor 210 through the external memory interface 220 to realize the data storage function. For example, files such as music and videos are saved in the external memory card.

[0076] The internal memory 221 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 221 can include a storage program area and a storage data area. The storage program area can store application programs required by at least one function in the operating system (such as a sound playing function, an image playing function, etc.), etc. The storage data area can store data created during the use of the terminal device (such as audio data, a phonebook, etc.), etc.

[0077] The terminal device can realize the audio function through an audio module 270, a loudspeaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, and an application processor, etc. For example, music playing, recording, etc.

[0078] The audio module 270 is for converting digital audio information into an analog audio signal output, and for converting an analog audio input into a digital audio signal. The speaker 270A, also called a "loudspeaker", is for converting an audio electrical signal into a sound signal. The terminal device can listen to music or listen to a hands-free call through the speaker 270A. The receiver 270B, also called a "earpiece", is for converting an audio electrical signal into a sound signal. When the terminal device is on a call or receiving a voice message, the receiver 270B can be held close to the ear to listen to the voice. The microphone 270C, also called a "microphone", "mic", is for converting a sound signal into an electrical signal. The earphone interface 270D is for connecting a wired earphone.

[0079] The pressure sensor 280A is for sensing a pressure signal, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 280A can be disposed on the display screen 294. When a touch operation is applied to the display screen 294, the terminal device can detect the intensity of the touch operation according to the pressure sensor 280A. The terminal device can also calculate the position of the touch according to the detection signal of the pressure sensor 280A.

[0080] The gyroscope sensor 280B can be used to determine the motion posture of the terminal device. The barometer sensor 280C is for measuring air pressure. The magnetic sensor 280D includes a Hall sensor. The acceleration sensor 280E can detect the magnitude of acceleration of the terminal device in various directions (generally three axes). The distance sensor 280F is for measuring distance. The proximity light sensor 280G can include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The ambient light sensor 280L is for sensing ambient light brightness. The fingerprint sensor 280H is for acquiring a fingerprint. The temperature sensor 280J is for detecting temperature.

[0081] The touch sensor 280K can be disposed on the display screen 294, and the touch sensor 280K and the display screen 294 together form a touch screen, also called a "touch panel". The touch sensor 280K is for detecting a touch operation applied thereto or in the vicinity thereof. The touch sensor 280K can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 294. In other embodiments, the touch sensor 280K can also be disposed on the surface of the terminal device, in a position different from that of the display screen 294.

[0082] The bone conduction sensor 180M can obtain a vibration signal.

[0083] The keys 290 include a power key, a volume key, and the like. The keys 290 can be mechanical keys. Alternatively, the keys 290 can be touch keys. The terminal device can receive key input and generate key signal input related to user settings and function control of the terminal device. The motor 291 can generate a vibration prompt. The indicator 292 can be an indicator light and can be used to indicate a charging state, a power change, and can also be used to indicate a message, a missed call, a notification, and the like. The timer 296 can be used to record time information. For example, when the terminal device records a video, the start time and the end time of the video can be recorded, and the length of the recorded video can also be recorded.

[0084] In an embodiment of the present application, as an example, the software system of the terminal device can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The layered architecture can adopt an Android system, or an IOS system, or other operating systems, which are not limited in the embodiments of the present application. The following takes an Android system as an example to illustrate the software structure of the terminal device. Figure 3

[0085] Figure 3 A software structure block diagram of a terminal device provided in an embodiment of the present application is shown in FIG. 2. The layered architecture divides the software system of the terminal device into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces.

[0086] In some embodiments, the system can include an application layer (applications), a user space, and a kernel space.

[0087] The application layer can include a series of application packages, and the application layer runs the application by calling the application programming interface (API) provided by the application framework layer.

[0088] For example, the application packages can include camera, gallery, calendar, call, map, navigation, wireless local area networks (WLAN), Bluetooth, music, video, short message, game, and the like. Of course, the application layer can also include third-party application packages, such as social applications, third-party music applications, third-party video applications, payment applications, shopping applications, bank applications, chat applications, or financial applications, which are not limited in the present application.

[0089] ​The user space can include an application framework layer that provides an application programming interface (API) and a programming framework for applications of the application layer.

[0090] In one embodiment, referring to Figure 3 , the application framework layer can include an input manager service (IMS), a window manager service (WMS), and a visual framework layer. The IMS can include an input event reader, an input event dispatcher, and an event hub queue, etc. It should be understood that the input event can include a touch event, which can include a user touch event and a pen touch event. The user touch event can be triggered by the user's finger, knuckle, etc. The WMS can include a window. The visual framework layer can include a user interface control (e.g., Textview) and a ViewRootImpl, which can display a screen on the application interface. The ViewRootImpl is the top of a view hierarchy and can be understood as a manager of a root view of all views in a window. The ViewRootImpl is used to implement the connection between the view and the WMS to control the rendering of the window. Alternatively, the visual framework can also be referred to as a user interface framework layer.

[0091] Optionally, the application framework layer can also include a ray tracing pixel analysis module (not shown in Figure 3 ), which can be used to determine the processing logic of the terminal device to display the screen based on the ray tracing technology.

[0092] Optionally, the user space can also include a device access node, which can be used to transmit events in the kernel space.

[0093] The kernel space can also be referred to as a kernel layer, which is a layer between hardware and software. The kernel layer includes a driver layer, which can be used to drive hardware to work. As an example, the driver layer includes a touch panel driver (TP driver), a display driver, a sensor driver, a graphics processing unit driver (GPU driver), and the like, which are not limited in the embodiments of the present application. For example, the display driver can be a liquid crystal display driver (LCD driver), which can be used to drive an LCD display screen in a screen of a terminal device to display content. The graphics processing unit driver can be used to drive a GPU in the terminal device to work. The kernel layer can also include an input core and an input handler. The input core is a bridge between the input handler and the driver layer, and provides an interface of the driver layer downwardly and an interface of the input handler upwardly. The input handler provides a unified interface of a device for an application in a user space and an event processing submitted by the driver layer.

[0094] The terminal device can interact with the hardware layer through the kernel space. The hardware layer includes hardware devices such as a touch panel (TP), a display panel, a sensor, a graphics processing unit, and the like. Functions of the modules can be referred to the related descriptions in the embodiments below. For example, the sensor can include a pressure sensor, a gyroscope sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, and the like. Functions of the sensors are not described in the embodiments of the present application.

[0095] The touch panel includes a touch panel sensor (TP sensor) and a touch integrated circuit (IC) chip, and the display panel includes a display screen and a display IC chip. In an embodiment, the touch IC chip and the display IC chip can be integrated or independently arranged. The display screen can include, but is not limited to, an LCD display screen and a light-emitting diode display screen, which are not limited in the embodiments of the present application. It should be understood that Figure 3 The specific touch IC chip and the display IC chip are not shown in the embodiments of the present application, and the touch panel and the LCD display screen are taken as examples. It should be understood that the screen of the terminal device described in the embodiments of the present application can include the touch panel and the display panel. Optionally, in some embodiments, the touch panel can also be referred to as a touch screen. Optionally, in some embodiments, the display panel can also be referred to as a display screen.

[0096] This application does not limit the layering of the software structure of the terminal device. The modules included in each layer in the following embodiments are the modules involved in the embodiments of this application, and the modules included in each layer do not constitute a limitation on the structure of the terminal device. In another embodiment of this application, the terminal device may include more or fewer modules than illustrated, or combine some modules, or split some modules, or arrange different modules. The illustrated modules can be implemented in hardware, software, or a combination of software and hardware.

[0097] When a user opens a game app on a terminal device, the terminal device can use ray tracing technology to display the game screen, providing the user with an immersive experience.

[0098] Methods for displaying game visuals using ray tracing technology on a terminal device may include: the terminal device first divides the display area into multiple sub-regions, then places a light probe in each sub-region, and then searches the light probes in each region to determine whether the light probes in each region have detected lighting information. For each sub-region that has detected lighting information, the terminal device can perform ray tracing calculations based on the pixels within the sub-region for rendering.

[0099] Among them, the illumination probes can be placed uniformly, and the order of ray tracing calculation for each pixel is also fixed.

[0100] However, in practical applications, it has been found that when terminal devices use ray tracing technology to display game graphics, screen stuttering often occurs.

[0101] Research has found that the reason for screen stuttering on terminal devices is that the chip in the terminal device occupies a small area, and the hardware used to deploy ray tracing technology (hereinafter referred to as ray tracing hardware) in the terminal device is limited. The computing power that this hardware can provide is limited. However, the amount of computing power required for the terminal device to display game screen using ray tracing technology may exceed the maximum computing power that the ray tracing hardware can provide, resulting in a longer time required for the terminal device to display game screen, or even screen stuttering.

[0102] In the technical solution of this application, the terminal device can reduce the amount of computation required when displaying game screens using ray tracing technology by reducing the number of lighting probes placed in some areas or reducing the order of ray tracing calculations for pixels in some areas. This reduces the load on the terminal device when displaying game screens using ray tracing technology, improves game performance and rendering efficiency, and helps avoid screen stuttering.

[0103] Next, this application will combine Figures 4 to 19 The technical solution of this application will be further described below.

[0104] Figure 4 The flowchart of the display method of the terminal device provided in an embodiment of the present application is shown. The method can be applied to the terminal device as shown in Figure 2 The method can be executed by the terminal device, or can be executed by a component (such as a chip, a chip system, etc.) applied to the terminal device, or can also be implemented by a logical module or software capable of realizing all or part of the terminal device functions, for example, can be implemented by an application or a service in the operating system of the terminal device, and the embodiments of the present application do not limit this.

[0105] S401, obtaining the to-be-displayed data of the terminal device.

[0106] In the method, the terminal device can obtain the to-be-displayed data after receiving the first instruction of the user, and the to-be-displayed data can be the data required to be displayed by the terminal device based on the first instruction.

[0107] In the game scenario, the first instruction is used to indicate that the user has clicked the game start button or the user has clicked the game start button or the user has clicked the game operation button. In this scenario, the to-be-displayed data can include data for displaying a game screen.

[0108] As an example, as shown in Figure 5 , it is assumed that the user interface of the terminal device contains a game icon. After the user clicks the icon, the terminal device can receive the first instruction.

[0109] As another example, after the user clicks the game icon, the terminal device can display a user interface as shown in Figure 6 , which can contain a game start button. After the user clicks the game start button, the terminal device can receive the first instruction.

[0110] As another example, when the user clicks the game start button, the terminal device can display a user interface as shown in Figure 7 , which can contain user operation buttons, such as direction buttons and game operation buttons. After the user clicks the direction buttons and / or the game operation buttons, the terminal device can receive the first instruction.

[0111] In a possible implementation, a game application package can be deployed in the terminal device, and the game application package can store game screen data. The to-be-displayed data can be all or part of the game screen data.

[0112] Optionally, the to-be-displayed data can be associated with the user instruction received by the terminal device.

[0113] The terminal device receives different user instructions, and the to-be-displayed data can also be different. Figure 7 For example, the to-be-displayed data corresponding to the user clicking the up key in the direction key is different from the to-be-displayed data corresponding to the user clicking the down key.

[0114] In this implementation, the terminal device can obtain the to-be-displayed data corresponding to the first instruction from the game picture data based on the first instruction.

[0115] S402, display the to-be-displayed data in the display area of the terminal device, wherein the display area includes a first area and a second area, and the first area and the second area correspond to different at least one of the following information: density of light probes, or order of pixel point light fiber tracking calculation.

[0116] In this method, the terminal device can divide the display area of the terminal device through the light ray tracking pixel analysis module.

[0117] Optionally, the light ray tracking pixel analysis module of the terminal device can divide the first area and the second area according to the importance of the display area. Optionally, the importance of the display area can be determined by the area of the region that the user can see.

[0118] As an example, for any one area, if the ratio of the area that the user can see in the area to the area of the area is greater than or equal to a first ratio, the area can be determined as an important area. If the ratio of the area that the user can see in the area to the area of the area is less than the first ratio, the area can be determined as an unimportant area.

[0119] In this method, the density of the light probes corresponding to different display areas can be different, so that the terminal device can reduce the density of the light probes in some unimportant areas, that is, the number of light probes in some unimportant areas, the number of light probes that need to obtain light information is reduced, thereby reducing the amount of calculation required when the light probes obtain light information, thereby reducing the load when the light probes obtain light information, which is conducive to improving the game performance and rendering efficiency.

[0120] The order of light ray tracking calculation corresponding to different display areas can be different, so that the terminal device can reduce the order of light ray tracking calculation in some unimportant areas when performing light ray tracking calculation, thereby facilitating to reduce the amount of calculation required when the terminal device performs light ray tracking calculation, thereby reducing the load when the terminal device performs light ray tracking calculation, which is conducive to improving the game performance and rendering efficiency.

[0121] In the method, the display region of the terminal device can include a first region and a second region, wherein the first region can be some unimportant region, and the second region can be some important region.

[0122] Optionally, the screen edge region of the terminal device is generally a region that is not looked at by the user or a region that is not frequently looked at. In this case, the first region can include the screen edge region. In this case, the interval between the pixel coordinates of the pixel points in the screen edge region and the pixel coordinates of the screen boundary pixel points can be less than or equal to the first preset coordinate interval.

[0123] As an example, the first preset coordinate interval can be two pixel coordinates.

[0124] As shown in Figure 8 , it is assumed that the display region (or screen pixel region) of the terminal device includes MxN pixel points, that is, M rows and N columns of pixel points. The ray tracing pixel analysis module of the terminal device can determine the pixel points in the first row, the second row, the M-1th row, the Mth row, the first column, the second column, the N-1th column, and the Nth column as the pixel points in the screen edge region.

[0125] In other words, the ray tracing pixel analysis module of the terminal device can determine the pixel points with pixel coordinates located at (0, 0), (1, 1), (M-2, N-2), and (M-1, N-1) as the pixel points in the screen edge region. (0, 0) can include the pixel coordinates with row number 0 and column number 0, that is, the pixel coordinates of the first row and the first column. (1, 1) can include the pixel coordinates with row number 1 and column number 1, that is, the pixel coordinates of the second row and the second column. (M-2, N-2) can include the pixel coordinates with row number M-2 and column number N-2, that is, the pixel coordinates of the M-1th row and the N-1th column. (M-1, N-1) includes the pixel coordinates with row number M-1 and column number N-1, that is, the pixel coordinates of the Mth row and the Nth column.

[0126] In this example, the shaded part represents the screen edge region.

[0127] Optionally, in some scenarios, for example, in the scenario where the user clicks the user interface, there is a part of the region of the screen of the terminal device that is blocked, the blocked region is a region that cannot be seen by the user, and the blocked region can be referred to as a screen blocked region. In this case, the first region can also include the screen blocked region.

[0128] The screen blocked region can include a first sub-region and an overlapping region of the screen region of the terminal device. The first sub-region can be a rectangular region established based on the user operation region and including the screen boundary corner of the terminal device, and the screen boundary corner of the terminal device is located at the lower left corner or the lower right corner of the screen of the terminal device.

[0129] In the method, the terminal device can first determine the pixel coordinates of the user operation region, and then determine the pixel coordinates of the screen occlusion region based on the pixel coordinates of the user operation region.

[0130] Optionally, the method for determining the pixel coordinates of the user operation region by the terminal device can include: the terminal device can perceive the touch condition of the display screen of the terminal device based on the touch sensors in the touch panel. When the touch sensors perceive that the capacitance value of a part of the region in the touch panel of the terminal device is greater than the first capacitance value, the terminal device can determine the part of the region as the user operation region, obtain the first coordinate information corresponding to the user operation region, and transmit the first coordinate information to the ray tracing pixel analysis module of the terminal device. The ray tracing pixel analysis module of the terminal device can determine the pixel coordinates corresponding to the first coordinate information based on the first coordinate information, and then determine the pixel coordinates corresponding to the first coordinate information as the pixel coordinates of the user operation region.

[0131] In the implementation manner, the first coordinate information can be the coordinates of the user operation region on the touch panel of the terminal device.

[0132] Optionally, the touch panel of the terminal device can be divided into a plurality of grids arranged in rows and columns, and the first coordinate information can indicate the position of the grid corresponding to the user operation region in the plurality of grids arranged in rows and columns. The coordinates of the user operation region on the touch panel of the terminal device can be understood as the position of the user operation region in the grids arranged in rows and columns. In some embodiments, the touch panel of the terminal device can be divided into 18 rows and 38 columns of grids.

[0133] Taking the case that the touch panel of the terminal device is divided into 6 rows and 8 columns of grids as an example, when the user clicks the user interface, the capacitance value of the touch panel of the terminal device can be as shown in FIG. 6. Figure 9 In the method, it is assumed that the first capacitance value is 100, and the touch panel of the terminal device can simulate the region with the capacitance value greater than 100 as an elliptical region, and then establish a first coordinate system based on the elliptical region to obtain the coordinate information of the elliptical region in the first coordinate system.

[0134] Optionally, the first coordinate system established by the terminal device based on the elliptical region can be as shown in FIG. 7. Figure 10 In the example, the first coordinate system can be a two-dimensional coordinate system, the origin of the first coordinate system can be the center point of the elliptical region, and the two coordinate axes of the first coordinate system can coincide with the major axis and the minor axis of the elliptical region, respectively.

[0135] The coordinate information of the elliptical region in the first coordinate system can include coordinate origin information and coordinate axis information of the elliptical region. The coordinate origin information can indicate a position of a coordinate origin of the first coordinate system in a row-column arrangement grid of the touch panel of the terminal, and the coordinate axis information can indicate coordinate positions of a major axis and a minor axis of the elliptical region in the first coordinate system and directions of two coordinate axes in the first coordinate system.

[0136] In this example, the coordinate information of the elliptical region in the first coordinate system can be the first coordinate information.

[0137] Optionally, when the touch sensor of the terminal device transmits the first coordinate information to the ray tracing pixel analysis module of the terminal device, the first coordinate information can be first transmitted to a ViewRootImpl module in a view framework layer through a sensor driver, a core layer and an event processing layer in a kernel space of the terminal device, and then transmitted to the ray tracing pixel analysis module through the ViewRootImpl module.

[0138] In an implementation manner, after the ViewRootImpl module receives the first coordinate information, the ViewRootImpl module can directly transmit the first coordinate information to the ray tracing pixel analysis module.

[0139] In another implementation manner, the ray tracing pixel analysis module can first transmit first indication information to the ViewRootImpl module, and the first indication information indicates that the ViewRootImpl module transmits the first coordinate information to the ray tracing pixel analysis module after receiving the first coordinate information.

[0140] After the ray tracing pixel analysis module of the terminal device receives the first coordinate information, the ray tracing pixel analysis module can determine a pixel coordinate corresponding to the first coordinate information in combination with the screen pixel region and the pixel coordinates of the screen pixel region, and then determine a pixel coordinate corresponding to the user operation region based on the pixel coordinate corresponding to the first coordinate information.

[0141] As an example, the ray tracing pixel analysis module of the terminal device can determine a first correspondence relationship between a row-column arrangement grid of the touch panel of the terminal device and the pixel coordinates of the screen pixel region according to the touch panel region of the terminal device, the screen pixel region and the pixel coordinates of the screen pixel region, and then determine the pixel coordinate corresponding to the first coordinate information based on the first correspondence relationship.

[0142] In this example, the terminal device can first determine a relationship between the touch panel region of the terminal device and the row-column arrangement grid of the touch panel of the terminal device, and a relationship between the screen pixel region of the terminal device and the pixel coordinates of the screen pixel region of the terminal device, and then determine a relationship between the touch panel region of the terminal device and the screen pixel region of the terminal device, and determine the first correspondence relationship based on these relationships.

[0143] Optionally, the area of the touch panel region of the terminal device can be greater than or equal to the area of the screen pixel region of the terminal device. It should be understood that the area difference between the touch panel region of the terminal device and the screen pixel region of the terminal device is not large and can be ignored.

[0144] Suppose the row-column arrangement grid of the touch panel of the terminal device is as shown in (a) of FIG. 6, the row-column arrangement grid of the touch panel includes m×n grids, and suppose the pixel coordinates of the screen pixel region of the terminal device are as shown in (b) of FIG. 6, the screen pixel region of the terminal device includes M×N pixels, and the m×n grids correspond to the M×N pixels. Figure 11 Figure 11 In this example, suppose the position of the user operation region in the row-column arrangement grid of the touch panel can be as shown in (a) of FIG. 7, and then the pixel coordinates corresponding to the first coordinate information can be as shown in (b) of FIG. 7. The shaded part represents the user operation region.

[0145] Optionally, the pixel coordinates of the screen pixel region can be associated with the direction in which the user holds the terminal device. Figure 12 Figure 12 For example, when the user holds the terminal device horizontally, the pixel coordinates of the screen pixel region of the terminal device can be as shown in FIG. 8. Wherein (0, 0) can include the pixel coordinates of the row number 0 and the column number 0, that is, the pixel coordinates of the first row and the first column. (M-1, N-1) includes the pixel coordinates of the row number M-1 and the column number N-1, that is, the pixel coordinates of the Mth row and the Nth column.

[0146] For another example, when the user holds the terminal device vertically, the pixel coordinates of the screen pixel region of the terminal device can be as shown in FIG. 9. Wherein (0, 0) can include the pixel coordinates of the row number 0 and the column number 0, that is, the pixel coordinates of the first row and the first column. (M-1, N-1) includes the pixel coordinates of the row number M-1 and the column number N-1, that is, the pixel coordinates of the Mth row and the Nth column.

[0147] Optionally, when the direction in which the user holds the terminal device is different, the number of rows and the number of columns of the pixels included in the screen pixel region of the terminal device can be different, that is, the pixel coordinates of the screen pixel region of the terminal device can be different, and the first correspondence relationship between the row-column arrangement grid of the touch panel of the terminal device and the pixel coordinates of the screen pixel region can also be different. Figure 13 For another example, when the user holds the terminal device vertically, the pixel coordinates of the screen pixel region of the terminal device can be as shown in FIG. 9. Wherein (0, 0) can include the pixel coordinates of the row number 0 and the column number 0, that is, the pixel coordinates of the first row and the first column. (M-1, N-1) includes the pixel coordinates of the row number M-1 and the column number N-1, that is, the pixel coordinates of the Mth row and the Nth column.

[0148] Figure 14 Optionally, when the direction in which the user holds the terminal device is different, the number of rows and the number of columns of the pixels included in the screen pixel region of the terminal device can be different, that is, the pixel coordinates of the screen pixel region of the terminal device can be different, and the first correspondence relationship between the row-column arrangement grid of the touch panel of the terminal device and the pixel coordinates of the screen pixel region can also be different.

[0149] Optionally, when the direction in which the user holds the terminal device is different, the number of rows and the number of columns of the pixels included in the screen pixel region of the terminal device can be different, that is, the pixel coordinates of the screen pixel region of the terminal device can be different, and the first correspondence relationship between the row-column arrangement grid of the touch panel of the terminal device and the pixel coordinates of the screen pixel region can also be different.

[0150] ​​​Optionally, the method for determining the pixel coordinates of the screen occlusion region based on the pixel coordinates of the user operation region can comprise: the ray tracing pixel analysis module of the terminal device can determine the pixel coordinates within the overlapping region of the first sub-region and the screen region of the terminal device based on the pixel coordinates of the user operation region and the pixel coordinates of the screen boundary corner of the terminal device, and determine the pixel coordinates within the overlapping region of the first sub-region and the screen region of the terminal device as the pixel coordinates of the screen occlusion region.

[0151] Optionally, the screen occlusion region can not include the screen edge region.

[0152] Optionally, in the game scenario, there is also a region of the screen for the user to slide back and forth, which is an area that the user cannot see clearly, and this region can be referred to as a screen blur region. In this case, the first region can also include the screen blur region.

[0153] The screen blur region can include the overlapping region of the second sub-region and the screen region of the terminal device. The second sub-region can be a region of a circle with the screen boundary corner of the terminal device as the center and the distance between the screen boundary corner of the terminal device and the coordinate origin indicated by the first coordinate information (or the center point of the user operation region) as the radius. The screen boundary corner of the terminal device can be the lower left corner or the lower right corner of the screen of the terminal device.

[0154] Optionally, the screen blur region does not include the screen occlusion region.

[0155] In this method, the terminal device can determine the pixel coordinates of the screen blur region based on the user operation region.

[0156] As an example, the ray tracing pixel analysis module of the terminal device can first obtain the first coordinate information corresponding to the user operation region, and then determine the pixel coordinates of the screen blur region based on the first coordinate information.

[0157] In this method, the ray tracing pixel analysis module of the terminal device can obtain the first coordinate information in the manner described in the foregoing embodiments, which will not be described here.

[0158] Optionally, the ray tracing pixel analysis module of the terminal device can determine the coordinate origin pixel coordinates according to the coordinate origin information in the first coordinate information, then determine the pixel coordinates within the overlapping region of the second sub-region and the screen region of the terminal device based on the pixel coordinates of the screen boundary corner of the terminal device, and determine the pixel coordinates of the screen blur region based on the pixel coordinates within the overlapping region of the second sub-region and the screen region of the terminal device, wherein the pixel coordinates of the screen blur region do not include the pixel coordinates of the screen occlusion region.

[0159] In the method, the second region can be a line-of-sight concentrated region, and the line-of-sight concentrated region can include other regions of the screen of the terminal device except for the screen edge region, the screen occlusion region, and the screen blur region.

[0160] Optionally, in a scenario in which a user clicks a user interface, the line-of-sight concentrated region, the screen edge region, the screen occlusion region, and the screen blur region can be as shown in Figure 15 .

[0161] In the method, after the light ray tracing pixel analysis module of the terminal device determines the first region and the second region, the terminal device can determine the first information, and the first information includes the density of the light probe in each of the first region and the second region and the order of the pixel point in each region for light ray tracing calculation.

[0162] Optionally, the density of the light probe in the first region can be less than the density of the light probe in the second region, and / or the order of the pixel point in the first region for light ray tracing calculation can be less than the order of the pixel point in the second region for light ray tracing calculation.

[0163] As an example, the light probes in the first region and the second region can be as shown in Figure 16 , where the shaded part represents the light probe.

[0164] When the density of the light probe in the first region is less than the density of the light probe in the second region, the density of the light probe in the first region can be reduced, that is, the number of light probes in the first region can be reduced, which can reduce the amount of calculation required when the light probe in the first region acquires illumination information, thereby reducing the load when the light probe in the first region acquires illumination information, and being conducive to improving game performance and rendering efficiency.

[0165] When the order of the pixel point in the first region for light ray tracing calculation is less than the order of the pixel point in the second region for light ray tracing calculation, the order of the pixel point in the first region for light ray tracing calculation can be reduced, which can reduce the amount of calculation required when the pixel point in the first region performs light ray tracing calculation, thereby reducing the load when the pixel point in the first region performs light ray tracing calculation, and being conducive to improving game performance and rendering efficiency.

[0166] The terminal device can reduce the number of light probes in the first region and / or reduce the order of the pixel point in the first region for light ray tracing calculation, so that when the terminal device displays the to-be-displayed data, the amount of calculation when the first region displays the to-be-displayed data can be reduced, thereby reducing the load when the first region displays the to-be-displayed data, and being conducive to improving game performance and rendering efficiency.

[0167] Optionally, the density of the light probe in the first region can be zero.

[0168] The density of the light probe in the first region can be zero, that is, the light probe can not be placed in the first region, which can further reduce the calculation amount and further improve the game performance and rendering efficiency.

[0169] In the method, after the light ray tracing pixel analysis module of the terminal device determines the first information, the first information can be transmitted to the GPU, and after the GPU receives the first information, the GPU can perform light probe layout and light ray tracing calculation based on the first information.

[0170] Optionally, when the light ray tracing pixel analysis module of the terminal device transmits the first information to the GPU, the first information can be transmitted to the GPU through a graphic processor driver.

[0171] In the embodiments of the present application, the manner of transmitting information inside the system of the terminal device is only a simple example, and does not limit the scope of the present application.

[0172] In the scenario where the user clicks the user interface, the display method of the terminal device can be as shown in Figure 17 .

[0173] In the method, the display area of the terminal device includes a screen edge area, a screen blur area, a screen occlusion area and a line of sight concentration area.

[0174] The method can be applied to a terminal device as shown in Figure 2 . Specifically, the method can be executed by the terminal device, or can be executed by a component (such as a chip, a chip system, etc.) applied to the terminal device, or can also be implemented by a logic module or software capable of realizing all or part of the functions of the terminal device, for example, can be implemented by an application or a service in the operating system of the terminal device. The embodiments of the present application do not limit this.

[0175] S1701, receiving a first user instruction, the first user instruction indicating that the game starts.

[0176] As an example, after the user clicks the game start button as shown in Figure 6 , the terminal device can receive the first user instruction.

[0177] S1702, determining a screen edge area.

[0178] In the method, the terminal device can determine the screen edge area by referring to the foregoing embodiments, which will not be described here.

[0179] S1703, determining information corresponding to the screen edge area, the information corresponding to the screen edge area including the density of the light probe corresponding to the screen edge area and the order of the pixel point for light ray tracing calculation.

[0180] In the method, the information corresponding to the screen edge region can refer to the foregoing embodiments, and details are not described herein.

[0181] S1704, rendering the screen edge region based on the information corresponding to the screen edge region.

[0182] Optionally, the information corresponding to the screen edge region can be determined by the terminal device based on the ray tracing pixel analysis module. In this case, the ray tracing pixel analysis module of the terminal device can first transmit the information corresponding to the screen edge region to the GPU, and then the GPU renders the screen edge region based on the information corresponding to the screen edge region.

[0183] S1705, receiving a second user instruction, the second user instruction indicating that the user clicks the user interface.

[0184] Optionally, when the user clicks the directional key and / or the game operation key as shown in Figure 7 , the terminal device can receive the second user instruction.

[0185] S1706, determining the screen occlusion region, the screen blur region and the line of sight concentration region.

[0186] In the method, the method for determining the screen occlusion region, the screen blur region and the line of sight concentration region can refer to the foregoing embodiments, and details are not described herein.

[0187] S1707, determining information corresponding to each of the screen occlusion region, the screen blur region and the line of sight concentration region, the information corresponding to each region including a density of a light probe corresponding to each region and an order of ray tracing calculation of a pixel point.

[0188] In the method, the method for determining the information corresponding to each region can refer to the foregoing embodiments, and details are not described herein.

[0189] S1708, rendering each region based on the information corresponding to each of the screen occlusion region, the screen blur region and the line of sight concentration region.

[0190] In the method, the information corresponding to each region can be determined by the terminal device based on the ray tracing pixel analysis module. In this case, the ray tracing pixel analysis module of the terminal device can first transmit the information corresponding to each region to the GPU, and then the GPU renders each region based on the information corresponding to each region, respectively.

[0191] Optionally, in some possible implementation manners, S1702 to S1704 can also be located after S1705.

[0192] Figure 18This is a schematic diagram of the structure of a display device for a terminal device provided in one embodiment of this application. Figure 18 As shown, the display device 1800 of the terminal device may include an acquisition module 1801 and a processing module 1802.

[0193] As an example, the display device 1800 of the terminal device can be used to implement... Figure 4 The terminal device display method of the embodiment shown. The acquisition module 1801 can be used to execute S401, and the processing module 1802 can be used to execute S402.

[0194] As another example, the display device 1800 of the terminal device can be used to implement... Figure 17 The terminal device display method of the embodiment shown. The acquisition module 1801 can be used to execute S1701 and S1705, and the processing module 1802 can be used to execute S1702, S1703, S1704, S1706, S1707 and S1708.

[0195] Figure 19 This is a schematic diagram of the structure of the display device of a terminal device provided in another embodiment of this application. For example... Figure 19 As shown, the display device 1900 of the terminal device includes a processor 1901 and an interface circuit 1902. The processor 1901 and the interface circuit 1902 are coupled to each other. It is understood that the interface circuit 1902 can be a transceiver or an input / output interface. Optionally, the display device 1900 of the terminal device may also include a memory 1903 for storing instructions executed by the processor 1901, or storing input data required by the processor 1901 to execute instructions, or storing data generated after the processor 1901 executes instructions.

[0196] As an example, processor 1901 can be used to implement the functions of the processing module 1802 described above, and interface circuit 1902 can be used to implement the functions of the acquisition module 1801 described above.

[0197] In this example, the display device 1900 of the terminal device can be the terminal device itself, or it can be a chip or chip system applied in the terminal device.

[0198] The steps of the methods in embodiments of the present application can be implemented by hardware, or can be implemented by a combination of software and the processor executing the software instructions. The software instructions can be composed of corresponding software modules, which can be stored in the memory or any other storage medium well known in the art. An exemplary storage medium is coupled to the processor, so that the processor can read information from, and write information to, the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an ASIC. The ASIC can be located in a network device or terminal. Of course, the processor and the storage medium can also exist as discrete components in the network device or terminal.

[0199] In the present application, the memory can include cache, random access memory (RAM), flash memory, read-only memory (ROM), synchronous dynamic random access memory (SDRAM), programmable read-only memory, erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory, register, hard disk drive (HDD), or solid-state drive (SSD), mobile hard disk, or compact disc read-only memory (CD-ROM), and the like. The memory is any other medium capable of storing desired program codes in the form of instructions or data structures and capable of being accessed by a computer, but is not limited thereto. The memory in embodiments of the present application can also be a circuit or any other device capable of realizing a storage function, for storing computer programs or instructions, and / or data.

[0200] In this application, the processor can be one or more central processing units (CPUs), in the case of the processor being a CPU, the CPU can be a single core CPU or a multi-core CPU. The processor can be a general purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a programmable logic during (PLD), a graphics processing unit (GPU), a special purpose integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic component, a discrete hardware component, a general purpose processor, a microprocessor, or any other conventional processor. The processor can be a general purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a programmable logic during (PLD), a graphics processing unit (GPU), a special purpose integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic component, a discrete hardware component, a general purpose processor, a microprocessor, or any other conventional processor.

[0201] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer programs or instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments are performed. The computer can be a general purpose computer, a special purpose computer, a computer network, a network device, a user equipment or other programmable apparatus. The computer programs or instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer programs or instructions can be transferred from one website, computer, server or data center to another website, computer, server or data center through wired or wireless manner. The computer readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center and the like integrated with one or more available media. The available media can be a magnetic medium, such as a floppy disk, a hard disk, a magnetic tape; an optical medium, such as a digital video disc; or a semiconductor medium, such as a solid state disk.

[0202] The embodiments of the present application also provide a computer readable storage medium, which stores computer programs or instructions, and the computer programs or instructions are executed by a computer (for example, a processor) to implement part or all of the steps of any one method performed by any device in the embodiments of the present application.

[0203] The embodiments of the present application further provide a computer program product including a computer program or a set of instructions, which, when executed on a computer, implements part or all of the steps of any of the methods performed by any of the apparatuses in the embodiments of the present application.

[0204] In the various embodiments of the present application, the terms and / or descriptions among different embodiments are consistent and can be referred to each other if there is no special description and logical conflict, and the technical features among different embodiments can be combined to form new embodiments according to their inherent logical relationship.

[0205] It can be understood that the various numerical numbers involved in the embodiments of the present application are only used for differentiation for the convenience of description, and are not used to limit the scope of the embodiments of the present application. The size of the serial numbers of the above processes does not mean the execution order, and the execution order of the processes should be determined according to their functions and inherent logic.

Claims

1. A display method for a terminal device, characterized in that, The method includes: Obtain the data to be displayed from the terminal device; The data to be displayed is displayed in the display area of ​​the terminal device, wherein the display area includes a first area and a second area, and the first area and the second area differ in at least one of the following: the density of the illumination probe, or the order of the ray tracing calculation of the pixel.

2. The method according to claim 1, characterized in that, The density of light probes in the first region is less than the density of light probes in the second region; And / or, the order of ray tracing calculation for pixels in the first region is less than the order of ray tracing calculation for pixels in the second region.

3. The method according to claim 2, characterized in that, The density of the light probes in the first region is zero.

4. The method according to claim 2 or 3, characterized in that, The first region includes a screen edge region, and the interval between the pixel coordinates of the pixels in the screen edge region and the pixel coordinates of the pixels on the screen boundary is less than or equal to a first preset coordinate interval.

5. The method according to any one of claims 2 to 4, characterized in that, When the terminal device detects a user operation, the first area includes a screen occlusion area, which includes a first sub-area that overlaps with the screen area of ​​the terminal device. The first sub-area is a rectangular area established based on the user operation area and includes the screen boundary corner of the terminal device. The tolerance value of the user operation area is greater than or equal to the first tolerance value.

6. The method according to claim 5, characterized in that, The first region also includes a blurred screen region, which includes a second sub-region that overlaps with the screen region of the terminal device. The second sub-region is a circle formed by taking the screen boundary corner of the terminal device as the center and the distance between the screen boundary corner of the terminal device and the center point of the user operation area as the radius. The blurred screen region does not include the screen occlusion region.

7. A display device for a terminal equipment, characterized in that, Includes functional modules for implementing the method as described in any one of claims 1 to 6.

8. A display device for a terminal equipment, characterized in that, Includes a processor for causing the apparatus to perform the method of any one of claims 1 to 6 by executing a computer program or instructions stored in a memory and / or by means of logic circuitry.

9. The apparatus according to claim 8, characterized in that, The display device of the terminal equipment also includes a memory for storing the computer program or instructions.

10. A chip, characterized in that, The chip stores a computer program, which, when executed by the chip, implements the method as described in any one of claims 1 to 6.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions that, when executed on a display device of a terminal device, cause the method of any one of claims 1 to 6 to be implemented.

12. A computer program product, characterized in that, The computer program product includes instructions for implementing the method as described in any one of claims 1 to 6.

Images