Image loading methods, electronic devices, chips, and readable storage media

Abstract

This application provides an image loading method, relating to the field of terminal devices. When loading images on a display interface, if a hotspot display area is identified, the image content corresponding to that hotspot display area is loaded first, where the hotspot display area is the area of ​​focus for the user's eyes. This application also provides an electronic device, a chip, and a computer-readable storage medium. This application adjusts the image loading order based on the area of ​​focus for the human eye, ensuring that image content within that area is displayed first, thus improving the user experience.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to an image loading method, electronic device, chip, and computer-readable storage medium. Background Technology

[0002] When users browse images, such as on large-screen devices, they typically have a visually focused area. However, existing display interfaces usually process images in a fixed order, such as from top to bottom, left to right, or right to left for multiple images. On devices with weaker image processing capabilities, images within the user's focused area may be processed and displayed more slowly, degrading the user experience. Summary of the Invention

[0003] In view of this, it is necessary to provide an image loading method that can overcome the above problems and enable the image content within the area of ​​human eye focus to be displayed first.

[0004] The first aspect of this application discloses an image loading method, including: receiving an image loading instruction; if there is a hotspot display area on the display interface, prioritizing the loading of image content corresponding to the hotspot display area; wherein, the hotspot display area is the area of ​​focus for the user's eyes.

[0005] By adopting this technical solution, image content within the area of ​​human eye focus can be displayed first, improving the user experience.

[0006] In one possible implementation, the image loading method further includes: if a user is detected watching in front of the display interface and the user's eye gaze position falls within the display interface, determining that the display interface has a hot spot display area; or if no user is detected watching in front of the display interface, or if a user is detected watching in front of the display interface and the user's eye gaze position does not fall within the display interface, determining that the display interface does not have a hot spot display area.

[0007] By adopting this technical solution, it is possible to determine whether there are hotspot display areas on the display interface, which facilitates the priority decoding and display of image content within the area of ​​human eye focus.

[0008] In one possible implementation, if the eye gaze positions of multiple viewing users fall within the display interface, the eye gaze areas of viewing users within a preset whitelist are determined as the hotspot display areas; or if the eye gaze positions of multiple viewing users fall within the display interface, the eye gaze areas of viewing users within a preset whitelist are determined as hotspot display areas of first priority, and the eye gaze areas of viewing users not within the preset whitelist are determined as hotspot display areas of second priority.

[0009] By adopting this technical solution, when there are multiple hotspot display areas on the display interface, the area that the whitelisted viewing user (such as the device owner) is focused on can be decoded and displayed first.

[0010] In one possible implementation, the display interface includes multiple images, and the step of preferentially loading the image content corresponding to the hotspot display area includes: packaging the decoding information and display position information of the multiple images into multiple decoding tasks, wherein the multiple decoding tasks correspond one-to-one with the multiple images, and the decoding information includes one or more of image storage path, image size, and image sampling rate; preferentially selecting the decoding task belonging to the hotspot display area for decoding processing, and rendering and displaying it on the display interface according to the decoding result.

[0011] By adopting this technical solution, in scenarios where multiple images are displayed, images within the area of ​​human eye focus can be decoded and displayed first, thereby improving the user experience.

[0012] In one possible implementation, the method further includes: if the display position of the image partially or entirely falls within the hotspot display area, the image is identified as an image belonging to the hotspot display area.

[0013] In one possible implementation, the display interface includes an image, and the priority loading of the image content corresponding to the hotspot display area includes: rendering and displaying the image on the display interface at a preset resolution; preferentially selecting an image area belonging to the hotspot display area for decoding processing, so as to render and display the image area on the display interface at a first resolution; wherein, the first resolution is greater than the preset resolution.

[0014] By adopting this technical solution, in scenarios where a single image is displayed in full screen, the image content within the area of ​​human eye focus can be decoded and displayed first, thereby improving the user experience.

[0015] In one possible implementation, the step of preferentially selecting image regions belonging to the hotspot display area for decoding processing includes: decomposing the image into multiple regions according to a preset image data block division rule; packaging the multiple regions into multiple region decoding tasks, and preferentially selecting region decoding tasks belonging to the hotspot display area for decoding processing.

[0016] By adopting this technical solution, in scenarios where a single image is displayed in full screen, the image content within the area of ​​human eye focus can be decoded and displayed first, thereby improving the user experience.

[0017] In one possible implementation, the decoding process includes transcoding and color space conversion. The step of preferentially selecting image regions belonging to the hotspot display area for decoding includes: decomposing the image into multiple regions according to a preset image data block partitioning rule; packaging the multiple regions into multiple region decoding tasks; performing the transcoding process on the region decoding tasks belonging to the hotspot display area, and performing the transcoding process on the region decoding tasks of other display areas on which the hotspot display area depends, and saving the transcoding results; and preferentially selecting the region decoding tasks belonging to the hotspot display area for color space conversion.

[0018] By adopting this technical solution, in full-screen display scenarios where a single image has encoding dependencies, the image content within the area of ​​human eye focus can be decoded and displayed first, thereby improving the user experience.

[0019] In one possible implementation, the decoding process further includes downsampling, and the step of preferentially selecting the region decoding task belonging to the hot spot display area for the color space conversion process includes: preferentially selecting the region decoding task belonging to the hot spot display area for the color space conversion process and the downsampling process.

[0020] In one possible implementation, the method further includes: dividing the image into regions of interest and regions of non-interest; when encoding the image, using the regions of interest as the encoding dependency for the regions of non-interest.

[0021] By adopting this technical solution, the predicted region of interest can be used as the encoding dependency for the non-region of interest, which facilitates the priority completion of image decoding of the region of interest when performing image decoding on the terminal side.

[0022] In one possible implementation, the decoding process includes transcoding and color space conversion. The step of preferentially selecting image regions belonging to the hotspot display area for decoding includes: decomposing the image into multiple regions according to a preset image data block division rule; packaging the multiple regions into multiple region decoding tasks; if the image regions of the hotspot display area do not include non-interested regions, preferentially selecting region decoding tasks belonging to the hotspot display area for the transcoding and color space conversion processes.

[0023] By adopting this technical solution, in full-screen display scenarios of single images with encoding dependencies, it is possible to prioritize displaying the image content within the area of ​​human eye focus by only transcoding the region decoding task of the hot display area.

[0024] In one possible implementation, the method further includes: if the image area of ​​the hot spot display area includes the non-interested area, performing the transcoding process on the region decoding task belonging to the hot spot display area, and performing the transcoding process on the region decoding tasks of other display areas on which the hot spot display area depends, and saving the transcoding results; when each region decoding task has completed the transcoding process, preferentially selecting the region decoding task belonging to the hot spot display area to perform the color space conversion process.

[0025] In one possible implementation, the method further includes: if the display interface does not have a hotspot display area, loading the image content of the display interface according to a preset loading rule.

[0026] By adopting this technical solution, image content on the display interface can be loaded using preset loading rules when there is no hotspot display area on the display interface.

[0027] Secondly, embodiments of this application provide a computer-readable storage medium including computer instructions that, when executed on an electronic device, cause the electronic device to perform the image loading method as described in the first aspect.

[0028] Thirdly, embodiments of this application provide an electronic device, which includes a processor and a memory. The memory is used to store instructions, and the processor is used to call the instructions in the memory to cause the electronic device to execute the image loading method as described in the first aspect.

[0029] Fourthly, embodiments of this application provide a computer program product that, when run on a computer, causes the computer to execute the image loading method as described in the first aspect.

[0030] Fifthly, embodiments of this application provide an apparatus having the function of implementing the electronic device behavior described in the method of the first aspect. The function can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-described function.

[0031] It is understood that the computer-readable storage medium described in the second aspect, the electronic device described in the third aspect, the computer program product described in the fourth aspect, and the device described in the fifth aspect all correspond to the method described in the first aspect. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here. Attached Figure Description

[0032] Figure 1 A schematic flowchart illustrating an image loading method provided in an embodiment of this application;

[0033] Figure 2 A schematic diagram illustrating an application scenario of displaying multiple images using an electronic device provided in an embodiment of this application;

[0034] Figure 3 A schematic diagram illustrating an application scenario of displaying a single image using an electronic device provided in an embodiment of this application;

[0035] Figure 4 This is a schematic diagram of the functional modules of an image loading device provided in an embodiment of this application;

[0036] Figure 5 This is a schematic diagram of the structure of a possible electronic device provided in an embodiment of this application. Detailed Implementation

[0037] It should be noted that in this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and drawings of this application are used to distinguish similar objects, not to describe a specific order or sequence.

[0038] For ease of understanding, some concepts related to the embodiments of this application are illustrated and explained by way of example for reference.

[0039] Reference Figure 1 As shown in the embodiment of this application, an image loading method is applied to an electronic device 100 (such as...). Figure 2 , Figure 3,or Figure 5 As shown, the electronic device 100 can be a device with a display screen, such as a television, computer, advertising screen, or mobile phone. In this embodiment, the image loading method may include:

[0040] 11. Receive image loading instructions.

[0041] In some embodiments, the image loading instruction is used to trigger the display interface of the electronic device 100 to display one or more images. The image loading instruction may be triggered by entering an application (such as a photo application or other applications containing images), a folder, clicking on an image thumbnail to display the original image, or dragging the sidebar of an application interface. For example, a user might click to enter a folder containing saved images on a computer, or a user might enter the photos application on a mobile phone.

[0042] In some embodiments, when an image loading instruction is received, it can be determined whether a hotspot display area exists on the display interface to determine whether priority display processing is required. The display interface can be the display area of ​​the screen of the electronic device 100. The hotspot display area can be the area of ​​focus for the user's eyes. The electronic device 100 can be equipped with a camera, which can be mounted on the same side as the screen of the electronic device 100. The electronic device 100 can determine whether a hotspot display area exists on the display interface based on existing eye-tracking technology. For example, the electronic device 100 can be equipped with an existing eye-tracking device to acquire the eye movement trajectory data of the user watching the display interface, and obtain the predicted viewing area (hotspot display area). When a user is detected watching the display interface and the user's eye gaze falls within the display interface, it can be determined that a hotspot display area exists on the display interface; when a user is detected watching the display interface but the user's eye gaze does not fall within the display interface, it can be determined that no hotspot display area exists on the display interface; when no user is detected watching the display interface, it can be determined that no hotspot display area exists on the display interface.

[0043] For example, the camera of the electronic device 100 can be used to detect whether there is a user watching in front of the display interface. When it is confirmed that there is a user watching, the movement angle of the user's eyeball is tracked and locked. Then, the current spatial coordinates of the pupil are determined based on the movement angle of the eyeball. The current spatial coordinates of the pupil are then mapped onto the two-dimensional coordinate system of the display interface. Finally, based on the point where the pupil falls on the two-dimensional coordinate system, it is determined whether the user's eyeball gaze position falls within the display interface, and the area of ​​eyeball attention when it falls within the display interface.

[0044] 12. If there are hotspot display areas on the display interface, the image content corresponding to the hotspot display area will be loaded first.

[0045] In some embodiments, if there are hotspot display areas on the display interface, the hotspot display areas can be defined as high-priority areas and non-hotspot display areas can be defined as low-priority areas. When displaying images, images in high-priority areas are prioritized for image acquisition, image decoding, and image post-processing. This ensures that even when the image processing capability of the electronic device 100 is not high, the image display processing of high-priority areas is completed first, that is, the image content corresponding to the hotspot display areas is loaded first.

[0046] For example, such as Figure 2 The image shown illustrates a thumbnail display of multiple images, using a television screen as an example. The display can currently show 15 images, numbered 1 to 15. Assuming that eye-tracking technology determines the viewer's focus area as display area A1, which is the high-priority area, the display area includes images 6, 7, 11, and 12. When displaying images, the interface prioritizes images 6, 7, 11, and 12, ensuring they are displayed first. Other images are processed only after images 6, 7, 11, and 12 have been displayed.

[0047] In some embodiments, when processing multiple images for display, the decoding information and display position information of each image on the display interface can be packaged into multiple decoding tasks. Then, decoding tasks belonging to hotspot display areas are prioritized for decoding processing, thereby enabling the decoding results of hotspot display areas to be rendered and displayed on the display interface first. These multiple decoding tasks correspond one-to-one with multiple images, and the image decoding information may include one or more of the following: image storage path, image size, image rotation angle, and image sampling rate. Figure 2 As shown, for 15 images, there are 15 corresponding decoding tasks. The decoding tasks corresponding to images 6, 7, 11, and 12 are selected first for decoding processing, so that images 6, 7, 11, and 12 can be rendered and displayed on the display interface in advance compared to other images.

[0048] In some embodiments, when the high-priority area includes multiple images, the processing order of each image can be set according to actual needs (e.g., from left to right, from top to bottom), which is not limited here. Similarly, when the low-priority area includes multiple images, the processing order of each image can also be set according to actual needs (e.g., from left to right, from top to bottom), which is also not limited here.

[0049] In some embodiments, when the display position of an image partially or entirely falls within the hotspot display area, the image can be identified as belonging to the hotspot display area, meaning it should be prioritized for display. For example, it can be set that when half or more of the display position of an image falls within the hotspot display area, the image is considered to belong to the hotspot display area; alternatively, it can be set that when one-third or more of the display position falls within the hotspot display area, the image is considered to belong to the hotspot display area. No specific limitation is made here.

[0050] In some embodiments, when there is no image in the hotspot display area, that is, the image content corresponding to the hotspot display area is empty, there is no need to prioritize loading. In this case, the existing image loading rules can be used to load the image content of other non-hotspot display areas, for example, loading the image content of non-hotspot display areas sequentially from left to right and from top to bottom.

[0051] like Figure 3 The diagram illustrates a scenario where a single image is displayed in full-screen or original resolution. This single image can be a high-resolution image, and the display interface is illustrated using a television screen as an example. When displaying the image, a preset resolution image (lower than the original image resolution) can be displayed first. Then, image area A2, which belongs to the hotspot display area, is prioritized for decoding. This allows image area A2 to be rendered and displayed on the display interface at a first resolution (e.g., the original image resolution, or another specified resolution lower than the original image resolution). The first resolution is greater than the preset resolution. For example, for an image I1 with a resolution of 1440P, if the electronic device 100 has weak image decoding capabilities and a long decoding time, image I1 can be displayed on the display interface at a resolution of 400P first. Then, image area A2, which belongs to the hotspot display area, is prioritized for decoding, allowing image area A2 to be displayed at a 1440P resolution compared to other image areas.

[0052] For example, in Figure 3 In this system, displaying an image at a preset resolution is defined as a non-high-definition display state, while displaying the image at a first resolution is defined as a high-definition display state. That is, during the display process, all image areas are first displayed in a non-high-definition display state, and then image areas belonging to the hotspot display areas are preferentially selected for display in high-definition display state.

[0053] In some embodiments, when processing a single high-resolution image, the image can be decomposed into multiple regions according to a preset image data block division rule. These regions are then packaged into multiple region decoding tasks, with each region decoding task corresponding to one region. The region decoding task belonging to the hotspot display area is then preferentially selected for decoding processing. This preset image data block division rule can be set according to actual needs; for example, it can be divided according to 8*8 size data blocks BD1, meaning an 8*8 pixel area constitutes one region decoding task. Figure 3 In the process, data blocks BD1 that partially or entirely fall into image region A2 are prioritized for decoding.

[0054] In some embodiments, the image decoding process can be broadly divided into transcoding, color space conversion, and downsampling. However, some image decoding and display applications may not include downsampling. For example, if a 4K resolution image I1 is ultimately displayed at 2K resolution on an electronic device, downsampling is required. When displaying a single high-resolution image, for certain image formats, such as JPEG, DC coefficient differential coding is used during image encoding. This coding considers the similarity between adjacent blocks to reduce the amount of encoded data; that is, adjacent data blocks BD1 may have encoding dependencies. Image decoding requires a specific order for successful decoding. In this case, directly performing block-by-block decoding is ineffective. For data block BD1, transcoding is dependent, while color space conversion and downsampling are independent. If, during the decoding process, the data block BD1 of the hotspot display area and the display area it depends on is transcoded first, and then the data block BD1 belonging to the hotspot display area is selected first for color space conversion and downsampling, the user can still see the image content of the hotspot display area faster.

[0055] In some embodiments, the image encoding process generally follows a left-to-right, top-to-bottom order to encode the data blocks contained in the image sequentially. That is, the right data block is encoded with reference to the left data block, and the bottom data block is encoded with reference to the top data block. Based on this encoding rule, the data blocks of other display areas (non-hotspot display areas) on which the encoding of the hotspot display area depends can be determined.

[0056] For example, when processing the display of a single high-resolution image, the image is decomposed into multiple region decoding tasks according to a preset image data block division rule. Then, the region decoding tasks of the hot spot display area and the display area on which the hot spot display area depends are transcoded and the transcoding results are saved. When the above transcoding process is completed, the region decoding tasks belonging to the hot spot display area are selected first for color space conversion and downsampling processing, so as to load the image content corresponding to the hot spot display area first.

[0057] For example, transcoding includes an inverse differential process. When displaying a single high-resolution image, the image is decomposed into multiple region decoding tasks according to a preset image data block division rule. Then, the region decoding tasks of the hotspot display area and the display areas on which the hotspot display area depends are transcoded, and the results of the inverse differential process of the region decoding tasks are saved. When the results of the inverse differential process of these region decoding tasks are obtained, the region decoding tasks belonging to the hotspot display area are selected first for color space conversion and downsampling processing, which can achieve priority loading of the image content corresponding to the hotspot display area.

[0058] In some embodiments, for a single high-resolution image display scenario, if the regions of the image that are likely to become areas of human visual interest are predicted in advance during image encoding, and non-interested regions are encoded with reference to the areas of interest, then during image decoding, it is not necessary to transcode the data blocks BD1 of the non-hotspot display areas; only the data blocks BD1 of the hotspot display areas need to be transcoded. Specifically, before image encoding, the image is divided into areas of interest and non-interested regions, and the number of areas of interest and non-interested regions can be set according to actual needs. When encoding the image, the data blocks BD1 of the areas of interest can be used as the encoding dependency of the data blocks BD1 of the non-interested regions, improving the encoding compression rate. When image decoding is required, the image is decomposed into multiple region decoding tasks. When the image area of ​​the hotspot display area does not include the non-interested areas, it indicates that there is no encoding dependency between the image area of ​​the hotspot display area and the non-interested areas. The region decoding task belonging to the hotspot display area can be selected first for transcoding, color space conversion, and downsampling, without needing to transcode other non-hotspot display areas. When the image area of ​​the hot spot display area includes the non-interested area, it indicates that there is an encoding dependency between the image area of ​​the hot spot display area and the non-interested area. In this case, the region decoding tasks of the hot spot display area and the display area that the hot spot display area depends on can be transcoded. After the transcoding process is completed, the region decoding tasks belonging to the hot spot display area are selected first for color space conversion and downsampling.

[0059] In some embodiments, multiple users may be viewing the display interface, and multiple eye-tracking areas may be identified on the display interface based on eye-tracking technology. In this case, the eye-tracking areas of users within a preset whitelist can be designated as hotspot display areas, while the eye-tracking areas of other users not within the preset whitelist are ignored. If the preset whitelist includes multiple users (i.e., multiple hotspot display areas), the loading rules for these multiple hotspot display areas can be: randomly loading the image content corresponding to each hotspot display area, or loading the image content corresponding to each hotspot display area in a loading order from left to right and from top to bottom, or other custom loading rules. This preset whitelist can be pre-built and saved to the electronic device 100. For example, the preset whitelist may contain the owner information of the electronic device 100, and facial recognition technology can be used to determine whether the current user is a user within the preset whitelist.

[0060] In some embodiments, when the eye gaze positions of multiple viewers fall within the display interface, the eye gaze areas of viewers within a preset whitelist can be designated as first-priority hotspot display areas, the eye gaze areas of viewers not within the preset whitelist can be designated as second-priority hotspot display areas, and non-hotspot display areas can be designated as third-priority hotspot display areas. That is, for multiple hotspot display areas, the electronic device 100 first processes the image display for the hotspot display areas corresponding to viewers within the whitelist, then processes the image display for the hotspot display areas corresponding to viewers not within the whitelist, and finally processes the image display for the non-hotspot display areas. It can be understood that for each priority level of display area, image content loading can also be performed in a loading order such as from left to right or from top to bottom.

[0061] 13. If the display interface does not have a hotspot display area, load the image content of the display interface according to the preset loading rules.

[0062] In some embodiments, if there is no hotspot display area on the display interface, the image content of the display interface can be loaded according to a preset loading rule. This preset loading rule can be an existing image loading rule, such as loading image content from left to right or from top to bottom.

[0063] The image loading method described above determines the user's area of ​​focus based on the human eye's field of vision, and adjusts the decoding order of multiple images on the display interface or the decoding order of regions within a single image, so that images or image blocks within the user's area of ​​focus are decoded and displayed first, thus improving the user experience.

[0064] Reference Figure 4The diagram shows a functional module schematic of an image loading device 10 according to an embodiment of this application. The image loading device 10 can be installed in an electronic device 100. The image loading device 10 may include an eye-tracking module 101, a decoding task generation module 102, a decoding task management module 103, a decoding module 104, and a display module 105.

[0065] For scenarios involving the thumbnail display of multiple images:

[0066] The eye-tracking module 101 is used to track the user's eye focus area on the display interface based on the eye data captured by the camera. This eye focus area is the hotspot display area. The eye focus area tracked by the eye-tracking module 101 can be transmitted to the decoding task management module 103.

[0067] The decoding task generation module 102, in response to an image loading command, packages the display position information and decryption information of multiple images into multiple decoding tasks, with each decoding task corresponding to one image. The multiple decoding tasks packaged by the decoding task generation module 102 can be passed to the decoding task management module 103.

[0068] The decoding task management module 103 is used to select decoding tasks from multiple decoding tasks and send them to the decoding module 104 for decoding processing. When selecting decoding tasks, the decoding task management module 103 prioritizes decoding tasks belonging to the hotspot display area and sends them to the decoding module 104 for decoding processing.

[0069] The display module 105 is used to control the display interface of the electronic device 100 to render and display according to the decoding result output by the decoding module 104.

[0070] For scenarios involving full-screen or original image display of a single image:

[0071] The display module 105 first renders and displays the image on the display interface at a preset resolution.

[0072] The eye-tracking module 101 is used to track the user's eye focus area on the display interface based on the eye data captured by the camera. This eye focus area is the hotspot display area. The eye focus area tracked by the eye-tracking module 101 can be transmitted to the decoding task management module 103.

[0073] The decoding task generation module 102, in response to an image loading command, divides the decoding of a single image into multiple region decoding tasks and stores them in a region decoding task queue. Each region decoding task can correspond to one image block. The region decoding task queue generated by the decoding task generation module 102 can be passed to the decoding task management module 103.

[0074] The decoding task management module 103 selects region decoding tasks from the region decoding task queue and sends them to the decoding module 104 for decoding processing. When selecting region decoding tasks, the decoding task management module 103 prioritizes region decoding tasks belonging to hotspot display areas and sends them to the decoding module 104 for decoding processing. The image bitmap data of the image blocks decoded by the decoding module 104 can be stored in the image region pool.

[0075] The display module 105 is used to extract the image bitmap data of the decoded image block from the image region pool and render and display it on the specified area.

[0076] It is understood that the division of the various modules in the image loading device 10 described above is only for illustrative purposes. In other embodiments, the image loading device 10 can be divided into different modules as needed to complete the functions of the image loading device 10 described above.

[0077] The implementation of each module in the image loading device 10 provided in this application embodiment can be in the form of a computer program. The above one or more modules can be a series of computer program instruction segments that can perform specific functions. The instruction segments can be used to describe the execution process of the image loading device 10 in the electronic device 100.

[0078] refer to Figure 5 This is a schematic diagram of the hardware structure of the electronic device 100 provided in an embodiment of this application. Figure 5 As shown, the electronic device 100 may include a processor 1001, a memory 1002, a communication bus 1003, and a camera 1004. The memory 1002 is used to store one or more computer programs 1005 (e.g., ...). Figure 4 (Image loading device 10). One or more computer programs 1005 are configured to be executed by the processor 1001. The one or more computer programs 1005 may include instructions that can be used to implement the image loading method described above in the electronic device 100.

[0079] It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements.

[0080] Processor 1001 may include one or more processing units, such as application processors (APs), graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, DSPs, CPUs, baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0081] The processor 1001 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 1001 is a cache memory. This memory can store instructions or data that the processor 1001 has just used or that are used repeatedly. If the processor 1001 needs to use the instruction or data again, it can retrieve it directly from this memory. This avoids repeated accesses, reduces the waiting time of the processor 1001, and thus improves the efficiency of the system.

[0082] In some embodiments, the processor 1001 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM interface, and / or a USB interface, etc.

[0083] In some embodiments, memory 1002 may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, memory, plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0084] This embodiment also provides a computer storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the image loading method in the above embodiment.

[0085] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the image loading method in the above embodiment.

[0086] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component, or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the image loading method in the above method embodiments.

[0087] In this embodiment, the first electronic device, computer storage medium, computer program product, or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0088] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0089] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0090] The unit described as a separate component may or may not be physically separate. The component shown as a unit can be one physical unit or multiple physical units, that is, it can be located in one place or distributed in multiple different places. Some or all of the units can be selected to achieve the purpose of the solution in this embodiment according to actual needs.

[0091] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0092] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially or in other words, the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0093] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be covered within the scope of protection of this application.

Claims

1. An image loading method, applied to an electronic device, the electronic device including a display screen, characterized in that, The method comprises: receiving a picture loading instruction, the picture loading instruction being used to load a first picture stored locally in the electronic device; in response to the picture loading instruction, packing picture content of the first picture to be displayed on a display interface of the display screen into a plurality of decoding tasks; if a hot display area exists in the display interface, preferentially selecting decoding tasks belonging to the hot display area for decoding processing, and rendering and displaying on the display interface according to the decoding result; wherein the decoding processing comprises transcoding processing and color space conversion processing, and the preferential selection of the decoding tasks belonging to the hot display area for decoding processing comprises: performing the transcoding processing on the decoding tasks belonging to the hot display area, and performing the transcoding processing on decoding tasks of other display areas relied on by the hot display area, and saving the transcoding result; preferentially selecting the decoding tasks belonging to the hot display area for the color space conversion processing.

2. The picture loading method of claim 1, wherein, The method further comprises: if it is detected that a viewing user exists in front of the display interface and the eyeball fixation position of the viewing user falls within the display interface, determining that a hot display area exists in the display interface; or if it is detected that no viewing user exists in front of the display interface, or a viewing user exists in front of the display interface and the eyeball fixation position of the viewing user does not fall within the display interface, determining that no hot display area exists in the display interface.

3. The picture loading method of claim 2, wherein, The method further comprises: if the eyeball fixation positions of a plurality of viewing users fall within the display interface, determining the eyeball fixation area of a viewing user in a preset whitelist as the hot display area; or if the eyeball fixation positions of a plurality of viewing users fall within the display interface, determining the eyeball fixation area of a viewing user in a preset whitelist as a hot display area of a first priority level, and determining the eyeball fixation area of a viewing user not in the preset whitelist as a hot display area of a second priority level.

4. The picture loading method according to any one of claims 1 to 3, characterized in that, The packing of the picture content of the first picture to be displayed on the display interface of the display screen into a plurality of decoding tasks comprises: rendering and displaying the first picture on the display interface at a preset resolution; decomposing the first picture into a plurality of regions according to a preset picture data block division rule, and packing the plurality of regions into a plurality of decoding tasks, the plurality of decoding tasks corresponding to the plurality of regions one by one; The rendering and displaying on the display interface according to the decoding result comprises: rendering and displaying on the display interface at a first resolution according to the decoding result, the first resolution being greater than the preset resolution.

5. The picture loading method of claim 1, wherein, The decoding processing further comprises downsampling processing, and the preferential selection of the decoding tasks belonging to the hot display area for the color space conversion processing comprises: preferentially selecting the decoding tasks belonging to the hot display area for the color space conversion processing and the downsampling processing.

6. The picture loading method of claim 1, wherein, The method further comprises: dividing an attention area and a non-attention area on the first picture; when encoding the first picture, regarding the attention area as an encoding dependency of the non-attention area.

7. The picture loading method of claim 6, wherein, The transcoding processing is performed on the decoding task belonging to the hotspot display region and the decoding task of other display regions relied by the hotspot display region, and the transcoding processing includes: If the picture region of the hotspot display region does not include the non-focus region, the transcoding processing is performed only on the decoding task belonging to the hotspot display region.

8. The picture loading method of claim 6, wherein, The transcoding processing is performed on the decoding task belonging to the hotspot display region and the decoding task of other display regions relied by the hotspot display region, and the transcoding processing includes: If the picture region of the hotspot display region includes the non-focus region, the transcoding processing is performed on the decoding task belonging to the hotspot display region and the decoding task of other display regions relied by the hotspot display region.

9. The picture loading method of claim 1, wherein, The method further includes: If the display interface does not exist the hotspot display region, loading picture content of the first picture displayed by the display interface according to a preset loading rule.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer instructions, when the computer instructions run on the electronic device, make the electronic device execute the picture loading method in any one of claims 1 to 9.

11. An electronic device, comprising: The electronic device includes a display screen, a processor and a memory, the display screen and the memory are coupled with the processor, the memory is used to store instructions, and the processor is used to call the instructions in the memory, so that the electronic device executes the picture loading method in any one of claims 1 to 9.

12. A chip coupled with a memory in an electronic device, the chip comprising: The chip is used to control the electronic device to execute the picture loading method in any one of claims 1 to 9.

Images