Method and terminal device for generating a heat map

CN116108118BActive Publication Date: 2026-10-20HUAWEI TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202210343050.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-11-09
Filing Date
2022-03-31
Publication Date
2026-10-20
Estimated Expiration
2042-03-31

AI Technical Summary

Technical Problem

当前的地图相册给用户提供的信息有限,也不能直接展示图像拍摄相关位置的热度,实用性不强

Benefits of technology

[0049]上述第二方面到第四方面的有益效果,请参见上述第一方面的有益效果的描述,这里不再重复赘述。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116108118B_ABST
    Figure CN116108118B_ABST
Patent Text Reader

Abstract

The application provides a method for generating a heat map and a terminal device. The method is applied to the terminal device and includes: acquiring a first image and a first shooting position corresponding to the first image; acquiring a first map and a first road position associated with the first shooting position in the first map; determining first heat information corresponding to the first road position according to the first shooting position and the first road position; and generating a first heat map according to the first map and the first heat information corresponding to the first road position. The scheme provided by the application can intuitively display the distribution characteristics and heat characteristics of the image shooting position based on the heat map, and enhance the practicability of the map album.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202111318628.2, filed on November 9, 2021, entitled "An Image Display Method and Terminal Device", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of image processing technology, and in particular to a method and terminal device for generating heat maps. Background Technology

[0004] A major user demand when using photo albums is to review past experiences by browsing images taken at different times and locations. Currently, map-based photo albums can be used to address this need. Map-based photo albums display user-taken images on a map, allowing users to browse images taken in different locations using the map. However, current map-based photo albums offer limited information and cannot directly show the popularity of locations where images were taken, making them less practical. Summary of the Invention

[0005] This application provides a method and terminal device for generating heat maps, which are used to intuitively display the distribution and heat characteristics of image shooting locations based on heat maps, thereby enhancing the practicality of map albums.

[0006] In a first aspect, this application provides a method for generating a heat map, applied to a terminal device. The method includes: acquiring a first image and a first shooting location corresponding to the first image; acquiring a first map and a first road location in the first map associated with the first shooting location; determining first heat information corresponding to the first road location based on the first shooting location and the first road location; and generating a first heat map based on the first map and the first heat information corresponding to the first road location.

[0007] In this method, the terminal device can generate a heat map of the image based on the image's shooting location information and road information in the map. The generated heat map can be used as a map album and can intuitively display the distribution characteristics and heat information of the image shooting location in combination with road location. Therefore, this method can display more information related to the image through the heat map, enhance the practicality of the map album, and enable users to have an intuitive understanding of the shooting locations and routes with high heat, thereby improving the user experience.

[0008] In one possible design, the method further includes: displaying a first interface containing the first heat map, or the first interface containing the first heat map and a first navigation route from a first target location to a second target location.

[0009] In this method, the terminal device can display the navigation route by combining a heat map. While realizing the navigation function, it can also show the user the heat information of the images taken near the navigation route. In this way, while providing the user with the functions they need, it can also present more information to the user and improve the user experience.

[0010] In one possible design, the first road location is located on the first navigation route; the method further includes: obtaining a first distance between the first location and the first road location; the first location is the location of the terminal device on the first navigation route; if the first distance is less than or equal to a set first distance threshold, then displaying a first prompt message, the first prompt message being used to indicate that the terminal device is about to pass or is passing the first road location.

[0011] In this method, during navigation, when the terminal device detects that it is about to pass by or has passed by a road location with heat information, it can prompt the user so that the user can promptly perceive the heat-generating locations around the user's location. This allows the user to choose whether to take pictures at the location based on the heat-generating locations, thereby improving the user experience.

[0012] In one possible design, the thermal value corresponding to the thermal information of the first road location is greater than a preset thermal value.

[0013] In this method, the terminal device can selectively prompt the user to pass through or pass through high heat value road sections. By prompting the user on the location of high heat value roads, important information can be conveyed to the user on the one hand, and the number of prompts can be appropriately reduced on the other hand, avoiding the problem of excessive prompts causing a decrease in user experience.

[0014] In one possible design, before or after displaying the first interface, the method further includes: receiving a first operation to select the first road location; and in response to the received first operation, displaying a second interface containing information indicating a first recommended location; wherein the distance between the first recommended location and the first road location is less than or equal to a set second distance threshold. The second interface covers the first interface.

[0015] In this method, after a user selects a road location, the terminal device can recommend nearby locations to the user. Based on this, the terminal device can make location recommendations based on the generated heat map, which can meet the user's demand for shooting location recommendations and thus better meet the user's personalized needs.

[0016] In one possible design, the first recommended location can be any of the following: a tourist attraction, a parking spot, or a photo spot.

[0017] In this method, the recommended locations are shooting locations that the user may be interested in. Therefore, the terminal device can combine user interests to make location recommendations, thereby improving the relevance and accuracy of location recommendations and thus improving the user experience.

[0018] In one possible design, before displaying the first interface, the method further includes: launching a first application and displaying an application interface of the first application, the application interface of the first application including a first control; the display of the first interface includes: displaying the first interface in response to an operation performed on the first control.

[0019] In this method, users can open the heat map and navigation interface through the application installed on the terminal device, which makes it convenient for users to control and operate, and also makes it convenient for users to use the heat map.

[0020] In one possible design, the first application is a gallery application or a map application.

[0021] In this method, the heat map can be combined with the map to display the heat distribution information of the image's shooting location, while the image library application can be used to manage images and the map application can be used to manage maps. Therefore, by using the image library application or the map application as the control application for the heat map, the heat map can be viewed, used and managed in a simple and efficient manner, as well as the image viewing and map function usage can be combined with the heat map, which also facilitates related operations for users.

[0022] In one possible design, the second interface further includes a second control corresponding to the first recommended location; the method further includes: in response to an operation performed on the second control, displaying a second navigation route to the first recommended location.

[0023] In this method, after recommending a location, the terminal device can further navigate to the recommended location according to the user's instructions, providing a continuous service of location recommendation and navigation, making it easier for users to quickly go to the recommended location to take pictures, and improving the user experience.

[0024] In one possible design, before displaying the first interface, the method further includes: displaying the second interface, wherein the second interface further includes a second control corresponding to the first recommended location; the display of the first interface, which includes the first heat map and a first navigation route from the first target location to the second target location, specifically includes: receiving an operation applied to the second control, displaying the first interface, which includes the first heat map and the first navigation route from the first target location to the first recommended location.

[0025] In this method, after recommending a location, the terminal device can further navigate to the recommended location according to the user's instructions, providing continuous location recommendation and navigation services, making it easier for users to go to the recommended location to take pictures, and improving the user experience.

[0026] In one possible design, the second interface further includes: a first recommended image corresponding to the first recommended position; the method further includes: in response to a received second operation, obtaining the shooting parameters of the first recommended image, and displaying the shooting interface; in response to an operation to trigger the shooting of an image, taking a picture according to the shooting parameters of the first recommended image.

[0027] In this method, the terminal device can take pictures according to the shooting parameters of the recommended image, thereby providing users with better shooting suggestions based on the recommended image. This allows users to refer to the recommended image to take pictures and obtain images with higher satisfaction, thus providing users with richer functions.

[0028] In one possible design, the second operation is an operation performed on the third control corresponding to the first recommended image.

[0029] In this method, the terminal device provides a selection control for the shooting parameters of the recommended image, allowing the user to freely select the recommended image to be taken.

[0030] In one possible design, the second interface further includes: identification information of the first image; the method further includes: receiving an operation applied to the identification information of the first image, and displaying a third interface, wherein the third interface includes the first image. The third interface covers the second interface.

[0031] In this method, after the user selects a road location, the terminal device can present the user with images taken near that road location, allowing the user to quickly and directly browse past images taken near that road location.

[0032] In one possible design, before generating the first heat map based on the first map and the first heat information corresponding to the first road location, the method further includes: obtaining a second image and a second shooting location corresponding to the second image; obtaining a second road location in the first map associated with the second shooting location; determining the second heat information corresponding to the second road location based on the second shooting location and the second road location; the step of generating the first heat map based on the first map and the first heat information corresponding to the first road location includes: generating the first heat map based on the first map, the first heat information corresponding to the first road location, and the second heat information corresponding to the second road location.

[0033] In this method, for multiple images, the terminal device can determine the road location and its heat information corresponding to each image, and then display the heat information of the road location corresponding to each image in the heat map. Therefore, the heat map can display the heat distribution of the image in combination with the road location, which can provide and display more information to users and improve the practicality of the heat map.

[0034] In one possible design, the first road location is the same as the second road location; generating the first heat map based on the first map, the first heat information corresponding to the first road location, and the second heat information corresponding to the second road location includes: determining third heat information corresponding to the first road location based on the first heat information and the second heat information; and generating the first heat map based on the first map and the third heat information corresponding to the first road location.

[0035] In this method, road locations and their thermal information are determined based on all associated shooting locations. One road location can be associated with multiple shooting locations. Therefore, in the generated heat map, the thermal information of a road point reflects the thermal information of shooting locations within a certain radius. In other words, the thermal information of a road point reflects the thermal information within a local area. Thus, using the thermal information of road points can accurately reflect the thermal information of shooting locations in the surrounding environment, while avoiding the potentially overly complex information display that might occur when based solely on specific shooting locations. This achieves a more concise and efficient display of thermal information, improving the user experience. Furthermore, the display of thermal information can be further combined with geographical features, making it easier for users to specifically view the distribution of image shooting locations and images taken in different areas, thereby enhancing the user experience.

[0036] In one possible design, determining the first thermal information corresponding to the first road location based on the first shooting location and the first road location includes: determining a first weight based on the first shooting location and the first road location; wherein the first weight is negatively correlated with the distance between the first shooting location and the first road location; obtaining a set first thermal value corresponding to the first shooting location; determining a second thermal value corresponding to the first road location based on the first weight and the first thermal value; and determining the first thermal information based on the second thermal value.

[0037] In this method, the heat value of a road location is determined based on the heat values ​​of nearby shooting locations. The closer the shooting location is to the road location, the greater its contribution to the heat value; conversely, the farther the shooting location is from the road location, the smaller its contribution. Therefore, the heat information of road locations determined in this way can relatively accurately and comprehensively reflect the heat information of shooting locations in the surrounding environment. It also links the distribution information of image shooting locations with specific geographical locations on the map, facilitating the integration of actual geographical locations with the heat information of image shooting locations and improving the practicality of the heat map.

[0038] In one possible design, the method further includes: determining a third thermal value corresponding to the first shooting location based on the first weight and the first thermal value; obtaining a set second weight corresponding to the first shooting location; determining a fourth thermal value corresponding to the first shooting location based on the third thermal value and the second weight; determining fourth thermal information corresponding to the first shooting location based on the fourth thermal value; and generating a second thermal map based on the first thermal map and the fourth thermal information corresponding to the first shooting location.

[0039] In this method, the terminal device displays the thermal information of the road location and the shooting location in the same thermal map, which can obtain a thermal map based on the characteristics of the road and the characteristics of the image shooting point, and can more accurately and comprehensively reflect the thermal information of the image shooting.

[0040] In one possible design, the method further includes displaying the second heat map.

[0041] In one possible design, determining the third thermal value corresponding to the first shooting position based on the first weight and the first thermal value includes: determining the third thermal value according to the following formula: X = K * w * x + x, where X is the third thermal value, K is a set coefficient, w is the first weight, and x is the first thermal value.

[0042] In this method, the terminal device can optimize the default thermal information of the shooting location based on the road location, which can further improve the accuracy of the thermal value of the shooting location.

[0043] In one possible design, the first road location is situated within an area of ​​a predetermined size centered on the first shooting location.

[0044] In this method, selecting a road location close to the shooting location for displaying thermal information can improve the accuracy of road thermal information and display the thermal information of the shooting location as accurately as possible through the road location.

[0045] In one possible design, the first road location is the road location closest to the first shooting location within an area of ​​the set size.

[0046] In a second aspect, embodiments of this application provide an electronic device, the electronic device including a display screen, a memory and one or more processors; wherein, the memory is used to store computer program code, the computer program code including computer instructions; when the computer instructions are executed by the one or more processors, the electronic device causes the electronic device to perform the method described in the first aspect or any possible design of the first aspect.

[0047] Thirdly, this application provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method described in the first aspect or any possible design of the first aspect.

[0048] Fourthly, this application provides a computer program product comprising a computer program or instructions that, when executed on a computer, cause the computer to perform the methods described in the first aspect or any possible design of the first aspect.

[0049] For the beneficial effects described in the second to fourth aspects above, please refer to the description of the beneficial effects in the first aspect above, which will not be repeated here. Attached Figure Description

[0050] Figure 1 This is a schematic diagram of the hardware architecture of a terminal device provided in an embodiment of this application;

[0051] Figure 2 This application provides a schematic diagram of the software architecture of a terminal device.

[0052] Figure 3 A schematic diagram illustrating a method for generating a heat map according to an embodiment of this application;

[0053] Figure 4 This is a schematic diagram of a map display interface;

[0054] Figure 5 This is a schematic diagram of another map display interface;

[0055] Figure 6a A schematic diagram of a road pattern heat map provided in an embodiment of this application;

[0056] Figure 6b A schematic diagram of a heat map of another road pattern provided in an embodiment of this application;

[0057] Figure 7 A schematic diagram of a hybrid heat map provided in an embodiment of this application;

[0058] Figure 8 A schematic diagram of an optimized heat map provided in an embodiment of this application;

[0059] Figure 9 A schematic diagram illustrating a method for using a heat map as provided in an embodiment of this application;

[0060] Figure 10a A schematic diagram of a gallery interface provided in an embodiment of this application;

[0061] Figure 10b A schematic diagram of a road pattern heat map interface provided in an embodiment of this application;

[0062] Figure 10c A schematic diagram of a hybrid mode heat map interface provided in an embodiment of this application;

[0063] Figure 10d A schematic diagram of a typical heat map interface provided in an embodiment of this application;

[0064] Figure 10e A schematic diagram of a local heat map interface provided in an embodiment of this application;

[0065] Figure 10f A schematic diagram of a recommendation interface provided in an embodiment of this application;

[0066] Figure 10g A schematic diagram of an image display interface provided in an embodiment of this application;

[0067] Figure 11 A schematic diagram illustrating another method of using heat maps provided in an embodiment of this application;

[0068] Figure 12a A schematic diagram of a panoramic navigation interface provided in an embodiment of this application;

[0069] Figure 12b A schematic diagram of a partial navigation interface provided in an embodiment of this application;

[0070] Figure 13 A schematic diagram illustrating a method for generating a heat map according to an embodiment of this application;

[0071] Figure 14 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Detailed Implementation

[0072] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature.

[0073] For ease of understanding, exemplary descriptions of concepts related to this application are provided for reference.

[0074] 1) The terminal device is a device with display function. In some embodiments of this application, the terminal device is a device with wireless connection function.

[0075] In some embodiments of this application, the terminal device may be a portable device, such as a mobile phone, tablet computer, wearable device with display function (e.g., watch, bracelet, helmet, earphone, etc.), vehicle terminal device, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), smart home device (e.g., smart TV, smart speaker, etc.), smart robot, workshop equipment, wireless terminal in self-driving, wireless terminal in remote medical surgery, wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, or wireless terminal in smart home, flying equipment (e.g., smart robot, hot air balloon, drone, airplane), etc.

[0076] In some embodiments of this application, the terminal device may also be a portable device that includes other functions such as a personal digital assistant and / or a music player. Exemplary embodiments of the portable device include, but are not limited to, devices equipped with... Alternatively, it can be a portable device with another operating system. The aforementioned portable device can also be other portable devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of this application, the aforementioned terminal device may not be a portable terminal device, but rather a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0077] 2) Heatmaps, also known as heat maps, are a type of map representation that uses color distribution to describe the distribution, density, and trends of objects. Heatmaps can display or mark content that users are interested in and the geographical areas where users are located using special colors. They can intuitively present data that is not easy to understand or express in the traditional sense, such as density, frequency, hotspot distribution, and regional clustering.

[0078] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0079] This application provides a method and terminal device for generating heatmaps. This solution combines image information with road information from the map, adding user-captured images to the map and generating a corresponding heatmap. Users can then view and use the images within the heatmap, incorporating road information. This solution improves the efficiency of both heatmap generation and image viewing. Furthermore, it can integrate road information and user-personalized information to provide richer and more accurate recommendations for image capture locations, enhancing the user experience of the heatmap.

[0080] First, refer to... Figure 1 The structure of the terminal device to which the method provided in the embodiments of this application is applicable will be described.

[0081] like Figure 1 As shown, the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a USB interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a SIM card interface 195, etc.

[0082] The sensor module 180 may include a gyroscope sensor, an accelerometer, a proximity sensor, a fingerprint sensor, a touch sensor, a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, an ambient light sensor, a barometric pressure sensor, a bone conduction sensor, etc.

[0083] Understandable, Figure 1 The terminal device 100 shown is merely an example and does not constitute a limitation on the terminal device. The terminal device may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 1 The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0084] Processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of the terminal device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.

[0085] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0086] The method for generating heat maps provided in this application embodiment can be executed by the processor 110, which can control or call other components. For example, it can call the processing program of this application embodiment stored in the internal memory 121, or call the processing program of this application embodiment stored in a third-party device through the external memory interface 120. It can also control the wireless communication module 160 to communicate with other devices, thereby improving the intelligence and convenience of the terminal device 100 and enhancing the user experience. The processor 110 may include different devices. For example, when integrating a CPU and a GPU, the CPU and GPU can cooperate to execute the method for generating heat maps provided in this application embodiment. For example, in the method for generating heat maps, some algorithms are executed by the CPU, and other algorithms are executed by the GPU to achieve faster processing efficiency.

[0087] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, terminal device 100 may include one or N displays screens 194, where N is a positive integer greater than 1. Display screen 194 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, display screen 194 can display images (pictures or photographs), heat maps, videos, web pages, or documents, etc.

[0088] In this embodiment of the application, the display screen 194 can be a single flexible display screen, or it can be a splicing display screen composed of two rigid screens and a flexible screen located between the two rigid screens.

[0089] Camera 193 (a front-facing camera or a rear-facing camera, or a single camera that can function as both) is used to capture still images or videos. Typically, camera 193 may include a photosensitive element such as a lens assembly and an image sensor. The lens assembly includes multiple lenses (convex or concave lenses) for collecting light signals reflected from the object being photographed and transmitting these signals to the image sensor. The image sensor generates a raw image of the object being photographed based on the light signals.

[0090] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of terminal device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area can store the operating system, application program code (such as image processing functions, heat map generation functions, etc.), etc. The data storage area can store data created during the use of terminal device 100.

[0091] The internal memory 121 may also store one or more computer programs corresponding to the algorithm of the method for generating heat maps provided in the embodiments of this application. The one or more computer programs are stored in the internal memory 121 and configured to be executed by one or more processors 110. The one or more computer programs include instructions that can be used to perform the various steps in the following embodiments.

[0092] In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0093] Of course, the algorithm code for the method of generating heat maps provided in this application embodiment can also be stored in external memory. In this case, the processor 110 can run the algorithm code for generating heat maps stored in external memory through the external memory interface 120.

[0094] The sensor module 180 may include a gyroscope sensor, an accelerometer sensor, a proximity sensor, a fingerprint sensor, a touch sensor, etc.

[0095] A touch sensor, also known as a "touch panel," can be located on the display screen 194. The touch sensor and display screen 194 together form a touch display screen, also called a "touch screen." The touch sensor detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some embodiments, the touch sensor may also be located on the surface of the terminal device 100, in a different position than the display screen 194.

[0096] For example, the display screen 194 of the terminal device 100 can display a main interface, which includes icons for multiple applications (such as a camera application, a gallery application, etc.). The user can tap the camera application icon on the main interface using a touch sensor, triggering the processor 110 to launch the camera application and open the camera 193. The display screen 194 then displays the camera application's interface, such as a viewfinder.

[0097] The wireless communication function of the terminal device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0098] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0099] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use on the terminal device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via the antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device. In this embodiment, the mobile communication module 150 can also be used for information interaction with other devices.

[0100] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0101] The wireless communication module 160 can provide solutions for wireless communication applications on the terminal device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signal, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2. In this embodiment, the wireless communication module 160 can be used to establish communication connections with other devices and perform data interaction. Alternatively, the wireless communication module 160 can be used to access access point devices, send control commands to other terminal devices, or receive data sent from other terminal devices.

[0102] Additionally, terminal device 100 can implement audio functions such as music playback and recording via audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor. Terminal device 100 can receive key input 190, generating key signal inputs related to user settings and function control. Terminal device 100 can use motor 191 to generate vibration alerts (e.g., vibration alert for incoming calls). The indicator 192 in terminal device 100 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. The SIM card interface 195 in terminal device 100 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with terminal device 100.

[0103] It should be understood that Figure 1 The terminal device 100 shown is merely an example; in practical applications, the terminal device 100 may include more than [examples of other devices]. Figure 1 The more or fewer components shown may be combined into two or more components, or they may have different component configurations, which is not limited in the embodiments of this application. Figure 1 The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0104] The software system of terminal device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of terminal device 100.

[0105] Layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. For example... Figure 2 As shown, the software architecture can be divided into four layers, from top to bottom: the application layer, the application framework layer (framework, FWK), the Android runtime and system libraries, and the Linux kernel layer.

[0106] The application layer is the top layer of the operating system and includes native operating system applications such as camera, gallery, calendar, Bluetooth, music, video, and messaging. The applications discussed in this application are referred to as apps (APPs), which are software programs capable of performing one or more specific functions. Typically, multiple apps can be installed on a terminal device. Examples include camera apps, email apps, gallery apps, and map apps. The apps mentioned below can be system apps pre-installed on the terminal device or third-party apps downloaded by the user from the network or obtained from other terminal devices during use.

[0107] Of course, for developers, they can write applications and install them into this layer. In one possible implementation, the application can be developed using the Java language, by calling the Application Programming Interface (API) provided by the application framework layer. Developers can then interact with the underlying operating system (such as the kernel layer) through the application framework to develop their own applications.

[0108] For example, a map application at the application layer can provide a map to a gallery application. The gallery application can then generate a heat map by executing the scheme provided in this embodiment based on the stored images and the map provided by the map application. Alternatively, a gallery application at the application layer can provide images to a map application. The map application can then generate a heat map by executing the scheme provided in this embodiment based on the acquired map and the images provided by the gallery application. After generating the heat map, it can be stored and displayed through either the gallery application or the map application, and its usage can be displayed in real time through the map application.

[0109] The application framework layer provides APIs and a programming framework for applications within the application layer. The application framework layer can include predefined functions. It may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0110] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0111] A content provider is used to store and retrieve data, and to make this data accessible to applications. The data may include files (e.g., documents, videos, images, audio), text, and other information. For example, the data may include data related to heat maps generated according to the scheme provided in the embodiments of this application.

[0112] A view system includes visual controls, such as controls that display text, images, documents, and other content. View systems can be used to build applications. An interface in a display window can consist of one or more views. For example, a display interface including a text notification icon could include a view displaying text, a view displaying images, a view displaying a heat map, and so on.

[0113] The phone manager provides communication functionality for terminal devices. The notification manager allows applications to display notification information in the status bar; it can be used to convey informative messages and can disappear automatically after a short pause without user interaction.

[0114] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0115] The core libraries of the Android system consist of two parts: one part contains the functionalities that Java calls, and the other part is the core libraries of the Android system. The application layer and application framework layer run in a virtual machine. Taking Java as an example, the virtual machine executes the Java files in the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0116] The system library can include multiple functional modules. For example: a surface manager, a media library, a 3D graphics processing library (e.g., OpenGL ES), and a 2D graphics engine (e.g., SGL). The surface manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of various common audio and video formats, as well as still image files. The media library supports various audio and video encoding formats, such as MPEG4, H.564, MP3, AAC, AMR, JPG, and PNG. The 3D graphics processing library implements 3D graphics drawing, image rendering, compositing, and layer processing. The 2D graphics engine is the drawing engine for 2D graphics.

[0117] The kernel layer provides core system services for the operating system, such as security, memory management, process management, network protocol stack, and driver models, all of which are implemented based on the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer contains many drivers related to terminal devices, including: display drivers; keyboard drivers as input devices; Flash drivers for memory-based devices; camera drivers; audio drivers; Bluetooth drivers; and WiFi drivers.

[0118] It is important to understand that the functional services described above are just an example. In practical applications, terminal devices may be divided into more or fewer functional services based on other factors, or the functions of each service may be divided in other ways, or the devices may not be divided into functional services and may work as a whole.

[0119] The method provided in this application will be described in detail below with reference to specific embodiments.

[0120] The method for generating heat maps provided in this application mainly includes two stages: generating the heat map and using the heat map, which will be described below.

[0121] I. Generation of Heat Maps

[0122] See Figure 3 The method for generating heat maps provided in this application embodiment may include:

[0123] S301: The terminal device acquires multiple images and determines the geographical location information of the multiple images.

[0124] In this embodiment, the multiple images can be images captured and saved by the user using a terminal device. For example, the multiple images can be images from the terminal device's gallery application, wherein the terminal device stores the captured images in the gallery application after capturing them according to the user's instructions.

[0125] In some embodiments of this application, during the process of capturing and saving images, the terminal device can also acquire and save at least one of the following information corresponding to the image: parameter information, time information, and geographic location information. The parameter information includes image parameters and shooting parameters. Image parameters indicate the image's own characteristic information, such as image resolution, image size, and image color. Shooting parameters are the parameters used when capturing the image, indicating the configuration information of the terminal device or its camera (or webcam) when capturing the image. Time information indicates the time when the terminal device captured the image, and geographic location information indicates the image's shooting location, i.e., the geographical location of the terminal device when capturing the image.

[0126] Optionally, the multiple images can be all images captured by the terminal device, a selection of images chosen by the user from all images captured by the terminal device, or a selection of images chosen by the terminal device from all images it has captured. For example, the multiple images can be all images saved in the terminal device's gallery application, multiple images selected by the user in the gallery application, or multiple images randomly selected or selected by the terminal device in the gallery application according to set rules. The set rules could, for example, be selecting images captured by the terminal device within a set time period, or selecting images captured by the terminal device within a set geographical area, etc.

[0127] In some embodiments of this application, the terminal device can trigger the heat map generation process either by user control or automatically. For example, in the user-controlled mode, the terminal device can receive control commands from the user through a gallery application or a map application, and trigger the heat map generation process in response to the received control commands. For instance, the terminal device can trigger the heat map generation process when the user opens the gallery application. As another example, the terminal device can receive the user's action of opening a heat map in the map application, and trigger the heat map generation process in response to that action. In the automatically triggered mode, the terminal device can trigger the heat map generation process periodically, or trigger it when images captured by the terminal device meet set conditions. These set conditions could be, for example, that the number of newly added images in the terminal device's gallery application reaches a set threshold compared to the previous triggering of the heat map generation process.

[0128] After generating a heatmap, if the images upon which the heatmap was based are updated (added, deleted, or modified), the terminal device can update the heatmap based on the updated images. Specifically, when the update involves adding images, the terminal device can add those images to the previously generated heatmap; when the update involves deleting images, the terminal device can delete the corresponding information from the previously generated heatmap; and when the update involves modifying images, the terminal device can make corresponding modifications to the previously generated heatmap based on the modifications made to those images. The triggering method for heatmap updates is the same as the triggering method for heatmap generation, and will not be elaborated further here.

[0129] S302: The terminal device obtains the first map.

[0130] The first map is an electronic map, which can be obtained from map applications by terminal devices.

[0131] In some embodiments of this application, the first map contains the geographical locations indicated by the geographical location information of the aforementioned multiple images, that is, the geographical area corresponding to the first map contains the shooting locations of the multiple images.

[0132] S303: The terminal device determines the shooting points of multiple images in a first map based on the geographical location information of multiple images, wherein the shooting point of each image is used to indicate the shooting location of the image.

[0133] In this embodiment, the terminal device can determine the shooting points corresponding to multiple images in a first map based on the geographical location information corresponding to multiple images, and further generate a heat map based on the shooting points corresponding to multiple images in the first map, the road information of the first map, and the first map. The road information of the first map is used to indicate the location of road areas included in the first map.

[0134] The geographic location information corresponding to each image is used to indicate the location where the image was taken. Therefore, the terminal device can directly search and determine the location point corresponding to each image in the first map based on the geographic location information corresponding to each image in multiple images, thereby obtaining the shooting points of multiple images.

[0135] For example, Figure 4 This is a schematic diagram of a map display interface. Taking a vehicle-mounted infotainment system as an example, the map displayed on the screen of the vehicle-mounted system is as follows: Figure 4 As shown, when multiple images include images 1 to 5, the shooting points corresponding to images 1 to 5 in the first map are respectively Figure 4 The locations A to E are shown in the diagram.

[0136] S304: The terminal device determines at least one road point in the first map based on the shooting points of multiple images.

[0137] In this step, after determining the shooting point of each image in multiple images, the terminal device, for each image, can determine whether a road point corresponding to that image exists in the first map based on the shooting point of the image and the road information in the first map. If it exists, the corresponding road point can be obtained, and the association between the image and the corresponding road point can be established; if it does not exist, it is determined that there is no corresponding road point in the first map. After performing the above processing for each image, the terminal device can determine at least one road point and at least one image associated with each road point from the first map. The road points associated with different images in the first map may be the same or different. After determining at least one image associated with each road point, the terminal device can determine the association between each road point and the shooting point of its associated at least one image. Therefore, for each road point, the terminal device can obtain the association between the road point and at least one image, and the association between the road point and at least one shooting point, where at least one image corresponds one-to-one with at least one shooting point, and each shooting point represents the shooting location of the corresponding image.

[0138] In one possible approach, each image can correspond to a road point. In this method, when the terminal device determines whether a road point corresponding to an image exists in the first map based on the image's capture point and road information in the first map, it first determines whether a road area of ​​a predetermined size exists within a road area centered on the capture point, based on the image's capture point and road information in the first map. If a road area exists, the point closest to the capture point within that road area is further identified as the road point corresponding to the image; otherwise, it can be determined that no road point corresponding to the image exists.

[0139] For example, such as Figure 4 As shown, taking image point A in image 1 as an example, the range of the first region corresponding to image point A can be... Figure 4The area shown is defined by a circular dashed circle with point A as the center and radius l1. Based on the road information of the first map, it can be determined that a road area exists within this region. Further, the road point A1, which is closest to point A in this road area, is identified. Road point A1 is the road point corresponding to image 1, and image 1 is associated with road point A1, as is point A. Similarly, taking point B of image 2 as an example, there is no road area within the first region centered on point B, therefore, there is no road point corresponding to image 2 in the first map. Likewise, the road points corresponding to images 3 through 5 can be determined as A1, D1, and E1, respectively. The road point corresponding to images 1 and 3 is the same, both being road point A1. Therefore, road point A1 is associated with images 1 and 3, and also with points A and C. Road point D1 is associated with image 4, and also with point D. Road point E1 is associated with image 5, and also with point 5.

[0140] In another possible approach, each image can correspond to multiple road points. In this method, when the terminal device determines whether a road point corresponding to the image exists in the first map based on the image's capture point and road information in the first map, it first determines whether a road area of ​​a predetermined size exists within a first region centered on the capture point, based on the image's capture point and road information in the first map. If a road area exists, then all location points within that road area are further identified as road points corresponding to the image; if not, it can be determined that no road point corresponds to the image.

[0141] For example, for Figure 4 In the scene shown, all locations within the first area corresponding to shooting point A and within the road area can be used as road points corresponding to image 1. Figure 5 All location points in road area 1 shown are road points corresponding to image 1, and are associated with image 1 and shooting point A. For example, Figure 5 All the location points in road area 2 shown are the road points corresponding to image 4, and are associated with image 4 and shooting point D.

[0142] Based on the above methods, the terminal device can map the shooting points of discrete images to road points in a relatively concentrated road area, and associate the images with the corresponding road points. This allows the distribution characteristics of the image shooting location to be displayed based on the relatively concentrated road points, thus more concisely and efficiently reflecting the distribution characteristics of the image shooting location while ensuring high accuracy.

[0143] S305: The terminal device determines the heat value of each road point based on the shooting points of multiple images and at least one road point.

[0144] In some embodiments of this application, after determining at least one road point in the first map according to the steps described above, the terminal device can determine the heat value of each road point based on the location and default heat value of at least one camera associated with that road point, as well as the location of the road point itself. Specifically, the terminal device can pre-configure the same default heat value for each camera. For example, the default heat value can be 1, i.e., a unit value. When calculating the heat value of each road point, the terminal device first determines the weight of each camera associated with that road point based on the distance between that road point and the road point itself. Then, it performs a weighted sum of the default heat values ​​of these camera points according to their determined weights to obtain the heat value of the road point. The distance between a camera point and a road point has a negative correlation with the weight of the camera point; that is, the smaller the distance between a camera point and its associated road point, the greater the weight of the camera point. The terminal device can calculate the weight corresponding to the shooting point according to a set function based on the distance between the shooting point and the associated road point, or it can determine the weight corresponding to the distance as the weight corresponding to the shooting point based on the distance between the shooting point and the associated road point, as well as the preset correspondence between different distance values ​​and weight values.

[0145] In the above method, the heat value of a road point is determined based on the heat values ​​of nearby shooting points. The closer the shooting point is to the road point, the greater its contribution to the road point's heat value; conversely, the farther the shooting point is from the road point, the smaller its contribution. Therefore, using road point heat value information can accurately reflect the heat information of the image's location in the surrounding environment, while avoiding the potentially overly complex information display that might occur when based solely on shooting point heat values. This achieves a more concise and efficient display of heat information, improving the user experience. Furthermore, the heat information can be further displayed in conjunction with geographical features, making it easier for users to specifically view the distribution of image shooting locations and images taken in different areas, thereby enhancing the user experience.

[0146] For example, for Figure 4 In the scenario shown, the road point corresponding to both image 1 and image 3 is road point A1. Road point A1 is associated with shooting points A and C. Therefore, the weight w corresponding to shooting point A can be determined based on the distance between shooting point A and road point A1. A The weight w corresponding to shooting point C is determined based on the distance between shooting point C and road point A1. C Therefore, the thermal value of road point A1 is determined to be w. A ×x A +w C ×x C , where xA x is the default thermal value for shooting point A. C The default thermal value for shooting point C, w A w represents the weight corresponding to shooting point A. C Let x be the weight corresponding to shooting point C. A =x C Since the distance between shooting point A and road point A1 is less than the distance between shooting point C and road point A1, therefore w A >w C .

[0147] S306: The terminal device displays the heat value information of each road point in the first map to obtain the first heat map.

[0148] As an optional implementation, after determining the heat value of each road point, the terminal device can display the heat value of each road point in the first map according to the display format corresponding to the different heat values ​​set, thereby obtaining a first heat map based on road characteristics.

[0149] As another optional implementation, after determining the heat value of each road point, the terminal device can determine the heat level corresponding to the range of heat values ​​to which each road point belongs, based on the set correspondence between different heat value ranges and heat levels. Then, according to the set display format corresponding to different heat levels, the heat level corresponding to each road point is displayed in the first map, resulting in a first heat map based on road characteristics.

[0150] In the above embodiments, a higher heat value or heat level of a road point indicates that there are locations with captured images and / or a greater number of captured images in the vicinity of that road point. Based on this, users can intuitively and quickly determine the captured image situation near a road point according to the display format of different road point heat values. This facilitates users' perception of hotspot road sections for image capture and assists them in analyzing data and planning their trips.

[0151] In some embodiments of this application, as an optional implementation, when displaying the heat value or heat level of a road point, the terminal device may display the heat value or heat level of the road point only at its location. As another optional implementation, when each image corresponds to only one road point, the terminal device may display the heat value or heat level of the road point within a defined area where the road point is located. This defined area may be a road area of ​​a defined size centered on the road point, or it may be part or all of the road area within a first area corresponding to the shooting point associated with the road point.

[0152] For example, when there are many identified road points, the terminal device can display the heat value or heat level of only the road point location, thus accurately displaying the heat information. When there are few identified road points, the terminal device can display the heat value or heat level of the road points within a defined area where the road points are located, thus ensuring that users can quickly and intuitively see the heat information of each road point.

[0153] For example, for Figure 4 In the scenario shown, each image is associated with only one road point. Image 1 is associated with both shooting point A and road point A1. Therefore, when the terminal device displays the heat value or heat level of road point A1, it can use a region of a set size centered on road point A1 as the defined area where road point A1 is located, or it can use the road area within the first region corresponding to shooting point A as the defined area where road point A1 is located (for example, it could be...). Figure 5 The road area shown in the figure (1), or the road area in the overlapping area between the first area range corresponding to shooting point A and the first area range corresponding to shooting point C, is taken as the set area where road point A1 is located, and all locations in the set area where road point A1 is located are displayed as the heat value or heat level of road point A1.

[0154] For example, the terminal device can display the heat value or heat level of a road point by displaying a designated area containing the road point in different colors. In this method, the terminal device can pre-set the correspondence between different heat values ​​or heat levels and different colors. When displaying the heat value or heat level of each road point, the designated area containing each road point is displayed in the color corresponding to that road point's heat value or heat level.

[0155] For example, for Figure 4 In the scenario shown, after determining the heat value of each road point using the method described above, the terminal device can determine the heat level of each road point based on its heat value, and display the heat level of each road point according to the display format corresponding to its heat level, as shown below. Figure 6a or Figure 6b The first heat map is shown. In which... Figure 6a In the display, the heat level of a road point is shown within a set-size area centered on that road point. Figure 6b In the image, the display location of the heat level of a road point is the entire road area within the first region corresponding to the shooting point associated with that road point.

[0156] The first heat map obtained by the aforementioned terminal device is based on roads and can intuitively reflect the heat information of images captured near roads, but it cannot intuitively display the heat information of images captured near each image capture location. Therefore, based on the first heat map, the terminal device can also display the heat information of images captured near each image capture location.

[0157] Optionally, after performing step S306 above, the terminal device may also perform the following steps S307 to S308:

[0158] S307: The terminal device determines the thermal value of each shooting point based on the shooting points of multiple images and at least one road point, or based on the shooting points of multiple images.

[0159] In this embodiment of the application, the terminal device may determine the thermal value of each shooting point using either method 1 or method 2.

[0160] Method 1

[0161] In this method, after obtaining the heat values ​​of each road point, the terminal device can calculate the heat value of each shooting point based on the default heat value, corresponding weight, and location of each shooting point determined in the previous steps. Specifically, the terminal device can first optimize the default heat value of each shooting point according to its corresponding weight to obtain the base heat value of each shooting point, and then determine the final heat value of each shooting point based on these base heat values. For each shooting point, the terminal device can determine the base heat value of that shooting point using the following formula:

[0162] X = K * w * x + x

[0163] In this formula, X is the base thermal value of the shooting point, K is a set coefficient, w is the weight corresponding to the shooting point, and x is the default thermal value of the shooting point. Different shooting points correspond to the same coefficient K.

[0164] After determining the basic thermal values ​​of each shooting point, in one possible scenario, for each shooting point with associated road points, the terminal device first determines whether there are other shooting points within a second area of ​​a predetermined size centered on that shooting point. If so, the terminal device can use that shooting point and the other existing shooting points as reference points for that shooting point; if not, the terminal device uses the shooting point itself as its reference point. After determining the reference points for each shooting point, the terminal device determines the weight of each reference point based on the distance between the shooting point and each corresponding reference point, and then performs a weighted sum of the basic thermal values ​​of these reference points according to their respective weights to obtain the final thermal value of the shooting point. In another possible scenario, for each shooting point without associated road points, the terminal device uses the shooting point itself as its reference point, determines the weight of each reference point based on the distance between the shooting point and each corresponding reference point, and then multiplies the weight by the default thermal value of the shooting point to obtain the final thermal value of the shooting point.

[0165] There is a negative correlation between the distance between the reference point and the shooting point and the weight corresponding to the reference point. The terminal device can calculate the weight corresponding to the reference point according to a set function based on the distance between the reference point and the shooting point, or it can determine the weight corresponding to the distance as the weight corresponding to the reference point based on the distance between the reference point and the shooting point and the preset correspondence between different distance values ​​and weight values. Optionally, the size of the second region can be the same as the size of the first region described in the above embodiment.

[0166] For example, such as Figure 4 As shown, the second region corresponding to shooting point A can be a region composed of position points whose distance from shooting point A is less than or equal to a set distance threshold l1, i.e. Figure 4 The area shown is defined by a circular dashed line with point A as the center and radius l1. Shooting points C and D are located within the second area corresponding to shooting point A. Therefore, the reference points corresponding to shooting point A are shooting points A, C, and D. The thermal value of shooting point A is: w1 × x A '+w2×x C '+w3×x D ', where w1 is the weight when shooting point A is used as its own reference point, w2 is the weight when shooting point C is used as the reference point of shooting point A, w3 is the weight when shooting point D is used as the reference point of shooting point A, and x A 'x' represents the base thermal value of shooting point A. A '=K×w A ×x A +x A x C'x' represents the base thermal value at shooting point C. C '=K×w C ×x C +x C x D 'x' represents the base thermal value of shooting point D. D '=K×w D ×x D +x D If there are no other shooting points within the second region corresponding to shooting point B, then the thermal value of shooting point B is w4×x. B Where w4 is the weight corresponding to the shooting point B as its own reference point, and x B This is the default thermal value for shooting point B.

[0167] Method 2

[0168] In this method, the terminal device can calculate the thermal value of each shooting point based on the location and default thermal value determined in the above steps. Specifically, for each shooting point, the terminal device can determine the corresponding reference points and their corresponding weights according to the method described in Method 1 above, and then perform a weighted summation of the default thermal values ​​of these reference points according to their respective weights to obtain the final thermal value of the shooting point.

[0169] For example, for Figure 4 In the scene shown, the reference points corresponding to shooting point A are shooting points A, C, and D. Therefore, the thermal value of shooting point A is: w1 × x A +w2×x C +w3×x D Where w1 is the weight when shooting point A is used as its own reference point, w2 is the weight when shooting point C is used as the reference point of shooting point A, w3 is the weight when shooting point D is used as the reference point of shooting point A, and x A x is the default thermal value for shooting point A. C x is the default thermal value for shooting point C. D This is the default thermal value for shooting point D. If there are no other shooting points within the second region corresponding to shooting point B, then the thermal value for shooting point B is w4×x. B Where w4 is the weight corresponding to the shooting point B as its own reference point, and x B This is the default thermal value for shooting point B.

[0170] S308: The terminal device displays the thermal value information of each shooting point in the first thermal map to obtain the second thermal map.

[0171] As one optional implementation, the terminal device can display the thermal value information of each shooting point determined according to method 1 above in the first thermal map. As another optional implementation, the terminal device can display the thermal value information of each shooting point determined according to method 2 above in the first thermal map.

[0172] The method for the terminal device to display the final heat value information of the shooting point of each image associated with the road point can refer to the method provided in step 4 above, and will not be repeated here. During the display process, the area where the shooting point is located is a region of a set size centered on that shooting point.

[0173] By displaying the thermal values ​​of each shooting point in the first thermal map, the terminal device can further obtain a second thermal map based on road characteristics and image shooting point characteristics. This second thermal map can more accurately and comprehensively reflect the thermal information of the image shooting.

[0174] For example, for Figure 4 In the scenario shown, the terminal device receives... Figure 6a After obtaining the first heat map shown, the final heat value of each image's shooting point can be determined, and the heat level of each shooting point can be determined based on that heat value. Figure 6a In the first heat map shown, the heat levels of each shooting point are displayed according to the display format corresponding to the heat level of each shooting point, resulting in the following: Figure 7 The second heat map is shown.

[0175] Optionally, the terminal device can remove the heat values ​​or heat levels used to represent road points from the second heat map to obtain a third heat map based solely on the characteristics of the image capture point, which does not contain road-based heat information.

[0176] In some embodiments of this application, the terminal device can determine the method of generating the heat map and the type of heat map to be displayed based on user instructions. For example, the terminal device can provide a control switch for switching between different heat maps. When the user selects to enable the road mode via the control switch, the terminal device can generate and display a first heat map based on road characteristics; when the user selects to enable the mixed mode via the control switch, the terminal device can generate and display a second heat map based on both road characteristics and image capture point characteristics; when the user selects to enable the normal mode via the control switch, the terminal device can generate and display a third heat map based solely on image capture point characteristics.

[0177] In some embodiments of this application, when the terminal device is an in-vehicle terminal device, the terminal device can automatically display a heat map based on road characteristics or a heat map based on road characteristics and image capture point characteristics when it detects that the vehicle is in a driving state.

[0178] Optionally, in the above method, after displaying the heat values ​​or heat levels of road points and / or image capture locations, the terminal device can further optimize the display of the resulting heat map. In one example, the terminal device can remove heat information with low heat values ​​or heat levels, that is, only display heat information with high heat values ​​or heat levels, and not display information with low heat values ​​or heat levels, thereby selectively displaying more important heat information and further improving the accuracy of the heat map. In another example, the terminal device can also optimize the resulting heat map by combining regional elements in the map. For example, for heat information outside the area where a certain type of location (e.g., a scenic spot) is located in the heat map, the terminal device can remove it, thereby retaining the heat information within the area where the designated type of location is located, thus making the heat display effect of some types of images more accurate. For example, for Figure 7 The heat map shown can be optimized by removing heat information from images located outside the area of ​​attraction P, as well as removing heat information from road points associated with those images, to obtain the desired result. Figure 8 The heat map shown can more accurately display the popularity of scenic spot images.

[0179] Optionally, in this embodiment of the application, after generating the first heat map or the second heat map, the terminal device can store and display the first heat map and the second heat map using a map application or a gallery application. When displaying the heat map using a map application, the functions provided by the map application can also be used simultaneously, such as real-time location display, location search, and navigation.

[0180] In some embodiments of this application, the road points described in the above embodiments can also be replaced with location points in other types of areas, such as location points in areas with linear shape characteristics (e.g., location points in railway areas or river areas), thereby enabling the determination of heat maps based on the characteristics of other types of areas.

[0181] In the above embodiments, the terminal device can create a heat map of the image based on road information and the location where the image was taken, which can improve the accuracy of the heat map. It can also combine road information to display the heat information of images taken at different locations, so that users can have an intuitive understanding of locations and routes with high heat, thereby improving the user experience of using the heat map.

[0182] II. Use of Heat Maps

[0183] In the process described above, after generating a heat map, the terminal device can display the heat map to the user. Furthermore, it can utilize the heat map based on user controls and the terminal device's current location to achieve interactive experiences such as browsing, querying, and recommendations based on the heat map. A specific example will be provided below.

[0184] Specifically, based on the above embodiments, the following examples can be given:

[0185] Example 1

[0186] Reference Figure 9 The method for using heat maps provided in this application embodiment may include:

[0187] S901: The terminal device receives the user's operation to open the gallery application.

[0188] S902: In response to the received operation, the terminal device calls the gallery application to display the gallery interface, which includes heat map function controls.

[0189] The heat map function control is used to trigger entry into the heat map mode to display the heat map.

[0190] Optionally, the gallery interface may also include image-related content. For example, image-related content may include albums, image thumbnails, time and location information, quantity information, and other content that can be used to view images or to view image attribute information.

[0191] For example, the gallery interface can be Figure 10a The interface shown displays image thumbnails and heatmap function controls. When the terminal device receives a user's click on a thumbnail, it can display the original image corresponding to that thumbnail.

[0192] S903: The terminal device receives the user's operation on the heat map function control and responds to the operation by displaying the heat map interface.

[0193] The user's actions on the heatmap trigger the display of the heatmap in road mode, that is, trigger the terminal device to display a heatmap based on road characteristics. The content displayed in the heatmap interface can be a heatmap based on road characteristics. Optionally, the heatmap can be generated by the terminal device based on images in the gallery application after receiving user actions on the heatmap function controls, or the heatmap can be a heatmap pre-generated by the terminal device based on images in the gallery application and saved in the gallery application.

[0194] It should be noted that the terminal device can use the method provided in the above embodiments to generate the heat map. Of course, other heat map generation methods can also be used to generate the above-mentioned heat map based on road characteristics. This application embodiment does not make specific limitations on this.

[0195] For example, based on Figure 10a As shown in the gallery interface, users can enter the road heatmap mode by clicking the heatmap function control. The terminal device then responds to the user's click on the heatmap function control by calling the map application to display, for example... Figure 10b The heat map interface shown includes a heat map based on road characteristics.

[0196] Optionally, the heat map interface displayed on the terminal device also includes at least one option control for switching between different types of heat maps. When the user selects one of the option controls, the terminal device can switch the heat map in the currently displayed heat map interface to the heat map of the type corresponding to that option control.

[0197] For example, such as Figure 10b As shown, the heat map display interface includes three option controls: Road Mode, Hybrid Mode, and Normal Mode. Road Mode corresponds to a heat map based solely on road characteristics, Hybrid Mode corresponds to a heat map based on both road and camera point characteristics, and Normal Mode corresponds to a heat map based solely on camera point characteristics. Currently... Figure 10b The heatmap interface displays a heatmap based solely on road characteristics (containing only heat value information for road points), so the option control corresponding to the road mode is displayed as the selected mode. In one example, based on... Figure 10a As shown in the interface, when the user selects the mixed mode option control, the terminal device can... Figure 10b The heat map displayed in the heat map interface is switched to Figure 10c The heat map shown below, in which, Figure 10c The heat map shown is relative Figure 10b The heat map shown has been enhanced with thermal value information for the shooting location. In another example, based on... Figure 10c As shown in the interface, when the user selects an option control in normal mode, the terminal device can... Figure 10c The heat map displayed in the heat map interface is switched to Figure 10d The heat map shown in the figure, wherein Figure 10d The heat map shown is relative Figure 10c The heat map shown has removed the heat value information of road points and only retained the heat value information of the shooting point.

[0198] In some embodiments of this application, the heat map interface may include a search box control. Users can enter the location to be searched in the search box, and the terminal device can search for and determine the location in the heat map and display a portion of the heat map containing the location.

[0199] S904: The terminal device receives the user's click on any road area displayed in the heat map interface.

[0200] S905: The terminal device zooms in to display the content of the corresponding part of the road area in the heat map.

[0201] For example, based on Figure 10b The heat map interface shown can display the following when the user clicks on road L: Figure 10e The heat map interface shown here is a magnified view of the map near the road L that the user clicked, which can more clearly display the heat value information of the area near road L.

[0202] Optionally, when the heat map interface displays a heat map based solely on road characteristics, the method may include the following steps S906–S907:

[0203] S906: The terminal device receives the user's click on any location point in the road area.

[0204] The location point can be a road point or a location point other than a road point.

[0205] S907: In response to the received operation, the terminal device displays a recommended interface, which includes image information and / or recommended location information.

[0206] To facilitate users' quick and easy viewing of images taken near different road areas, the recommendation interface can include image information corresponding to the user-selected location. Specifically, when the location is a road point, the image information indicates the image associated with that location; when the location is not a road point, the image information indicates the image associated with a shooting point within a defined area near that road point. For example, the image information can include the image's name, thumbnail, or other identifying information.

[0207] For example, when the user clicks Figure 10e When at any road point in the map, the terminal device can display as follows: Figure 10fThe recommended interface shown may include thumbnails of at least one image associated with the road point. The recommended interface may cover part or all of the heatmap interface. The at least one image associated with the road point may be all images associated with the road point, a randomly selected subset of images from all associated images, images saved by the user, or a subset of highly-rated images selected from the associated images using a predefined rating algorithm. When a user selects a thumbnail of one of the images by clicking, the terminal device may display an image display interface, which shows the original image corresponding to the selected thumbnail. The image display interface may cover part or all of the recommended interface / heatmap interface.

[0208] Given users' frequent requests for shooting location recommendations, the terminal device can make recommendations related to shooting locations and methods based on the heat map after displaying it. Therefore, the display interface can include recommended location information. This information indicates recommended locations of a defined type near the current location. For example, locations near the current location can specifically meet the following conditions: the distance to the current location is less than or equal to a set threshold, and / or the shortest distance to the road where the current location is located is less than or equal to a set threshold. The defined type of location can be a scenic spot, parking spot, photo spot, park, shopping mall, amusement park, etc., where a photo spot can be a location where the number of images taken exceeds a set value. Optionally, a photo spot can be a location previously visited by the user corresponding to the terminal device, or a location obtained by the terminal device from a server (or cloud) that the user corresponding to the terminal device has not visited.

[0209] For example, such as Figure 10f The recommendation interface shown also includes identification information for at least one recommended location, such as... Figure 10f The attractions shown are "Attraction 1" and "Attraction 2".

[0210] Optionally, the recommendation interface may also include a navigation control for the recommended location. This navigation control is used to trigger navigation to the recommended location. For example, Figure 10f The recommended interface also includes navigation controls ("Go here") for "Attraction 1" and "Attraction 2". After executing step S907, the terminal device can continue to execute the following steps S908-S909:

[0211] S908: The terminal device receives the user's operation on the navigation control corresponding to any recommended location, wherein the recommended interface contains recommended location information and the navigation control corresponding to the recommended location.

[0212] This action is used to instruct navigation to the recommended location.

[0213] S909: The terminal device responds to the received operation by displaying a navigation interface.

[0214] For example, when a user clicks Figure 10f When the terminal device displays the navigation control corresponding to any of the recommended locations shown, it can display... Figure 10g The navigation interface shown displays a navigation route from the current location of the terminal device to the recommended location, allowing the user to travel to the recommended location based on this route.

[0215] Optionally, the recommendation interface may also include recommended images associated with the recommended locations (e.g., Figure 10f The information of the recommended image 1 shown and the control corresponding to the recommended image (e.g., Figure 10f The recommended image shown is the "Take the Same Image" option corresponding to recommended image 1. Recommended images are images associated with the recommended location and have a rating higher than a set value. When acquiring a recommended image, the terminal device simultaneously acquires and saves the image's shooting parameters. The recommended image can be downloaded from a server by the terminal device. The rating of the recommended image can be obtained by the cloud using a set image analysis model, or, if the recommended image is shared on a public social media platform, the server can determine the rating based on information from the public social media platform (such as visitor ratings). For example, the average visitor ratings obtained from the public social media platform can be used as the recommended image's rating.

[0216] For example, if a terminal device analyzes the types of images in a photo library application and determines that the proportion of portrait images among all images is higher than a set value, it can be determined that the user of the terminal device prefers portrait photography. Then, when the user clicks on a location in the heat map, the terminal device will prioritize recommending and displaying the shooting location corresponding to the recommended portrait images with higher ratings in the recommendation interface. At the same time, it can also attach the shooting parameters of the recommended images, so that the user of the terminal device can use the shooting parameters of the recommended images when taking pictures, thereby taking pictures with higher ratings and improving the user's picture shooting experience.

[0217] Based on this, after executing step S907 or step S909, the terminal device can also execute the following steps S910 to S911:

[0218] S910: The terminal device receives the user's operation on the control corresponding to any recommended image, wherein the recommendation interface contains the recommended image associated with the recommended location and the control corresponding to the recommended image.

[0219] This operation is used to trigger the terminal device to capture an image according to the recommended image capture parameters.

[0220] S911: The terminal device responds to the received operation and displays the shooting interface.

[0221] S912: The terminal device receives the user's trigger to take a picture.

[0222] S913: The terminal device responds to the received operation and takes a picture according to the shooting parameters corresponding to the recommended image selected by the user.

[0223] For example, when the user clicks Figure 10f When the "Take the Same Image" option corresponding to the recommended image 1 shown in the diagram is selected, the terminal device can call the camera application to display the shooting interface and obtain the shooting parameters of the recommended image 1. When the user performs an operation in the shooting interface to trigger taking a photo, the terminal device can take a photo according to the shooting parameters corresponding to the recommended image 1 and call the gallery application to save the captured image.

[0224] In some embodiments of this application, when recommending shooting locations, the terminal device can recommend locations based solely on attraction information. For example, when a user clicks on a location within a road area on a heatmap, the terminal device can display recommended information for all attractions near the corresponding road segment. When the user clicks on a location outside the road area, it can display shooting locations near that location. For instance, clicking on a road recommends all shooting attractions near the entire road, while clicking on an attraction area along the roadside only recommends shooting locations for that attraction, thus providing users with targeted recommendations.

[0225] In some embodiments of this application, the terminal device can also perform image classification and analysis to determine personalized information such as the user's image-taking habits, and then recommend shooting locations based on the determined personalized information. For example, the terminal device can analyze and determine the location and time distribution characteristics of the user's images based on the image's time information and geographical location information, and then recommend shooting locations based on the determined location and time distribution characteristics.

[0226] For example, if the geographic location information of multiple images determines that they were taken at the same location, and the time information of these multiple images indicates that their shooting times are regular (e.g., the time difference between two adjacent shooting times falls within a set range), then the shooting locations of these multiple images can be determined to be locations that the user regularly visits. The terminal device can then display information recommending these regularly visited locations to the user when the user clicks on a location near that shooting location on a hotspot map, and can simultaneously show the user images taken at those regularly visited locations.

[0227] Example 2

[0228] Reference Figure 11 Another method for using heat maps provided in this application embodiment may include:

[0229] S1101: The terminal device receives the user's operation to open the map application.

[0230] S1102: In response to the received operation, the terminal device calls the map application to display the map interface, which includes a heat map function control.

[0231] Optionally, the map interface may display information indicating the current location of the terminal device.

[0232] S1103: The terminal device receives the user's operation on the heat map function control and responds to the operation by displaying the heat map interface.

[0233] The content displayed in the heat map interface can be a heat map based on road characteristics.

[0234] As an optional implementation, in this example, the heat map function control can have the same display format and function as the heat map function control described in Example 1 above.

[0235] As another optional implementation, in this example, the heat map function control may include at least one option control for switching between different types of heat maps as described in Example 1 above. When the user selects one of the option controls, the terminal device can switch the currently displayed map interface to a heat map interface for displaying the heat map of the type corresponding to that option control.

[0236] The method for generating heat maps can be found in the description in Example 1, and will not be repeated here.

[0237] For example, the heat map interface can be as described in Example 1 above. Figure 10b or Figure 10c The heat map interface shown.

[0238] In some embodiments of this application, when the terminal device is an in-vehicle terminal device, the terminal device can detect the vehicle's motion status in real time. When it detects that the vehicle is in a driving state, the terminal device can automatically switch to a heat map display mode. For example, after the user opens the map application on the terminal device and the terminal device displays the map interface, the terminal device may not execute the above step S1103, but instead execute the following steps: When the terminal device detects that it is currently in driving mode, it displays the heat map interface. It can then continue to execute the following steps S1104 and subsequent steps.

[0239] S1104: The terminal device receives the user's query for navigation routes and displays a panoramic navigation interface, which includes a panoramic view of the navigation route from the origin to the destination, and the navigation route includes heat value information.

[0240] The heat map information in the navigation route indicates the magnitude of the heat map value at the current location. This heat map information is determined based on the heat map information displayed in the heat map interface.

[0241] Optionally, in the panoramic navigation interface, only heat value information located in the road area corresponding to the navigation route can be displayed. For heat value information located outside the road area involved in the navigation route, the terminal device can not display it, so that users can only focus on the heat distribution information on the navigation route and avoid interference from other information.

[0242] For example, when the heat map interface is Figure 10e When the user queries the navigation route from origin R to destination Q, the terminal device can add the navigation route from origin R to destination Q to the specified interface. Figure 10e The heat map shown is obtained by removing heat values ​​from areas outside the road area corresponding to the navigation route and retaining the heat values ​​within the road area corresponding to the navigation route. Figure 12a The panoramic navigation interface shown is displayed. Among them, as shown... Figure 12a As shown, destination Q can be located in an area without heat map information, such as a location that the user is searching for and has not previously been imaged. Of course, destination Q can also be located in a road segment with heat map information, such as... Figure 12a The location shown in red, displaying heatmap information, could be a location where the user previously took an image. Alternatively, destination Q could be located near a road segment with heatmap information, such as a parking spot near a location where the user previously took an image.

[0243] S1105: The terminal device receives the user's command to start navigation and displays a partial navigation interface, which includes a magnified view of a portion of the navigation route corresponding to the current location of the terminal device.

[0244] Once navigation is activated, the navigation route changes as the terminal device moves, but the starting point of the navigation route remains the current location of the terminal device, and the ending point of the navigation route remains the destination.

[0245] For example, based on Figure 12a The panoramic navigation interface shown can display the following when the terminal device is currently at location point S: Figure 12bThe partial navigation interface shown includes a portion of the navigation route near location point S.

[0246] Optionally, the method may further include the following steps S1106 to S1108:

[0247] S1106: When the location of the terminal device corresponds to a target location point that meets the set conditions, the terminal device displays a prompt message to indicate that it has passed through or is about to pass through a high heat value road section.

[0248] The setting conditions include: belonging to the target road point or the distance between the target road point and the target road point is less than or equal to a set threshold, and the target road point is a road point located on the navigation route and associated with at least one image.

[0249] When the location of the terminal device corresponds to the target road point, the prompt message displayed by the terminal device is used to indicate that it is passing through a road section with a high heat value; when the location of the terminal device corresponds to a location point whose distance from the target road point is less than or equal to a set threshold, the prompt message displayed by the terminal device is used to indicate that it is about to pass through a road section with a high heat value.

[0250] S1107: The terminal device receives the user's click on any location point on the navigation route.

[0251] S1108: In response to the received operation, the terminal device displays a recommended interface, which includes image information and / or recommended location information.

[0252] The specific execution method for this step can be referred to the method described in step S907 of Example 1 above, and will not be repeated here.

[0253] Optionally, after performing step S1108, the terminal device may also continue to perform steps S908 to S913 as described in Example 1.

[0254] It should be noted that Examples 1 and 2 above are merely illustrative examples of how to use heat maps and do not constitute a limitation on the use of heat maps. In Examples 1 and 2, the execution order of each step can be adjusted according to actual needs, and other steps can be added or some steps can be removed. The methods provided in Examples 1 and 2 can also be integrated or used as mutual references; no specific limitations are made in this application embodiment.

[0255] Based on the methods provided in Examples 1 and 2 above, the terminal device can recommend shooting locations based on various information such as local image data, corresponding heat maps, server-side information, and environmental information (road information, scenic spot information), enabling a more comprehensive, professional, and personalized interactive experience, making it easier to meet various personalized needs of users, thereby improving the user experience.

[0256] The above solution can be applied to mobile devices such as in-vehicle systems, enabling the display of heat maps and the recommendation of shooting locations based on the real-time location of the mobile device. This allows users to quickly and intuitively perceive the heat of images taken at different locations and browse images while on the move. It also facilitates users to quickly and intuitively view and go to recommended shooting locations, resulting in a better interactive experience.

[0257] Based on the above embodiments and the same concept, this application also provides an image display method, such as... Figure 13 As shown, the method includes:

[0258] S1301: The terminal device acquires the first image and the first shooting position corresponding to the first image.

[0259] For example, the first image can be any one of the multiple images described in the above embodiments, and the first shooting position corresponding to the first image is the shooting point corresponding to the first image.

[0260] Specifically, the method by which the terminal device obtains the first shooting position can refer to the method described in step S303 of the above embodiment, and will not be repeated here.

[0261] S1302: The terminal device acquires a first map and a first road location in the first map that is associated with the first shooting location.

[0262] For example, the first map can be the first map described in the above embodiments, and the first road location is the road point associated with the shooting point corresponding to the first image.

[0263] For example, the first image can be image 1 as described in the above embodiments, the first shooting position can be shooting point A as described in the above embodiments, and the first road position can be road point A1 as described in the above embodiments.

[0264] In some embodiments of this application, the first road location is situated within a region of a predetermined size centered on the first shooting location. The first road location can be the closest road location to the first shooting location within the predetermined size region. The predetermined size region can be the first region range described in the above embodiments.

[0265] Specifically, the method by which the terminal device obtains the first road location associated with the first shooting location can refer to the method described in step S304 of the above embodiment, and will not be repeated here.

[0266] S1303: The terminal device determines the first thermal information corresponding to the first road location based on the first shooting location and the first road location.

[0267] In some embodiments of this application, when the terminal device determines the first thermal information corresponding to the first road location based on the first shooting location and the first road location, it can do so in the following way: determine a first weight based on the first shooting location and the first road location; wherein the first weight is negatively correlated with the distance between the first shooting location and the first road location; obtain a set first thermal value corresponding to the first shooting location; determine a second thermal value corresponding to the first road location based on the first weight and the first thermal value; and determine the first thermal information based on the second thermal value.

[0268] The first heat value can be the default heat value of the first shooting location described in the above embodiments, and the second heat value corresponding to the second road location is the heat value contributed by the first shooting location to the first road point. If the first road point is only associated with the first image, then the first heat information corresponding to the second heat value is the final heat information of the first road point. If the first road point is also associated with other images, then it is also necessary to determine the heat values ​​contributed by the shooting locations of other images to the first road point, and to perform a weighted summation of the heat values ​​contributed by all road points to the first shooting location to obtain the final heat value of the first shooting location, thereby determining the final heat information of the first shooting location. For example, before generating the first heat map based on the first map and the first heat information corresponding to the first road location, the terminal device can also obtain the second image and the second shooting location corresponding to the second image; obtain the second road location associated with the second shooting location in the first map; and determine the second heat information corresponding to the second road location based on the second shooting location and the second road location, that is, process the second image using the same processing method as the first image to obtain the second heat information corresponding to the heat value contributed by the second shooting location of the second image to the first road location. Where the first road location is the same as the second road location, that is, both the first shooting location and the second shooting location are associated with the first road location, the terminal device can superimpose the first thermal information and the second thermal information to obtain the final third thermal information of the first road location.

[0269] For example, the thermal information can be the specific thermal value described in the above embodiments, or it can be the thermal level corresponding to the thermal value.

[0270] Specifically, the method by which the terminal device determines the first thermal information corresponding to the first road location based on the first shooting location and the first road location can refer to the method for determining the thermal value of the road point described in step S305 of the above embodiment, and will not be repeated here.

[0271] S1304: The terminal device generates a first heat map based on the first map and the first heat information corresponding to the first road location.

[0272] For example, the first heat map can be the first heat map described in the above embodiments. The method by which the terminal device generates the first heat map based on the first map and the first heat information corresponding to the first road location can refer to the method for obtaining the first heat map described in step S306 of the above embodiments, and will not be repeated here.

[0273] In some embodiments of this application, after generating a first heat map based on the first map and the first heat information corresponding to the first road location, the terminal device can further determine the heat information of the first shooting location and add the heat information of the first shooting location to the first heat map to obtain a second heat map. For details, please refer to the methods described in steps S307 to S308 of the above embodiments, which will not be repeated here.

[0274] In some embodiments of this application, after generating a first heat map, the terminal device can display a first interface. In one possible scenario, the first interface may include the first heat map. In another possible scenario, the first interface may include the first heat map and a first navigation route from a first target location to a second target location.

[0275] For example, the first interface can be as described in the above embodiments. Figure 10b or Figure 10c or Figure 10g The interface shown.

[0276] In some embodiments of this application, when the first interface includes a first navigation route, and the first road location is located on the first navigation route, the terminal device can also obtain a first distance between the first location and the first road location; the first location is the position of the terminal device on the first navigation route; if the terminal device determines that the first distance is less than or equal to a set first distance threshold, it displays a first prompt message, which is used to prompt the terminal device that it is about to pass or is passing the first road location. The heat value corresponding to the heat information of the first road location is greater than a preset heat value. For example, the first location can be the target location point described in the above embodiments.

[0277] In some embodiments of this application, before displaying a first interface containing a first heatmap and a first navigation route, or after displaying a first interface containing only the first heatmap, the terminal device may receive a first operation to select the first road location, and in response to the received first operation, display a second interface containing information for indicating a first recommended location; wherein the distance between the first recommended location and the first road location is less than or equal to a set second distance threshold.

[0278] Where the first interface contains only the first heat map, the first operation can be the operation described in step S906 of the above embodiments, and the second interface can be the recommendation interface described in step S906 of the above embodiments. Based on this, after displaying the first heat map, the terminal device can display the corresponding recommendation interface after the user selects the location of the first road in the first heat map.

[0279] If the first interface includes a first heat map and a first navigation route, the second interface may also include a second control corresponding to the first recommended location; then the terminal device can respond to the operation performed on the second control and display a second navigation route to the first recommended location. The first recommended location is the second target location. For example, the first recommended location can be any of the recommended locations described in the above embodiments, the second interface can be the recommended interface described in step S906 of the above embodiments, the first operation can be the operation described in step S908 of the above embodiments, the second control can be the navigation control described in step S908 of the above embodiments, and the second navigation route displayed by the terminal device can be the same as described in the above embodiments. Figure 10g The navigation route shown is illustrated. Based on this, after displaying the recommendation interface, the terminal device can further navigate to the recommended locations on the recommendation interface.

[0280] In some embodiments of this application, the second interface further includes a first recommended image corresponding to the first recommended position. The terminal device can then respond to the received second operation by obtaining the shooting parameters of the first recommended image, displaying the shooting interface, and, in response to the operation to trigger the shooting of the image, performing a shot according to the shooting parameters of the first recommended image. The second operation is an operation performed on a third control corresponding to the first recommended image. For example, the first recommended image may be... Figure 10f For any of the recommended images shown, the third control can be... Figure 10f The control corresponding to the recommended image (“Take the same style”) mentioned above can be accessed by the user via a second action. Figure 10f The operation of the control corresponding to the recommended image.

[0281] In some embodiments of this application, the second interface further includes: identification information of the first image; then the terminal device can receive an operation applied to the identification information of the first image and display a third interface, wherein the third interface includes the first image. For example, the first image may be... Figure 10f If any image thumbnail in the associated image list shows the original image, then the identification information of the first image is: Figure 10f The image thumbnail shown is shown in the image, while the third interface displays the original image.

[0282] In some embodiments of this application, before displaying the first interface, the terminal device may first launch a first application and display the application interface of the first application, wherein the application interface of the first application includes a first control. Then, the terminal device can display the first interface in response to an operation performed on the first control. The first application is a gallery application or a map application. For example, when the first application is a gallery application, the application interface of the first application can be... Figure 10a In the interface shown, the first control can be Figure 10a The heat map function control shown, used to trigger entry into the road heat map mode, can have the following first interface: Figure 10b The interface shown is as follows. When the first application is a map application, the first interface can be... Figure 12a The interface shown.

[0283] The specific execution process of each of the above steps can be referred to the relevant description in the above embodiments, and will not be repeated here.

[0284] Based on the above embodiments and the same concept, this application also provides a terminal device, which is used to implement the method for generating heat maps provided in this application. Figure 14 As shown, the terminal device 1400 may include: a display screen 1401, a memory 1402, one or more processors 1403, and one or more computer programs (not shown). These devices may be coupled via one or more communication buses 1404.

[0285] The display screen 1401 is used to display images, videos, application interfaces, and other related user interfaces. The memory 1402 stores one or more computer programs (code), which include computer instructions; one or more processors 1403 call the computer instructions stored in the memory 1402, causing the terminal device 1400 to execute the method for generating heat maps provided in this application embodiment.

[0286] In a specific implementation, the memory 1402 may include high-speed random access memory and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 1402 may store an operating system (hereinafter referred to as the system), such as Android, iOS, Windows, or Linux embedded operating systems. The memory 1402 can be used to store implementation programs of the embodiments of this application. The memory 1402 may also store network communication programs, which can be used to communicate with one or more additional devices, one or more user devices, or one or more network devices. The one or more processors 1403 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits used to control the execution of programs in the scheme of this application.

[0287] It needs to be explained that, Figure 14 This is merely one implementation of the terminal device 1400 provided in this application embodiment. In actual applications, the terminal device 1400 may include more or fewer components, which is not limited here.

[0288] Based on the above embodiments and the same concept, this application also provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method provided in the above embodiments.

[0289] Based on the above embodiments and the same concept, this application also provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer performs the method provided in the above embodiments.

[0290] The methods provided in this application can be implemented entirely or partially through software, hardware, firmware, or any combination thereof. When implemented in software, they can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be magnetic media (e.g., floppy disk, hard disk, magnetic tape), optical media (e.g., digital video disc (DVD), or semiconductor media (e.g., SSD), etc.

[0291] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A method for generating heat maps, applied to a terminal device, characterized in that, The method includes: Obtain the first image and the first shooting position corresponding to the first image; Obtain a first map and the location of a first road in the first map that is associated with the first shooting location; A first weight is determined based on the first shooting location and the first road location; wherein, the first weight is negatively correlated with the distance between the first shooting location and the first road location; Obtain the first thermal value corresponding to the first shooting location; Based on the first weight and the first thermal value, determine the second thermal value corresponding to the first road location; Based on the second thermal value, determine the first thermal information corresponding to the first road location; A first heat map is generated based on the first map and the first heat information corresponding to the location of the first road.

2. The method as described in claim 1, characterized in that, The method further includes: The first interface is displayed, which includes the first heat map and a first navigation route from the first target location to the second target location.

3. The method as described in claim 2, characterized in that, The first road location is on the first navigation route; the method further includes: Obtain a first distance between a first location and a first road location; the first location is the location of the terminal device on the first navigation route. If the first distance is less than or equal to a set first distance threshold, a first prompt message is displayed. The first prompt message is used to indicate that the terminal device is about to pass through or is passing through the first road location.

4. The method as described in claim 3, characterized in that, The thermal value corresponding to the thermal information of the first road location is greater than the preset thermal value.

5. The method according to any one of claims 2 to 4, characterized in that, Before or after displaying the first interface, the method further includes: Receive the first operation of selecting the first road location; In response to the received first operation, a second interface is displayed, the second interface containing information for indicating a first recommended location; wherein the distance between the first recommended location and the first road location is less than or equal to a set second distance threshold.

6. The method as described in claim 5, characterized in that, The first recommended location can be any of the following: scenic spot, parking spot, or photo spot.

7. The method as described in claim 5, characterized in that, Before displaying the first interface, the method further includes: Launch the first application and display its application interface, which contains the first control. The first display interface includes: In response to an operation performed on the first control, the first interface is displayed.

8. The method as described in claim 7, characterized in that, The first application is a gallery application or a map application.

9. The method as described in claim 5, characterized in that, The second interface also includes a second control corresponding to the first recommended position; the method further includes: In response to an operation performed on the second control, a second navigation route is displayed to navigate to the first recommended location.

10. The method as described in claim 5, characterized in that, Before displaying the first interface, the method further includes: The second interface is displayed, wherein the second interface also includes a second control corresponding to the first recommended position; The first interface is displayed, which includes the first heat map and a first navigation route from the first target location to the second target location, specifically including: The system receives an operation applied to the second control and displays the first interface, which includes the first heat map and a first navigation route from the first target location to the first recommended location.

11. The method as described in claim 5, characterized in that, The second interface also includes: a first recommended image corresponding to the first recommended position; The method further includes: In response to the received second operation, the shooting parameters of the first recommended image are obtained, and the shooting interface is displayed; In response to the operation that triggers the capture of an image, an image is captured based on the capture parameters of the first recommended image.

12. The method as described in claim 11, characterized in that, The second operation is an operation performed on the third control corresponding to the first recommended image.

13. The method as described in claim 5, characterized in that, The second interface also includes: the identification information of the first image; The method further includes: The operation of receiving the identification information applied to the first image is used to display a third interface, which contains the first image.

14. The method according to any one of claims 1 to 4, characterized in that, Before generating the first heat map based on the first map and the first heat information corresponding to the first road location, the method further includes: Obtain the second image and the second shooting position corresponding to the second image; Obtain the location of the second road in the first map that is associated with the second shooting location; Based on the second shooting location and the second road location, determine the second thermal information corresponding to the second road location; The step of generating a first heat map based on the first map and the first heat information corresponding to the first road location includes: The first heat map is generated based on the first map, the first heat information corresponding to the first road location, and the second heat information corresponding to the second road location.

15. The method as described in claim 14, characterized in that, The location of the first road is the same as the location of the second road; The step of generating the first heat map based on the first map, the first heat information corresponding to the first road location, and the second heat information corresponding to the second road location includes: Based on the first thermal information and the second thermal information, determine the third thermal information corresponding to the location of the first road; The first heat map is generated based on the third heat information corresponding to the first map and the first road location.

16. The method as described in claim 1, characterized in that, The method further includes: Based on the first weight and the first thermal value, determine the third thermal value corresponding to the first shooting position; Obtain the second weight corresponding to the first shooting position as set; Based on the third thermal value and the second weight, determine the fourth thermal value corresponding to the first shooting position; The fourth thermal information corresponding to the first shooting position is determined based on the fourth thermal value; A second heat map is generated based on the first heat map and the fourth heat information corresponding to the first shooting location.

17. The method as described in claim 16, characterized in that, Determining the third thermal value corresponding to the first shooting position based on the first weight and the first thermal value includes: The third thermal value is determined according to the following formula: Wherein, X is the third thermal value, K is a set coefficient, and the... For the first weight, the This is the first thermal value.

18. The method according to any one of claims 1 to 4, characterized in that, The first road location is within a set size area centered on the first shooting location.

19. The method as described in claim 18, characterized in that, The first road location is the road location closest to the first shooting location within the area of ​​the set size.

20. A terminal device, characterized in that, The terminal device includes a display screen, a memory, and one or more processors; The memory is used to store computer program code, which includes computer instructions; when the computer instructions are executed by the one or more processors, the terminal device performs the method as described in any one of claims 1 to 19.

21. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on a terminal device, causes the terminal device to perform the method as described in any one of claims 1 to 19.

Citation Information

Patent Citations

  • Information prompt method, mobile terminal and computer readable storage medium

    CN107450996A

  • Picture photographing and photographing parameter providing methods and apparatuses

    CN108174097A

  • Providing geographic locations related to user interests

    CN109074358A