Picture sharing method and electronic device

CN116561085BActive Publication Date: 2026-09-04HUAWEI TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202210109290.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-01-28
Publication Date
2026-09-04
Estimated Expiration
2042-01-28

AI Technical Summary

Technical Problem

[0004]然而,相关技术中,电子设备2显示多张图片的方式,无法让用户切身实地的体验拍摄多张图片时的过程,对用户制定游览多张图片对应的城市/地点/景点的路线不具有借鉴价值

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116561085B_ABST
    Figure CN116561085B_ABST
Patent Text Reader

Abstract

The application provides a picture sharing method and an electronic device. The method is applied to a first electronic device, and the method comprises the following steps: when it is determined that multiple pictures need to be shared, determining multiple segmented routes and picture information of pictures associated with each segmented route based on picture information of the multiple pictures and a tour route when a user takes the multiple pictures; generating a to-be-shared data packet based on the multiple segmented routes and the picture information of the pictures associated with each segmented route; and transmitting the to-be-shared data packet to a second electronic device, so that the second electronic device analyzes the to-be-shared data packet and displays the multiple segmented routes and the pictures associated with each segmented route. Thus, by fusing the tour route and the multiple pictures in terms of time and position, the multiple pictures can be displayed in a segmented manner according to the tour route, and the user can intuitively and immersively browse the multiple pictures according to the tour route.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of electronic technology, and more particularly to a method for sharing images and an electronic device. Background Technology

[0002] With the continuous development of the Internet and electronic devices, multiple images can be shared between electronic devices, satisfying users' social needs for sharing images.

[0003] In related technologies, user 1 often uses electronic device 1 to share multiple pictures taken while visiting a city / location / attraction with user 2's electronic device 2, enabling electronic device 2 to share image data and shooting locations of multiple pictures and support querying each picture on an electronic map.

[0004] However, in the relevant technologies, the way electronic device 2 displays multiple pictures does not allow users to personally experience the process of taking multiple pictures, and it is not of any reference value for users to plan routes to visit the cities / locations / attractions corresponding to multiple pictures. Summary of the Invention

[0005] This application provides a method for sharing images and an electronic device that integrates a tour route with multiple images in terms of time and location, enabling segmented display of multiple images according to the tour route. This allows users to intuitively and immersively browse multiple images according to the tour route.

[0006] In one aspect, this application provides a method for sharing images, applied to a first electronic device.

[0007] The method includes:

[0008] When it is determined that multiple images need to be shared, based on the image information of the multiple images and the user's tour route when taking the multiple images, multiple segmented routes and the image information of the associated images of each segmented route are determined. The image information of the multiple images includes at least the image data, shooting time and shooting location of each image.

[0009] Based on the image information of multiple segmented routes and the associated images of each segmented route, a data package to be shared is generated;

[0010] The data packet to be shared is transmitted to the second electronic device so that the second electronic device can parse the data packet to be shared and display multiple segmented routes and the associated image of each segmented route.

[0011] Using the image sharing method provided in the first aspect, when the first electronic device determines that multiple images need to be shared, it can determine multiple segmented routes and image information of associated images for each segmented route based on the image information of the multiple images and the user's browsing route when taking the multiple images. The browsing route can be integrated with the multiple images in terms of time and location. Based on the image information of the multiple segmented routes and associated images for each segmented route, the first electronic device can generate a data packet to be shared, facilitating storage and transmission. The first electronic device can transmit the data packet to be shared to a second electronic device, providing a new way of image sharing and enhancing users' interest and enthusiasm for sharing images. Consequently, the second electronic device parses the data packet to be shared to obtain the image information of the multiple segmented routes and associated images for each segmented route. Based on the image information of the multiple segmented routes and associated images for each segmented route, the second electronic device can display the multiple segmented routes and associated images for each segmented route, allowing for segmented display of multiple images according to the browsing route. This facilitates an intuitive and immersive browsing experience for users following the browsing route.

[0012] In one possible design, the method also includes:

[0013] Obtain navigation information for the user's vehicle while multiple images are being taken;

[0014] Based on the vehicle's navigation information, determine the vehicle's driving route;

[0015] The driving route of the vehicle will be used as the tour route.

[0016] Thus, the first electronic device can fuse the vehicle's driving route with multiple images in terms of time and location to generate a data packet to be shared.

[0017] In one possible design, the method also includes:

[0018] Obtain movement information of the device used by the user when taking multiple pictures;

[0019] Filter out invalid information from the device's movement information to obtain the filtered device movement information;

[0020] By fitting the filtered device movement information with the navigation information of the standard route, a tour route is obtained.

[0021] Therefore, the first electronic device can, based on the valid movement route of the device, fuse the movement route of the device with multiple images in terms of time and location to generate a data packet to be shared.

[0022] In one possible design, the method also includes:

[0023] Based on the image information of multiple images, image filtering and location aggregation are performed on multiple images to obtain multiple points of interest.

[0024] By fitting multiple points of interest for photography using navigation information from standard routes, a tour route is obtained.

[0025] In one possible design, a tour route is obtained by fitting multiple points of interest (POIs) using navigation information from a standard route, including:

[0026] Based on the time of each shooting point of interest, the time of multiple shooting points of interest is averaged to obtain the median time of multiple shooting points of interest.

[0027] Based on the intermediate time of multiple shooting points of interest, the time ordering of multiple shooting points of interest is obtained;

[0028] Based on the temporal order of multiple points of interest (POIs), the starting and ending positions are determined by using the positions of two POIs that are adjacent in time. The routes between these POIs are calculated using navigation information from standard routes, and the multiple routes are then merged to obtain the tour route.

[0029] Therefore, the first electronic device can fuse the tour route obtained from multiple images with the time and location of the multiple images to generate a data packet to be shared.

[0030] In one possible design, based on image information from multiple images and the user's browsing route when taking multiple images, multiple segmented routes and image information of associated images for each segmented route are determined, including:

[0031] Based on the image information of multiple images, image filtering and location aggregation are performed on multiple images to obtain multiple points of interest.

[0032] Based on multiple points of interest for shooting, the tour route is divided, and the starting and ending positions of every two adjacent points of interest for shooting are used as the starting and ending positions to obtain multiple segmented routes.

[0033] Based on the image information of multiple images, each segment of the route is associated with multiple images to obtain the image information of the associated images for each segment of the route.

[0034] Therefore, by taking the points of interest as the starting and ending positions, the first electronic device can determine multiple segmented routes and the image information of the associated images for each segmented route.

[0035] In one possible design, based on image information from multiple images, image filtering and location aggregation are performed on the multiple images to obtain multiple points of interest, including:

[0036] Images that were taken in the same area are grouped together to obtain multiple groups of images;

[0037] Based on the image information of each group of images, the location and time of multiple groups of images are averaged to obtain a shooting point of interest corresponding to each group of images, as well as the location and time of each shooting point of interest.

[0038] In one possible design, when the tour route is obtained from a vehicle driven by the user while taking multiple images, the method further includes:

[0039] The parking locations along the tour route will be designated as dividing points.

[0040] Determine whether there are any points of interest within the area to which the dividing point belongs;

[0041] If there are points of interest within the area to which the dividing point belongs, the dividing point will be designated as a new point of interest.

[0042] If there is no point of interest to be photographed within the area to which the dividing point belongs, the dividing point is determined not to be a point of interest to be photographed.

[0043] Therefore, the first electronic device can quickly and accurately acquire multiple points of interest for shooting.

[0044] In one possible design, the method further includes, before generating the data packet to be shared:

[0045] Displays multiple segmented routes and associated images for each segmented route.

[0046] This allows users to preview the effect of multiple images being displayed according to the tour route.

[0047] In one possible design, the start and end positions of each segmented route are two temporally adjacent points of interest (POIs). Each POI is obtained based on image information from multiple images, through image filtering and location aggregation. The display then shows multiple segmented routes and associated images for each segmented route, including:

[0048] In the electronic map, each segmented route is displayed between two adjacent points of interest (POIs) using lines with arrows. The arrows on each line point from the earlier POI to the later POI. An icon for the associated image of each segmented route is displayed within the area of ​​each POI.

[0049] This provides a possible way to display multiple images and tour routes.

[0050] In one possible design, the method also includes:

[0051] Reverse geocoding is performed on the shooting locations of the associated images for each segmented route to determine the location name of each point of interest.

[0052] The location name of each point of interest is displayed within the area to which it belongs.

[0053] This allows users to quickly identify each point of interest for shooting.

[0054] In one possible design, the method also includes:

[0055] Upon receiving an action on the icon of an associated image for a segmented route, a user interface is displayed, which allows browsing each image in the associated images of the segmented route.

[0056] Therefore, in addition to displaying multiple pictures and tour routes, it can also display related pictures of individual points of interest, achieving the effect of on-site navigation.

[0057] In one possible design, when a photo album application is installed in the first electronic device, the method further includes:

[0058] Display a control within a user interface of the photo album application;

[0059] After receiving the operation triggered on the control, it is determined that multiple images need to be shared.

[0060] This provides an entry point to trigger the first electronic device to share multiple images using a new image-sharing method.

[0061] Secondly, this application provides a method for sharing images, applied to a second electronic device.

[0062] The method includes:

[0063] The data packet to be shared is obtained from the first electronic device. The data packet to be shared is generated by the first electronic device based on the image information of multiple segmented routes and the associated images of each segmented route. The image information of multiple segmented routes and the associated images of each segmented route is determined by the first electronic device based on the image information of multiple images and the tour route when the user takes multiple images. The image information of multiple images includes at least the image data, shooting time and shooting location of each image.

[0064] The data packet to be shared is parsed to obtain multiple segmented routes and image information of the associated images of each segmented route;

[0065] Based on the image information of multiple segmented routes and the associated images of each segmented route, the system displays multiple segmented routes and the associated images of each segmented route.

[0066] Using the image sharing method provided in the second aspect, the second electronic device can display multiple segmented routes and associated images of each segmented route based on image information. It can display multiple images in segments according to the tour route, which is beneficial for users to intuitively and immersively browse multiple images according to the tour route.

[0067] In one possible design, the start and end positions of each segmented route are two temporally adjacent points of interest (POIs). Each POI is obtained based on image information from multiple images, through image filtering and location aggregation. The display then shows multiple segmented routes and associated images for each segmented route, including:

[0068] This allows users to browse multiple images according to a tour route.

[0069] In the electronic map, each segmented route is displayed between two adjacent points of interest (POIs) using lines with arrows. The arrows on each line point from the earlier POI to the later POI. An icon for the associated image of each segmented route is displayed within the area of ​​each POI.

[0070] This provides a possible way to display multiple images and tour routes.

[0071] In one possible design, the method also includes:

[0072] Reverse geocoding is performed on the shooting locations of the associated images for each segmented route to determine the location name of each point of interest.

[0073] The location name of each point of interest is displayed within the area to which it belongs.

[0074] This allows users to quickly identify each point of interest for shooting.

[0075] In one possible design, the method also includes:

[0076] Upon receiving an action on the icon of an associated image for a segmented route, a user interface is displayed, which allows browsing each image in the associated images of the segmented route.

[0077] Therefore, in addition to displaying multiple pictures and tour routes, it can also display related pictures of individual points of interest, achieving the effect of on-site navigation.

[0078] In one possible design, when a photo album application is installed on the second electronic device, multiple segmented routes and associated images for each segmented route are displayed, including:

[0079] Display multiple segmented routes and associated images for each segmented route within a single user interface of the photo album application.

[0080] This provides an entry point for triggering a second electronic device to display multiple images using a new image-sharing method.

[0081] Thirdly, this application provides an electronic device, including: a memory and a processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory, causing the electronic device to execute the image sharing method in the first aspect and any possible design of the first aspect, and / or causing the electronic device to execute the image sharing method in the second aspect and any possible design of the second aspect.

[0082] Fourthly, this application provides a chip system applied to an electronic device including a memory, a display screen, and a sensor; the chip system includes a processor; when the processor executes computer instructions stored in the memory, the electronic device executes the image sharing method in the first aspect and any possible design of the first aspect, and / or, the electronic device executes the image sharing method in the second aspect and any possible design of the second aspect.

[0083] Fifthly, this application provides a computer-readable storage medium having a computer program stored thereon, the computer program being processed by a processor to cause an electronic device to implement the image sharing method in the first aspect and any possible design of the first aspect when executed, and / or to cause the electronic device to implement the image sharing method in the second aspect and any possible design of the second aspect when executed.

[0084] Sixthly, this application provides a computer program product, comprising: execution instructions stored in a readable storage medium, at least one processor of an electronic device being able to read the execution instructions from the readable storage medium, the at least one processor executing the execution instructions causing the electronic device to implement the image sharing method in the first aspect and any possible design of the first aspect, and / or causing the electronic device to implement the image sharing method in the second aspect and any possible design of the second aspect. Attached Figure Description

[0085] Figure 1 Signaling interaction diagram of an image sharing method provided in an embodiment of this application;

[0086] Figures 2A-2B A schematic diagram illustrating the effect of a route provided in one embodiment of this application;

[0087] Figures 3A-3B A schematic diagram illustrating the effect of a route provided in one embodiment of this application;

[0088] Figures 4A-4B A schematic diagram illustrating the effect of a route provided in one embodiment of this application;

[0089] Figure 5 A schematic diagram illustrating the effect of a route provided in one embodiment of this application;

[0090] Figure 6 A schematic flowchart illustrating an embodiment of the image sharing method provided in this application;

[0091] Figures 7A-7B This is a schematic diagram illustrating the effect of multiple image aggregation according to an embodiment of this application;

[0092] Figure 8 This is a schematic diagram illustrating the effect of multiple image aggregation according to an embodiment of this application;

[0093] Figures 9A-9B This application provides a schematic diagram illustrating the effect of displaying multiple images in one embodiment.

[0094] Figure 10 This is a schematic diagram of the structure of an electronic device provided in one embodiment of this application;

[0095] Figure 11 This is a software structure block diagram of an electronic device provided in one embodiment of this application. Detailed Implementation

[0096] In this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c alone can mean: a alone, b alone, c alone, a combination of a and b, a combination of a and c, a combination of b and c, or a, b, and c, where a, b, and c can be single or multiple. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance. The terms “center,” “longitudinal,” “lateral,” “up,” “down,” “left,” “right,” “front,” and “rear,” etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this application.

[0097] This application provides a method and electronic device for sharing images. It can integrate a user's tour route when taking multiple pictures into the multiple pictures to generate a data package to be shared. This facilitates sharing the tour route and multiple pictures with other users, providing a new way of sharing images and enhancing users' interest and enthusiasm in sharing images. Based on the data package to be shared, multiple pictures can be displayed on an electronic map in segments according to the tour route, realizing a real-world visual browsing of multiple pictures. This allows users to intuitively and immersively browse multiple pictures according to the tour route.

[0098] In addition, based on the data package to be shared, it is also possible to conduct on-site navigation tours of associated images of individual shooting locations in the tour route, which is conducive to efficient and accurate experience based on the existing experience of the sharing users.

[0099] Based on the foregoing description, the following embodiments of this application will take a device with multiple electronic devices as an example, and, in conjunction with the accompanying drawings and application scenarios, will elaborate on the image sharing method provided by this application.

[0100] For ease of explanation, the multiple electronic devices in this application are illustrated using the first electronic device and the second electronic device as examples. The first electronic device and the second electronic device are communicatively connected. The communication connection mentioned in this application may include wired communication connections and / or wireless communication connections. Wired communication connections may employ coaxial cable, optical fiber, digital subscriber line (DSL), etc., while wireless communication connections may employ Bluetooth, infrared, Wi-Fi, microwave, etc.

[0101] Please see Figure 1 , Figure 1 This is a signaling interaction diagram of an image sharing method provided in an embodiment of this application.

[0102] like Figure 1 As shown, the image sharing method of this application may include:

[0103] S101. When the first electronic device determines that multiple pictures need to be shared, it determines multiple segmented routes and the image information of the associated pictures of each segmented route based on the image information of the multiple pictures and the user's tour route when taking the multiple pictures. The image information of the multiple pictures includes at least the image data, shooting time and shooting location of each picture.

[0104] The multiple images mentioned in this application can include two or more images, which typically represent photos taken by a user while visiting one or more attractions / locations in a city. For example, multiple images could be photos taken by a user while visiting various attractions in a city.

[0105] In addition to the image data, shooting time and shooting location of each image, the image information of multiple images can also include the shooting device identifier of each image. The shooting device identifier can be represented by the device model or device name, such as device ID.

[0106] The first electronic device may determine that it needs to share multiple pictures after receiving an operation from the user on the first electronic device, or it may determine that it needs to share multiple pictures after receiving a request from the second electronic device. This application does not limit this.

[0107] In some embodiments, when a photo album application is installed on the first electronic device, the first electronic device may display a control in a user interface of the photo album application. This control is used to trigger the first electronic device to initiate a photo sharing function. This application does not limit the specific implementation of the user interface and the control.

[0108] Upon receiving an operation triggered on the control, the first electronic device can determine that multiple images need to be shared. The operation triggered on the control may include, but is not limited to, clicks, double-clicks, and long presses. Therefore, the first electronic device can execute step S101.

[0109] It should be noted that, in addition to photo album applications, system applications or third-party applications installed on the first electronic device can also activate the image sharing function of the first electronic device, enabling the first electronic device to execute the content of embodiment S101.

[0110] Therefore, when it is determined that multiple images need to be shared, the first electronic device can obtain image information and browsing routes for multiple images.

[0111] Typically, electronic devices store not only image data but also the time and location of the image capture. For example, image files may store extended information (such as EXIF ​​information) in formats like JPG. This extended information records image attribute information and image data, and the attribute information may include, but is not limited to, the camera's identifier, the capture time, and the capture location.

[0112] Based on the above description, the first electronic device can obtain image information of multiple images by parsing image files, namely the image data, shooting time, and shooting location of each image.

[0113] In addition to acquiring image information from multiple pictures, the first electronic device can also determine the tour route. The tour route is the actual route taken by the user when capturing the multiple pictures.

[0114] Therefore, based on the image information of multiple images and the tour route, the first electronic device can divide the tour route into multiple segmented routes and determine the image information of the associated images for each segmented route.

[0115] In conclusion, the first electronic device is well-positioned to provide a new way of sharing images.

[0116] S102, the first electronic device generates a data packet to be shared based on the image information of multiple segmented routes and the associated images of each segmented route.

[0117] The first electronic device can generate a data packet to be shared based on multiple segmented routes and image information associated with each segmented route, using various methods. This application does not limit the specific implementation method of the data packet to be shared.

[0118] In some embodiments, the first electronic device can store navigation information for each segment of the route and the association between each segment and associated images in a configuration file. The first electronic device can then obtain image information containing multiple images and a data packet to be shared, facilitating data storage and transmission.

[0119] S103, The first electronic device transmits the data packet to be shared to the second electronic device.

[0120] The first electronic device can directly send the data packet to be shared to the second electronic device.

[0121] Alternatively, the first electronic device can send the data packet to be shared to a sharing platform (such as a server or other electronic device). The sharing platform is used for publicly viewing the data packet. Thus, the second electronic device can obtain the data to be shared from the sharing platform, achieving the purpose of the first electronic device transmitting the data packet to the second electronic device.

[0122] S104. The second electronic device parses the data packet to be shared to obtain multiple segmented routes and image information of the associated images of each segmented route.

[0123] After obtaining the data packet to be shared, the second electronic device can parse the data packet to be shared according to the generation method of the data packet to be shared in S102 to obtain multiple segmented routes and image information of the associated images of each segmented route.

[0124] In some embodiments, when the data packet to be shared includes image information of multiple images and a configuration file, the second electronic device can read the image information of multiple images and can read the navigation information of multiple segmented routes and the association between each segmented route and the associated image from the configuration file.

[0125] Therefore, based on the image information of multiple images, the navigation information of multiple segmented routes, and the association between each segmented route and the associated images, the second electronic device can associate multiple segmented routes with multiple images to obtain the image information of multiple segmented routes and the associated images of each segmented route.

[0126] S105, the second electronic device displays multiple segmented routes and their associated images based on image information of each segmented route and its associated images.

[0127] The second electronic device can display multiple segmented routes and their associated images based on image information of each segmented route, thus enabling the visualization of multiple images using segmented routes and associated images.

[0128] In some embodiments, when a photo album application is installed on the second electronic device, the second electronic device can display multiple segmented routes and associated images for each segmented route in a user interface of the photo album application. This application does not limit the specific implementation of this user interface. For example, the user interface can be used to display an electronic map. Thus, the second electronic device can display multiple segmented routes and associated images for each segmented route on the electronic map, facilitating users to browse multiple images according to the tour route on the electronic map.

[0129] It should be noted that, in addition to photo album applications, system applications or third-party applications installed on the second electronic device can also display multiple segmented routes and associated images for each segmented route.

[0130] The image sharing method of this application, when a first electronic device determines that multiple images need to be shared, determines multiple segmented routes and image information of associated images for each segmented route based on the image information of the multiple images and the user's browsing route when taking the multiple images. This allows for the fusion of the browsing route with the multiple images in terms of time and location. Based on the image information of the multiple segmented routes and associated images for each segmented route, the first electronic device can generate a data packet to be shared, facilitating storage and transmission. The first electronic device can transmit the data packet to a second electronic device, providing a new way of sharing images and enhancing users' interest and enthusiasm for sharing images. The second electronic device parses the data packet to be shared, obtaining the image information of the multiple segmented routes and associated images for each segmented route. Based on the image information of the multiple segmented routes and associated images for each segmented route, the second electronic device can display the multiple segmented routes and associated images for each segmented route, allowing for segmented display of multiple images according to the browsing route. This facilitates an intuitive and immersive browsing experience for users following the browsing route.

[0131] Based on the foregoing description, the first electronic device may acquire the tour route in various ways, and the specific implementation method is not limited.

[0132] The following section details the specific implementation process of the first electronic device acquiring the tour route, using several different implementation methods.

[0133] In some embodiments, users often drive a vehicle while touring, and the vehicle's navigation information can accurately and completely record the user's tour route.

[0134] Based on the above description, the first electronic device can acquire navigation information of the vehicle driven by the user while taking multiple pictures. This application does not limit the specific implementation of the vehicle's navigation information. For example, the vehicle's navigation information can be a set of correspondences on electronic maps or latitude and longitude coordinates, and can be represented using methods such as tables, key-value pairs, or arrays.

[0135] For example, after a user finishes their tour, the vehicle can send its navigation information to the first electronic device. Alternatively, the vehicle can send its navigation information to the server, allowing the server to store the navigation information. The first electronic device can then retrieve the vehicle's navigation information from the server.

[0136] Therefore, based on the vehicle's navigation information, the first electronic device can determine the vehicle's driving route. This driving route can then be used as a tour route. Furthermore, the first electronic device can fuse the driving route with multiple images, combining time and location data to generate a data packet to be shared.

[0137] In other embodiments, when a user begins a tour, the device used by the user can turn on a switch to record the user's tour route while taking multiple pictures, so that the device can record the user's complete tour process.

[0138] The device can be a camera for taking multiple pictures, or it can be a user-carried device other than a camera; this application does not limit the scope of the application. For example, a user may carry a mobile phone and a watch; the mobile phone can take multiple pictures, and the watch can record the travel route.

[0139] Based on the above description, the first electronic device can acquire the device's movement information. This movement information can be used to indicate the device's movement route. This application does not limit the specific implementation of the device's movement information. For example, the device's movement information can be a set of correspondences on an electronic map or latitude and longitude coordinates, and it can be represented using methods such as tables, key-value pairs, or arrays.

[0140] Because users may take photos at a fixed location or move around while taking photos, the device's movement path may detour. Therefore, the first electronic device can filter out invalid information from the device's movement data, obtaining filtered movement information to ensure its validity. Invalid information can be understood as movement data resulting from detours. This corrects the device's movement path.

[0141] Therefore, by fitting the filtered movement information of the first electronic device with navigation information from a standard route, the first electronic device can determine a tour route. Subsequently, the first electronic device can fuse the device's movement route with multiple images in terms of time and location to generate a data packet to be shared.

[0142] The navigation information for the standard route is publicly available, and it can be used to indicate the standard route on the electronic map. The standard route can be understood as a route obtained by navigating on the electronic map based on the starting and ending positions in the device's movement information.

[0143] Please see Figures 2A-2B , Figures 2A-2B This is a schematic diagram illustrating the effect of a route provided in one embodiment of this application.

[0144] like Figure 2A As shown, route 11 is the movement route of the device before correction, and part of route 11 within box a has detoured, and part of route 11 within box b has detoured.

[0145] like Figure 2B As shown, Route 12 is the corrected movement route of the device, i.e., the tour route. The part of Route 12 within box a corrects the detour phenomenon, and the part of Route 12 within box b corrects the detour phenomenon.

[0146] In summary, the first electronic device can obtain an accurate tour route by correcting the device's movement path.

[0147] The first electronic device can correct its movement path in various ways.

[0148] The following details the specific implementation of how the first electronic device can correct the device's movement path.

[0149] Method 1: Distance comparison of split routes

[0150] The first electronic device can progressively divide the device's movement route into segments and determine whether the ratio between the distance of each segment and the distance of the standard route exceeds a preset ratio (e.g., 2:1). Here, the standard route can be a route obtained by navigating on an electronic map using the starting and ending positions of each segment.

[0151] If the error exceeds the limit, the first electronic device can determine that the currently segmented route may contain detours. Therefore, the first electronic device needs to correct the currently segmented route, which can be replaced with a standard route.

[0152] If the distance is not exceeded, the first electronic device can continue to analyze the next segment of the route until the distance between the last segment of the route in the device's movement path and the standard route is compared.

[0153] Thus, the first electronic device can determine the corrected movement path of the device as the tour route.

[0154] Please see Figures 3A-3B , Figures 3A-3B This is a schematic diagram illustrating the effect of a route provided in one embodiment of this application.

[0155] like Figure 3A As shown, route 21 is the movement route of the device before correction, and line segment AB in route 21 is a segment of the movement route of the device before correction. Line segment AB in route 21 shows a detour.

[0156] like Figure 3B As shown, Route 22 is the corrected movement route of the device, i.e., the tour route, and line segment AB in Route 22 is a segment of the corrected movement route of the device. Line segment AB in Route 22 corrects the detour phenomenon.

[0157] Method 2: Filtering the range of points of interest during shooting

[0158] The first electronic device can identify points of interest (POIs) by determining the main locations where the user lingers during browsing based on the shooting location of each of multiple images. Thus, the first electronic device can obtain multiple POIs.

[0159] Since there is a high probability of detours at the stopping locations, the first electronic device can correct the route within the area (e.g., 500 meters) of each point of interest by combining it with a standard route, thus obtaining the corrected movement route of the device. Here, the standard route can be a route obtained by navigation on an electronic map, using two adjacent points of interest at different times as the starting and ending points.

[0160] Thus, the first electronic device can determine the corrected movement path of the device as the tour route.

[0161] Please see Figures 4A-4B , Figures 4A-4B This is a schematic diagram illustrating the effect of a route provided in one embodiment of this application.

[0162] like Figure 4A As shown, route 31 is the movement route of the device before correction, and the part of route 31 within frame c is the route within the area of ​​a shooting point of interest before correction. The part of route 31 within frame c shows a detour.

[0163] like Figure 4B As shown, route 32 is the corrected movement route of the device, i.e. the tour route, and the part of route 32 within frame c is the corrected route within the area to which the point of interest belongs. The part of route 32 within frame c corrects the detour phenomenon.

[0164] In other embodiments, the first electronic device can perform image filtering and location aggregation on the multiple images based on the image information of the multiple images to obtain multiple points of interest for shooting, as well as the location and time of each point of interest.

[0165] The point of interest (POI) can be determined based on the main shooting locations (i.e., the positions mentioned above) among multiple images. For example, if at least one of the multiple images exists within a preset range, the first electronic device can determine the center of the preset range as the location of the POI, and determine the shooting time of the POI based on the shooting time of at least one of the aforementioned images.

[0166] Therefore, the first electronic device can fit multiple points of interest (POIs) using a standard route, based on the location and time of each captured point of interest, to obtain a tour route. The first electronic device can then fuse the tour route obtained from multiple images with the images in terms of time and location to generate a data packet to be shared.

[0167] Here, the standard route can be understood as a route obtained by navigating on an electronic map, with each pair of adjacent points of interest (POIs) as the starting and ending points. The adjacent POIs mentioned in this application can be understood as a combination of multiple POIs arranged in chronological order from earliest to latest.

[0168] In some embodiments, the first electronic device can average the position and time of multiple points of interest (POIs) based on the position and time of each POI to obtain the median time of the multiple POIs. Based on the median time of the multiple POIs, the first electronic device can then sort the multiple POIs by time to obtain a time ordering relationship between the multiple POIs.

[0169] The temporal order of the multiple shooting points can be used to indicate the order of each point of interest among the multiple shooting points of interest, either in the order of early to late or in the order of late to early.

[0170] Therefore, the first electronic device calculates the route between two adjacent shooting points of interest based on the time sequence of multiple shooting points of interest, using the positions of every two shooting points of interest that are adjacent in time as the starting and ending positions, and merges multiple routes to obtain the tour route.

[0171] In summary, the first electronic device can obtain a tour route based on publicly available standard routes. Please refer to [link / reference]. Figure 5 , Figure 5 This is a schematic diagram illustrating the effect of a route provided in one embodiment of this application.

[0172] like Figure 5 As shown, segmented routes 41, 42, and 43 can be combined into a single tour route.

[0173] Segment route 41 is formed by connecting boxes d1 and d2, and the direction of segment route 41 is from box d1 to box d2. Segment route 42 is formed by connecting boxes d2 and d3, and the direction of segment route 42 is from box d2 to box d3. Segment route 43 is formed by connecting boxes d3 and d4, and the direction of segment route 43 is from box d3 to box d4.

[0174] Among them, the geometric center of frame d1 is the shooting point of interest A, the geometric center of frame d2 is the shooting point of interest B, the geometric center of frame d4 is the shooting point of interest C, and the geometric center of frame d5 is the shooting point of interest D.

[0175] Furthermore, the time sequence of shooting points of interest A, B, C, and D is as follows: the time of shooting point A is earlier than the time of shooting point B, the time of shooting point B is earlier than the time of shooting point C, and the time of shooting point C is earlier than the time of shooting point D.

[0176] Based on the description of S101 above, the first electronic device can use various methods to determine multiple segmented routes and image information of associated images for each segmented route based on image information of multiple images and the tour route.

[0177] Please see Figure 6 , Figure 6 This is a schematic flowchart illustrating an embodiment of the image sharing method provided in this application.

[0178] like Figure 6 As shown, the image sharing method of this application may include:

[0179] S201. The first electronic device performs image filtering and location aggregation on multiple images based on the image information of multiple images to obtain multiple points of interest for shooting.

[0180] The specific methods for capturing points of interest can be found in the content mentioned above, and will not be repeated here.

[0181] In some embodiments, the first electronic device may employ a density-based clustering algorithm (such as DBSCAN (density-based spatial clustering of applications with noise)) to group images whose shooting locations are within the same region based on the shooting location of each image in multiple images, thereby achieving image aggregation. The first electronic device can then obtain multiple groups of images centered on different regions, where each group of images consists of images within the same region.

[0182] This application does not limit the size of the region corresponding to each group of images. Furthermore, the size of the region corresponding to each group of images may be the same or different.

[0183] Therefore, based on the image information of each group of images, the first electronic device can perform position and time averaging on multiple groups of images to determine a shooting point of interest corresponding to each group of images, as well as the position and time of each shooting point of interest.

[0184] Below, in conjunction with Figures 7A-7B This section details the specific process by which the first electronic device acquires multiple points of interest for shooting.

[0185] Please see Figures 7A-7B , Figures 7A-7B This is a schematic diagram illustrating the effect of multiple image aggregation according to an embodiment of this application. For ease of explanation, the following multiple images are used as an example: 1.jpg, 2.jpg, 3.jpg, 4.jpg, 5.jpg, 6.jpg, 7.jpg, 8.jpg, 9.jpg, 10.jpg, 11.jpg, and 12.jpg.

[0186] like Figure 7A As shown, 1.jpg was taken at the geometric center of frame 11, 2.jpg was taken at the geometric center of frame 12, 3.jpg was taken at the geometric center of frame 13, and 4.jpg was taken at the geometric center of frame 14.

[0187] Boxes 11, 12, 13, and 14 are all within region a1. Therefore, 1.jpg, 2.jpg, 3.jpg, and 4.jpg can be considered as a group. This group of images corresponds to the shooting of point of interest A. The shooting time of point of interest A can be the middle time of this group of images, and the shooting location of point of interest A can be the center of region a1.

[0188] The image 5.jpg was taken from the geometric center of frame 21, the image 6.jpg was taken from the geometric center of frame 22, and the image 7.jpg was taken from the geometric center of frame 23.

[0189] Boxes 21, 22, and 23 are all within region a2. Therefore, 5.jpg, 6.jpg, and 7.jpg can be considered a group. This group of images corresponds to the shooting of point of interest B. The shooting time of point of interest B can be the middle time of this group of images, and the shooting location of point of interest B can be the center of region a2.

[0190] The image for 8.jpg was taken at the geometric center of frame 31, the image for 9.jpg was taken at the geometric center of frame 32, and the image for 10.jpg was taken at the geometric center of frame 13.

[0191] Boxes 31, 32, and 33 are all within region a3. Therefore, 8.jpg, 9.jpg, and 10.jpg can be considered as a group. This group of images corresponds to the point of interest C. The time when point of interest C was captured can be the middle time of this group of images, and the position of point of interest C can be the center of region a3.

[0192] The image for 11.jpg was taken at the geometric center of frame 41, and the image for 12.jpg was taken at the geometric center of frame 42.

[0193] Both boxes 41 and 42 are within region a4. Therefore, 11.jpg and 12.jpg can be considered as a group. This group of images corresponds to the point of interest D. The time when point of interest D was captured can be the middle time of this group of images, and the position of point of interest D can be the center of region a4.

[0194] Among them, the sizes of regions a1, a2, a3 and a4 are different.

[0195] In summary, the first electronic device can obtain multiple points of interest for shooting, as well as the location and time of each point of interest.

[0196] In addition to capturing the time and location of points of interest, the first electronic device can also perform reverse geocoding analysis on the capture locations of the associated images for each segment of the route to determine the location name of each captured point of interest. Reverse geocoding and geocoding are the inverse processes of each other.

[0197] Therefore, the location and time of each point of interest can be stored in the manner shown in Table 1.

[0198] For ease of explanation, in Table 1, ... Figures 7A-7B The following examples illustrate shooting points of interest A, B, C, and D.

[0199] Table 1

[0200]

[0201] Additionally, vehicles typically exhibit both driving and parked states. When the tour route represents the vehicle's driving path, the route doesn't necessarily indicate whether the vehicle is parked. However, when the vehicle is parked, the user might have taken a picture and could set that location as a point of interest.

[0202] Considering that the above method of dividing a group of images only takes into account the shooting position of the images, the first electronic device can check whether the parking position when the vehicle is in a parking state is a shooting point of interest after obtaining multiple shooting points of interest.

[0203] In some embodiments, the first electronic device, based on image information from multiple images, can determine a parking location as a dividing point when an image of the parking location exists along the tour route. Here, a parking location along the tour route can be understood as the location of a vehicle when it is parked.

[0204] Therefore, the first electronic device can determine whether there is a point of interest to be photographed within the area to which the segmentation point belongs.

[0205] When a point of interest exists within the area of ​​the segmentation point, the first electronic device can determine that the user took the picture while the vehicle was parked. Therefore, the first electronic device can identify the segmentation point as a newly added point of interest.

[0206] Therefore, the location of the newly added point of interest is the location of the dividing point, and the location of the newly added point of interest is the time of the dividing point (i.e., the parking time).

[0207] If no point of interest is captured within the area of ​​the segmentation point, the first electronic device can determine that no image was taken when the vehicle was parked. Therefore, the first electronic device can determine that the segmentation point is not a point of interest.

[0208] S202, the first electronic device divides the tour route based on multiple shooting points of interest, and uses the positions of every two shooting points of interest that are adjacent in time as the starting and ending positions to obtain multiple segmented routes.

[0209] The first electronic device divides the tour route based on the time sequence of multiple shooting points of interest, resulting in multiple segmented routes. It then associates the multiple shooting points of interest with the multiple segmented routes by using the positions of every two time-adjacent shooting points of interest as the start and end positions, thus obtaining multiple segmented routes.

[0210] The multiple segmented routes start at the earliest shooting point of interest among the multiple shooting points of interest and end at the latest shooting point of interest among the multiple shooting points of interest.

[0211] Understandably, when the earliest point of interest among multiple shooting points overlaps with the starting position of the tour route, the starting position of the multiple segmented routes becomes the starting position of the tour route.

[0212] When the earliest point of interest among multiple points of interest does not overlap with the starting point of the tour route, the multiple segmented routes do not include the route between the earliest point of interest and the starting point of the tour route.

[0213] Similarly, when the latest shooting point of interest among multiple shooting points overlaps with the end point of the tour route, the end point of the multiple segmented routes is the end point of the tour route.

[0214] When the latest point of interest among multiple points of interest does not overlap with the end point of the tour route, the multiple segmented routes do not include the route between the latest point of interest and the end point of the tour route.

[0215] Below, in conjunction with Figure 8 This section details the specific implementation method of the first electronic device in segmenting tour routes based on captured points of interest.

[0216] Please see Figure 8 , Figure 8 This is a schematic diagram illustrating the effect of multiple image aggregation according to an embodiment of this application. For ease of explanation, Figure 8 The following example uses four points of interest shown in Table 1.

[0217] like Figure 8 As shown, Route 10 is the tour route. In order of time from morning to night, shooting points of interest A, B, C, and D divides Route 1 into three segments: Segment 11, Segment 12, and Segment 13.

[0218] Regarding segmented route 11, the starting position of segmented route 11 is shooting point of interest A, and the ending position of segmented route 11 is shooting point of interest B.

[0219] For segmented route 12, the starting position of segmented route 12 is shooting point of interest B, and the ending position of segmented route 12 is shooting point of interest C.

[0220] For segmented route 13, the starting position of segmented route 13 is shooting point of interest C, and the ending position of segmented route 13 is shooting point of interest D.

[0221] Among them, box 51 corresponds to shooting point of interest A, box 52 corresponds to shooting point of interest B, box 53 corresponds to shooting point of interest C, and box 54 corresponds to shooting point of interest D.

[0222] In summary, the first electronic device can segment the tour route based on the points of interest captured, resulting in multiple segmented routes.

[0223] S203. The first electronic device associates each segment of the route with multiple images based on the image information of multiple images, and obtains the image information of the associated images of each segment of the route.

[0224] The first electronic device can associate each segment of the route with multiple images based on the image information of multiple images, and obtain the image information of the associated images for each segment of the route.

[0225] Thus, the first electronic device can determine multiple segmented routes and image information of the associated images for each segmented route.

[0226] Based on the above description, the first electronic device can capture points of interest as the starting and ending positions, and fuse and store navigation information for multiple segmented routes and image information of associated images for each segment.

[0227] The data format for integrated storage is shown in Table 2. For ease of explanation, Table 2 uses... Figure 8 The three segmented routes shown are illustrated as examples.

[0228] Table 2

[0229]

[0230] Based on the aforementioned description of S105, the second electronic device can display multiple segmented routes and associated images of each segmented route based on multiple shooting points of interest.

[0231] In some embodiments, the second electronic device may display each segmented route in an electronic map using lines with arrows connecting each two time-adjacent points of interest. The direction of the arrow on each line is from the earlier point of interest to the later point of interest. An icon of the associated image for each segmented route is displayed in the area belonging to each point of interest.

[0232] The icons for the associated images of each segment of the route can be displayed in various ways. For example, the icon for any associated image of a segment of the route can be a thumbnail of each image in the associated images of that segment of the route, or it can be a stacked image of thumbnails of each image in the associated images of that segment of the route, or it can be a thumbnail of one image in the associated images of that segment of the route with a count badge displayed in the upper right corner of the thumbnail. The count badge is used to indicate the total number of images in the associated images of that segment of the route. This application does not limit this.

[0233] In addition to displaying multiple segmented routes and associated images for each segment, the second electronic device can also display the location name of each point of interest within its respective area. This allows users to promptly access information about points of interest on the second electronic device.

[0234] Furthermore, upon receiving an operation on the icon of an associated image for a segmented route, the second electronic device can display a user interface. This user interface can be used to browse each image in the associated images of the segmented route. The aforementioned operations may include, but are not limited to, clicks, double-clicks, long presses, etc. This application does not limit the specific implementation of this user interface.

[0235] This allows users to select individual points of interest for image browsing and on-site navigation on the second electronic device, providing the possibility of on-site navigation for browsing related images of a single point of interest, which is conducive to efficiently and accurately following the existing experience of the sharing user.

[0236] In some embodiments, the user interface may include a thumbnail of each image and a control. The control provides an entry point for browsing each image. This application does not limit the specific implementation of the control. Thus, upon receiving an operation triggered by the control, the second electronic device can play each image in turn, according to the chronological order in which they were captured.

[0237] Below, in conjunction with Figures 9A-9B The document details how the second electronic device can display multiple segmented routes and associated images for each segmented route based on multiple points of interest.

[0238] Please see Figures 9A-9B , Figures 9A-9B This is a schematic diagram illustrating the effect of displaying multiple images according to an embodiment of this application. For ease of explanation, Figures 9A-9B The following example illustrates the three segmented routes shown in Table 2 and the associated images for each segmented route.

[0239] like Figure 9A As shown, the second electronic device can display segmented routes 11, 12, and 13 on the electronic map using lines with arrows, display associated images of point of interest A using icon 21, associated images of point of interest B using icon 22, associated images of point of interest C using icon 23, associated images of point of interest D using icon 24, and display the location names of point of interest A (xx lake), point of interest B (xx forest), point of interest C (x1 building), and point of interest D (x2 building).

[0240] After receiving the operation indicated by icon 21, the second electronic device can display... Figure 9B An exemplary user interface is shown for browsing 1.jpg, 2.jpg, 3.jpg, and 4.jpg.

[0241] Figure 9B The user interface may include: area 11 and control 12. Area 11 can be used to display thumbnails of 1.jpg, 2.jpg, 3.jpg, and 4.jpg. Control 12 can be used to navigate to a user interface that loops through 1.jpg, 2.jpg, 3.jpg, and 4.jpg in ascending order of their shooting times.

[0242] Additionally, the user interface may include controls 13 and 14. Control 13 provides an entry point to the previous point of interest (POI) captured earlier than point A. Control 14 provides an entry point to the next POI captured later than point A.

[0243] Based on the foregoing description, before generating the data packet to be shared as shown in S102, the first electronic device can also display multiple segmented routes and associated images for each segmented route. The specific implementation of the above process can be found in the description of the second electronic device displaying multiple segmented routes and associated images for each segmented route, and will not be repeated here. Thus, the first electronic device can preview and display multiple images.

[0244] In addition, the first electronic device can also display the location name of each point of interest within its respective area. The specific implementation of this process can be found in the description of the second electronic device displaying the location name of each point of interest, and will not be repeated here. This allows the user to promptly obtain information about the points of interest from the first electronic device.

[0245] Additionally, upon receiving an operation on the icon of an associated image for a segmented route, the first electronic device can also display a user interface for browsing each image in the associated images of the segmented route. The aforementioned operation may include, but is not limited to, clicks, double-clicks, long presses, etc. This application does not limit the specific implementation of this user interface. Thus, the user can select a single point of interest for shooting and browsing / navigating images on the first electronic device.

[0246] Based on the above description, any electronic device can be a mobile phone (such as a foldable screen phone, a large screen phone, etc.), a tablet computer, a laptop computer, a wearable device, an in-vehicle device, an augmented reality (AR) / virtual reality (VR) device, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a smart TV, a smart screen, a high-definition TV, a 4K TV, a smart speaker, a smart projector, etc. This application does not impose any restrictions on the specific type of electronic device.

[0247] The following example uses a mobile phone as an example of an electronic device, combined with... Figure 10 This application describes the electronic equipment involved.

[0248] Figure 10 This is a schematic diagram of the structure of an electronic device provided in one embodiment of this application. Figure 10 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0249] It is understood that the structure illustrated in this application does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0250] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0251] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0252] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0253] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0254] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0255] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0256] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0257] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0258] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.

[0259] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0260] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0261] It is understood that the interface connection relationships between the modules illustrated in this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0262] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0263] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0264] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0265] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0266] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0267] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0268] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0269] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0270] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0271] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0272] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0273] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0274] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0275] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0276] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0277] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0278] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0279] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0280] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0281] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0282] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.

[0283] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0284] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0285] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0286] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0287] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0288] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0289] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0290] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0291] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0292] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 may use the proximity sensor 180G to detect when a user holds the electronic device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.

[0293] The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0294] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0295] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs thermal protection by reducing the performance of a processor located near temperature sensor 180J to reduce power consumption. In other embodiments, when the temperature is below another threshold, electronic device 100 heats battery 142 to prevent abnormal shutdown of electronic device 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, electronic device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.

[0296] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0297] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.

[0298] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0299] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can be corresponding to touch operations applied to different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0300] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0301] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0302] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application uses the layered architecture Android system as an example to illustrate the software structure of electronic device 100. This application does not limit the type of operating system of the electronic device. For example, Android system, Linux system, Windows system, iOS system, Harmony OS, etc.

[0303] Figure 11 This is a software structure block diagram of an electronic device provided in one embodiment of this application. For example... Figure 11 As shown, the layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer (APP), the application framework layer (APP framework), the Android runtime and system libraries, and the kernel layer.

[0304] The application layer can include a series of application packages.

[0305] like Figure 11 As shown, the application package may include applications (APPs) such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, games, chat, shopping, travel, instant messaging (such as SMS), smart home, and device control.

[0306] Smart home applications can be used to control or manage network-connected home devices. For example, home devices may include lights, televisions, and air conditioners. Other examples include security door locks, speakers, robot vacuums, electrical outlets, body fat scales, table lamps, air purifiers, refrigerators, washing machines, water heaters, microwave ovens, rice cookers, curtains, fans, televisions, set-top boxes, doors, and windows.

[0307] In addition, the application package may also include applications such as the home screen (i.e., the desktop), the negative one screen, the control center, and the notification center.

[0308] The -1 screen, also known as the negative one screen, refers to the user interface (UI) displayed when swiping right from the main screen of an electronic device until the leftmost split screen is reached. For example, the -1 screen can be used to display quick service functions and notifications, such as global search, shortcuts to specific pages within applications (payment codes, WeChat, etc.), instant information and reminders (express delivery information, expense information, traffic conditions, ride-hailing information, schedule information, etc.), and followed events (football stands, basketball stands, stock information, etc.). The control center is the swipe-up notification bar on the electronic device, the user interface displayed when the user swipes up from the bottom of the device. The notification center is the pull-down notification bar on the electronic device, the user interface displayed when the user swipes down from the top of the device.

[0309] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0310] like Figure 11 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0311] A window manager is used to manage window programs, such as managing window state, properties, adding, deleting, and updating views, window order, message collection and processing, etc. The window manager can obtain the screen size, determine if a status bar is present, lock the screen, and capture the screen. Furthermore, the window manager serves as the entry point for external access to windows.

[0312] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0313] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0314] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).

[0315] The resource manager provides applications with various resources, such as localized strings, icons, images, user interface layout files (layout XML), video files, fonts, colors, and identity documents (IDs) (also known as serial numbers or accounts) for user interface modules (UI components). Furthermore, the resource manager is used to manage these resources uniformly.

[0316] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0317] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0318] The core library consists of two parts: one part is the functionalities that the Java language needs to call, and the other part is the core library of the Android system.

[0319] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0320] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGLES), 2D graphics engines (e.g., SGL), and image processing libraries.

[0321] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0322] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0323] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0324] A 2D graphics engine is a graphics engine for 2D drawing.

[0325] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0326] The following example, using a smart speaker to play sound, illustrates the workflow of the software and hardware of electronic device 100.

[0327] When the touch sensor 180K receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, timestamp of the touch operation, etc.). The raw input event is stored in the kernel layer. The application framework layer retrieves the raw input event from the kernel layer and identifies the control corresponding to the input event. Taking a single touch operation as an example, where the corresponding control is the smart speaker icon, the smart speaker application calls the interface of the application framework layer to launch the smart speaker application, and then calls the kernel layer to start the audio driver, converting the audio electrical signal into a sound signal through the speaker 170A.

[0328] It is understood that the structure illustrated in this application does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0329] For example, this application provides an electronic device, including: a memory and a processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory to cause the electronic device to execute the image sharing method in the preceding embodiments.

[0330] For example, this application provides a chip system applied to an electronic device including a memory, a display screen, and a sensor; the chip system includes a processor; when the processor executes computer instructions stored in the memory, the electronic device executes the image sharing method in the preceding embodiments.

[0331] For example, this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, causes an electronic device to implement the image sharing method described in the preceding embodiments.

[0332] For example, this application provides a computer program product, including: execution instructions, the execution instructions being stored in a readable storage medium, at least one processor of an electronic device being able to read the execution instructions from the readable storage medium, and the at least one processor executing the execution instructions causing the electronic device to implement the image sharing method in the preceding embodiments.

[0333] In the above embodiments, all or part of the functionality can be implemented by software, hardware, or a combination of software and hardware. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0334] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A method for sharing images, characterized in that, Applied to a first electronic device, the method includes: When it is determined that multiple images need to be shared, based on the image information of the multiple images and the user's tour route when taking the multiple images, multiple segmented routes and image information of associated images for each segmented route are determined. The image information of the multiple images includes at least the image data, shooting time, and shooting location of each image. This includes: based on the image information of the multiple images, performing image filtering and location aggregation on the multiple images to obtain multiple shooting points of interest; based on the multiple shooting points of interest, dividing the tour route and using the positions of every two time-adjacent shooting points of interest as the start and end positions to obtain multiple segmented routes; based on the time ordering relationship of the multiple shooting points of interest, dividing the tour route to obtain multiple segmented routes, and using the positions of every two time-adjacent shooting points of interest as the start and end positions, associating the multiple shooting points of interest with the multiple segmented routes to obtain multiple segmented routes. Based on the image information of the multiple segmented routes and the associated images of each segmented route, a data packet to be shared is generated; The data packet to be shared is transmitted to a second electronic device so that the second electronic device can parse the data packet to be shared and display the multiple segmented routes and the associated image of each segmented route.

2. The method according to claim 1, characterized in that, The method further includes: Obtain navigation information of the vehicle driven by the user when the multiple images were taken; Based on the vehicle's navigation information, determine the vehicle's driving route; The driving route of the vehicle is determined as the tour route.

3. The method according to claim 1, characterized in that, The method further includes: Obtain the movement information of the device used by the user when taking the multiple images; Invalid information in the movement information of the device is filtered to obtain the filtered movement information of the device. The tour route is obtained by fitting the filtered movement information of the device with the navigation information of the standard route.

4. The method according to claim 1, characterized in that, The method further includes: Based on the image information of the multiple images, image filtering and location aggregation are performed on the multiple images to obtain multiple points of interest for shooting. The tour route is obtained by fitting the multiple points of interest to the standard route navigation information.

5. The method according to claim 4, characterized in that, The process of fitting the multiple points of interest using standard route navigation information to obtain the tour route includes: Based on the time of each shooting point of interest, the time of the multiple shooting points of interest is averaged to obtain the median time of the multiple shooting points of interest. Based on the intermediate time of the multiple points of interest, the multiple points of interest are sorted by time to obtain the time sorting relationship of the multiple points of interest. Based on the temporal order of the multiple points of interest (POIs), the starting and ending positions are determined by using the positions of two adjacent POIs at different times. The routes between these POIs are calculated using navigation information from a standard route, and the multiple routes are then merged to obtain the tour route.

6. The method according to claim 1 or 4, characterized in that, Based on the image information of the multiple images, image filtering and location aggregation are performed on the multiple images to obtain multiple points of interest, including: Images that were captured in the same area are grouped together to obtain multiple groups of images; Based on the image information of each group of images, the location and time of the multiple groups of images are averaged to obtain a shooting point of interest corresponding to each group of images, as well as the location and time of each shooting point of interest.

7. The method according to claim 6, characterized in that, When the tour route is obtained from a vehicle driven by the user while the multiple images were being taken, the method further includes: The parking locations along the tour route are designated as dividing points; Determine whether there is a point of interest for shooting within the area to which the segmentation point belongs; If a point of interest exists within the area to which the segmentation point belongs, the segmentation point is identified as a newly added point of interest. If there is no point of interest to be photographed within the area to which the segmentation point belongs, the segmentation point is determined not to be a point of interest to be photographed.

8. The method according to any one of claims 1-5, characterized in that, Before generating the data packet to be shared, the method further includes: Display the multiple segmented routes and the associated images for each segmented route.

9. The method according to claim 8, characterized in that, At the start and end positions of each segmented route, there are two temporally adjacent points of interest (POIs). Each POI is obtained by filtering and aggregating the images from multiple images. The display of the multiple segmented routes and their associated images includes: In the electronic map, each segmented route is displayed between two adjacent points of interest (POIs) using lines with arrows. The arrows on each line point from the earlier POI to the later POI. An icon for the associated image of each segmented route is displayed within the area of ​​each POI.

10. The method according to claim 9, characterized in that, The method further includes: The location of the associated images for each segmented route is analyzed using reverse geocoding to determine the location name of each point of interest. The location name of each point of interest is displayed within the area to which it belongs.

11. The method according to claim 9, characterized in that, The method further includes: Upon receiving an operation on the icon of an associated image of a segmented route, a user interface is displayed for browsing each image in the associated images of the segmented route.

12. The method according to any one of claims 1-5, characterized in that, When a photo album application is installed in the first electronic device, the method further includes: Display a control in a user interface of the photo album application; After receiving the operation triggered on the control, it is determined that the multiple images need to be shared.

13. A method for sharing images, characterized in that, Applied to a second electronic device, the method includes: The data packet to be shared is obtained from a first electronic device. This data packet is generated by the first electronic device based on image information of multiple segmented routes and associated images of each segmented route. The image information of the multiple segmented routes and associated images of each segmented route is determined by the first electronic device when it determines that multiple images need to be shared, based on the image information of the multiple images and the user's tour route when taking the multiple images. The image information of the multiple images includes at least the image data, shooting time, and shooting location of each image. The process includes: filtering and aggregating the images based on their image information to obtain multiple points of interest (POIs); segmenting the tour route based on the multiple POIs, using the positions of every two time-adjacent POIs as the start and end positions to obtain multiple segmented routes; and segmenting the tour route based on the time order of the multiple POIs to obtain multiple segmented routes, using the positions of every two time-adjacent POIs as the start and end positions to associate the multiple POIs with the multiple segmented routes to obtain multiple segmented routes. The data packet to be shared is parsed to obtain the image information of the multiple segmented routes and the associated images of each segmented route; Based on the image information of the multiple segmented routes and the associated images of each segmented route, the multiple segmented routes and the associated images of each segmented route are displayed.

14. The method according to claim 13, characterized in that, At the start and end positions of each segmented route, there are two temporally adjacent points of interest (POIs). Each POI is obtained by filtering and aggregating the images from multiple images. The display of the multiple segmented routes and their associated images includes: In the electronic map, each segmented route is displayed between two adjacent points of interest (POIs) using lines with arrows. The arrows on each line point from the earlier POI to the later POI. An icon for the associated image of each segmented route is displayed within the area of ​​each POI.

15. The method according to claim 14, characterized in that, The method further includes: The location of the associated images for each segmented route is analyzed using reverse geocoding to determine the location name of each point of interest. The location name of each point of interest is displayed within the area to which it belongs.

16. The method according to claim 14, characterized in that, The method further includes: Upon receiving an operation on the icon of an associated image of a segmented route, a user interface is displayed for browsing each image in the associated images of the segmented route.

17. The method according to any one of claims 13-16, characterized in that, When a photo album application is installed in the second electronic device, displaying the multiple segmented routes and the associated images for each segmented route includes: The multiple segmented routes and the associated images for each segmented route are displayed in a user interface of the photo album application.

18. An electronic device, characterized in that, include: Memory and processor; The memory is used to store program instructions; The processor is configured to invoke program instructions in the memory to cause the electronic device to execute the image sharing method according to any one of claims 1-12, or to cause the electronic device to execute the image sharing method according to any one of claims 13-17.

19. A computer-readable storage medium, characterized in that, The method includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the image sharing method as described in any one of claims 1-12, or cause the electronic device to perform the image sharing method as described in any one of claims 13-17.

Citation Information

Patent Citations

  • Traveling track generating method and system

    CN104809203A

  • Photo information processing method and device as well as terminal

    CN105320689A

  • Travel route generation method and apparatus

    CN105320749A

  • Method and equipment for sharing travel experiences

    CN105335396A

  • Automatic video track forming method and system

    CN105721813A