Panoramic image-based information recommendation method, apparatus, and mobile terminal

Abstract

The application relates to a panoramic image-based information recommendation method and device, a mobile terminal and a storage medium. The method comprises the following steps: displaying a first local image of a target panoramic image projected into a viewfinder area of a mobile terminal; in response to displacement of the viewfinder area relative to the target panoramic image, displaying a second local image of the target panoramic image projected into the viewfinder area after the displacement in the viewfinder area after the displacement; and displaying recommendation information matched with a target image interval of the target panoramic image on the second local image when the second local image belongs to the target image interval. Through the above method, the interaction of a user can be enhanced, the user's attention to the recommendation information can be improved, and the information recommendation effect can be improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to an information recommendation method, apparatus, mobile terminal, and storage medium based on panoramic images. Background Technology

[0002] With the development of computer technology, information is being displayed in increasingly diverse ways, such as through panoramic images. A panoramic image is a composite image obtained by seamlessly stitching together a group of images with a certain point as the center. Mobile terminals can use their built-in gyroscopes to sense the user's movement, calculate the corresponding position of the panoramic image, and project it onto the mobile terminal's display interface. Different local images in the panoramic image are displayed from different positions, giving the user a 3D (3-dimensional) effect.

[0003] When using panoramic images for information recommendation, the recommendation information is usually added directly to the panoramic image and displayed as a part of the panoramic image, so that users can obtain the recommendation information from the projected image of the panoramic image.

[0004] However, users tend to focus on the projected image of the panoramic view, thus ignoring the recommended information within the panoramic image and affecting the effectiveness of information recommendation. Summary of the Invention

[0005] Therefore, it is necessary to provide an information recommendation method, apparatus, mobile terminal, and storage medium based on panoramic images that can improve the information recommendation effect in response to the above-mentioned technical problems.

[0006] An information recommendation method based on panoramic images, the method comprising:

[0007] In the viewfinder area of ​​the mobile terminal, a first partial image of the target panoramic image is projected onto the viewfinder area.

[0008] In response to a displacement of the framing area relative to the target panoramic image, a second partial image of the target panoramic image projected onto the framing area after the displacement is displayed in the framing area after the displacement.

[0009] When the second local image belongs to the target image range of the target panoramic image, recommendation information matching the target image range is displayed on the second local image.

[0010] An information recommendation device based on panoramic images, the device comprising:

[0011] The first projection module is used to display a first partial image of the target panoramic image projected onto the framing area of ​​the mobile terminal.

[0012] The second projection module is configured to, in response to a displacement of the framing area relative to the target panoramic image, display a second partial image of the target panoramic image projected onto the framing area after the displacement in the framing area after the displacement.

[0013] The information recommendation module is used to display recommended information matching the target image range on the second local image when the second local image belongs to the target image range of the target panoramic image.

[0014] A mobile terminal includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to perform the following steps:

[0015] In the viewfinder area of ​​the mobile terminal, a first partial image of the target panoramic image is projected onto the viewfinder area.

[0016] In response to a displacement of the framing area relative to the target panoramic image, a second partial image of the target panoramic image projected onto the framing area after the displacement is displayed in the framing area after the displacement.

[0017] When the second local image belongs to the target image range of the target panoramic image, recommendation information matching the target image range is displayed on the second local image.

[0018] A computer-readable storage medium having a computer program stored thereon, the computer program performing the following steps when executed by a processor:

[0019] In the viewfinder area of ​​the mobile terminal, a first partial image of the target panoramic image is projected onto the viewfinder area.

[0020] In response to a displacement of the framing area relative to the target panoramic image, a second partial image of the target panoramic image projected onto the framing area after the displacement is displayed in the framing area after the displacement.

[0021] When the second local image belongs to the target image range of the target panoramic image, recommendation information matching the target image range is displayed on the second local image.

[0022] The aforementioned information recommendation method, apparatus, mobile terminal, and storage medium based on panoramic images display a first partial image projected onto the viewfinder area of ​​the target panoramic image within the viewfinder area of ​​the mobile terminal. In response to displacement of the viewfinder area relative to the target panoramic image, a second partial image projected onto the viewfinder area after displacement is displayed. When the second partial image belongs to a target image region of the target panoramic image, recommendation information matching the target image region is displayed on the second partial image. In the information recommendation process, compared to directly adding recommendation information to a fixed position in the panoramic image, this method decouples the panoramic image from the recommendation information. Displaying recommendation information on a projected partial image enhances user interaction, increases user attention to the recommendation information, and thus improves the recommendation effect. Attached Figure Description

[0023] Figure 1 This is an application environment diagram of an information recommendation method based on panoramic images in one embodiment;

[0024] Figure 2 This is a flowchart illustrating an information recommendation method based on panoramic images in one embodiment;

[0025] Figure 3 This is a schematic diagram of different types of panoramic images in one embodiment;

[0026] Figure 4 This is a schematic diagram of an interface displaying a partial image in the viewfinder area after different displacements occur in one embodiment;

[0027] Figure 5 This is a schematic diagram of an interface that displays a partial image in the viewfinder area in one embodiment;

[0028] Figure 6 This is a schematic diagram of an interface displaying a partial image in a viewfinder area, as described in another embodiment.

[0029] Figure 8 This is a schematic diagram of an interface displaying recommendation information in one embodiment;

[0030] Figure 7 This is a schematic diagram of the viewfinder area in one embodiment;

[0031] Figure 9 This is a schematic diagram of the interface for displaying recommendation information when the target image range remains unchanged in one embodiment.

[0032] Figure 10 This is a schematic diagram of an interface that displays recommendation information when the target image range changes in one embodiment.

[0033] Figure 11 This is a schematic diagram of the interface displaying the recommendation information and details content entry points in one embodiment;

[0034] Figure 12 This is a schematic diagram illustrating the matching relationship between image regions and recommendation information in one embodiment;

[0035] Figure 13 This is a schematic diagram of a process for triggering the display of recommendation information in one embodiment;

[0036] Figure 14 This is a flowchart illustrating the process of automatically displaying recommendation information in one embodiment;

[0037] Figure 15 This is a flowchart illustrating an information recommendation method based on panoramic images in another embodiment;

[0038] Figure 16 This is a structural block diagram of an information recommendation device based on panoramic images in one embodiment;

[0039] Figure 17 This is an internal structure diagram of a mobile terminal in one embodiment. Detailed Implementation

[0040] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0041] The information recommendation method based on panoramic images provided in this application can be applied to, for example... Figure 1 In the application environment shown, mobile terminal 102 communicates with server 104 via a network. A user triggers the projection display of a panoramic image through mobile terminal 102. In response to this trigger, mobile terminal 102 displays a first partial image projected onto the viewfinder area of ​​the target panoramic image. In response to a displacement of the viewfinder area relative to the target panoramic image, mobile terminal 102 displays a second partial image projected onto the viewfinder area after the displacement. When the second partial image belongs to a target image region of the target panoramic image, recommended information matching the target image region is displayed on the second partial image. This recommended information can be provided by server 104. The recommended information can be displayed automatically based on the displacement or triggered by a recommended information trigger operation.

[0042] Among them, the mobile terminal 102 can be, but is not limited to, various laptops, smartphones, tablets, vehicle terminals and portable wearable devices, and the server 104 can be implemented by a standalone server or a server cluster composed of multiple servers.

[0043] In one embodiment, such as Figure 2 As shown, an information recommendation method based on panoramic images is provided, which is then applied to... Figure 1 Let's take a mobile terminal as an example to illustrate:

[0044] Step 202: In the viewfinder area of ​​the mobile terminal, display the first partial image of the target panoramic image projected onto the viewfinder area.

[0045] Panoramic images are composite images obtained by seamlessly stitching together a group of images with a specific point as the center. For example... Figure 3 As shown, a panoramic image can be a 360° circular image, a semi-circular image less than 360°, or a 720° spherical image. A mobile terminal refers to a mobile device that can be used while in motion. The mobile terminal can be displaced relative to the panoramic image, thereby altering local portions of the projected panoramic image. For example... Figure 4 As shown, the viewfinder area is the region on the mobile terminal's screen used to display a partial image of the panoramic image projection. The size of the viewfinder area can be the same as the mobile terminal's screen size, for example, displaying the projected partial image in full screen on the mobile terminal's screen. Alternatively, the size of the viewfinder area can be smaller than the mobile terminal's screen size, allowing other information to be displayed on the mobile terminal's screen in addition to the projected partial image. The target panoramic image is the panoramic image used to project the partial image onto the viewfinder area of ​​the mobile terminal for display. The first partial image is the partial image determined from the target panoramic image and used to be projected onto the viewfinder area for display.

[0046] Specifically, when a user triggers the projection display of a panoramic image on a mobile terminal, the mobile terminal displays a viewfinder area on the screen. Within the viewfinder area, a first partial image of the target panoramic image projected onto the viewfinder area is displayed. The user can view a partial image from any position within the target panoramic image by changing the viewfinder orientation of the mobile terminal or adjusting the projection center point of the target panoramic image. In a specific application, when the projection display of a panoramic image is triggered, a viewfinder area is displayed on the mobile terminal. Within the viewfinder area, a first partial image of the target panoramic image projected onto the viewfinder area is displayed. The center point of the first partial image is located at a pre-set coordinate position within the target panoramic image. For example, the coordinates of the center point of the first partial image in the coordinate system corresponding to the target panoramic image are (R, 0, 0), where R is the distance from the reference center point used when constructing the target panoramic image to any position within the target panoramic image.

[0047] Step 204: In response to the displacement of the framing area relative to the target panoramic image, a second partial image of the target panoramic image projected onto the framing area after the displacement is displayed in the framing area after the displacement.

[0048] The displacement refers to the relative displacement between the viewfinder area and the target panoramic image. Specifically, this displacement can be caused by the user changing the viewfinder orientation of the mobile device, or by the user adjusting the projection orientation of the target panoramic image. For example... Figure 5 As shown, adjusting the projection orientation of a panoramic image can be achieved by the user sliding a portion of the image within the viewfinder in any direction to change the projection orientation. For example... Figure 6 As shown, changing the framing orientation of a mobile terminal can be achieved by the user controlling the mobile terminal to rotate around a target point, which is the point in the direction the mobile terminal's screen is facing. Since displacement is relative, the change in the viewing angle of the mobile terminal's framing orientation can characterize the displacement of the framing area relative to the target panoramic image. The greater the change in viewing angle, the greater the relative displacement of the framing area; the smaller the change in viewing angle, the smaller the relative displacement of the framing area. Similarly, the adjustment range of the projection orientation of the target panoramic image can also characterize the displacement of the framing area relative to the target panoramic image. The greater the adjustment range, the greater the relative displacement of the framing area; the smaller the adjustment range, the smaller the relative displacement of the framing area.

[0049] Both the second and first partial images are partial images within the target panoramic image. Because the viewfinder area has shifted relative to the target panoramic image, the partial image projected from the target panoramic image onto the viewfinder area will change. Since the size of the viewfinder area remains unchanged, the first and second partial images have the same size. The position of the center point of the second partial image within the target panoramic image is related to the position of the center point of the first partial area within the target panoramic image and the shift of the viewfinder area relative to the target panoramic image. Specifically, the mobile terminal, based on the position of the center point of the first partial area within the target panoramic image and the shift of the viewfinder area relative to the target panoramic image, determines the position of the center point of the second partial area within the target panoramic image. Then, based on the size of the viewfinder area, it determines the second partial image to be projected, thereby displaying the second partial image projected from the target panoramic image onto the shifted viewfinder area.

[0050] Specifically, when the mobile terminal detects that the user has changed the framing position of the mobile terminal or adjusted the projection position of the target panoramic image, based on the displacement of the framing area relative to the target panoramic image, the mobile terminal displays a second partial image of the target panoramic image projected onto the framing area after the displacement, so that the projected partial image of the target panoramic image changes with the relative displacement, thereby realizing multi-angle display of the target panoramic image.

[0051] Step 206: When the second local image belongs to the target image range of the target panoramic image, display recommendation information that matches the target image range on the second local image.

[0052] The target image interval is configured with corresponding recommendation information and is a part of the target panoramic image. The image size corresponding to the target image interval is smaller than the image size of the target panoramic image but larger than the image size of the local image projected onto the viewfinder area. The number of image intervals in the target panoramic image can be one or more. For example, the target image interval can be one of several image intervals obtained after dividing the target panoramic image into intervals. The image intervals to which the projected second local images belong after different displacements may be the same or different. For example, for a 360° annular panoramic image, after dividing the target panoramic image into 60° equidistant intervals, six image intervals are obtained. When the relative angle between the center point of the second local image and the coordinate system of the 360° annular panoramic image is 30°, the image interval to which the second local image belongs is the first image interval; when the relative angle between the center point of the second local image and the coordinate system of the 360° annular panoramic image is 45°, the image interval to which the second local image belongs is the first image interval; and when the relative angle between the center point of the second local image and the coordinate system of the 360° annular panoramic image is 75°, the image interval to which the second local image belongs is the second image interval.

[0053] Recommended information is information suggested to users. It can be displayed through one or more interface elements. These elements can include, but are not limited to, various forms such as windows, dialog boxes, graphics, text, music, and videos. Text or image-based recommendations can be displayed using image interface elements, which can be static images or dynamic images composed of multiple static images. The displayed recommendations can be of one type of interface element or a combination of different types. Different image ranges can correspond to recommendations of the same type but different content, or to different types of recommendations, depending on the user's needs.

[0054] Specifically, such as Figure 7As shown, when the mobile terminal detects that the second local image belongs to the target image region of the target panoramic image, it overlays and displays recommended information that matches the target image region on the second local image. Users can obtain recommended information from the displayed second local image. By overlaying and displaying recommended information on the second local image, the user's attention can be drawn to the overlayed recommended information, thereby improving the effectiveness of information recommendation.

[0055] The aforementioned information recommendation method based on panoramic images displays a first partial image projected onto the viewfinder area of ​​the target panoramic image within the viewfinder area of ​​the mobile terminal. In response to displacement of the viewfinder area relative to the target panoramic image, a second partial image projected onto the displaced viewfinder area is displayed. When the second partial image belongs to a target image region of the target panoramic image, recommendation information matching the target image region is displayed on the second partial image. Compared to directly adding recommendation information to a fixed position in the panoramic image, displaying recommendation information when the second partial image belongs to the target image region of the target panoramic image increases the probability of recommendation information being displayed, thereby improving the information recommendation effect, by decoupling the panoramic image from the recommendation information and displaying the recommendation information on the projected partial image.

[0056] In one embodiment, the viewing area is a promotional information display page; the information recommendation method based on panoramic images further includes: in response to a launch operation of the target application, displaying the promotional information display page corresponding to the target application;

[0057] The promotional information display page refers to the page used to display and promote information when the application starts, such as the application's splash screen advertisement. The target application refers to the application that has the function of displaying the promotional information display page. The content displayed on the promotional information display page can be content authorized for display by the target application; specifically, it can be content related to the target application, or it can be content unrelated to the target application, such as information corresponding to other applications that have a cooperative relationship with the target application.

[0058] Specifically, when the mobile terminal detects that a user has launched an application, it will first display a promotional information page before entering the application's main page. In a specific application, the promotional information page may be displayed for a preset period of time after the application starts, and the application's main page will only be entered if the user does not interact with the content displayed on the promotional information page.

[0059] Furthermore, in the viewfinder area of ​​the mobile terminal, a first partial image of the target panoramic image projected onto the viewfinder area is displayed, including: on the promotional information display page, displaying the first partial image of the target panoramic image projected onto the viewfinder area.

[0060] In a specific application, such as Figure 8 As shown, when the target application is triggered to start, a promotional information display page is displayed in full screen. On the promotional information display page, a first partial image of the target panoramic image is displayed projected onto the viewing area, and the partial image can be updated and displayed in response to the displacement of the viewing area relative to the target panoramic image.

[0061] In this embodiment, when the user initiates the application, a promotional information display page is shown before entering the application's running page. By displaying a first partial image of the target panoramic image projected onto the viewing area on the promotional information display page, the user's attention can be attracted to a greater extent, which facilitates the subsequent recommendation of information.

[0062] In one embodiment, the framing area is a promotional information display area; the information recommendation method based on panoramic images further includes: displaying the promotional information display area in the information flow display page of the target application;

[0063] The "promotional information display area" refers to a specific area within the application's feed, such as a recommended ad slot in WeChat Moments. The "target application" refers to an application with feed display functionality. The content displayed in the promotional information display area can be authorized content for the target application; specifically, it can be content related to the target application or unrelated content, such as information from other applications that have a partnership with the target application. Specifically, when the mobile terminal detects that a user has entered the target application's feed, it displays the promotional information display area at a designated location within the feed.

[0064] Furthermore, in the viewfinder area of ​​the mobile terminal, a first partial image of the target panoramic image projected onto the viewfinder area is displayed, including: in the promotional information display area, displaying the first partial image of the target panoramic image projected onto the viewfinder area.

[0065] In a specific application, such as Figures 3-6As shown, the viewfinder area can be one of the promotional information display areas on the application's information feed page, such as the image display area in the recommended ad slot in WeChat Moments. When a user scrolls through information in WeChat Moments and scrolls the content corresponding to the recommended ad slot to the current page, the first partial image of the target panoramic image is projected onto the viewfinder area in the image display area of ​​the recommended ad slot.

[0066] In this embodiment, a promotional information display area is displayed on the information flow display page of the target application. The first partial image of the target panoramic image is projected onto the viewfinder area in the promotional information display area. This can increase the likelihood of displaying the viewfinder area by utilizing objects that users frequently browse. By displaying the projected partial image, the user's attention is attracted to a greater extent, which facilitates the subsequent recommendation of information.

[0067] In one embodiment, in response to a displacement of the view area relative to the target panoramic image, a second partial image projected from the target panoramic image onto the displaced view area is displayed in the displaced view area, including:

[0068] In response to an adjustment of the framing orientation for the framing area, a second partial image of the target panoramic image is displayed within the framing area after the framing orientation adjustment.

[0069] In this context, "viewing orientation" refers to the direction the mobile terminal is facing, where the viewfinder area is located. Specifically, when a user changes the orientation of the mobile terminal by holding it and rotating their arm or body, the mobile terminal, based on its built-in gyroscope sensor, can detect this orientation change and its specific parameters. Based on these parameters (such as the relative displacement with respect to the target panoramic image), the mobile terminal determines the new viewing orientation of the adjusted viewfinder area. The relative displacement between the viewfinder area and the target panoramic image resulting from the orientation adjustment is essentially a change in the orientation of the viewfinder area.

[0070] Specifically, when the gyroscope sensor of the mobile terminal detects a change in the orientation of the mobile terminal, i.e., the orientation of the viewfinder area is adjusted, it displays a second partial image projected onto the viewfinder area where the orientation of the target panoramic image has changed. For example... Figure 6 The mobile terminal shown represents the state of the device when positioned in different shooting directions.

[0071] In this embodiment, by adjusting the framing orientation of the view area, i.e., changing the orientation of the mobile terminal, the user can participate in the interactive process of displaying the projected partial image, which enriches the interactive forms in the process of displaying the partial image and increases the fun of the partial image display process.

[0072] In another embodiment, in response to a displacement of the framing area relative to the target panoramic image, displaying a second partial image of the target panoramic image projected onto the framing area after the displacement in the framing area includes: in response to a projection orientation adjustment operation for the target panoramic image, displaying a second partial image of the target panoramic image projected onto the framing area after the projection orientation adjustment in the framing area.

[0073] The projection orientation refers to the position of a reference point in the target panoramic image. This reference point can be any point selected from the target panoramic image. For example, if a point at 0° in a 360° panoramic image is chosen as the reference point, and the target panoramic image is rotated 45° clockwise, then that reference point will be positioned at 45° in the 360° panoramic image. Therefore, the projection orientation has been adjusted by rotating 45° clockwise. Adjusting the projection orientation of the target panoramic image can be done by dragging a displayed portion of the image on a mobile device.

[0074] In this embodiment, by adjusting the projection orientation of the target panoramic image, the local image of the projection can be changed without changing the orientation of the mobile terminal, thus providing users with diverse interaction methods and improving the effectiveness of information recommendation.

[0075] In one embodiment, the recommendation information includes a three-dimensional image; displaying recommendation information matching the target image region on a second local image includes: displaying a first-view image of the three-dimensional image projected onto the framing area on the second local image.

[0076] In this context, a 3D image refers to a stereoscopic image with length, width, and depth data. Different perspectives can showcase different effects of a 3D image. For example, a 3D image can be a simple cube or cuboid, or a complex 3D game character. A first-person perspective image is the image corresponding to any viewpoint of the 3D image, such as the front, back, or side view. Specifically, different 3D images can correspond to different target image regions. When the second local image belongs to the target image region of the panoramic image, a 3D image matching the target image region is projected onto the first-person perspective image within the viewfinder area and displayed on the second local image.

[0077] Furthermore, the information recommendation method based on panoramic images also includes: in response to the viewpoint shift of the 3D image relative to the framing area, displaying on the second local image a second viewpoint image projected onto the framing area after the viewpoint shift.

[0078] The first-view image and the second-view image are images corresponding to different display perspectives of the 3D image. Viewpoint shift is the change in the perspective of the 3D image relative to the viewfinder area. Specifically, viewpoint shift can be achieved by the user dragging the 3D image in a certain direction. Furthermore, when a 3D image is displayed on the second partial image, the function of adjusting the projection perspective of the displayed partial image can be disabled to ensure that the object affected by the dragging operation in a certain direction is unique.

[0079] In this embodiment, 3D images are displayed as recommendation information. On the one hand, this allows for the presentation of more diverse recommendations, attracting the user's attention through the 3D images. On the other hand, by displaying 3D images within a panoramic view and enabling the viewing angle of the 3D images to change based on user actions, the intensity of interaction with the user is increased, thereby improving the effectiveness of information recommendation.

[0080] In one embodiment, displaying recommendation information matching the target image region on a second local image includes: overlaying a recommendation information display area on the second local image; displaying the image corresponding to the recommendation information and a recommendation details entry in the recommendation information display area; the information recommendation method based on panoramic images further includes: in response to a details display triggering operation triggered when displaying the recommendation details entry, displaying recommendation details content corresponding to the recommendation information.

[0081] The recommendation details are more detailed data related to the recommendation information. For example, when the recommendation information is an advertisement, the recommendation details could be the advertisement details. Specifically, such as... Figure 11 As shown, when the recommended information corresponds to an application advertisement such as a game, the recommended details can be the application's download page; when the recommended information corresponds to a product advertisement, the recommended details can be the product's purchase page.

[0082] The details display trigger operation is used to trigger the display of the recommended details content corresponding to the recommended information. The details display trigger operation can be an operation triggered by the displayed recommended information itself, such as clicking or long-pressing the display area of ​​the recommended information. The details display trigger operation can also be a trigger operation detected by sensors in the mobile terminal. For example, the details display trigger operation can be detected by detecting the presence of acceleration in a certain direction using the mobile terminal's accelerometer. Actions such as jumping or shaking the mobile terminal will generate acceleration in a certain direction; therefore, jumping or shaking the mobile terminal can both serve as details display trigger operations.

[0083] In a specific application, recommended information matching the target image region is displayed on the second local image, including game download recommendations, such as game characters and game download links. When the mobile terminal detects vertical acceleration via its accelerometer or a trigger action targeting the game download link, the game download page is displayed.

[0084] In this embodiment, by responding to the triggered detail display operation when displaying recommendation information, the recommended details content corresponding to the recommendation information is displayed. In the case of a partial image of the target panoramic image being projected, the recommended details content can be displayed directly through simple interaction, allowing users to obtain the recommended details content and improving the effectiveness of information recommendation.

[0085] In one embodiment, in response to a details display trigger operation triggered when displaying the recommendation details entry, displaying recommendation details content corresponding to the recommendation information includes: in response to a details display trigger operation triggered when displaying the recommendation details entry, jumping to the application page corresponding to the recommendation information; and displaying recommendation details content corresponding to the recommendation information on the application page.

[0086] The application page is the running page of the application, used to display the recommendation details. The application page is different from the page containing the viewfinder area. Specifically, it could be the page for downloading the application corresponding to the recommendation in an app store, the page for purchasing the product corresponding to the recommendation in a shopping app, or the page of the sub-application corresponding to the recommendation running in the parent environment, such as a mini-program in WeChat. The mobile terminal responds to the details display trigger operation when the recommendation details entry is displayed, realizing page navigation and displaying the application page corresponding to the recommendation information on the mobile terminal. Within the application page, the recommendation details content corresponding to the recommendation information is displayed.

[0087] Specifically, in response to the details display trigger operation triggered when the recommendation details entry is displayed, the mobile terminal cancels the display of the second partial image and recommendation information, launches and jumps to the application corresponding to the recommendation information, and displays the recommendation details content corresponding to the recommendation information on the running page of the application.

[0088] In a specific application, when the mobile terminal detects vertical acceleration or a trigger operation targeting the game download entry via the accelerometer, the second partial image and the game download entry are canceled, and the application download page is displayed, with the game download page displayed within the application download page.

[0089] In this embodiment, by jumping from the partial image projection page of the panoramic image to the application corresponding to the recommended information, users can quickly and conveniently obtain specific recommended information. Furthermore, by targeting the application corresponding to the recommended information, user traffic can be redirected, and information can be effectively recommended.

[0090] In one embodiment, the information recommendation method based on panoramic images further includes: when the target image region to which the current local image in the framing area belongs remains unchanged when the target panoramic image is projected onto the framing area, in response to an information update triggering operation triggered when displaying recommendation information, displaying alternative recommendation information that matches the target image region on the second local image.

[0091] The recommended information matched within an image region can include multiple recommendations, such as the primary recommendation displayed initially and alternative recommendations. Alternative recommendations are the replacements for the primary recommendation displayed initially within the same image region when an update is needed. The information update trigger operation is used to trigger the updating of the displayed recommended information. This trigger operation can be triggered when recommended information is already displayed.

[0092] Specifically, when there are alternative recommendation information matching the target image range, when the current local image projected onto the framing area of ​​the target panoramic image changes, but the target image region to which the current local image belongs remains unchanged, alternative recommendation information matching the target image range can be displayed on the second local image through an information update trigger operation triggered in response to the display of recommendation information, thereby realizing the switching and updating of recommendation information.

[0093] In this embodiment, when there are alternative recommendation information matching the target image range, the update condition of the recommendation information is controlled so that the target image region to which the second local image in the viewfinder belongs is not updated when the target panoramic image is projected onto the viewfinder. This enables the mobile terminal to respond to the triggered information update operation under this condition, thereby updating the display recommendation information based on the alternative recommendation information, and thus achieving effective information updating and recommendation.

[0094] In one embodiment, the information recommendation method based on panoramic images further includes: when the target image region to which the current local image in the framing area belongs changes, in response to an information update triggering operation triggered when displaying recommendation information, displaying recommendation information matching the changed target image region on the current local image.

[0095] The information update trigger operation is used to trigger the display of updated recommended information. This operation can be triggered when recommended information is displayed. Specifically, the triggering condition for the information update trigger operation can include a change in the target image region to which the local image within the viewfinder belongs when the panoramic image of the target is projected. The information update trigger operation can be detected by sensors in the mobile terminal or by the user's interaction with the recommended information. For example, the information update trigger operation can be detected by detecting acceleration in a certain direction using the mobile terminal's accelerometer. Specifically, it could be determined whether the user is performing actions such as jumping or shaking the mobile terminal.

[0096] The change in the target image area can be achieved by the user controlling the mobile terminal or controlling the movement of the target panoramic image, resulting in a relative displacement between the viewfinder area and the target panoramic image. For example, Figure 9 As shown, the user rotates the mobile terminal and triggers the display of recommendation information. After the recommendation information is displayed on the second partial image, the user rotates the mobile terminal again. At this time, the partial image displayed in the viewfinder changes, but the recommendation information is always displayed. When the user stops rotating, the image range to which the partial image displayed in the viewfinder belongs changes. That is, when the current image range no longer matches the recommendation information, an information update trigger operation can be triggered to update the displayed recommendation information based on the recommendation information matched by the current image range.

[0097] Specifically, when the target image region to which the second partial image in the viewfinder belongs remains unchanged when the panoramic image is projected onto the viewfinder, the information update trigger operation may not be triggered when displaying recommendation information, or the mobile terminal may not respond to the information update trigger operation, or the recommendation information update processing flow may not be executed, in order to save data processing resources. When the target image region to which the second partial image in the viewfinder belongs changes, the mobile terminal responds to the information update trigger operation triggered when displaying recommendation information, updating the recommendation information displayed on the current partial image to recommendation information that matches the changed target image region. Thus, the mobile terminal can respond to the triggered information update trigger operation when update conditions are met, thereby updating the recommendation information.

[0098] In a specific application, such as Figure 10 As shown, taking a game advertisement as an example, the user triggers an operation through information recommendation, which displays "game character A" that matches the first image interval in the viewfinder area. If the user rotates the mobile terminal and the image interval to which the current local image belongs after rotation is still the first image interval, the displayed "game character A" will not be updated. If the user rotates the mobile terminal again and the image interval to which the current local image belongs after rotation is the second image interval, the displayed "game character A" will be replaced with "game character B" that matches the second image interval.

[0099] In this embodiment, by controlling the update condition of the recommendation information to be a change in the target image region to which the second local image in the viewfinder belongs when the target panoramic image is projected, the mobile terminal can respond to the triggered information update operation under this condition to update the recommendation information, thereby achieving effective information update and recommendation.

[0100] In one embodiment, in response to a details display trigger operation triggered when displaying the recommendation details entry, displaying recommendation details content corresponding to the recommendation information includes: in response to a details display trigger operation triggered when displaying the recommendation details entry, displaying recommendation details content corresponding to the recommendation information in the recommendation content display area of ​​the display page where the viewfinder area is located.

[0101] The recommended content display area is a portion of the page excluding the viewfinder area. It appears on the same page as the viewfinder area. Specifically, the recommended content display area can overlap with the viewfinder area, for example, displaying it above the viewfinder. When the user cancels the display of the recommended content area, interaction can continue based on the viewfinder area. Alternatively, the recommended content display area can be an area surrounding the viewfinder area, such as displaying it above or below it. Recommended details can be displayed in the area surrounding the viewfinder area, allowing users to access these details while continuing interaction based on the viewfinder area.

[0102] Specifically, in response to the detail display trigger operation triggered when the recommended details entry is displayed, the mobile terminal displays the recommended details content corresponding to the recommended information in the recommended content display area of ​​the display page where the viewfinder is located. The recommended content display area also displays a cancel display entry. The mobile terminal cancels the display of the recommended content display area by responding to the user's trigger operation on the cancel response entry.

[0103] In this embodiment, by displaying the recommended content display area and the framing area on the same page, users can obtain the recommended details and trigger the display of other recommended information without switching pages, which improves the convenience of users obtaining information and facilitates the effective recommendation of multiple recommended information.

[0104] In one embodiment, the information recommendation method based on panoramic images further includes: displaying a panoramic image identifier on a display page of a mobile terminal; and displaying a first partial image of a target panoramic image projected onto the viewfinder area of ​​the mobile terminal in response to a trigger operation on the panoramic image identifier, wherein the panoramic image identifier corresponds to the target panoramic image.

[0105] Panoramic image identifiers are used to characterize and differentiate different panoramic images. Specifically, a panoramic image identifier can be a trigger entry point that includes information corresponding to the panoramic image, such as the panoramic image name and type. For example, for game enthusiasts, the likelihood of triggering a game-related panoramic image is greater than that of a home-related panoramic image. Similarly, for game enthusiasts of type A, the likelihood of triggering a panoramic image corresponding to type A game is greater than that corresponding to type B game. By identifying the panoramic image type, users can more easily select panoramic images of interest, increasing the likelihood of triggering the target panoramic image and thus improving the success rate of recommended information.

[0106] The first local image is the local image corresponding to the pre-set projection center in the target panoramic image. By pre-setting the projection center, it can be ensured that the first local image displayed is the same when different mobile terminals, or when the same mobile terminal starts the target panoramic image from different directions, are the same. This ensures that the relative displacement between the framing area and the target panoramic image is achieved based on the same conditions, thereby ensuring that the recommended information corresponding to each target image area has a specific order, which is conducive to the reasonable arrangement of recommended information.

[0107] In a specific application, multiple candidate panoramic image icons are displayed on the mobile terminal's display page. In response to the user's selection operation on the candidate panoramic image icons, the mobile terminal selects the target panoramic image icon, and displays the first partial image of the target panoramic image corresponding to the target panoramic image icon projected onto the viewfinder area in the mobile terminal's framing area.

[0108] In this embodiment, by triggering the panoramic image identifier, the projection of a partial image of the target panoramic image is initiated, and a first partial image is displayed. This ensures that when different mobile terminals, or the same mobile terminal, initiates the target panoramic image from different orientations, the first partial image displayed by the mobile terminal is the same, which is conducive to achieving a reasonable distribution of recommendation information.

[0109] In one embodiment, the target image range is a first image range; the information recommendation method based on the panoramic image further includes: in response to a secondary displacement of the framing area relative to the target panoramic image, displaying a third partial image of the target panoramic image projected onto the framing area after the secondary displacement in the framing area after the secondary displacement; when the third partial image belongs to a second image range of the target panoramic image, canceling the display of recommendation information matching the first image range, and displaying recommendation information matching the second image range on the third partial image.

[0110] The first and second image intervals are both image intervals within the target panoramic image. Multiple image intervals can be obtained by dividing the target panoramic image into intervals. The interval division can be equidistant, resulting in each image region having the same size, or non-equidistant, resulting in each image region having different sizes. The specific interval division method can be adjusted according to actual needs. For example, when multiple different recommendation information corresponding to the same image interval are desired, for example... Figure 12 As shown, the 360° panoramic image is divided into 8 image intervals. The recommended information displayed in the range of [0°, 45°) is shown in Figure A1; the recommended information displayed in the range of [45°, 90°) is shown in Figure A2; ...; the recommended information displayed in the range of [270°, 315°) is shown in Figure A7; and the recommended information displayed in the range of [315°, 360°) is shown in Figure A8.

[0111] Secondary displacement refers to the displacement of the viewfinder area relative to the target panoramic image when displaying recommendation information. It can be understood that both primary and secondary displacement refer to the displacement of the viewfinder area relative to the target panoramic image, and the specific manner in which the displacement occurs can be the same. The distinction between primary and secondary displacement lies in the timing of the displacement, occurring before and after the display of recommendation information. After secondary displacement, the local image projected from the target panoramic image onto the viewfinder area becomes a third local image; that is, the local image changes based on the relative displacement that occurred.

[0112] Specifically, when recommendation information is displayed in the second local area, the mobile terminal detects the displacement of the viewfinder area relative to the target panoramic image. When a relative displacement is detected, it further determines whether the image interval to which the target panoramic image is projected onto the third local image in the viewfinder area has changed after the relative displacement. If a change occurs, the recommendation information displayed on the third local image is replaced with the recommendation information matched by the changed image interval. If no change occurs, the recommendation information matched by the original image interval continues to be displayed on the third local image.

[0113] In a specific application, when the first recommended information "Game Character A" matching the first image interval is displayed on the second local area, the mobile terminal detects a change in its orientation or a dragging operation by the user on the local image displayed within the viewfinder using a gyroscope sensor. After determining that the viewfinder has shifted relative to the target panoramic image, the mobile terminal further determines the image interval to which the third local image in the viewfinder belongs when the target panoramic image is projected. If the image interval is still the first image interval, "Game Character A" is displayed on the third local image; if the image interval is the second image interval, "Game Character B" matching the second image interval is displayed on the third local image. This achieves the updating of the recommended information displayed on the local image based on the change in the image interval to which the projected local image belongs.

[0114] In this embodiment, by responding to the secondary displacement when recommendation information is displayed, the recommendation information can be updated to match the second image interval when the image interval to which the third local region projected after the secondary displacement belongs changes from the first image interval to the second image interval. This achieves the updating of recommendation information based on the secondary displacement, and displays different recommendation information for different image intervals to which the displacement belongs, thereby achieving diversified display of recommendation information and improving the information recommendation effect.

[0115] In one embodiment, when the second local image belongs to the target image range of the target panoramic image, displaying recommendation information matching the target image range on the second local image includes: when the second local image belongs to the target image range of the target panoramic image, in response to an information recommendation triggering operation triggered when displaying the second local image, displaying recommendation information matching the target image range on the second local image.

[0116] Among them, the information recommendation trigger operation is used to trigger the display of recommended information. The information recommendation trigger operation can be a trigger operation when displaying a partial image. Specifically, the information recommendation trigger operation can be triggered by a partial image, such as a click operation or a long press operation. The information recommendation trigger operation can also be a trigger operation detected by sensors in the mobile terminal. For example, the mobile terminal's accelerometer can detect the existence of acceleration in a certain direction to detect the details display trigger operation. For example, actions such as jumping or shaking the mobile terminal will generate acceleration in a certain direction; therefore, jumping or shaking the mobile terminal can both serve as details display trigger operations.

[0117] Specifically, in response to a startup operation targeting the panoramic image, the mobile terminal displays a first partial image projected onto the viewfinder area of ​​the panoramic image. In response to a displacement of the viewfinder area relative to the panoramic image, the mobile terminal displays a second partial image projected onto the viewfinder area after the displacement. It should be noted that the displayed second partial image changes with the displacement. When the second partial image belongs to the target image region of the panoramic image, in response to an information recommendation trigger operation triggered when displaying the second partial image, recommended information matching the target image region is displayed on the second partial image. In other words, the recommended information is displayed based on the information recommendation trigger operation. The mobile terminal determines the recommended information to be displayed by detecting the target image region to which the partial image displayed at the time of the information recommendation trigger operation belongs, and displays this recommended information on the second partial image. The displayed recommended information can be updated based on changes in the image region to which the displayed partial image belongs, or it can be updated in response to an information update trigger operation. The specific settings can be configured according to the actual scenario requirements.

[0118] In a specific application, when a user clicks to open a panoramic game image, a first partial image projected onto the viewfinder of the mobile terminal is displayed. If the mobile terminal detects a change in orientation or a dragging operation on the displayed partial image using its gyroscope sensor, a second partial image projected onto the viewfinder corresponding to the displacement caused by the change in orientation or dragging is displayed. When the second partial image falls within the first image region of the target panoramic image, the mobile terminal detects acceleration in the target direction using its built-in accelerometer. For example, if the user performs actions such as jumping or shaking the mobile terminal, a recommendation message "Game Character A" matching the first image region is displayed on the second partial image.

[0119] Furthermore, the mobile terminal can detect changes in its orientation or dragging of a portion of the displayed image within the viewfinder using its gyroscope sensor. It then determines whether to update the displayed recommendation information based on whether the image interval of the third partial image projected onto the viewfinder changes. If the image interval remains the first image interval, "Game Character A" continues to be displayed on the third partial image; if the image interval is the second image interval, "Game Character B," matching the second image interval, is displayed on the third partial image. This achieves the goal of updating the recommendation information displayed on the partial image based on changes in the image interval of the projected partial image.

[0120] Furthermore, the mobile terminal can also determine whether to update the displayed recommendation information based on whether an information update trigger operation is triggered when displaying recommendation information. When the mobile terminal responds to the information update trigger operation, the target partial image projected onto the viewfinder area at the time of the information update trigger operation is displayed in the viewfinder area. Therefore, in this target partial image, the displayed recommendation information is updated to match the recommendation information of the target image range to which the target partial image belongs.

[0121] In this embodiment, by responding to the information recommendation triggering operation triggered by the user when displaying the second partial image, recommended information matching the target image range is displayed on the second partial image. The user can determine the timing of the display of the recommended information, and the display of recommended information through the information recommendation triggering operation triggered by the user can enhance the interaction in the information recommendation process, increase the user's participation in the information recommendation process, further attract the user's attention, and thus improve the effectiveness of information recommendation.

[0122] In one embodiment, when the second partial image belongs to the target image region of the target panoramic image, in response to an information recommendation triggering operation triggered when displaying the second partial image, recommendation information matching the target image region is displayed on the second partial image, including:

[0123] When the second partial image belongs to the target image range of the target panoramic image, in response to the movement of the mobile terminal in the target direction while displaying the second partial image, recommendation information matching the target image range is displayed on the second partial image.

[0124] The target direction can be any direction detectable by the mobile terminal. Specifically, movement in the target direction can be movement along the direction of gravity, or it can be back-and-forth movement in a certain direction. Back-and-forth movement refers to the process of the user controlling the mobile terminal to move from position A to position B and back to position A in a certain direction. In practical applications, back-and-forth movement can be actions such as shaking or jiggling the mobile terminal by the user, or it can be a jumping action with the mobile terminal in hand. Jumping can be an upward jump or a forward / backward jump. Because the user's height relative to the ground changes and then returns to its original position during the jump, regardless of whether it's an upward, forward, or backward jump, movement in the vertical direction is considered back-and-forth movement. Shaking is a back-and-forth movement without a specific direction, while jiggling is limited to back-and-forth movement in the vertical direction.

[0125] In a specific application, when the second local image belongs to the target image range of the target panoramic image, the mobile terminal detects and responds to the user's jumping action by holding the mobile terminal through the built-in gyroscope sensor, and displays recommended information that matches the target image range on the second local image. For example, if the user jumps, an advertisement image that matches the target image range is displayed.

[0126] In this embodiment, by displaying recommended information when the mobile terminal moves back and forth in the target direction, such as when the user jumps, it is possible to create the effect that the user's jumping behavior triggers the display of recommended information, thus achieving a more interactive and immersive experience.

[0127] In one embodiment, the information recommendation method based on panoramic images further includes: in response to the movement of the mobile terminal in the target direction while displaying recommendation information, canceling the display of recommendation information matching the target image region on the second local image.

[0128] The target direction can be any direction detectable by the mobile terminal. Specifically, it can be the same direction as the target direction triggered by the display of the recommendation information, or it can be a different direction. In particular, the display and cancellation trigger operations for the recommendation information are of the same type, enabling users to display and cancel recommendation information based on the same action. This is simple and convenient, allowing users to continue obtaining other recommendation information and thus improving the recommendation effect.

[0129] This application also provides an application scenario in which the above-described panoramic image-based information recommendation method is applied. Specifically, the panoramic image-based information recommendation method is applied in this scenario as follows:

[0130] Specific application scenarios could include mobile-based information feeds, splash screens, and live streaming ads, using panoramic image-based information recommendation methods to achieve a new gamified interactive advertising display format.

[0131] Specifically, advertisers need to upload a 360° or 720° panoramic image (A) and multiple ad images (A1, A2, A3, A4, etc.) triggered from different angles as recommended information when projecting the panoramic ad image. Each ad image corresponds to an angle range. Users can use image editing tools to design or use a panoramic camera to obtain the 360° or 720° panoramic image needed as ad material.

[0132] like Figure 13 As shown, taking a mobile phone as an example, when a user raises their phone and spins it, the panoramic image A moves along with the viewfinder area (advertisement space) on the phone screen. When it moves to a certain angle in the horizontal direction, the phone detects the user's jumping action (or the user's shaking or up-and-down shaking action), such as jumping upwards, through its built-in accelerometer. This triggers the advertisement image corresponding to the angle range in that horizontal direction. When displaying the advertisement image, the corresponding application is downloaded by detecting the user's operation on the advertisement image.

[0133] This creates the effect that the user's spinning and jumping behavior triggers a partial projection of the panoramic image A in the advertisement content, transforming it into advertisement image A1, A2, A3, or A4, thus achieving a more interactive and immersive experience.

[0134] In another embodiment, such as Figure 14 As shown, the partial projection of panoramic image A onto the advertisement space on the mobile phone screen changes with the movement of the mobile phone. When the mobile phone moves to a certain angle in the horizontal direction and stops moving, the advertisement image corresponding to the angle range in that horizontal direction can be directly triggered. When the advertisement image is displayed, the corresponding application is downloaded by detecting the user's jumping behavior.

[0135] In practice, when a user clicks on a panoramic image in an ad slot on their mobile phone, the initial image scene projected from the panoramic image is displayed on the phone screen. The panoramic image includes many image scenes, each corresponding to an angle of the panoramic image. The specific angle value can be relative to the initial image scene or relative to other reference points. One image scene can be displayed on the phone screen at a time.

[0136] Taking a panoramic image of degree M as an example, there are N advertising images evenly distributed across the panoramic image. For instance, advertising image 1 corresponds to angles 1-30 degrees, advertising image 2 corresponds to angles 30-60 degrees, advertising image 3 corresponds to angles 60-90 degrees, and so on. Starting from the initial image scene, when the user rotates their phone by angle 'a' and the phone's jumping action is detected, the phone's processor determines the angle range corresponding to the image scene after the rotation angle 'a' and displays the advertising image associated with that angle range. For example, if angle 'a' is 45 degrees, then advertising image 2 will be displayed.

[0137] When an ad image is displayed on a mobile phone ad slot, if a user clicks on the ad image, triggers a download entry, or the phone detects the user's jumping action again through its built-in accelerometer, the user will be redirected to the details page corresponding to the ad image. For example, if the displayed ad image is a game ad, the user will be redirected to the game download page.

[0138] The specific implementation process is as follows: The ad slot on the mobile phone first displays a panoramic image projection scene. The image scene changes as the phone moves. When it moves to a certain angle, the phone's processor, based on the matching relationship between the angle range and the ad image, retrieves the corresponding ad image and displays it in the current image scene. While displaying the ad image, if the phone's built-in accelerometer detects the user jumping, the user is directed to the details page corresponding to the ad image, such as being redirected to a game download page. If the phone's built-in gyroscope detects that the user continues to rotate to the next angle, the phone's processor will re-retrieve the corresponding ad image based on the matching relationship between the angle range and the ad image, updating the displayed ad image. For the updated ad image, the user can also be directed to the corresponding details page by detecting the user's jumping behavior.

[0139] The detection of the phone's rotation angle and the user's jumping behavior in the above processing can be achieved using a gyroscope sensor and an accelerometer sensor, respectively. The accelerometer sensor obtains the direction of gravitational acceleration and, by integrating the acceleration over time, calculates the phone's velocity in three-dimensional space, thereby detecting the jumping behavior of the user holding the phone. The gyroscope sensor obtains the phone's angular velocity in three-dimensional space; by integrating the angular velocity over time, it obtains the change in the phone's attitude, thus determining the user's visual rotation.

[0140] In a specific application, when a user clicks on a panoramic image in a front-end ad slot, the initial image scene projected from the panoramic image is displayed on the phone screen. This initial scene could be the scene corresponding to 0 degrees in the panoramic image. When the user rotates the phone, the phone's gyroscope sensor detects the rotation angle 'a', and the phone adjusts the projected image scene based on angle 'a'. When the user stops rotating and jumps, the phone screen displays image scene A of the panoramic image. The phone detects the user's jump using an accelerometer sensor and, based on angle 'a', determines the ad image corresponding to image scene A, then overlays that ad image onto image scene A. The user can then jump again to return to image scene A. Starting from image scene A, if the user rotates by angle 'b', image scene B is displayed on the phone screen. The phone determines the corresponding ad image (i.e., the ad image associated with image scene B) based on angle a+b, and then overlays that ad image onto image scene B.

[0141] In one embodiment, such as Figure 15 The diagram illustrates an information recommendation method based on panoramic images, comprising the following steps:

[0142] Step 1502: Display the panoramic image identifier on the mobile terminal's display page.

[0143] Step 1504: In response to the triggering operation for the panoramic image identifier, display a first partial image of the target panoramic image corresponding to the panoramic image identifier projected onto the framing area of ​​the mobile terminal.

[0144] Step 1506, in response to the framing orientation adjustment for the framing area, displays a second partial image of the target panoramic image projected onto the framing area after the framing orientation adjustment.

[0145] Step 1508: In response to the projection orientation adjustment operation for the target panoramic image, a second partial image of the target panoramic image after projection orientation adjustment is displayed in the viewfinder area.

[0146] Step 1510: When the second local image belongs to the target image range of the target panoramic image, in response to the mobile terminal's back-and-forth movement in the target direction while displaying the second local image, the recommendation information display area is superimposed on the second local image, and the process jumps to step 1512 or step 1518.

[0147] Step 1512: In the recommendation information display area, display the image corresponding to the recommendation information and the entry point for recommendation details.

[0148] Step 1514: In response to the details display trigger operation triggered when the recommendation details entry is displayed, jump to the application page corresponding to the recommendation information.

[0149] Step 1516: On the application page, display the recommendation details corresponding to the recommendation information.

[0150] Step 1518: Display recommendation information in the recommendation information display area.

[0151] Step 1520: When the target image region to which the current local image in the framing area belongs remains unchanged when the target panoramic image is projected onto the framing area, in response to the information update triggering operation triggered when displaying recommendation information, alternative recommendation information matching the target image region is displayed on the second local image.

[0152] Step 1522: When the target image region to which the current local image in the framing area belongs changes when the target panoramic image is projected, in response to the information update triggering operation triggered when displaying recommendation information, the recommendation information matching the changed target image region is displayed on the current local image.

[0153] It should be understood that, although Figure 2 and Figure 15 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figure 2 and Figure 15 At least some of the steps in the process may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but may be executed at different times. The execution order of these steps or stages is not necessarily sequential, but may be executed in turn or alternately with other steps or at least some of the steps or stages in other steps.

[0154] In one embodiment, such as Figure 16As shown, an information recommendation device 1600 based on panoramic images is provided. This device can be a software module, a hardware module, or a combination of both integrated into a mobile terminal. Specifically, the device includes: a first projection module 1602, a second projection module 1604, and an information recommendation module 1606, wherein:

[0155] The first projection module 1602 is used to display a first partial image of the target panoramic image projected onto the framing area of ​​the mobile terminal.

[0156] The second projection module 1604 is configured to, in response to a displacement of the framing area relative to the target panoramic image, display a second partial image of the target panoramic image projected onto the framing area after the displacement in the framing area after the displacement.

[0157] The information recommendation module 1606 is used to display recommended information matching the target image range on the second local image when the second local image belongs to the target image range of the target panoramic image.

[0158] In one embodiment, the information recommendation module further includes an overlay display unit and a recommendation information display unit; wherein: the overlay display unit is used to overlay and display a recommendation information display area on the second partial image; the recommendation information display unit is used to display recommendation information and a recommendation details entry point in the recommendation information display area;

[0159] The information recommendation device based on panoramic images also includes a recommendation details display module, which is used to display recommendation details content corresponding to the recommendation information in response to a details display trigger operation triggered when the recommendation details entry is displayed.

[0160] In one embodiment, the recommendation details display module includes an application page display unit and a recommendation details content display unit;

[0161] The application page display unit is used to respond to a details display trigger operation triggered when the recommendation details entry is displayed, and to jump to the application page corresponding to the recommendation information;

[0162] The recommended details display unit is used to display recommended details corresponding to the recommended information on the application page.

[0163] In one embodiment, the recommendation details display module is further configured to, in response to a details display trigger operation triggered when the recommendation details entry is displayed, display recommendation details content corresponding to the recommendation information in the recommendation content display area of ​​the display page where the viewfinder area is located.

[0164] In one embodiment, the second projection module is further configured to, in response to an adjustment of the framing orientation for the framing area, display a second partial image of the target panoramic image projected onto the framing area after the framing orientation adjustment.

[0165] In one embodiment, the second projection module is further configured to, in response to a projection orientation adjustment operation for the target panoramic image, display, within the framing area, the second partial image projected onto the framing area by the target panoramic image after the projection orientation adjustment.

[0166] In one embodiment, the information recommendation device based on panoramic images further includes a recommendation information update module;

[0167] The recommendation information update module is used to display alternative recommendation information that matches the target image region on the second local image when the target panoramic image is projected onto the current local image in the framing area and the target image region remains unchanged, in response to the information update triggering operation triggered when the recommendation information is displayed.

[0168] In one embodiment, the information recommendation device based on panoramic images further includes a recommendation information update module;

[0169] The recommendation information update module is used to display the recommended information matching the changed target image region on the current local image when the target panoramic image is projected onto the framing area and the target image region to which it belongs changes, in response to the information update triggering operation triggered when displaying the recommendation information.

[0170] In one embodiment, the target image region is a first image region; the information recommendation device based on panoramic images further includes a third projection module and a recommendation information update module; wherein:

[0171] The third projection module is used to respond to a secondary displacement of the framing area relative to the target panoramic image, and to display a third partial image of the target panoramic image projected onto the framing area after the secondary displacement in the framing area after the secondary displacement.

[0172] The recommendation information update module is used to, when the third local image belongs to the second image interval of the target panoramic image, cancel the display of the recommendation information that matches the first image interval, and display the recommendation information that matches the second image interval on the third local image.

[0173] In one embodiment, the information recommendation module is further configured to, in response to an information recommendation triggering operation triggered when displaying the second local image, display recommended information matching the target image range on the second local image when the second local image belongs to the target image range of the target panoramic image.

[0174] In one embodiment, the information recommendation module is further configured to, when the second partial image belongs to the target image range of the target panoramic image, in response to the mobile terminal's back-and-forth movement in the target direction while displaying the second partial image, display recommendation information matching the target image range on the second partial image.

[0175] In one embodiment, the information cancellation display module is further configured to cancel the display of recommended information matching the target image region on the second partial image in response to the movement of the mobile terminal in the target direction when the recommended information is displayed.

[0176] In one embodiment, the recommendation information includes a three-dimensional image; the information recommendation module is further configured to display a first-view image of the three-dimensional image projected onto the framing area on the second local image;

[0177] The information recommendation device based on panoramic images further includes a perspective conversion module, which, in response to a perspective shift of the three-dimensional image relative to the framing area, displays a second perspective image of the three-dimensional image projected onto the framing area after the perspective shift occurs on the second local image.

[0178] In one embodiment, the information recommendation device based on panoramic images further includes a panoramic image identification display module;

[0179] The panoramic image identifier display module is used to display candidate panoramic image identifiers on the display page of the mobile terminal;

[0180] The first projection module is further configured to, in response to a selection operation of a target panoramic image identifier among the candidate panoramic image identifiers, display a first partial image of the target panoramic image projected onto the framing area of ​​the mobile terminal; wherein the target panoramic image identifier corresponds to the target panoramic image.

[0181] In one embodiment, the framing area is a promotional information display page; the information recommendation device based on the panoramic image includes a promotional information display page display module, used to display the promotional information display page corresponding to the target application in response to the launch operation of the target application; the first projection module is further used to display a first partial image of the target panoramic image projected onto the framing area on the promotional information display page.

[0182] In one embodiment, the framing area is a promotional information display page, and the information recommendation device based on the panoramic image includes a promotional information display area display module, which is used to display the promotional information display area in the information flow display page of the target application; the first projection module is further used to display a first partial image of the target panoramic image projected onto the framing area in the promotional information display area.

[0183] For specific embodiments of the information recommendation device based on panoramic images, please refer to the embodiments of the information recommendation method based on panoramic images described above, which will not be repeated here. Each module in the above-described information recommendation device based on panoramic images can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in the mobile terminal in hardware form, or stored in the memory of the mobile terminal in software form, so that the processor can call and execute the operations corresponding to each module.

[0184] In one embodiment, a mobile terminal is provided, the internal structure of which can be shown as follows: Figure 17 As shown, the mobile terminal includes a processor, memory, communication interface, display screen, and input device connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage medium. The communication interface allows for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, carrier networks, NFC (Near Field Communication), or other technologies. When executed by the processor, the computer program implements an information recommendation method based on panoramic images. The display screen can be an LCD screen or an e-ink screen. The input device can be a touch layer covering the display screen, buttons, a trackball, or a touchpad on the mobile terminal's casing, or an external keyboard, touchpad, or mouse.

[0185] Those skilled in the art will understand that Figure 17 The structure shown is merely a block diagram of a portion of the structure related to the solution of this application and does not constitute a limitation on the mobile terminal to which the solution of this application is applied. A specific mobile terminal may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0186] In one embodiment, a mobile terminal is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above method embodiments.

[0187] In one embodiment, a computer-readable storage medium is provided storing a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0188] In one embodiment, a computer program product or computer program is provided, the computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of a mobile terminal reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, causing the mobile terminal to perform the steps in the above-described method embodiments.

[0189] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the methods described above. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical storage, etc. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0190] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0191] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. An information recommendation method based on panoramic images, characterized in that, The method includes: In the viewfinder area of ​​the mobile terminal, a first partial image of the target panoramic image is projected onto the viewfinder area. In response to a displacement of the framing area relative to the target panoramic image, a second partial image of the target panoramic image projected onto the framing area after the displacement is displayed in the framing area after the displacement. When the second partial image belongs to the target image interval of the target panoramic image, in response to the movement of the mobile terminal in the target direction while displaying the second partial image, recommended information matching the target image interval is displayed on the second partial image. The recommended information includes a first-view image projected onto the framing area, and the function of adjusting the projection view of the displayed partial image is disabled, so that the dragging operation on the second partial image has a unique target. The target image interval is one of multiple image intervals obtained after dividing the target panoramic image into intervals. The target direction includes the gravity direction. In response to a viewpoint shift of the 3D image relative to the framing area, a second viewpoint image of the 3D image projected onto the framing area after the viewpoint shift occurs is displayed on the second partial image; the viewpoint shift is achieved through a drag operation. When the target panoramic image is projected onto the target image range to which the current local image in the framing area belongs remains unchanged, in response to the information update triggering operation triggered when the recommendation information is displayed, alternative recommendation information matching the target image range is displayed on the second local image; When the target image interval to which the current local image in the framing area belongs changes when the target panoramic image is projected, in response to the information update triggering operation triggered when the recommendation information is displayed, the recommendation information matching the changed target image interval is displayed on the current local image. The information update triggering operation is determined by detecting whether the user is carrying a mobile terminal and performing a jumping action.

2. The method according to claim 1, characterized in that, The step of displaying recommendation information matching the target image region on the second local image includes: The recommendation information display area is overlaid on the second local image; The recommended information display area displays the image corresponding to the recommended information and the entry point for the recommended details; The method further includes: In response to a details display trigger operation triggered when the recommended details entry is displayed, recommended details content corresponding to the recommended information is displayed.

3. The method according to claim 2, characterized in that, The detail display trigger operation, triggered when the recommendation details entry is displayed, displays recommendation details content corresponding to the recommendation information, including: In response to the details display trigger operation triggered when the recommended details entry is displayed, the user is redirected to the application page corresponding to the recommended information; The application page displays recommendation details corresponding to the recommendation information.

4. The method according to claim 2, characterized in that, The detail display trigger operation, triggered when the recommendation details entry is displayed, displays recommendation details content corresponding to the recommendation information, including: In response to the details display trigger operation triggered when the recommended details entry is displayed, recommended details content corresponding to the recommended information is displayed in the recommended content display area of ​​the display page where the viewfinder area is located.

5. The method according to claim 1, characterized in that, The step of responding to a displacement of the framing area relative to the target panoramic image, and displaying a second partial image of the target panoramic image projected onto the framing area after the displacement, in the framing area after the displacement, includes: In response to an adjustment of the framing orientation for the framing area, a second partial image of the target panoramic image projected onto the framing area after the framing orientation adjustment is performed in the framing area after the framing orientation adjustment.

6. The method according to claim 1, characterized in that, The step of responding to a displacement of the framing area relative to the target panoramic image, and displaying a second partial image of the target panoramic image projected onto the framing area after the displacement, in the framing area after the displacement, includes: In response to a projection orientation adjustment operation on the target panoramic image, a second partial image projected onto the viewfinder area after the projection orientation adjustment of the target panoramic image is displayed in the viewfinder area.

7. The method according to claim 1, characterized in that, The target image region is a first image region; the method further includes: In response to a secondary displacement of the framing area relative to the target panoramic image, a third partial image of the target panoramic image projected onto the framing area after the secondary displacement is displayed in the framing area after the secondary displacement. When the third partial image belongs to the second image interval of the target panoramic image, the recommended information matching the first image interval is canceled, and the recommended information matching the second image interval is displayed on the third partial image.

8. The method according to any one of claims 1 to 7, characterized in that, The method further includes: In response to the launch operation of the target application, a promotional information display page corresponding to the target application is displayed; The step of displaying a first partial image projected onto the viewfinder area of ​​the mobile terminal, showing the panoramic image of the target projected onto the viewfinder area, includes: On the promotional information display page, a first partial image is displayed, projected onto the framing area from the target panoramic image.

9. The method according to any one of claims 1 to 7, characterized in that, The method further includes: Display promotional information in the information feed page of the target application; The step of displaying a first partial image projected onto the viewfinder area of ​​the mobile terminal, showing the panoramic image of the target projected onto the viewfinder area, includes: In the promotional information display area, a first partial image of the target panoramic image is projected onto the framing area.

10. The method according to any one of claims 1 to 7, characterized in that, The method further includes: On the mobile terminal's display page, candidate panoramic image identifiers are displayed; The step of displaying a first partial image projected onto the viewfinder area of ​​the mobile terminal, showing the panoramic image of the target projected onto the viewfinder area, includes: In response to a selection operation of a target panoramic image identifier among the candidate panoramic image identifiers, a first partial image of the target panoramic image projected onto the framing area of ​​the mobile terminal is displayed; wherein the target panoramic image identifier corresponds to the target panoramic image.

11. An information recommendation device based on panoramic images, characterized in that, The device includes: The first projection module is used to display a first partial image of the target panoramic image projected onto the framing area of ​​the mobile terminal. The second projection module is configured to, in response to a displacement of the framing area relative to the target panoramic image, display a second partial image of the target panoramic image projected onto the framing area after the displacement in the framing area after the displacement. The information recommendation module is used to display recommended information matching the target image interval on the second partial image when the second partial image belongs to the target image interval of the target panoramic image, in response to the movement of the mobile terminal in the target direction while displaying the second partial image. The recommended information includes a first-view image projected onto the framing area of ​​the three-dimensional image, and the function of adjusting the projection view of the displayed partial image is disabled, so that the dragging operation on the second partial image is unique; the target image interval is one of multiple image intervals obtained after dividing the target panoramic image into intervals; the target direction includes the gravity direction. A perspective conversion module is used to respond to a perspective shift of the 3D image relative to the framing area, and to display a second perspective image of the 3D image projected onto the framing area after the perspective shift occurs on the second local image; the perspective shift is achieved through a drag operation; The information recommendation module is further configured to, when the target image interval to which the current local image in the framing area belongs remains unchanged, respond to an information update triggering operation triggered when displaying the recommendation information, display alternative recommendation information matching the target image interval on the second local image; when the target image interval to which the current local image in the framing area belongs changes, respond to an information update triggering operation triggered when displaying the recommendation information, display recommendation information matching the changed target image interval on the current local image, wherein the information update triggering operation is determined by detecting whether the user is carrying a mobile terminal and performing a jumping action.

12. The information recommendation device based on panoramic images according to claim 11, characterized in that, The information recommendation module includes an overlay display unit and a recommendation information display unit; wherein: the overlay display unit is used to overlay and display a recommendation information display area on the second local image; the recommendation information display unit is used to display the image corresponding to the recommendation information and the recommendation details entry in the recommendation information display area; The information recommendation device based on panoramic images also includes a recommendation details display module, which is used to display recommendation details content corresponding to the recommendation information in response to a details display trigger operation triggered when the recommendation details entry is displayed.

13. The information recommendation device based on panoramic images according to claim 12, characterized in that, The recommendation details display module includes an application page display unit and a recommendation details content display unit; The application page display unit is used to respond to a details display trigger operation triggered when the recommendation details entry is displayed, and to jump to the application page corresponding to the recommendation information; The recommended details display unit is used to display recommended details corresponding to the recommended information on the application page.

14. The information recommendation device based on panoramic images according to claim 12, characterized in that, The recommended details display module is also used to respond to a details display trigger operation triggered when the recommended details entry is displayed, and to display recommended details content corresponding to the recommended information in the recommended content display area of ​​the display page where the viewfinder area is located.

15. The information recommendation device based on panoramic images according to claim 11, characterized in that, The second projection module is further configured to, in response to an adjustment of the framing orientation of the framing area, display a second partial image of the target panoramic image projected onto the framing area after the framing orientation adjustment.

16. The information recommendation device based on panoramic images according to claim 11, characterized in that, The second projection module is further configured to, in response to a projection orientation adjustment operation for the target panoramic image, display, within the framing area, the second partial image projected onto the framing area by the target panoramic image after the projection orientation adjustment.

17. The information recommendation device based on panoramic images according to claim 11, characterized in that, The target image region is the first image region; the device further includes a third projection module and a recommendation information update module; wherein: The third projection module is used to respond to a secondary displacement of the framing area relative to the target panoramic image, and to display a third partial image of the target panoramic image projected onto the framing area after the secondary displacement in the framing area after the secondary displacement. The recommendation information update module is used to, when the third local image belongs to the second image interval of the target panoramic image, cancel the display of recommendation information matching the first image interval, and display recommendation information matching the second image interval on the third local image.

18. The information recommendation device based on panoramic images according to claim 11, characterized in that, The device further includes a promotional information display page module, used to display a promotional information display page corresponding to the target application in response to a launch operation of the target application; the first projection module is also used to display a first partial image of the target panoramic image projected onto the framing area on the promotional information display page.

19. The information recommendation device based on panoramic images according to claim 11, characterized in that, The device further includes a promotional information display area display module, used to display a promotional information display area in the information flow display page of the target application; the first projection module is also used to display a first partial image of the target panoramic image projected onto the framing area in the promotional information display area.

20. The information recommendation device based on panoramic images according to claim 11, characterized in that, The device also includes a panoramic image label display module, used to display candidate panoramic image labels on the display page of the mobile terminal; The first projection module is further configured to, in response to a selection operation of a target panoramic image identifier among the candidate panoramic image identifiers, display a first partial image of the target panoramic image projected onto the framing area of ​​the mobile terminal; wherein the target panoramic image identifier corresponds to the target panoramic image.

21. A mobile terminal, comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the method of any one of claims 1 to 10.

22. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method of any one of claims 1 to 10.

23. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method of any one of claims 1 to 10.

Images