Information display method, device, electronic device, and storage medium

By displaying related information of a target audio segment in a video playback page, the recommendation effect of advertising videos is improved, enhancing user engagement and reducing costs.

JP7722791B2Active Publication Date: 2025-08-13BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2024519382
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-09-28
Filing Date
2022-09-19
Publication Date
2025-08-13
Estimated Expiration
2042-09-19

AI Technical Summary

Technical Problem

Current advertising videos only display single item information, leading to a poor recommendation effect.

Method used

Display related information of a target audio segment containing a preset keyword in a first display area of a video playback page during playback, enhancing the recommendation effect by converting auditory information into visual form.

Benefits of technology

Enhances user understanding and impression of the recommendation, expands the application scope, and reduces production costs by enabling the recommendation of actual and virtual items.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007722791000001
    Figure 0007722791000001
  • Figure 0007722791000002
    Figure 0007722791000002
  • Figure 0007722791000003
    Figure 0007722791000003
Patent Text Reader

Abstract

The embodiments of the present disclosure provide an information display method, an apparatus, an electronic device, and a storage medium, which include: playing a recommended video of a target object; and displaying related information of the target audio segment in a first display area of ​​a video playback page in response to the recommended video being played up to the target video segment corresponding to the target audio segment, which is an audio segment including a preset keyword.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This application claims priority from Chinese Application No. 202111140475.7, filed on September 28, 2021, and incorporates by reference all of the contents of that Chinese application.

[0002] [Technical field] TECHNICAL FIELD The present disclosure relates to the field of computer technology, for example, to an information display method, device, electronic device, and storage medium. [Background technology]

[0003] Currently, when playing advertising videos, item information such as photos of the recommended items and purchase links can be displayed on the video playback page to make it easier for users to view and purchase the recommended items.

[0004] However, in the related art, the advertisement video only displays single item information for the recommended items, which results in poor recommendation effect of the advertisement video. Summary of the Invention

[0005] The embodiments of the present disclosure provide an information display method, device, electronic device, and storage medium for displaying various information and enhancing the effectiveness of video recommendation.

[0006] According to a first aspect, an embodiment of the present disclosure comprises: Playing a recommendation video for the target object; In response to the recommended video being played up to a target video segment corresponding to the target audio segment, which is an audio segment including a preset keyword, displaying related information of the target audio segment in a first display area of a video playback page.

[0007] According to a second aspect, an embodiment of the present disclosure further comprises: a video playback module configured to play a recommendation video of the target object; and a first display module configured to display, when the recommended video is played up to a target video segment corresponding to the target audio segment, related information of the target audio segment, which is an audio segment including a preset keyword, in a first display area of a video playback page.

[0008] According to a third aspect, an embodiment of the present disclosure further comprises: at least one processor; a memory configured to store at least one program; When the at least one program is executed by the at least one processor, the at least one processor provides an electronic device that implements the information display method described in the embodiments of the present disclosure.

[0009] According to a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, the computer program, when executed by a processor, realizing the information display method described in the embodiment of the present disclosure. [Brief explanation of the drawings]

[0010] Throughout the drawings, the same or similar reference numerals represent the same or similar elements, and it should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0011] [Figure 1] 1 is a flowchart of an information display method according to an embodiment of the present disclosure.

[0012] [Figure 2] FIG. 1 is a schematic diagram of a video playback page according to an embodiment of the present disclosure.

[0013] [Figure 3] FIG. 10 is a schematic diagram of another video playback page according to an embodiment of the present disclosure.

[0014] [Figure 4] FIG. 10 is a schematic diagram illustrating a display form of related information according to an embodiment of the present disclosure.

[0015] [Figure 5] 10A and 10B are schematic diagrams illustrating another display form of information-related information according to an embodiment of the present disclosure.

[0016] [Figure 6] 10 is a flowchart of another information display method according to an embodiment of the present disclosure.

[0017] [Figure 7] FIG. 10 is a schematic diagram illustrating a transfer mode of related information according to an embodiment of the present disclosure.

[0018] [Figure 8] FIG. 10 is a schematic diagram illustrating another form of related information transfer according to an embodiment of the present disclosure.

[0019] [Figure 9] FIG. 4 is a schematic diagram of a second display area according to an embodiment of the present disclosure.

[0020] [Figure 10] FIG. 10 is a schematic diagram of another second display area according to an embodiment of the present disclosure.

[0021] [Figure 11] FIG. 10 is a schematic diagram of yet another second display area according to an embodiment of the present disclosure.

[0022] [Figure 12] 1 is a structural block diagram of an information display device according to an embodiment of the present disclosure.

[0023] [Figure 13] 1 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0024] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the drawings.

[0025] It should be understood that the steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel, and that method embodiments may include additional steps and / or omit performing illustrated steps, and the scope of the present disclosure is not limited in this respect.

[0026] As used herein, the term "comprises" and variations thereof are open inclusions, including but not limited to. The term "based on" means "based at least in part on." The term "in one embodiment" means "at least one embodiment," the term "in another embodiment" means "at least one other embodiment," and the term "in some embodiments" means "at least some embodiments." Relevant definitions of other terms are provided below.

[0027] It should be noted that the concepts of "first", "second", etc. referred to in this disclosure are used only to distinguish different devices, modules or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules or units.

[0028] It should be noted that the modifications "one" and "multiple" referred to in this disclosure are exemplary rather than limiting, and should be understood as "at least one" unless the context clearly indicates otherwise, as would be understood by one of ordinary skill in the art.

[0029] The names of messages or information interacting between multiple devices in the embodiments of the present disclosure are used for descriptive purposes only and are not intended to limit the scope of these messages or information.

[0030] FIG. 1 is a flowchart of an information display method according to an embodiment of the present disclosure. This method may be performed by an information display device, which may be implemented in software and / or hardware, and which may be located in an electronic device, typically a mobile phone or a tablet. The information display method according to an embodiment of the present disclosure is applied to a scene in which information is displayed based on audio data of a recommended video. As shown in FIG. 1, the information display method according to this embodiment may include the following steps:

[0031] S101: Play a recommendation video of a target object.

[0032] The recommendation video may be a video for recommending an object to a user, such as an advertising video or an e-commerce video. The target object may be an object recommended in the recommendation video, such as an event or an item recommended in the recommendation video. The item may be a real item or a virtual item, but this embodiment is not limited thereto.

[0033] For example, a user can watch a video through a video playback page. As shown in Figures 2 and 3, the electronic device can display the video playback page, switch the video played on the video playback page based on the user's video switching operation, automatically switch the video played on the video playback page based on a preset switching rule, or play the recommended video on the video playback page when switching to a recommended video for an object (i.e., a target object).

[0034] S102: When the recommended video is played up to a target video segment corresponding to a target audio segment, display related information of the target audio segment, which is an audio segment including a preset keyword, in a first display area of a video playback page.

[0035] The target audio segment may be an audio segment containing a preset keyword in the audio data of the recommendation video, i.e., an audio segment corresponding to a sentence or sentence segment in which the preset keyword is located, or an audio segment in which the preset keyword exists in its corresponding text content. The preset keyword may be a preset type of keyword, for example, a keyword related to special offer information (e.g., words such as clearance, cost performance, price reduction, bargain, wholesale, discount, special offer, cheap, time limit, etc., or a sentence related to special offer information), a keyword related to descriptive information (e.g., words or sentences related to size, color, shape, face value, etc.). Hereinafter, the preset keyword will be described as a keyword related to special offer information.

[0036] The target video segment is a video segment corresponding to the target audio segment in the recommended video, i.e., a video segment located between the start time node and the end time node corresponding to the target audio segment in the recommended video. The related information of the target audio segment may be information about the content played by the target audio segment, such as the content played by the target audio segment, summary information or important information about the content played by the target audio segment, or information about the object recommended by the target audio segment (i.e., information about the target object (e.g., bonus information)). The first display area may be an area on the video playback page for displaying the related information, and the size and position of the first display area can be set as needed. For example, the first display area can be set to have the same width as the second display area, and / or the first display area can be set to be located above the second display area, or in the center or one side of the video playback page, etc.

[0037] In a specific embodiment, the electronic device can obtain related information about the target audio segment from the server. For example, after a recommended video for a target object is uploaded to the server, the server determines whether the recommended video contains a target audio segment containing a preset keyword based on a preset rule (e.g., a pre-trained discrimination model) before distributing the recommended video. If the server determines that the recommended video contains a target audio segment, it determines target video segment information corresponding to the target audio segment and related information about the target audio segment. Therefore, when the recommended video needs to be played, the electronic device obtains the audio-video data, target video segment information, and related information about the target audio segment from the server, plays the recommended video on a video playback page based on the audio-video data, and displays related information about the target audio segment in the first display area 40 of the video playback page after the target video segment corresponding to the target video segment information is played, as shown in FIGS. 4 and 5.

[0038] In another specific embodiment, the electronic device can identify and obtain a target video segment corresponding to a target audio segment in a recommended video and related information about the target audio segment. For example, when the electronic device needs to play a recommended video for a target object, it first obtains the audio-video data of the recommended video from the server, determines whether the recommended video contains a target audio segment containing a preset keyword based on preset rules, and if it determines that the recommended video contains a target audio segment, determines target video segment information corresponding to the target audio segment and related information about the target audio segment. Then, it plays the recommended video on a video playback page based on the audio-video data. When the target video segment corresponding to the target video segment information is played, it displays related information about the target audio segment in the first display area 40 of the video playback page, as shown in Figures 4 and 5.

[0039] In this embodiment, when a recommendation video is played, information is displayed based on the audio played in the recommendation video. For example, when audio related to bonus information for a target object is played in the video, the bonus information for the target object is automatically displayed on the video playback page, and / or when a descriptive audio for the target object is played in the video, the descriptive information for the target object is automatically displayed on the video playback page. This realizes a conversion between auditory and visual information in the video, enhances the user's understanding of the auditory information in the video, and improves the effectiveness of the recommendation of the target object. Furthermore, because the information display does not need to be based on the currently played video screen, it is not required that the target object be a displayable actual item or that it be displayed on the video screen, and it is not required that the video producer fully understand the recommendation video in advance and decide when to display the information. This expands the application scope of recommendation videos, enables the recommendation of actual items and even virtual items, reduces the production costs of recommendation videos, and further reduces the recommendation costs for target objects.

[0040] In one embodiment, displaying information related to the target audio segment in the first display area of the video playback page includes displaying text information corresponding to the target audio segment and obtained by speech recognition of the target audio segment in the first display area of the video playback page.

[0041] In the above embodiment, the related information of the target audio segment may be character information corresponding to the target audio segment, i.e., the text content corresponding to the target audio segment. Therefore, when an audio segment containing a preset keyword is played, the character information corresponding to the audio segment is displayed on the video playback page. For example, the bonus information currently being played on the video playback page is synchronously displayed in text form, thereby achieving the effect of "hearing and seeing," enhancing the user's impression and understanding of the content played in the audio segment, and increasing the probability that the user will receive a recommendation for the target object.

[0042] For example, the electronic device may first determine a target audio segment included in a recommended video for the target object, or may determine the target audio segment via a server. Then, the recommended video for the target object is played on a video playback page. When the recommended video is played up to a target video segment corresponding to a target audio segment including a preset keyword, text information corresponding to the target audio segment is displayed in a first display area of the video playback page. For example, when the recommended video is played up to a video segment corresponding to an audio segment including a keyword related to bonus information, the electronic device or the server may obtain text information corresponding to the audio segment by performing voice recognition on the audio segment in advance, or may perform voice recognition on the audio segment to obtain text information corresponding to the audio segment, and display the text information in a first display area of the video playback page. The display state of the text information corresponding to the target audio segment, such as font, font size, and / or color, may be set as needed.

[0043] In the above embodiment, after displaying text information corresponding to the target audio segment, the text information may include text currently being played in the recommended video and text not currently being played in the recommended video (including text already played in the recommended video and / or text not yet played). Therefore, during playback of the recommended video, the text currently being played in the recommended video and the text not currently being played in the recommended video may be displayed in the same display state, or the text currently being played in the recommended video and the text not currently being played in the recommended video may be displayed in different display states. This can enhance the user's interest and impression in the text information (especially the text currently being played among the text information) and improve the enjoyment of the text information when it is displayed. Optionally, displaying the text information corresponding to the target audio segment in the first display area of the video playback page may include displaying the text currently being played among the text information in a first display state and the text not currently being played among the text information in a second display state in the first display area of the video playback page. The first display state and the second display state may be two display states that are not completely identical in terms of display format, such as font, font size, and / or color.

[0044] In addition, if it is not possible to simultaneously display the text information corresponding to the target audio segment in the first display area, some of the text information, including the text currently being played in the recommended video contained in the text information, is displayed in the first display area, and as the recommended video is played, the text information displayed in the first display area is updated, for example, by scrolling or turning the page.

[0045] In this embodiment, the display time of the related information of the target audio segment can be set as needed, for example, the related information of the target audio segment can be set to be displayed for a predetermined time (for example, 3 seconds or 5 seconds), or the target audio segment can be set to be displayed until the recommended video or the target video segment is played.

[0046] Considering the relevance of the displayed related information to the currently played content, in this embodiment, the related information of the target audio segment can be displayed in the first display area only when the target audio segment is played, i.e., only when the target video segment corresponding to the target audio segment is played. In this case, the information display method of this embodiment further includes: when the playback of the target video segment ends, stopping the display of the related information in the first display area, for example, stopping the display of the related information of the target audio segment at any position on the video playback page, or moving the related information of the target audio segment to another display area on the video playback page other than the first display area for display.

[0047] Furthermore, if the recommended video contains multiple audio segments containing preset keywords, any one of the multiple audio segments (for example, the first audio segment) can be set as the target audio segment, or all of the multiple audio segments can be set as target audio segments. If all of the multiple audio segments are set as target audio segments, for each target audio segment, related information for the target audio segment can be displayed in the first display area of the video playback page during the process of playing the video segment corresponding to the target audio segment, or when playing the first target audio segment, related information for the multiple target audio segments can be displayed in the first display area of the video playback page until the end of playback of the last target audio segment or the end of playback of the recommended video, but this can be set as needed.

[0048] In this embodiment, a recommended video for a target object is played. When the recommended video reaches a target video segment corresponding to a target audio segment containing a preset keyword, related information for the target audio segment is displayed in a first display area of the video playback page. By adopting the above technical means, this embodiment not only displays a variety of information but also transforms the auditory and visual dimensions, enhances the user's impression of the audio played in the recommended video, improves the recommendation effect of the recommended video, expands the application scope of the recommended video, and reduces the production costs of the recommended video.

[0049] 6 is a flowchart of another information display method according to an embodiment of the present disclosure. This embodiment can be combined with at least one selectable embodiment of the above-described embodiment. Optionally, stopping the display of the related information in the first display area includes moving the related information from the first display area to a second display area of the video playback page for displaying object information of the target object, and displaying the related information so that it gradually becomes smaller during the movement.

[0050] Optionally, the method further includes moving the related information from the first display area to a second display area of the video playback page, and then displaying the related information in the second display area, or displaying first detailed information corresponding to the related information in the second display area, and canceling the display of the related information.

[0051] Optionally, after displaying related information of the target audio segment in a first display area of a video playback page, the method further includes switching a current page from the video playback page to a details page of the target object in response to a trigger operation on the related information, and displaying second detailed information of the target object on the details page.

[0052] As shown in FIG. 6, the information display method according to this embodiment may include the following steps.

[0053] S201: Play a recommendation video for the target object.

[0054] S202: When the recommended video is played up to the target video segment corresponding to the target audio segment, which is an audio segment containing a preset keyword, display related information of the target audio segment in the first display area of the video playback page, and execute S203 or S205.

[0055] S203: When the playback of the target video segment is completed, the related information is moved from the first display area to a second display area of the video playback page for displaying object information of the target object, and during the movement, the related information is displayed so as to gradually become smaller.

[0056] In this embodiment, when the playback of the target video segment ends, the related information displayed in the first display area can be controlled to move to the second display area, so that the user can view and interact with the object information of the target object displayed in the second display area, which can include information such as a photo, name, price, and special offer information of the target object.

[0057] For example, as shown in Figures 2 and 3, the electronic device plays a recommended video for a target object on a video playback page, displays object information for the target object in the second display area 20 of the video playback page, and when the recommended video is played up to a target video segment corresponding to the target audio segment, displays related information for the target audio segment in the first display area 40 of the video playback page. As shown in Figures 4 and 5, the electronic device continues to play the recommended video, and when the playback of the target video segment ends, controls the movement of the related information for the target audio segment displayed in the first display area 40 to the second display area 20. During the movement, the display size of the related information is gradually reduced, as shown in Figures 7 and 8. During the movement, the movement trajectory, movement speed, and contraction speed of the related information can be set as needed, but this embodiment is not limited thereto.

[0058] S204: The related information is displayed in the second display area, or first detailed information corresponding to the related information is displayed in the second display area, and the display of the related information is canceled to end the operation.

[0059] The first detailed information may be detailed information related to the target audio segment, for example, if the target audio segment includes an audio segment related to bonus information, the first detailed information may be detailed bonus information of the target object, such as the initial price, current price, and / or bonus range of the target object.

[0060] For example, when playback of the target video segment corresponding to the target audio segment ends, the electronic device controls the movement of the related information of the target audio segment from the first display area 40 to the second display area 20. When the related information moves to the second display area 20, the electronic device continues to display the related information in the second display area 20 as shown in Figures 9 and 10, or displays detailed information (i.e., first detailed information) of the related information in the second display area 20 and stops displaying the related information as shown in Figure 11. For example, the electronic device may display the related information / first detailed information in a blank area of the second display area 20, control the movement and / or reduction of the object information of the target object initially displayed in the second display area 20, and display the related information / first detailed information in the blank area formed by the movement, and / or replace certain information initially displayed in the second display area 20 (e.g., bonus information initially displayed as a subtitle in the second display area 20) with the related information / first detailed information.

[0061] In this embodiment, it is possible to determine whether to display the related information / first detailed information of the related information in the second display area based on the size of the second display area 20 and / or the type of keyword included in the target audio segment. For example, if the second display area 20 is a small display area (e.g., smaller than a preset threshold), the related information can be directly displayed in the second display area. If the second display area 20 is a large display area (e.g., larger than a preset threshold), the first detailed information of the related information can be directly displayed in the second display area. Alternatively, it is possible to determine whether the preset keyword included in the target audio segment is a preset type keyword, and if the preset keyword included in the target audio segment is a preset type keyword, the first detailed information of the related information can be displayed in the second display area. If the preset keyword included in the target audio segment is not a preset type keyword, the related information can be displayed in the second display area.

[0062] For example, if the preset keyword is a keyword related to bonus information and the related information of the target audio segment is text information corresponding to the target audio segment, when the size of the second display area 20 is large and the preset keyword included in the target audio segment is not a preset type keyword, or when the size of the second display area 20 is small, as shown in Figures 9 and 10, the movement of the text information of the target audio segment from the first display area 40 to the display position (e.g., subtitle position) of the bonus information of the target object in the second display area 20 can be controlled, and the bonus information displayed at that position can be replaced with the related information. If the size of the second display area 20 is large and the preset keyword included in the target audio segment is a preset type of keyword (for example, a keyword related to a time sale, discount, price reduction, coupon, etc.), the movement of the text information of the target audio segment from the first display area 40 to a certain position (such as a boundary position or a center position) in the second display area 20 is controlled, the reduction of the information such as the photo or name of the target object initially displayed in the second display area 20 is controlled, and its display position is adjusted toward the boundary, so that the first detailed information of the related information can be displayed in the center area of the second display area 20, as shown in Figure 11 (Figure 11 illustrates an example in which the first detailed information is coupon information).

[0063] S205: In response to a trigger operation on the related information, switch the current page from the video playback page to a details page of the target object, and display second detailed information of the target object on the details page.

[0064] The second detailed information can be understood as detailed information about the target object, such as detailed introduction information about the target object.

[0065] For example, the electronic device plays a recommended video of a target object on a video playback page. If the recommended video includes a target video segment corresponding to a target audio segment containing a preset keyword, the electronic device displays related information of the target audio segment in a first display area of the video playback page. When the user wants to view second detailed information of the target object recommended in the recommended video or purchase the target object, the user can trigger (e.g., click) the related information. Furthermore, when the electronic device detects that the user triggers the related information displayed on the video playback page, the electronic device can switch the current page from the video playback page to a details page of the target object and display the second detailed information of the target object on the details page for the user to view. The details page can be in the same or different application software as the video playback page. If the details page is in a different application software from the video playback page, the electronic device can call a corresponding interface of the application software in which the details page is located to instruct the application software in which the details page is located to display the details page of the target object.

[0066] In addition, when related information of the target audio segment moves from the first display area to the second display area or is displayed in the second display area, if it is detected that the user triggers the related information, or if it is detected that the user triggers any position in the second display area (including a control position or a non-control position in the second display area), the current display page can be switched from the video playback page to a detail page of the target object so that the user can easily view second detailed information of the target object.

[0067] In the information display method of this embodiment, the display and movement of related information of the target audio segment can guide the user to interact, and provide the user with richer information display and interaction methods, thereby improving the user's viewing experience, interaction experience, and recommendation effect of the recommended video.

[0068] 12 is a structural block diagram of an information display device according to an embodiment of the present disclosure. This device may be realized by software and / or hardware and may be disposed in an electronic device, typically a mobile phone or a tablet, and can display related information by executing the information display method according to the present application. As shown in FIG. 12, the information display device according to this embodiment includes: a video playing module 1201 configured to play a recommendation video of the target object; The video playback page may include a first display module 1202 configured to display related information of the target audio segment, which is an audio segment including a preset keyword, in a first display area of the video playback page when the recommended video is played up to a target video segment corresponding to the target audio segment.

[0069] In the information display device of this embodiment, a video playback module plays a recommended video for a target object, and when the recommended video reaches a target video segment corresponding to a target audio segment containing a preset keyword, a first display module displays information related to the target audio segment in a first display area of the video playback page. By adopting the above technical means in this embodiment, when the recommended video plays a specific audio containing a preset keyword, information related to the specific audio is displayed on the video playback page. This not only enables the display of diverse information, but also realizes the conversion between the auditory and visual dimensions, strengthens the user's impression of the audio played in the recommended video, improves the recommendation effect of the recommended video, expands the application scope of the recommended video, and reduces the production costs of the recommended video.

[0070] In the above embodiment, the first display module 1202 can be configured to display text information corresponding to the target audio segment and obtained by voice recognition of the target audio segment in a first display area of the video playback page.

[0071] In the above embodiment, the first display module 1202 can be configured to display characters of the text information that are currently being played in a first display state in a first display area of the video playback page, and to display characters of the text information that are not currently being played in a second display state.

[0072] Optionally, the information display device of this embodiment may further include a second display module configured to stop displaying the related information in the first display area when playback of the target video segment ends.

[0073] In the above embodiment, the second display module can be configured to move the related information from the first display area to a second display area of the video playback page for displaying object information of the target object, and to display the related information so that it gradually becomes smaller during the movement.

[0074] Optionally, the information display device of this embodiment may further include a third display module configured to move the related information from the first display area to a second display area of the video playback page, and then display the related information in the second display area, or to display first detailed information corresponding to the related information in the second display area and cancel the display of the related information.

[0075] Optionally, the information display device of this embodiment may further include a page switching module configured to, after displaying related information of the target audio segment in a first display area of the video playback page, switch the current page from the video playback page to a details page of the target object in response to a trigger operation on the related information, and display second detailed information of the target object on the details page.

[0076] The information display device according to the embodiment of the present disclosure can execute the information display method according to any embodiment of the present disclosure, and has a corresponding functional module for executing the information display method. For technical details not described in detail in this embodiment, please refer to the information display method according to any embodiment of the present disclosure.

[0077] Referring now to FIG. 13, FIG. 13 illustrates a structural diagram of an electronic device (e.g., a terminal device) 1300 suitable for implementing an embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (PADs), portable media players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital televisions (TVs) and desktop computers. The electronic device illustrated in FIG. 13 is merely an example and does not impose any limitations on the functionality and scope of use of the embodiment of the present disclosure.

[0078] 13, electronic device 1300 may include a processing unit (e.g., a central processor, a graphics processor, etc.) 1301, which can perform various appropriate operations and processes based on programs stored in read-only memory (ROM) 1302 or programs loaded from storage device 1308 into random access memory (RAM) 1303. RAM 1303 further stores various programs and data necessary for the operation of electronic device 1300. Processing unit 1301, ROM 1302, and RAM 1303 are connected to each other via bus 1304. Input / output (I / O) interface 1305 is also connected to bus 1304.

[0079] Typically, input devices 1306, including, for example, a touch screen, touch board, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 1307, including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1308, including, for example, a magnetic tape, hard disk, etc.; and communication devices 1309 may be connected to the I / O interface 1305. The communication devices 1309 may enable the electronic device 1300 to communicate wirelessly or via wires to exchange data with other devices. While FIG. 13 illustrates the electronic device 1300 with various devices, it should be understood that it need not implement or include all of the illustrated devices. Alternatively, more or fewer devices may be implemented or included.

[0080] In particular, according to an embodiment of the present disclosure, the processes described with reference to the flowcharts may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program stored on a non-transitory computer-readable medium, the computer program including program code for performing the method illustrated in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 1309, or may be installed from the storage device 1308, or may be installed from the ROM 1302. When the computer program is executed by the processing device 1301, it performs the functions defined by the method of the embodiment of the present disclosure.

[0081] The computer-readable medium of the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the above. The computer-readable storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to, an electrical connection having at least one conductor, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM) or flash memory, an optical fiber, a portable compact magnetic disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in combination with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a propagated data signal, in baseband or as part of a carrier, having computer-readable program code carried thereon. Such a propagated data signal may take various forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.The program code contained in the computer readable medium may be transmitted over any suitable medium, including, but not limited to, wire, cable, radio frequency (RF), or the like, or any suitable combination of the above.

[0082] In some embodiments, clients and servers may communicate using any network protocol now known or later developed, such as, for example, HyperText Transfer Protocol (HTTP), and may interconnect via any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include local area networks (Wide Area Networks, WANs), wide area networks (WANs), extranets (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any network now known or later developed.

[0083] The computer-readable medium may be included in the electronic device, or may exist separately from the electronic device.

[0084] At least one program is stored on the computer-readable medium, and when the at least one program is executed by the electronic device, it causes the electronic device to play a recommended video of the target object, and when the recommended video is played up to a target video segment corresponding to the target audio segment, display related information of the target audio segment, which is an audio segment including a preset keyword, in a first display area of a video playback page.

[0085] Computer program code for carrying out the operations of the present disclosure may be written in one or a variety of programming languages or combinations thereof, including, but not limited to, Java, Smalltalk, and C++ object-oriented programming languages, and further including common procedural programming languages such as "C" or similar. The program code may run entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. When referring to a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet through an Internet Service Provider).

[0086] The flowcharts and block diagrams in the figures illustrate possible system architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or portion of code, which includes at least one executable instruction for performing the specified logical function. It should be noted that in some alternative implementations, the functions depicted in the blocks may be performed in a different order than that depicted in the figures. For example, two successively depicted blocks may actually be executed essentially in parallel, or may be executed in the reverse order, depending on the functionality. It should be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented in a dedicated hardware-based system that performs the specified functions or operations, or in a combination of dedicated hardware and computer instructions.

[0087] The units according to the embodiments of the present disclosure may be implemented in a software or hardware manner, and the names of the units may not necessarily be used to limit the units themselves.

[0088] The functionality described herein may be implemented, at least in part, in at least one hardware logic element. For example, exemplary types of hardware logic elements that may be used include, but are not limited to, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Parts (ASSPs), Systems on Chips (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0089] In the context of this disclosure, a machine-readable medium may be a tangible medium, and may contain or store a program used by or in connection with an instruction execution system, device, or apparatus. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include at least one wire-based electrical connection, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0090] According to at least one embodiment of the present disclosure, Example 1 includes: Playing a recommendation video for the target object; When the recommended video is played up to a target video segment corresponding to the target audio segment, displaying related information of the target audio segment, which is an audio segment including a preset keyword, in a first display area of the video playback page.

[0091] According to at least one embodiment of the present disclosure, Example 2 is the method according to Example 1, wherein displaying related information of the target audio segment in a first display area of the video playback page includes: Displaying text information corresponding to the target audio segment and obtained by speech recognition of the target audio segment in a first display area of a video playback page.

[0092] According to at least one embodiment of the present disclosure, Example 3 is the method according to Example 2, wherein displaying text information corresponding to the target audio segment in a first display area of the video playback page includes: In a first display area of the video playback page, characters currently being played back among the character information are displayed in a first display state, and characters not currently being played back among the character information are displayed in a second display state.

[0093] According to at least one embodiment of the present disclosure, Example 4 is a method according to Examples 1 to 3, The method further includes ceasing the display of the related information in the first display area when the playback of the target video segment ends.

[0094] According to at least one embodiment of the present disclosure, Example 5 is the method according to Example 4, wherein stopping the display of the related information in the first display area includes: The method includes moving the related information from the first display area to a second display area of the video playback page for displaying object information of the target object, and displaying the related information so that it gradually becomes smaller during the movement.

[0095] According to at least one embodiment of the present disclosure, Example 6 is the method according to Example 5, wherein after moving the related information from the first display area to a second display area of the video playback page: Displaying the related information in the second display area; or The method further includes displaying first detailed information corresponding to the related information in the second display area, and canceling the display of the related information.

[0096] According to at least one embodiment of the present disclosure, Example 7 is the method according to any one of Examples 1 to 3, wherein after displaying related information of the target audio segment in a first display area of the video playback page, The method further includes switching a current page from the video playback page to a details page of the target object in response to a trigger operation on the related information, and displaying second detailed information of the target object on the details page.

[0097] According to at least one embodiment of the present disclosure, Example 8 provides: a video playback module configured to play a recommendation video of the target object; and a first display module configured to display related information of the target audio segment, which is an audio segment including a preset keyword, in a first display area of a video playback page when the recommended video is played up to a target video segment corresponding to the target audio segment.

[0098] According to at least one embodiment of the present disclosure, Example 9 provides: at least one processor; a memory configured to store at least one program; When the at least one program is executed by the at least one processor, the at least one processor provides an electronic device that realizes the information display method according to any one of the first to seventh embodiments.

[0099] According to at least one embodiment of the present disclosure, Example 10 provides a computer-readable storage medium having a computer program stored therein, which, when executed by a processor, realizes the information display method described in any of Examples 1 to 7.

[0100] It should be noted that although operations are illustrated using a particular sequence, this should not be understood as requiring that these operations be performed in the particular sequence or order illustrated. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes some specific implementation details, these should not be construed as limitations on the scope of the disclosure. Some features that are described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may also be implemented in multiple embodiments, either alone or in any suitable subcombination.

Claims

1. Playing a recommendation video for the target object; In response to the recommended video being played up to the target video segment, the target video segment being an audio segment including a preset keyword, displaying related information of the target audio segment in a first display area of a video playback page; Displaying information related to the target audio segment in a first display area of the video playback page includes displaying text information corresponding to the target audio segment and obtained by speech recognition of the target audio segment in the first display area of the video playback page; In the information display method, displaying the text information corresponding to the target audio segment in a first display area of the video playback page includes displaying currently played characters of the text information in a first display state and displaying currently not played characters of the text information in a second display state in the first display area of the video playback page.

2. 2. The method of claim 1, further comprising ceasing display of the related information in the first display area in response to the target video segment finishing playing.

3. Stopping the display of the related information in the first display area includes:

3. The method of claim 2, further comprising: moving the related information from the first display area to a second display area of the video playback page for displaying object information of the target object; and displaying the related information so that it gradually becomes smaller during the movement.

4. After moving the related information from the first display area to a second display area of the video playback page, Displaying the related information in the second display area; or The method of claim 3 , further comprising: displaying first detailed information corresponding to the related information in the second display area; and canceling the display of the related information.

5. After displaying the related information of the target audio segment in a first display area of the video playback page, The method of claim 1 , further comprising: in response to a trigger operation on the related information, switching a current page from the video playback page to a details page of the target object, and displaying second detailed information of the target object on the details page.

6. a video playback module configured to play a recommendation video of the target object; a first display module configured to display, when the recommended video is played up to a target video segment corresponding to a target audio segment, related information of the target audio segment, which is an audio segment including a preset keyword, in a first display area of a video playback page; Displaying information related to the target audio segment in a first display area of the video playback page includes displaying text information corresponding to the target audio segment and obtained by speech recognition of the target audio segment in the first display area of the video playback page; an information display device, wherein displaying the text information corresponding to the target audio segment in a first display area of the video playback page includes displaying, in the first display area of the video playback page, characters of the text information that are currently being played in a first display state, and displaying characters of the text information that are not currently being played in a second display state.

7. at least one processor; a memory configured to store at least one program; 6. An electronic device that, when the at least one program is executed by the at least one processor, causes the at least one processor to implement the information display method according to claim 1.

8. A computer-readable storage medium storing a computer program, which, when executed by a processor, realizes the information display method according to any one of claims 1 to 5.

9. A program that, when executed by a processor, realizes the information display method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • An information recommendation method and device based on video playing and a storage medium

    CN109543102A

  • Content recommendation method and device, electronic equipment and storage medium

    CN111143610A

  • Video and audio processing method in network live broadcast, computer equipment and medium

    CN112839237A

  • Support system for converting voice to writing, method thereof, and system for determination of correction part

    JP2006267319A

  • Relevant information retrieval device

    JP2007148976A