Search processing method and device and computer readable storage medium

Abstract

The invention relates to a search processing method and device and a computer readable storage medium, and relates to the technical field of artificial intelligence. The search processing method comprises the following steps: receiving a question input by a user; according to the question, an answer of the question and a plurality of answer videos related to the question are displayed in a search result page, and the answer is a statement which is generated by carrying out machine understanding on the answer videos and is described in a natural language; the description information comprises description information of each answer video generated by performing machine understanding on each answer video in the plurality of answer videos.

Description

Technical Field

[0001] The present disclosure relates to the field of artificial intelligence technology, and in particular to a search processing method, device and computer-readable storage medium. Background Art

[0002] With the development of Internet technology, users obtain various information from Internet platforms, and information acquisition becomes more and more convenient.

[0003] Search is a common way to obtain information. Usually, users enter keywords, sentences, etc. to search for some related content for display. Summary of the invention

[0004] The inventor found that in the related art, users search by inputting keywords, sentences, etc., and some related content is displayed. In particular, for video search, by matching the keywords input by users with videos, only some related videos and video titles are displayed to users, which leads to poor search effect and poor user experience.

[0005] A technical problem to be solved by the present disclosure is: how to improve the accuracy and effectiveness of search and enhance the search effect.

[0006] According to some embodiments of the present disclosure, a search processing method is provided, comprising: receiving a question input by a user; and displaying an answer to the question and a plurality of answer videos related to the question in a search results page according to the question, wherein the answer is a sentence described in a natural language generated by machine understanding of the plurality of answer videos, and comprises description information of each answer video generated by machine understanding of each of the plurality of answer videos.

[0007] In some embodiments, displaying the answer to a question and multiple answer videos related to the question in a search results page includes: displaying a reference identifier of each answer video at a corresponding position of the description information of each answer video in the answer; and displaying a reference identifier of each answer video on each answer video.

[0008] In some embodiments, the search processing method further includes: receiving a trigger operation of a user on a reference identifier displayed in the answer; and playing an answer video corresponding to the reference identifier.

[0009] In some embodiments, the search processing method further includes: displaying one or more candidate questions in a search results page based on the question and the multiple answer videos.

[0010] In some embodiments, the search processing method further includes: receiving a user's selection operation on any candidate question among one or more candidate questions, jumping to a conversation page; and displaying an answer to the selected candidate question on the conversation page.

[0011] In some embodiments, the search processing method further includes: displaying an entry control for continuing to ask questions in the search results page; receiving a user trigger operation on the entry control and jumping to the session page.

[0012] In some embodiments, the search processing method further includes: displaying at least one of the answer and the candidate question in a conversation page.

[0013] In some embodiments, displaying the answer to a question and multiple answer videos related to the question in a search result page includes: automatically playing some or all of the multiple answer videos when the display range of the answer is within a first preset range.

[0014] In some embodiments, displaying the answer to a question and multiple answer videos related to the question in a search result page further includes: displaying preview information of the multiple answer videos when the display position of the answer is outside a first preset range.

[0015] In some embodiments, when the display range of the answer is within a preset range, automatically playing some or all of the multiple answer videos includes: when the display position at the bottom of the last row of answers is above a first reference line, automatically playing some or all of the multiple answer videos.

[0016] In some embodiments, when the display range of the answer is within a preset range, automatically playing some or all of the answer videos of multiple answer videos also includes: when the display position of the bottom of the last row of answers is below a first reference line and the display position of the top of the first row of answers is above a second reference line, automatically playing some or all of the answer videos of multiple answer videos, wherein the second reference line is above the first reference line.

[0017] In some embodiments, the search results page includes a fixed display area and a search card area that supports sliding display, and displaying the answer to the question and multiple answer videos related to the question in the search results page also includes: displaying the answer and multiple answer videos in the search card area.

[0018] In some embodiments, the search card area includes a first area and a second area, and displaying answers and multiple answer videos in the search card area includes: displaying the answers in the first area, wherein the display range of the first area is adaptively adjusted according to the length of the answer within a second preset range; and displaying multiple answer videos in the second area, wherein the multiple answer videos support sliding display in the second area.

[0019] In some embodiments, displaying the answer in the first area includes: when the length of the answer exceeds a second preset range, hiding the content of the answer that exceeds the second preset range and displaying an expansion control; receiving a user trigger operation on the expansion control to fully display the answer.

[0020] In some embodiments, displaying the answer in the first area also includes: displaying a hidden control when the length of the answer exceeds a second preset range and the answer is displayed in full; receiving a user trigger operation on the hidden control to hide the content of the answer that exceeds the second preset range.

[0021] In some embodiments, the search processing method further includes: receiving a first operation of a user on any answer video among a plurality of answer videos; and switching the answer video corresponding to the first operation from a first display state to a second display state.

[0022] In some embodiments, the search processing method further includes: receiving a second operation of the user on a control in the search results page; and switching the control corresponding to the second operation from a third display state to a fourth display state.

[0023] In some embodiments, the search processing method further includes: displaying a plurality of recommended videos related to the question on a search results page, wherein the search strategies of the plurality of recommended videos and the plurality of answer videos are different.

[0024] In some embodiments, the search processing method further includes: receiving a trigger operation of a user on any recommended video among a plurality of recommended videos; and playing the any recommended video.

[0025] In some embodiments, a trigger operation of a user on any answer video among a plurality of answer videos is received; and the arbitrary answer video is played.

[0026] In some embodiments, based on the question, displaying the answer to the question and multiple answer videos related to the question in the search results page includes: based on the question, using a first neural network model to perform machine understanding on multiple videos in a first database, obtaining multiple answer videos related to the question from the multiple videos, and generating description information for each answer video; generating an answer based on the description information of each answer video.

[0027] In some embodiments, the search processing method also includes: receiving information input by a user; when the input information is not a problem, based on the input information, using a second neural network to perform machine understanding of multiple multimedia contents in a second database, and obtaining multiple target multimedia contents related to the input information from the multiple multimedia contents; and displaying the multiple target multimedia contents in a search results page.

[0028] According to some other embodiments of the present disclosure, a search processing device is provided, including: a receiving module, configured to receive a question input by a user; and a display module, configured to display an answer to the question and a plurality of answer videos related to the question in a search results page according to the question, wherein the answer is a sentence described in a natural language generated by machine understanding of the plurality of answer videos, and includes description information of each answer video generated by machine understanding of each of the plurality of answer videos.

[0029] According to some further embodiments of the present disclosure, a search processing device is provided, comprising: a processor; and a memory coupled to the processor, for storing instructions, wherein when the instructions are executed by the processor, the processor executes the search processing method as described in any of the aforementioned embodiments.

[0030] According to some further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, wherein when the program is executed by a processor, the search processing method of any of the aforementioned embodiments is implemented.

[0031] In the search processing method disclosed in the present invention, a question input by a user is received, and the answer to the question and multiple answer videos related to the question can be displayed in the search results page according to the question. And the answer is a sentence described in natural language generated by machine understanding of multiple answer videos, and the answer includes description information of each answer video generated by machine understanding of each answer video in multiple answer videos. The method disclosed in the present invention changes the traditional video search method, and can automatically answer the question input by the user and display the relevant answer video. And the answer is generated based on the machine understanding of the video, and the description information of multiple answer videos in the answer is associated and fused to be expressed in natural language. After entering the question, the user can intuitively see the answer and answer video of the question, and clearly know the relationship between the answer video and the answer, understand the content described in the answer video, and facilitate further viewing of the detailed content of the answer video. The method disclosed in the present invention improves the accuracy and effectiveness of the search, improves the search effect and display effect, and improves the user experience.

[0032] Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0034] Figure 1 A flowchart of a search processing method according to some embodiments of the present disclosure is shown.

[0035] Figure 2 A schematic diagram illustrating a search result page according to some embodiments of the present disclosure.

[0036] Figure 3 Schematic diagrams showing search result pages according to other embodiments of the present disclosure.

[0037] Figure 4 Schematic diagrams showing search result pages according to still other embodiments of the present disclosure.

[0038] Figure 5 Schematic diagrams showing search result pages according to still other embodiments of the present disclosure.

[0039] Figure 6 Schematic diagrams showing search result pages according to still other embodiments of the present disclosure.

[0040] Figure 7 A schematic diagram showing the structure of a search processing device according to some embodiments of the present disclosure is shown.

[0041] Figure 8 A schematic diagram showing the structure of a search processing device according to some other embodiments of the present disclosure.

[0042] Fig. 9 A schematic diagram showing the structure of a search processing device according to some further embodiments of the present disclosure. DETAILED DESCRIPTION

[0043] The technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The following description of at least one exemplary embodiment is actually only illustrative and is by no means intended to limit the present disclosure and its application or use. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0044] The present disclosure proposes a search processing method, which is applicable to video search scenarios and human-computer conversation scenarios, and can improve the accuracy and effectiveness of search, enhance search effects and display effects, and enhance user experience. Figures 1 to 5 Give a description.

[0045] Figure 1 Flowcharts of some embodiments of the search processing method disclosed herein. Figure 1 As shown, the method of this embodiment includes: steps S102 to S104.

[0046] In step S102, a question input by a user is received.

[0047] The information input by the user can be received in various forms by setting a search box to receive text input by the user, or by receiving voice, image, etc. input by the user. The information input by the user can be received directly on the search page, or by receiving the information input by the user on other pages and jumping to the search page for display. For example, the information input by the user can be received through a human-computer interaction conversation page and jumped to the search page, but is not limited to the examples given.

[0048] In some embodiments, it is determined whether the information input by the user is a question. For example, semantic recognition and grammatical recognition are performed on the text input by the user to determine whether the text input by the user is a question; or voice recognition is performed on the voice input by the user to determine whether the voice input by the user is a question; or image recognition is performed on the image input by the user to determine whether the image input by the user is a question, without limitation to the examples cited. In the case where the information input by the user is a question, the question-and-answer search function is automatically triggered.

[0049] In step S104, according to the question, the answer to the question and a plurality of answer videos related to the question are displayed in the search result page.

[0050] In some embodiments, the answer is a sentence described in natural language generated by machine understanding of multiple answer videos, and includes description information of each answer video generated by machine understanding of each answer video in the multiple answer videos.

[0051] In some embodiments, based on the question, a first neural network model is used to perform machine understanding on multiple videos in a first database, multiple answer videos related to the question are obtained from the multiple videos, and description information of each answer video is generated; an answer is generated based on the description information of each answer video.

[0052] The first database can be configured to store multiple videos for answering questions raised by users, that is, multiple videos can be used for video Q&A. The first database can also store other resources such as text, images, audio, etc. for answering questions raised by users. Each video is input into the first neural network for machine understanding to obtain description information of each video. For example, the first neural network can perform multimodal recognition on the subtitles, titles, images, voices, etc. of each video, understand the content of each video, generate description information of each video, and select answer videos related to the question from them. For example, each video can be sorted according to one or more indicators such as the relevance of each video to the question, search popularity (number or frequency), number of user comments, number of user likes, number of user views, etc., and the video ranked before the preset ranking is selected as the answer video related to the question. For example, sort each video and select the top 3 or top 4 videos as the answer video.

[0053] After selecting multiple answer videos, you can generate answers described in natural language based on the description information of each answer video or based on the description information of each answer video combined with the knowledge information in the preset knowledge base. The answer can be a paragraph including one or more sentences, which conforms to the user's reading habits, and the fluency and fluency meet the preset conditions to improve the user experience.

[0054] The answer can be presented in the form of text or played in the form of voice, etc. For example, the answer is displayed in the form of text, and a voice playback control is set at the corresponding position of the text, and the user triggers the voice playback control to play the voice corresponding to the text.

[0055] In some embodiments, a reference identifier of each answer video is displayed at a corresponding position of the description information of each answer video in the answer; and a reference identifier of each answer video is displayed on each answer video.

[0056] The specific form of the reference mark can be set according to the actual situation. For example, the reference mark can be in various forms such as numbers, keywords of the video, and the title of the video. The reference mark can be set after the description information of the corresponding answer video, so as to indicate that the description information of the corresponding answer video is before the reference mark. The position of the reference mark can also be adjusted according to the actual situation. The reference mark can be displayed on each answer video by adding a layer (such as a mask), or in other forms, not limited to the examples given.

[0057] For example, Figure 2 As shown, the reference identifier can be set in the form of a superscript after the description information of each answer video.

[0058] In some embodiments, a trigger operation of a user on a reference mark displayed in an answer is received; and an answer video corresponding to the reference mark is played.

[0059] The trigger operation can be in various forms such as click, selection, etc., which are not limited in this disclosure. The answer video corresponding to the reference identifier can be played through a video playback page different from the search result page, the answer video can be played on the search result page, or the answer video can be played through a floating window, without being limited to the examples given.

[0060] The search results page can also be called a question and answer result page, which displays the answer and multiple answer videos according to the user's question. Of course, it is also possible to display only one answer video. In some embodiments, the search results page as a whole supports sliding display. For example, it can receive the user's left and right sliding or up and down sliding operation to display more content. When sliding to a preset boundary, a prompt message can be displayed. The search results page can also support zooming in and out as a whole. The user can zoom in and out of the search results page through preset operations.

[0061] In some embodiments, the search result page includes a fixed display area and a search card area that supports sliding display, and the answer and multiple answer videos are displayed in the search card area, that is, the answer and multiple answer videos as a whole support sliding display. Of course, the area for displaying the answer can also be located in the fixed display area, and the area for displaying multiple answer videos can also be located in the fixed display area, which will not be repeated here.

[0062] For example, the fixed display area includes at least one item in the input area and the option area. Figure 2 As shown, the top of the search result page is an input area, which can be set with at least one of a search control and a voice control. For example, in response to a user clicking on the input area, a keyboard area pops up to receive information input by the user, and receives a trigger operation of the search control by the user, and displays a search card area.

[0063] like Figure 2 As shown, the fixed display area also includes an option area, which is set below the input area. The option area includes multiple option controls, and the multiple option controls are used to trigger different search scenarios or search ranges. A user trigger operation on any option control is received, and search results related to the information input by the user are obtained according to the search scenario or search range corresponding to the triggered option control, and the search results are displayed.

[0064] For example, the first option control is used to trigger a video question-and-answer scenario, receives a user trigger on the first option control and receives a question input by the user, and displays the answer and multiple answer videos. For example, the second option control is used to trigger a user search scenario, receives a user trigger on the second option control and receives information input by the user, and displays multiple related user information. For example, the third option control is used to trigger a video search scenario, receives a user trigger on the third option control and receives information input by the user, and displays multiple related videos. For example, the fourth option control is used to trigger an audio search scenario, receives a user trigger on the fourth option control and receives information input by the user, and displays multiple related audios. For example, the fifth option control is used to trigger a shopping search scenario, receives a user trigger on the fifth option control and receives information input by the user, and displays multiple related audios. For example, the sixth option control is used to trigger a live broadcast search scenario, receives a user trigger on the sixth option control and receives information input by the user, and displays multiple related live broadcasts.

[0065] The order of triggering the option control and receiving the information input by the user can be adjusted, and is not limited to the examples given above. The setting of the option control and the search scenario can be based on actual needs, and is not limited to the examples given above. Different search scenarios can use different databases and different neural networks for search. The option area can also be set in the search card area, or as a separate area, to support sliding display, for example, the option area supports left and right sliding display.

[0066] In some embodiments, the search card area includes a first area and a second area, wherein the answer is displayed in the first area and a plurality of answer videos are displayed in the second area. Figure 2 As shown, the first area can be located above the second area, which is more in line with the user's reading habits and improves the display effect.

[0067] In some embodiments, multiple answer videos support sliding display in the second area. A user's sliding operation is received, and the answer video within the second area is displayed. In this way, more answer videos can be displayed when the page area is limited, providing users with richer content.

[0068] Each answer video is displayed in a preset size. When the total display range of multiple answer videos exceeds the display range of the second area, some of the multiple answer videos may be fully displayed, and the remaining answer videos may be incompletely displayed or not displayed. Upon receiving the user's sliding operation, the remaining answer videos within the display range of the second area are displayed.

[0069] like Figure 2 As shown, there are three answer videos in the second area, the first two answer videos are displayed in full, and the third video is not displayed in full. The third answer video can be displayed by the user sliding to the left.

[0070] In some embodiments, the display range of the answer is adjusted according to the length of the answer. Figure 3 and Figure 4 As shown, when the answer is short, the display range of the answer is smaller, and more remaining information can be displayed on the page. When the answer is long, the display range of the answer is larger, occupying a larger area on the page.

[0071] Multiple answer videos can display preview information, can be played automatically, or some videos can display preview information and some videos can be played automatically. When the display range of the answer is adjusted according to the length of the answer, the position of the answer video in the search results page is uncertain. In addition, when the search card area supports sliding display, the position of the answer video in the search results page is also uncertain. Therefore, the automatic playback or display of preview information of the answer video can be adjusted according to the display situation.

[0072] In some embodiments, when the display range of the answer is within the first preset range, some or all of the answer videos of the multiple answer videos are automatically played. When the display position of the answer is outside the first preset range, preview information of the multiple answer videos is displayed. For example, when the display range of the answer is within the first preset range, the answer video within the display range of the second area is automatically played. For example, Figure 2 As shown, there are three answer videos in the second area, and the first two answer videos are automatically played. Alternatively, when the display range of the answer is within the first preset range, the first answer video is automatically played.

[0073] In some embodiments, when the display position of the bottom of the last row of answers is above the first reference line, some or all of the multiple answer videos are automatically played.

[0074] The first reference line can be fixed, for example, the first reference line can be used to limit the display range of the answer. Figure 3 As shown, a title may be displayed above the answer to indicate that the text is the answer. The first reference line may be set to be a reference line with a preset distance from the bottom of the title.

[0075] The display position of the bottom of the last line of the answer (for example, the horizontal line at the bottom of the last line of text) is above the first reference line, indicating that the current display range of the answer is small, and the answer video is fully displayed in the search result page and is located in a relatively central or upper position in the search result page. In this case, the answer video is within the user's field of vision, and part or all of the answer video is automatically played, which can improve the display effect and attract users to watch the answer video without page jump, making it easier for users to watch the answer video.

[0076] In some embodiments, when the display position of the bottom of the last line of answers is below a first reference line and the display position of the top of the first line of answers (for example, the horizontal line at the top of the first line of text) is above a second reference line, some or all of the answer videos among multiple answer videos are automatically played, wherein the second reference line is above the first reference line.

[0077] The second reference line may be fixed, and the second reference line may be the top position of the search card area. Figure 4 As shown, the second reference line can be the bottom position of the option area. The display position of the top of the first row of answers is above the second reference line, which can indicate that the search card area is slid upward, and the answer video is fully displayed in the search results page and is located in the middle or upper position of the search results page. In this case, the answer video is within the user's line of sight, and part or all of the answer video is automatically played, which can improve the display effect and attract users to watch the answer video without page jump, making it easier for users to watch the answer video.

[0078] The fully displayed answer video can be automatically played, or a preset number of answer videos can be automatically played in the order of display, or all answer videos can be automatically played. The specific answer videos to be automatically played can be set and are not limited to the examples given.

[0079] In some embodiments, a trigger operation of a user on any answer video among a plurality of answer videos is received; and the corresponding answer video is played. The corresponding answer video may be played through a video playback page different from the search result page, or may be played on the search result page, or may be played through a floating window, without limitation to the examples given.

[0080] In some embodiments, the display range of the first area is adaptively adjusted within the second preset range according to the length of the answer. The display range of the first area is the display range of the answer, and the second preset range is used to limit the maximum display range of the answer.

[0081] In some embodiments, when the length of the answer exceeds a second preset range, the content of the answer that exceeds the second preset range is hidden, and an expansion control is displayed; a user trigger operation on the expansion control is received, and the answer is fully displayed.

[0082] In some embodiments, when the length of the answer exceeds a second preset range and the answer is displayed in full, a hide control is displayed; a user trigger operation on the hide control is received, and the content of the answer that exceeds the second preset range is hidden.

[0083] like Figure 2As shown, an expansion control (view larger) can be displayed at the end of the answer display. The user can trigger it by clicking, etc. The display effect after expansion is as follows Figure 5 As shown. Figure 5 As shown, a hidden control can also be displayed at the last position of the answer display. The user can hide part of the content by triggering the hidden control (show less). The display effect after hiding is as follows Figure 2 shown.

[0084] In the case of a long answer, part of the answer content can be hidden so that the answer video can be displayed more, so that the search result page can display richer content, improve the display effect, and enhance the user's reading experience. By expanding the hidden content, users can easily view the complete answer.

[0085] In some embodiments, one or more candidate questions are displayed in a search results page based on the question and the multiple answer videos.

[0086] One or more candidate questions are related to the question and some or all of the videos in the multiple answer videos. For example, the candidate question may be "Can more answer videos be displayed?", etc. One or more candidate questions may be generated by machine understanding the question and the multiple answer videos. Figure 2 As shown, one or more candidate questions can be displayed in the third area, and the third area can be below the second area, in accordance with the user's reading order, to improve the display effect. The third area can be located in the search card area.

[0087] In some embodiments, a user selection operation on any candidate question among one or more candidate questions is received, and the page is redirected to a conversation page; on the conversation page, an answer to the selected candidate question is displayed.

[0088] The conversation page can receive questions input by the user and display the corresponding answers. For example, the conversation page is a human-computer interaction page. The conversation page can display the selected candidate questions and the corresponding answers, and can also display other candidate questions.

[0089] By directly displaying one or more candidate questions, users can directly ask subsequent questions without having to input questions, thereby improving convenience and display effects.

[0090] In some embodiments, an entry control for continuing to ask questions is displayed in the search results page; a trigger operation of the entry control by the user is received, and the session page is jumped to. In some embodiments, at least one of the answer and the candidate question is displayed in the session page.

[0091] like Figure 2As shown, the entry control can be set in the third area, in the same area as one or more candidate questions. The entry control can be set in front of one or more candidate questions according to the reading direction, and is not limited to the examples given. When entering the conversation page through the entry control, the conversation page can display the answer in the search results page, and can also display one or more candidate questions, receive the user's selection operation for any candidate question in the one or more candidate questions, and display the answer to the selected candidate question on the conversation page.

[0092] In some embodiments, multiple recommended videos related to the question are displayed on the search results page, wherein the search strategies of the multiple recommended videos and the multiple answer videos are different. The search strategy may include at least one of a search algorithm and a selection index.

[0093] The neural network model for generating the recommended video may be different from the neural network model for generating the answer video, that is, the search algorithm is different. The selection indexes for selecting the recommended video and the answer video may be different. For example, a comprehensive index may be determined based on multiple indicators including the relevance of each video to the question, search popularity (number or frequency), number of user comments, number of user likes (degree of preference), and number of user views, and each video may be sorted based on the comprehensive index, and the video ranked before the first preset ranking may be selected as the answer video related to the question; each video may be sorted based on the number of user likes, and the video ranked before the second preset ranking may be selected as the recommended video related to the question.

[0094] like Figure 2 As shown, multiple recommended videos can be displayed in the fourth area, and the fourth area can be set in the search card area.

[0095] In some embodiments, a trigger operation of a user on any recommended video among a plurality of recommended videos is received; and the corresponding recommended video is played. The corresponding recommended video may be played through a video playback page different from the search result page, or may be played on the search result page, or may be played through a floating window, without limitation to the examples cited.

[0096] By displaying recommended videos, the content in the search result page can be enriched, the display effect can be improved, and the different needs of users can be met, thereby improving the user experience.

[0097] In some embodiments, a reference indicator is displayed on each answer video and / or each recommended video. The reference indicator may be, for example, one or more indicators such as relevance to the question, search popularity (number or frequency), number of user comments, number of user likes (degree of preference), number of user views, etc. For example, the reference indicator may be displayed by adding a layer to the video, without limitation to the examples given.

[0098] In some embodiments, a first operation of a user on any answer video among a plurality of answer videos is received; and the answer video corresponding to the first operation is switched from a first display state to a second display state.

[0099] In some embodiments, a second operation of the user on a control in the search results page is received; and the control corresponding to the second operation is switched from a third display state to a fourth display state.

[0100] The first operation and the second operation may be the same operation or different operations. For example, the first operation and the second operation are both pressing, or the first operation is pressing and the second operation is selecting, without limitation to the examples.

[0101] like Figure 6 As shown, after receiving the user's first operation, the answer video corresponding to the first operation can be switched from the first display state to the second display state by setting a first mask. For example, the display color, transparency, and other states of the answer video can be changed by the first mask. After receiving the user's second operation, the control corresponding to the second operation can be switched from the third display state to the fourth display state by setting a second mask. The display color, transparency, and other states of the control can be changed by the second mask, not limited to the examples given. The color, transparency, and other states of the first mask and the second mask can be different.

[0102] The switching of the display state of the answer video is also applicable to the recommended video, receiving a first operation of the user on any recommended video among multiple recommended videos; and switching the recommended video corresponding to the first operation from the first display state to the second display state.

[0103] By switching the display status of the video or control, the user can intuitively feel the operation of the video or control, thereby improving the display effect and user experience.

[0104] In the search processing method of the above embodiment, a question input by a user is received, and the answer to the question and multiple answer videos related to the question can be displayed in the search result page according to the question. And the answer is a sentence described in natural language generated by machine understanding of multiple answer videos, and the answer includes the description information of each answer video generated by machine understanding of each answer video in multiple answer videos. The method of the above embodiment changes the traditional video search method, and can automatically answer the question input by the user and display the relevant answer video. And the answer is generated based on the machine understanding of the video, and the description information of multiple answer videos in the answer is associated and fused in a natural language. After entering the question, the user can intuitively see the answer and answer video of the question, and clearly know the relationship between the answer video and the answer, understand the content described in the answer video, and facilitate further viewing of the detailed content of the answer video. The method of the above embodiment improves the accuracy and effectiveness of the search, improves the search effect and display effect, and improves the user experience.

[0105] The above embodiments mainly describe how to respond to and display questions input by users.

[0106] In some embodiments, information input by a user is received; if the input information is not a problem, a second neural network is used to perform machine understanding of multiple multimedia contents in a second database based on the input information, and multiple target multimedia contents related to the input information are obtained from the multiple multimedia contents; and the multiple target multimedia contents are displayed in a search results page.

[0107] A second database may be set up to store multimedia content for search. The multimedia content may include, for example, at least one of text, voice, image, and video. When the multimedia content is a video, the display method of the answer video or the recommended video in the above embodiment is also applicable.

[0108] In some embodiments, a trigger operation of a user on any target multimedia content is received, and detailed information of the corresponding multimedia content is further displayed, for example, playing a video or audio, enlarging and displaying text or images, etc.

[0109] Different searches are performed and different content is displayed for different types of information input by users, which improves the search and display effects, meets the different needs of users, and improves the user experience.

[0110] The directions of up, down, left, and right in this disclosure are based on the general reading direction of the page. The triggering operations for different videos and controls in this disclosure can be different types of operations, for example, some triggering operations are clicks, and some triggering operations are selections, which are not limited here.

[0111] The present disclosure also provides a search processing device, Figure 7 Give a description.

[0112] Figure 7 FIG. 1 is a structural diagram of some embodiments of the search processing device disclosed in the present invention. Figure 7 As shown, the device 70 of this embodiment includes: a receiving module 710 and a display module 720 .

[0113] The receiving module 710 is configured to receive a question input by a user.

[0114] The display module 720 is configured to display the answer to the question and multiple answer videos related to the question in the search result page according to the question, wherein the answer is a sentence described in natural language generated by machine understanding of the multiple answer videos, and includes description information of each answer video generated by machine understanding of each answer video in the multiple answer videos.

[0115] In some embodiments, the display module 720 is configured to display a reference identifier of each answer video at a corresponding position of the description information of each answer video in the answer; and to display a reference identifier of each answer video on each answer video.

[0116] In some embodiments, the receiving module 710 is further configured to receive a trigger operation of a user on a reference mark displayed in the answer; the display module 720 is further configured to play an answer video corresponding to the reference mark.

[0117] In some embodiments, the display module 720 is further configured to display one or more candidate questions in the search result page based on the question and the multiple answer videos.

[0118] In some embodiments, the receiving module 710 is further configured to receive a user's selection operation of any candidate question among the one or more candidate questions;

[0119] In some embodiments, the display module 720 is further configured to jump to a conversation page where answers to the selected candidate questions are displayed.

[0120] In some embodiments, the display module 720 is also configured to display an entry control for continuing to ask questions in the search results page; the receiving module 710 is also configured to receive a user's trigger operation on the entry control, and the display module 720 is also configured to jump to the session page and display the session page.

[0121] In some embodiments, the display module 720 is further configured to display at least one of the answer and the candidate question in the conversation page.

[0122] In some embodiments, the display module 720 is configured to automatically play part or all of the answer videos of the plurality of answer videos when the display range of the answer is within a first preset range.

[0123] In some embodiments, the display module 720 is configured to display preview information of multiple answer videos when the display position of the answer is outside the first preset range.

[0124] In some embodiments, the display module 720 is configured to automatically play part or all of the answer videos among the multiple answer videos when the display position of the bottom of the last row of answers is above the first reference line.

[0125] In some embodiments, the display module 720 is configured to automatically play some or all of the answer videos among a plurality of answer videos when the display position of the bottom of the last row of answers is below a first reference line and the display position of the top of the first row of answers is above a second reference line, wherein the second reference line is above the first reference line.

[0126] In some embodiments, the search result page includes a fixed display area and a search card area supporting sliding display, and the display module 720 is configured to display the answer and multiple answer videos in the search card area.

[0127] In some embodiments, the search card area includes a first area and a second area, and the display module 720 is configured to display the answer in the first area, wherein the display range of the first area is adaptively adjusted within a second preset range according to the length of the answer; and display multiple answer videos in the second area, wherein the multiple answer videos support sliding display in the second area.

[0128] In some embodiments, the display module 720 is configured to hide the content in the answer that exceeds the second preset range and display an expansion control when the length of the answer exceeds the second preset range; the receiving module 710 is also configured to receive a user's trigger operation on the expansion control, and the display module 720 is configured to display the answer in full.

[0129] In some embodiments, the display module 720 is configured to display a hidden control when the length of the answer exceeds a second preset range and the answer is displayed in full; the receiving module 710 is also configured to receive a user trigger operation on the hidden control, and the display module 720 is configured to hide the content in the answer that exceeds the second preset range.

[0130] In some embodiments, the receiving module 710 is further configured to receive a first operation of a user on any answer video among multiple answer videos; the display module 720 is further configured to switch the answer video corresponding to the first operation from a first display state to a second display state.

[0131] In some embodiments, the receiving module 710 is further configured to receive a second operation of the user on a control in the search results page; the display module 720 is further configured to switch the control corresponding to the second operation from the third display state to the fourth display state.

[0132] In some embodiments, the display module 720 is further configured to display a plurality of recommended videos related to the question on the search result page, wherein the search strategies of the plurality of recommended videos and the plurality of answer videos are different.

[0133] In some embodiments, the receiving module 710 is further configured to receive a trigger operation of a user on any recommended video among a plurality of recommended videos; and the display module 720 is further configured to play the any recommended video.

[0134] In some embodiments, the receiving module 710 is further configured to receive a user's triggering operation on any answer video among the multiple answer videos; the display module 720 is further configured to play the any answer video.

[0135] In some embodiments, the search processing device also includes: a control module 730, which is configured to use a first neural network model to perform machine understanding on multiple videos in a first database based on the question, obtain multiple answer videos related to the question from the multiple videos, and generate description information for each answer video; generate an answer based on the description information of each answer video.

[0136] In some embodiments, the receiving module 710 is further configured to receive information input by a user; the control module 730 is further configured to use a second neural network to perform machine understanding of multiple multimedia contents in the second database based on the input information, and obtain multiple target multimedia contents related to the input information from the multiple multimedia contents; the display module 720 is further configured to display multiple target multimedia contents in the search results page.

[0137] The search processing device in the embodiments of the present disclosure can be implemented by various computing devices or computer systems. Figure 8 as well as Fig. 9 Give a description.

[0138] Figure 8 FIG. 1 is a structural diagram of some embodiments of the search processing device disclosed in the present invention. Figure 8 As shown, the device 80 of this embodiment includes: a memory 810 and a processor 820 coupled to the memory 810, and the processor 820 is configured to execute the search processing method in any of some embodiments of the present disclosure based on the instructions stored in the memory 810.

[0139] The memory 810 may include, for example, a system memory, a fixed non-volatile storage medium, etc. The system memory may store, for example, an operating system, an application program, a boot loader, a database, and other programs.

[0140] Fig. 9 FIG. 1 is a structural diagram of some other embodiments of the search processing device disclosed in the present invention. Fig. 9 As shown, the device 90 of this embodiment includes: a memory 910 and a processor 920, which are similar to the memory 810 and the processor 820 respectively. It can also include an input and output interface 930, a network interface 940, a storage interface 950, etc. These interfaces 930, 940, 950 and the memory 910 and the processor 920 can be connected, for example, through a bus 960. Among them, the input and output interface 930 provides a connection interface for input and output devices such as a display, a mouse, a keyboard, and a touch screen. The network interface 940 provides a connection interface for various networked devices, for example, it can be connected to a database server or a cloud storage server. The storage interface 950 provides a connection interface for external storage devices such as SD cards and USB flash drives.

[0141] The present disclosure also provides a computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the search processing method of any of the aforementioned embodiments is implemented.

[0142] The present disclosure also provides a computer program having instructions stored thereon, wherein when the instructions are executed by a processor, the search processing method of any of the aforementioned embodiments is implemented.

[0143] The present disclosure also provides a computer program product having instructions stored thereon, wherein the instructions, when executed by a processor, implement the search processing method of any of the aforementioned embodiments.

[0144] Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable non-transient storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0145] The present disclosure is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present disclosure. It should be interpreted that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0146] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0147] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0148] The above description is only a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present disclosure should be included in the protection scope of the present disclosure.

Claims

1. A search processing method, comprising: Receive user input questions; Based on the question, the answer to the question and multiple answer videos related to the question are displayed in the search results page, wherein the answer is a sentence described in natural language generated by machine understanding of the multiple answer videos, and includes description information of each answer video generated by machine understanding of the multiple answer videos.

2. The search processing method according to claim 1, wherein: The step of displaying the answer to the question and a plurality of answer videos related to the question in the search result page comprises: Displaying a reference identifier of each answer video at a corresponding position of the description information of each answer video in the answer; A reference mark of each answer video is displayed on each answer video.

3. The search processing method according to claim 2, further comprising: receiving a triggering operation of the user on the reference identifier displayed in the answer; Play the answer video corresponding to the reference identifier.

4. The search processing method according to claim 1, further comprising: One or more candidate questions are displayed in the search result page based on the question and the multiple answer videos.

5. The search processing method according to claim 4, further comprising: receiving a selection operation of the user on any candidate question among the one or more candidate questions, and jumping to a conversation page; On the conversation page, answers to the selected candidate questions are displayed.

6. The search processing method according to claim 1, further comprising: Displaying an entry control for continuing to ask questions on the search result page; Receive the user's triggering operation on the entry control and jump to the session page.

7. The search processing method according to claim 6, further comprising: At least one of the answer and the candidate question is displayed in the conversation page.

8. The search processing method according to claim 1, wherein: The step of displaying the answer to the question and a plurality of answer videos related to the question in the search result page comprises: When the display range of the answer is within a first preset range, part or all of the multiple answer videos are automatically played.

9. The search processing method according to claim 8, wherein: The displaying of the answer to the question and a plurality of answer videos related to the question in the search result page also includes: When the display position of the answer is outside the first preset range, preview information of the multiple answer videos is displayed.

10. The search processing method according to claim 8, wherein: When the display range of the answer is within a preset range, automatically playing part or all of the multiple answer videos includes: When the display position of the bottom of the last row of the answer is above the first reference line, some or all of the multiple answer videos are automatically played.

11. The search processing method according to claim 10, wherein: When the display range of the answer is within a preset range, automatically playing part or all of the multiple answer videos also includes: When the display position of the bottom of the last row of answers is below a first reference line and the display position of the top of the first row of answers is above a second reference line, some or all of the multiple answer videos are automatically played, wherein the second reference line is above the first reference line.

12. The search processing method according to claim 1, wherein: The search result page includes a fixed display area and a search card area that supports sliding display, and the answer to the question and multiple answer videos related to the question displayed in the search result page also include: The answer and the plurality of answer videos are displayed in the search card area.

13. The search processing method according to claim 12, wherein: The search card area includes a first area and a second area, and displaying the answer and the plurality of answer videos in the search card area includes: Displaying the answer in the first area, wherein the display range of the first area is adaptively adjusted within a second preset range according to the length of the answer; The multiple answer videos are displayed in the second area, wherein the multiple answer videos support sliding display in the second area.

14. The search processing method according to claim 13, wherein: Displaying the answer in the first area includes: When the length of the answer exceeds the second preset range, hiding the content of the answer that exceeds the second preset range, and displaying an expansion control; A triggering operation of the expansion control by the user is received, and the answer is fully displayed.

15. The search processing method according to claim 14, wherein: The displaying the answer in the first area further comprises: When the length of the answer exceeds the second preset range and the answer is completely displayed, displaying a hidden control; A triggering operation of the hiding control by the user is received, and the content of the answer exceeding the second preset range is hidden.

16. The search processing method according to claim 1, further comprising: Receiving a first operation of the user on any answer video among the multiple answer videos; The answer video corresponding to the first operation is switched from a first display state to a second display state.

17. The search processing method according to claim 1, further comprising: receiving a second operation of the user on a control in the search result page; The control corresponding to the second operation is switched from the third display state to the fourth display state.

18. The search processing method according to claim 1, further comprising: A plurality of recommended videos related to the question are displayed on the search result page, wherein the search strategies of the plurality of recommended videos and the plurality of answer videos are different.

19. The search processing method according to claim 18, further comprising: receiving a triggering operation of the user on any recommended video among the plurality of recommended videos; Play any of the recommended videos.

20. The search processing method according to claim 1, further comprising: Receiving a trigger operation of the user on any answer video among the multiple answer videos; Play the arbitrary answer video.

21. The search processing method according to any one of claims 1 to 20, wherein: According to the question, displaying the answer to the question and a plurality of answer videos related to the question in the search result page includes: According to the question, using a first neural network model, machine understanding is performed on a plurality of videos in a first database, the plurality of answer videos related to the question are obtained from the plurality of videos, and description information of each answer video is generated; The answer is generated according to the description information of each answer video.

22. The search processing method according to claim 21, further comprising: receiving information input by the user; In the case where the input information is not a problem, using a second neural network to perform machine understanding on a plurality of multimedia contents in a second database according to the input information, and obtaining a plurality of target multimedia contents related to the input information from the plurality of multimedia contents; The plurality of target multimedia contents are displayed in the search result page.

23. A search processing device, comprising: A receiving module, configured to receive a question input by a user; The display module is configured to display the answer to the question and multiple answer videos related to the question in a search result page according to the question, wherein the answer is a sentence described in natural language generated by machine understanding of the multiple answer videos, and includes description information of each answer video generated by machine understanding of the multiple answer videos.

24. A search processing device, comprising: processor; as well as A memory coupled to the processor, for storing instructions, wherein when the instructions are executed by the processor, the processor executes the search processing method according to any one of claims 1 to 22.

25. A computer-readable storage medium having a computer program stored thereon, wherein: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 22 are implemented.

Images