Information display method, computing device and computer storage medium

Abstract

The present invention discloses an information display method, a computing device and a computer storage medium. The method includes: obtaining an input first image; comparing the first image with images in a preset gallery to identify a second image matching the first image; obtaining book image annotation information associated with the second image; wherein the book image annotation information is derived from the book content of an e-book platform; and displaying the book image annotation information. The adoption of this solution can quickly present detailed information corresponding to an entity to the user, simplify user operations, and improve information display efficiency; and, the solution does not require manual identification of entity names, greatly reduces the misjudgment rate, and improves the accuracy of the displayed information; in addition, the solution can improve the vertical depth of information displayed to the user, and is suitable for large-scale application and implementation.

Description

Technical Field

[0001] The present invention relates to the field of information processing technology, and in particular to an information display method, a computing device and a computer storage medium. Background Art

[0002] With the continuous development of science and technology and society, people's demand for information is also increasing. For example, when people visit scenic spots, exhibitions and other scenes, they usually want to obtain detailed information about entities such as buildings and paintings in the scenic spots. At present, if people want to obtain detailed information about entities such as buildings and paintings, they often need to first know the name of the entity, and then use the name of the entity to query the detailed information of the entity through the corresponding search engine.

[0003] However, during the implementation process, the inventors found that the prior art has the following defects: the method of first obtaining the entity name and then obtaining detailed information of the entity through a search engine in the prior art is cumbersome and inefficient; and, the method requires manual identification of the entity name first, thereby greatly increasing the misjudgment rate of the entity name, thereby affecting the accuracy of the entity information subsequently obtained. Summary of the invention

[0004] In view of the above problems, the present invention is proposed to provide an information display method, a computing device and a computer storage medium that overcome the above problems or at least partially solve the above problems.

[0005] According to one aspect of the present invention, there is provided an information display method, comprising:

[0006] Get a first input image;

[0007] Comparing the first image with images in a preset gallery to identify a second image that matches the first image;

[0008] Acquire book image annotation information associated with the second image; wherein the book image annotation information is derived from book content on an e-book platform;

[0009] The book image annotation information is displayed.

[0010] According to another aspect of the present invention, there is provided a computing device, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus;

[0011] The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform the following operations:

[0012] Get a first input image;

[0013] Comparing the first image with images in a preset gallery to identify a second image that matches the first image;

[0014] Acquire book image annotation information associated with the second image; wherein the book image annotation information is derived from book content on an e-book platform;

[0015] The book image annotation information is displayed.

[0016] According to another aspect of the present invention, a computer storage medium is provided, wherein the storage medium stores at least one executable instruction, and the executable instruction enables a processor to perform operations corresponding to the above-mentioned information display method.

[0017] According to the information display method, computing device and computer storage medium provided by the present invention, firstly, an input first image is obtained; the first image is further compared with images in a preset gallery to identify a second image matching the first image; then book image annotation information associated with the second image is obtained; wherein the book image annotation information is derived from the book content of the e-book platform; and finally the book image annotation information is displayed. This solution can quickly present detailed information corresponding to an entity to users, simplify user operations, and improve information display efficiency; and this solution does not require manual identification of entity names, greatly reducing the misjudgment rate and improving the accuracy of displayed information; in addition, this solution can improve the vertical depth of information displayed to users and is suitable for large-scale application and implementation.

[0018] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0020] Figure 1 A schematic diagram of a process of an information display method provided according to Embodiment 1 of the present invention is shown;

[0021] Figure 2 A schematic diagram of a flow chart of an information display method provided according to Embodiment 2 of the present invention is shown;

[0022] Figure 3A schematic diagram showing a flow chart of an information display method provided according to Embodiment 3 of the present invention is shown;

[0023] Figure 4 A schematic diagram of a flow chart of an information display method provided according to Embodiment 4 of the present invention is shown;

[0024] Figure 5 A schematic diagram of the structure of a computing device provided according to Embodiment 6 of the present invention is shown. DETAILED DESCRIPTION

[0025] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully communicated to those skilled in the art.

[0026] Embodiment 1

[0027] Figure 1 The flowchart of an information display method provided according to the first embodiment of the present invention is shown. The method provided in this embodiment can be executed in an e-book platform.

[0028] like Figure 1 As shown, the method includes:

[0029] Step S110: Acquire an input first image.

[0030] When the user wants to learn more about an entity (such as a painting, a building, a sculpture, etc.), the user can input the first image corresponding to the entity.

[0031] In an optional implementation, the first image may be an image captured in real time by an image capture device. For example, when a user browses a painting in a museum and wants to learn more about the painting, the user may use a scanning function provided by a user terminal application of an e-book platform (such as a "scan" function provided by the application) and an image capture device (such as a camera in the user terminal) to capture the image of the painting in real time.

[0032] In another optional implementation, the first image is an image uploaded through a preset portal. For example, a user can upload a stored image through an image upload portal provided by the terminal application, such as uploading an image stored in a user terminal album.

[0033] In addition, in another optional implementation, in order to facilitate the subsequent rapid search for the second image corresponding to the first image and save system computing resources, this embodiment can filter the first image after obtaining the input first image to eliminate invalid images such as blank images or images with poor clarity.

[0034] Step S120: Compare the first image with images in a preset gallery to identify a second image that matches the first image.

[0035] In this embodiment, a preset gallery is pre-configured, in which at least one image is stored, and the images in the gallery have a direct or indirect association with the book content of the electronic book platform.

[0036] After the first image is obtained in step S110, the second image matching the first image in the library can be determined by comparing the first image with the images in the preset library. Optionally, the second image can be identified from the library by combining one or more of the following identification methods:

[0037] Identification method one: extract the feature fingerprint of the first image; compare the feature fingerprint of the first image with the feature fingerprint of the images in the preset gallery to identify the second image that matches the feature fingerprint of the first image. In the specific implementation process, the size of the first image can be adjusted to the preset size, and then the color simplification operation is performed on the first image. After the color simplification, the feature fingerprint of the first image is generated according to the grayscale value of each pixel; similarly, the feature fingerprint of the image in the preset gallery can be obtained by the same method as the feature fingerprint of the first image, wherein, in order to improve the comparison efficiency, the feature fingerprint of the image in the preset gallery can be calculated in advance, so that only the feature fingerprint of the first image needs to be calculated during the comparison process, thereby saving comparison time. Furthermore, during the comparison process, if the similarity between the feature fingerprint of an image in the preset image and the feature fingerprint of the first image exceeds the preset threshold, the image is determined to be the second image.

[0038] Identification method 2: extract the feature area of ​​the first image; compare the feature area of ​​the first image with the feature area of ​​the image in the preset gallery to identify the second image that matches the feature area of ​​the first image. Among them, the feature area can be one or more. In the specific implementation process, the size of the first image can be adjusted so that the size of the first image is consistent with the size of the image in the preset image. Then, the feature area (such as the central area) of the first image and the feature area of ​​the image in the preset gallery are extracted respectively, wherein two images of the same size have the same feature area; further obtain the image features (such as color features, texture features, etc.) of the feature area of ​​the first image, and obtain the image features of the feature area of ​​the image in the preset gallery, and compare the two types of image features. If the image features of the feature area of ​​a certain image in the preset gallery are similar to the image features of the feature area of ​​the first image, the image is determined to be the second image.

[0039] Step S130: Acquire book image annotation information associated with the second image; wherein the book image annotation information comes from the book content of the e-book platform.

[0040] In order to improve the vertical depth of the information finally displayed to the user, this embodiment uses the book content of the e-book platform as the information library, queries the information associated with the second image in the information library based on the second image, and then uses the information as book image annotation information associated with the second image.

[0041] Step S140: displaying book image annotation information.

[0042] The present embodiment does not limit the specific method of displaying the book image annotation information. For example, to improve the display effect and display efficiency, the first image can be used as the first layer, a second layer can be created on the first layer, and the book image annotation information can be displayed in the second layer, and the transparency of the first image can be further adjusted (such as adjusting the overall transparency of the first layer to a semi-transparent state) to ensure the display clarity of the book image annotation information.

[0043] In an optional implementation, after the book image annotation information is displayed, in response to a preset trigger operation for the book image annotation information, the page is redirected to the book reading page corresponding to the book image annotation information. For example, the book image annotation information M is derived from the content on page 55 of book A. When the user clicks on the displayed book image annotation information M, the page can be linked to the reading page on page 55 of book A, thereby facilitating the user to browse in-depth information.

[0044] In another optional implementation, in addition to displaying the book image annotation information, the source information of the book image annotation information may be further displayed, wherein the source information is specifically the relevant information of the book to which the book image annotation information belongs (such as the book name and the book author, etc.).

[0045] In another optional implementation, if there are multiple book image annotation information, the display ranking of each book image annotation information can be determined based on at least one dimension, and then each book image annotation information is displayed in descending order according to the display ranking. The dimension includes at least one of the following dimensions: the degree of association between the book image annotation information and the second image, the ranking of the book corresponding to the book image annotation information, the number of citations of the book image annotation information, the number of annotations of the book image annotation information, and the number of likes of the book image annotation information. The ranking of the book corresponding to the book image annotation information can be a popularity ranking, a praise ranking, and / or a ranking of matching with the user portrait, etc.

[0046] It can be seen that when the user wants to learn more about the entity-related information, the user only needs to provide the first image of the entity, and the corresponding book image annotation information can be quickly presented to the user, thereby simplifying the user operation and improving the efficiency of information display; and the solution does not need to manually identify the entity name, thereby greatly reducing the misjudgment rate and improving the accuracy of the displayed information; furthermore, the presenting of book image annotation information to the user in this embodiment can further improve the vertical depth of the information displayed to the user. In addition, the solution is simple and easy to implement and is suitable for large-scale application and implementation.

[0047] Embodiment 2

[0048] Figure 2 The flowchart of an information display method provided according to the second embodiment of the present invention is shown. This embodiment is a further optimization of the method in the first embodiment.

[0049] like Figure 2 As shown, the method includes:

[0050] Step S210: Acquire an input first image.

[0051] Step S220: Compare the first image with the book illustrations in the electronic book platform gallery to identify a second image that matches the first image; wherein the electronic book platform gallery contains the book illustrations in the electronic book platform.

[0052] In this embodiment, the book illustrations of the books in the e-book platform are extracted in advance, and the e-book platform gallery is generated according to the extracted book illustrations. Then, the first image is compared with the book illustrations in the e-book platform gallery, and the second image is identified from the e-book platform gallery. In other words, the second image in this embodiment is the book illustration in the e-book platform.

[0053] Step S230: Acquire book image annotation information associated with the second image; wherein the book image annotation information is the illustration annotation of the book of the second image in the electronic book platform.

[0054] In the actual implementation process, the book drawings of the books in the e-book platform have corresponding drawing annotations, so that in the process of generating the e-book platform library, the drawing annotations corresponding to each book drawing can be recorded. Therefore, after the second image is determined, the drawing annotations of the second image in the book are directly used as the book image annotation information associated with the second image.

[0055] Step S240: displaying book image annotation information.

[0056] It can be seen that this embodiment generates an e-book platform gallery by extracting book illustrations and illustration annotations of books in the e-book platform, and then quickly determines the book illustrations and illustration annotations that match the first image based on the e-book platform gallery, and finally displays the illustration annotations in the book corresponding to the entity to the user, thereby facilitating the user to easily and quickly obtain the entity information and improving the display efficiency of the entity information.

[0057] Embodiment 3

[0058] Figure 3 The flowchart of an information display method provided according to the third embodiment of the present invention is shown. This embodiment is a further optimization of the method in the first embodiment.

[0059] like Figure 3 As shown, the method includes:

[0060] Step S310: Acquire an input first image.

[0061] Step S320: Compare the first image with sample images in a third-party gallery to identify a second image that matches the first image; wherein the third-party gallery contains sample images obtained from a third-party platform.

[0062] What is different from the second embodiment is that the preset image library in this embodiment is a third-party image library, so the second image in this embodiment is a sample image.

[0063] Step S330: Obtain the keyword of the second image.

[0064] In the specific implementation process, when obtaining sample images from a third-party platform, the image name, image introduction, etc. corresponding to the sample image can also be obtained, so that the subject word of the sample image can be generated according to the image name and / or image introduction of the sample image. Among them, this embodiment does not limit the specific subject word extraction method. For example, invalid characters can be removed from the image name and / or image introduction, and named entity recognition can be performed on the removed text, and the identified named entity is used as the subject word of the sample image. Among them, the subject word corresponding to a sample image can be one or more.

[0065] Furthermore, the subject word of the sample image may be associated with the sample image and stored in a third-party image library, so that after the second image is obtained, the subject word stored in association with the second image may be directly obtained.

[0066] Step S340: Searching for book content information associated with the subject word in books on the e-book platform.

[0067] In an optional implementation, the subject word may be directly used as a search word, and the book content of the books on the e-book platform may be used as a search information base to find book content information associated with the subject word.

[0068] In another optional implementation, the user location information may be obtained, and the book content information associated with the user location information and the subject word may be searched in the books on the e-book platform, thereby improving the matching degree between the subsequently displayed book image annotation information and the actual entity. For example, if the subject word of the second image is "Great Wall" and the user location information is "Shanhaiguan", then the associated book content information may be searched in the books on the e-book platform using "Great Wall" and "Shanhaiguan" as search words.

[0069] In another optional implementation, in order to improve query efficiency and search accuracy, in the process of searching for book content information associated with a subject word in books on an e-book platform, the book category corresponding to the subject word may be determined first; and then the book content information associated with the subject word may be searched in the books of the book category. For example, the subject word is "Great Wall", and the book categories corresponding to "Great Wall" include tourism, geography, etc., so that the book content information associated with "Great Wall" may be further searched in the tourism and geography books.

[0070] Step S350: acquiring book image annotation information associated with the second image according to the book content information.

[0071] If the book content information determined in step S340 is one piece, the book content information can be directly used as the book image annotation information associated with the second image.

[0072] If there are multiple pieces of book content information determined in step S340, target book content information is filtered out from the multiple pieces of book content information according to at least one dimension; and the target book content information is used as book image annotation information associated with the second image; wherein the dimension includes at least one of the following dimensions: the degree of matching between the book content information and the subject word, the ranking of the book corresponding to the book content information, the number of times the book content information is cited, the number of times the book content information is annotated, and the number of times the book content information is liked. The ranking of the book corresponding to the book content information may be a popularity ranking, a praise ranking, a ranking of matching with the user portrait, and the like.

[0073] Step S360: Displaying book image annotation information.

[0074] It can be seen that this embodiment obtains sample images from a third-party platform to generate a third-party gallery, and identifies the second image from the third-party gallery, thereby improving the scope of application of the present method; and, this embodiment obtains book image annotation information from books on the e-book platform based on the subject words of the second image, which can further improve the matching degree between the book image annotation information and the actual entity, thereby improving the user experience.

[0075] Embodiment 4

[0076] Figure 4 The flowchart of an information display method provided according to the fourth embodiment of the present invention is shown. This embodiment is a further optimization of the method in the first embodiment.

[0077] like Figure 4 As shown, the method includes:

[0078] Step S410: Acquire an input first image.

[0079] Step S420: compare the first image with the book illustrations in the electronic book platform library to determine whether there is a second image matching the first image in the electronic book platform library; if so, execute step S430; if not, execute step S440.

[0080] In this embodiment, the final book image annotation information is obtained based on the e-book platform library and the third-party library, thereby further improving the scope of application of the method. Among them, the e-book platform library contains the book illustrations in the e-book platform; the third-party library contains sample images obtained from the third-party platform.

[0081] In the specific implementation process, the priority of the e-book platform library is higher than that of the third-party library, so the e-book platform library is preferentially searched for book illustrations matching the first image. If book illustrations matching the first image can be found, step S430 is executed; if book illustrations matching the first image cannot be found, step S440 is further executed to search for sample images matching the first image in the third-party library.

[0082] Step S430: taking the book illustration that matches the first image as the second image.

[0083] Step S440: Compare the first image with sample images in a third-party image library, and use the sample image that matches the first image as the second image.

[0084] Step S450: Acquire book image annotation information associated with the second image.

[0085] Among them, if the second image is located in the e-book platform gallery, that is, the second image is a book illustration, then refer to the corresponding part in Example 2 to obtain the book image annotation information associated with the second image; if the second image is located in a third-party gallery, that is, the second image is a sample image, then refer to the corresponding part in Example 3 to obtain the book image annotation information associated with the second image.

[0086] Step S460: Displaying book image annotation information.

[0087] It can be seen that this embodiment preferentially searches for the second image in the e-book platform gallery, and further searches a third-party gallery when the second image is not found in the e-book platform gallery. This further avoids the disadvantage of being unable to find book image annotation information while ensuring information display efficiency, thereby improving the scope of application of this solution.

[0088] Embodiment 5

[0089] According to a fifth embodiment of the present invention, a non-volatile computer storage medium is provided, wherein the computer storage medium stores at least one executable instruction, and the computer executable instruction can execute a method in any of the above method embodiments.

[0090] The executable instructions may be specifically used to cause the processor to perform the following operations:

[0091] Get a first input image;

[0092] Comparing the first image with images in a preset gallery to identify a second image that matches the first image;

[0093] Acquire book image annotation information associated with the second image; wherein the book image annotation information is derived from book content on an e-book platform;

[0094] The book image annotation information is displayed.

[0095] In an optional implementation, the preset gallery includes: an e-book platform gallery, the e-book platform gallery includes illustrations of books in the e-book platform;

[0096] The executable instructions cause the processor to perform the following operations:

[0097] The first image is compared with book illustrations in the electronic book platform gallery to identify a second image that matches the first image.

[0098] In an optional implementation, the preset gallery includes: a third-party gallery, the third-party gallery containing sample images obtained from a third-party platform;

[0099] The executable instructions cause the processor to perform the following operations:

[0100] The first image is compared with sample images in a third-party image library to identify a second image that matches the first image.

[0101] In an optional implementation, the preset gallery includes: an e-book platform gallery and a third-party gallery; the e-book platform gallery contains book illustrations in the e-book platform; the third-party gallery contains sample images obtained from a third-party platform;

[0102] The executable instructions cause the processor to perform the following operations:

[0103] Compare the first image with the book drawings in the electronic book platform gallery to determine whether there is a second image matching the first image in the electronic book platform gallery;

[0104] If yes, taking the book illustration matching the first image as the second image;

[0105] If not, the first image is compared with sample images in a third-party image library, and the sample image that matches the first image is used as the second image.

[0106] In an optional implementation, if the second image is located in the e-book platform gallery;

[0107] Then the book image annotation information associated with the second image is specifically: the illustration annotation of the book of the second image in the electronic book platform.

[0108] In an optional implementation, if the second image is located in a third-party image library;

[0109] The executable instructions cause the processor to perform the following operations:

[0110] Acquire a keyword of the second image;

[0111] Searching for book content information associated with the subject word in books on the e-book platform;

[0112] The book image annotation information associated with the second image is acquired according to the book content information.

[0113] In an optional implementation, if there are multiple pieces of book content information associated with the subject word;

[0114] The executable instructions cause the processor to perform the following operations:

[0115] Filtering target book content information from multiple pieces of book content information according to at least one dimension;

[0116] using the target book content information as book image annotation information associated with the second image;

[0117] The dimension includes at least one of the following dimensions:

[0118] The matching degree between the book content information and the subject words, the ranking of the book corresponding to the book content information, the number of citations of the book content information, the number of annotations of the book content information, and the number of likes of the book content information.

[0119] In an optional implementation, the executable instruction causes the processor to perform the following operations:

[0120] Get user location information;

[0121] Searching for book content information associated with the user location information and the subject word in books on the electronic book platform.

[0122] In an optional implementation, the executable instruction causes the processor to perform the following operations:

[0123] Determine the book category corresponding to the subject term;

[0124] Search the books in the book category for book content information associated with the subject word.

[0125] In an optional implementation, the executable instruction causes the processor to perform the following operations:

[0126] Extracting a feature fingerprint of the first image; comparing the feature fingerprint of the first image with feature fingerprints of images in a preset gallery to identify a second image that matches the feature fingerprint of the first image;

[0127] And / or, extracting a feature region of the first image; comparing the feature region of the first image with feature regions of images in a preset gallery to identify a second image that matches the feature region of the first image.

[0128] In an optional implementation, the executable instruction causes the processor to perform the following operations:

[0129] After the book image annotation information is displayed, in response to a preset trigger operation for the book image annotation information, the page is jumped to a book reading page corresponding to the book image annotation information.

[0130] In an optional implementation, the executable instruction causes the processor to perform the following operations:

[0131] Display the source information of the book image annotation information.

[0132] In an optional implementation, the first image is an image acquired in real time by an image acquisition device;

[0133] And / or, the first image is an image uploaded through a preset entrance.

[0134] It can be seen that when the user wants to learn more about the entity-related information, the user only needs to provide the first image of the entity, and the corresponding book image annotation information can be quickly presented to the user, thereby simplifying the user operation and improving the efficiency of information display; and the solution does not need to manually identify the entity name, thereby greatly reducing the misjudgment rate and improving the accuracy of the displayed information; furthermore, the presenting of book image annotation information to the user in this embodiment can further improve the vertical depth of the information displayed to the user. In addition, the solution is simple and easy to implement and is suitable for large-scale application and implementation.

[0135] Embodiment 6

[0136] Figure 5 A schematic diagram of the structure of a computing device provided according to Embodiment 6 of the present invention is shown. The specific embodiment of the present invention does not limit the specific implementation of the computing device.

[0137] like Figure 5 As shown, the computing device may include: a processor (processor) 502 , a communications interface (Communications Interface) 504 , a memory (memory) 506 , and a communication bus 508 .

[0138] The processor 502, the communication interface 504, and the memory 506 communicate with each other via the communication bus 508. The communication interface 504 is used to communicate with other devices such as client or other server network elements. The processor 502 is used to execute the program 510, which can specifically execute the relevant steps in the above method embodiment.

[0139] Specifically, the program 510 may include program codes, which include computer operation instructions.

[0140] The processor 502 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention. The one or more processors included in the computing device may be processors of the same type, such as one or more CPUs; or processors of different types, such as one or more CPUs and one or more ASICs.

[0141] The memory 506 is used to store the program 510. The memory 506 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0142] The program 510 may be specifically configured to enable the processor 502 to perform the following operations:

[0143] Get a first input image;

[0144] Comparing the first image with images in a preset gallery to identify a second image that matches the first image;

[0145] Acquire book image annotation information associated with the second image; wherein the book image annotation information is derived from book content on an e-book platform;

[0146] The book image annotation information is displayed.

[0147] In an optional implementation, the preset gallery includes: an e-book platform gallery, the e-book platform gallery includes illustrations of books in the e-book platform;

[0148] The program 510 may be specifically used to enable the processor 502 to perform the following operations:

[0149] The first image is compared with book illustrations in the electronic book platform gallery to identify a second image that matches the first image.

[0150] In an optional implementation, the preset gallery includes: a third-party gallery, the third-party gallery containing sample images obtained from a third-party platform;

[0151] The program 510 may be specifically used to enable the processor 502 to perform the following operations:

[0152] The first image is compared with sample images in a third-party image library to identify a second image that matches the first image.

[0153] In an optional implementation, the preset gallery includes: an e-book platform gallery and a third-party gallery; the e-book platform gallery contains book illustrations in the e-book platform; the third-party gallery contains sample images obtained from a third-party platform;

[0154] The program 510 may be specifically used to enable the processor 502 to perform the following operations:

[0155] Compare the first image with the book drawings in the electronic book platform gallery to determine whether there is a second image matching the first image in the electronic book platform gallery;

[0156] If yes, taking the book illustration matching the first image as the second image;

[0157] If not, the first image is compared with sample images in a third-party image library, and the sample image that matches the first image is used as the second image.

[0158] In an optional implementation, if the second image is located in the e-book platform gallery;

[0159] Then the book image annotation information associated with the second image is specifically: the illustration annotation of the book of the second image in the electronic book platform.

[0160] In an optional implementation, if the second image is located in a third-party image library;

[0161] The program 510 may be specifically used to enable the processor 502 to perform the following operations:

[0162] Acquire a keyword of the second image;

[0163] Searching for book content information associated with the subject word in books on the e-book platform;

[0164] The book image annotation information associated with the second image is acquired according to the book content information.

[0165] In an optional implementation, if there are multiple pieces of book content information associated with the subject word;

[0166] The program 510 may be specifically used to enable the processor 502 to perform the following operations:

[0167] Filtering target book content information from multiple pieces of book content information according to at least one dimension;

[0168] using the target book content information as book image annotation information associated with the second image;

[0169] The dimension includes at least one of the following dimensions:

[0170] The matching degree between the book content information and the subject words, the ranking of the book corresponding to the book content information, the number of citations of the book content information, the number of annotations of the book content information, and the number of likes of the book content information.

[0171] In an optional implementation, the program 510 may be specifically configured to enable the processor 502 to perform the following operations:

[0172] Get user location information;

[0173] Searching for book content information associated with the user location information and the subject word in books on the electronic book platform.

[0174] In an optional implementation, the program 510 may be specifically configured to enable the processor 502 to perform the following operations:

[0175] Determine the book category corresponding to the subject term;

[0176] Search the books in the book category for book content information associated with the subject word.

[0177] In an optional implementation, the program 510 may be specifically configured to enable the processor 502 to perform the following operations:

[0178] Extracting a feature fingerprint of the first image; comparing the feature fingerprint of the first image with feature fingerprints of images in a preset gallery to identify a second image that matches the feature fingerprint of the first image;

[0179] And / or, extracting a feature region of the first image; comparing the feature region of the first image with feature regions of images in a preset gallery to identify a second image that matches the feature region of the first image.

[0180] In an optional implementation, the program 510 may be specifically configured to enable the processor 502 to perform the following operations:

[0181] After the book image annotation information is displayed, in response to a preset trigger operation for the book image annotation information, the page is jumped to a book reading page corresponding to the book image annotation information.

[0182] In an optional implementation, the program 510 may be specifically configured to enable the processor 502 to perform the following operations:

[0183] Display the source information of the book image annotation information.

[0184] In an optional implementation, the first image is an image acquired in real time by an image acquisition device;

[0185] And / or, the first image is an image uploaded through a preset entrance.

[0186] It can be seen that when the user wants to learn more about the entity-related information, the user only needs to provide the first image of the entity, and the corresponding book image annotation information can be quickly presented to the user, thereby simplifying the user operation and improving the efficiency of information display; and the solution does not need to manually identify the entity name, thereby greatly reducing the misjudgment rate and improving the accuracy of the displayed information; furthermore, the presenting of book image annotation information to the user in this embodiment can further improve the vertical depth of the information displayed to the user. In addition, the solution is simple and easy to implement and is suitable for large-scale application and implementation.

[0187] The algorithm or display provided herein is not inherently related to any particular computer, virtual system or other equipment. Various general purpose systems can also be used together with the teachings based on this. According to the above description, it is obvious to construct the structure required for this type of system. In addition, the embodiment of the present invention is not directed to any specific programming language yet. It should be understood that various programming languages ​​can be utilized to realize the content of the present invention described herein, and the description made to specific languages ​​above is for disclosing the best mode of the present invention.

[0188] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0189] Similarly, it should be understood that in order to streamline the present invention and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, the various features of the embodiments of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the following intention: that the claimed invention requires more features than the features explicitly recited in each claim. More specifically, as reflected in the claims below, inventive aspects lie in less than all the features of the individual embodiments disclosed above. Therefore, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, with each claim itself serving as a separate embodiment of the present invention.

[0190] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0191] In addition, those skilled in the art will appreciate that, although some embodiments herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims below, any one of the claimed embodiments may be used in any combination.

[0192] The various component embodiments of the present invention can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all functions of some or all components according to embodiments of the present invention. The present invention can also be implemented as a device or apparatus program (e.g., computer program and computer program product) for executing part or all of the methods described herein. Such a program implementing the present invention can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0193] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be understood as limitations on the order of execution.

Claims

1. An information display method, comprising: Get a first input image; Comparing the first image with the book illustrations in the electronic book platform gallery; If there is a book illustration matching the first image in the e-book platform gallery, the book illustration matching the first image is used as the second image, and the illustration annotation of the second image in the book is used as the book image annotation information associated with the second image; If there is no book illustration matching the first image in the gallery of the e-book platform, the first image is compared with the sample image in the third-party gallery, and the sample image matching the first image is used as the second image; and the subject word of the second image is obtained, and the subject word is used as the search word, and the book content of the book on the e-book platform is used as the search information library to find the book content information associated with the subject word; if there are multiple pieces of book content information associated with the subject word, according to the ranking of the book corresponding to the book content information, the number of citations of the book content information, the number of annotations of the book content information, and the number of likes of the book content information, the target book content information is screened out from the multiple pieces of book content information, and the target book content information is used as the book image annotation information associated with the second image; wherein the book image annotation information comes from the book content of the e-book platform; The book image annotation information is displayed.

2. The method according to claim 1, wherein: The step of searching for book content information associated with the subject word in books on the electronic book platform further includes: Get user location information; Searching for book content information associated with the user location information and the subject word in books on the electronic book platform.

3. The method according to claim 1, wherein: The step of searching for book content information associated with the subject word in books on the electronic book platform further includes: Determine the book category corresponding to the subject term; Search the books in the book category for book content information associated with the subject word.

4. The method according to any one of claims 1 to 3, wherein: The second image is obtained by: Extracting a feature fingerprint of the first image; comparing the feature fingerprint of the first image with feature fingerprints of images in an e-book platform gallery or a third-party gallery to identify a second image that matches the feature fingerprint of the first image; And / or, extracting a feature area of ​​the first image; comparing the feature area of ​​the first image with feature areas of images in an e-book platform gallery or a third-party gallery to identify a second image that matches the feature area of ​​the first image.

5. The method according to any one of claims 1 to 3, wherein: After displaying the book image annotation information, the method further includes: in response to a preset trigger operation for the book image annotation information, jumping a page to a book reading page corresponding to the book image annotation information.

6. The method according to any one of claims 1 to 3, wherein: The method further includes: displaying source information of the book image annotation information.

7. The method according to any one of claims 1 to 3, wherein: The first image is an image acquired in real time by an image acquisition device; And / or, the first image is an image uploaded through a preset entrance.

8. A computing device comprising: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform the following operations: Get a first input image; Comparing the first image with the book illustrations in the electronic book platform gallery; If there is a book illustration matching the first image in the e-book platform gallery, the book illustration matching the first image is used as the second image, and the illustration annotation of the second image in the book is used as the book image annotation information associated with the second image; If there is no book illustration matching the first image in the gallery of the e-book platform, the first image is compared with the sample image in the third-party gallery, and the sample image matching the first image is used as the second image; and the subject word of the second image is obtained, and the subject word is used as the search word, and the book content of the book on the e-book platform is used as the search information library to find the book content information associated with the subject word; if there are multiple pieces of book content information associated with the subject word, according to the ranking of the book corresponding to the book content information, the number of citations of the book content information, the number of annotations of the book content information, and the number of likes of the book content information, the target book content information is screened out from the multiple pieces of book content information, and the target book content information is used as the book image annotation information associated with the second image; wherein the book image annotation information comes from the book content of the e-book platform; The book image annotation information is displayed.

9. The computing device of claim 8, wherein: The executable instructions cause the processor to perform the following operations: Get user location information; Searching for book content information associated with the user location information and the subject word in books on the electronic book platform.

10. The computing device of claim 8, wherein: The executable instructions cause the processor to perform the following operations: Determine the book category corresponding to the subject term; Search the books in the book category for book content information associated with the subject word.

11. The computing device according to any one of claims 8 to 10, wherein: The executable instructions cause the processor to perform the following operations: Extracting a feature fingerprint of the first image; comparing the feature fingerprint of the first image with feature fingerprints of images in an e-book platform gallery or a third-party gallery to identify a second image that matches the feature fingerprint of the first image; And / or, extracting a feature area of ​​the first image; comparing the feature area of ​​the first image with feature areas of images in an e-book platform gallery or a third-party gallery to identify a second image that matches the feature area of ​​the first image.

12. The computing device according to any one of claims 8 to 10, wherein: The executable instructions cause the processor to perform the following operations: After the book image annotation information is displayed, in response to a preset trigger operation for the book image annotation information, the page is jumped to a book reading page corresponding to the book image annotation information.

13. The computing device according to any one of claims 8 to 10, wherein: The executable instructions cause the processor to perform the following operations: Display the source information of the book image annotation information.

14. The computing device according to any one of claims 8 to 10, wherein: The first image is an image acquired in real time by an image acquisition device; And / or, the first image is an image uploaded through a preset entrance.

15. A computer storage medium, wherein at least one executable instruction is stored in the storage medium, and the executable instruction enables a processor to perform an operation corresponding to the information display method according to any one of claims 1 to 7.

Images