Content synchronization method, device, electronic device and storage medium

Abstract

The embodiment of the present invention discloses a content synchronization method, device, electronic device and storage medium, the method comprising: acquiring a target image, and extracting target reading content in the target image; the target reading content is the content that the user is currently reading on a paper book; by matching the target reading content with the book content of a target electronic book corresponding to the paper book, determining the target reading page number of the target reading content in the target electronic book; jumping the target electronic book from the current reading page to the target reading page corresponding to the target reading page number. The technical solution of the embodiment of the present invention, by acquiring the image corresponding to the reading content of the user in the paper book and matching it with the content in the electronic book, realizes automatic and rapid positioning of the target page number of the content in the image in the electronic book, and displays the content corresponding to the target page number, thereby realizing the technical effect of content synchronization.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of computer technology, and in particular to a content synchronization method, device, electronic device, and storage medium. Background Art

[0002] With the popularity of mobile devices and e-books, more and more users will use their spare time to read books on mobile devices. In order to improve the user's reading experience, they will read paper books at other times. When a user reads the same book on both a mobile device and a paper book, there will be a situation where the content read on the paper book cannot be directly synchronized to the same position in the e-book, that is, there is a problem that the previous content cannot be continued.

[0003] In order to solve the problem of asynchronous reading content, the current method is that the user turns pages in the book displayed on the mobile device according to the content currently being read in the paper book and checks the specific content on the page until the content found is the same as the content currently being read.

[0004] When implementing the technical solution based on the above method, the inventor found the following problems:

[0005] When manually determining the specific page of the currently read content in the electronic book, there are technical problems such as low search efficiency, cumbersome and complicated operations, and long time consumption. Summary of the invention

[0006] The present invention provides a content synchronization method, device, electronic device and storage medium to conveniently and efficiently determine the specific page number of the current reading content of a user on a paper book in an electronic book, and display the page number content, thereby achieving the technical effect of synchronizing the reading progress.

[0007] In a first aspect, an embodiment of the present invention provides a content synchronization method, the method comprising:

[0008] Acquire a target image, and extract target reading content in the target image; the target reading content is the content that the user is currently reading on a paper book;

[0009] By matching the target reading content with the book content of the target electronic book corresponding to the paper book, the target reading page number of the target reading content in the target electronic book is determined; the matching process includes a matching process based on catalog information and / or a matching process based on content similarity;

[0010] The target electronic book is jumped from the current reading page to the target reading page corresponding to the target reading page number.

[0011] In a second aspect, an embodiment of the present invention further provides a content synchronization device, the device comprising:

[0012] A reading content extraction module is used to obtain a target image and extract target reading content in the target image; the target reading content is the content currently read by the user on the paper book;

[0013] A reading page number determination module is used to determine the target reading page number of the target reading content in the target electronic book by matching the target reading content with the book content of the target electronic book corresponding to the paper book; the matching process includes a matching process based on catalog information and / or a matching process based on content similarity;

[0014] The reading page jump module is used to jump the target electronic book from the current reading page to the target reading page corresponding to the target reading page number.

[0015] In a third aspect, an embodiment of the present invention further provides an electronic device, the electronic device comprising:

[0016] one or more processors;

[0017] a storage device for storing one or more programs,

[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement the content synchronization method as described in any one of the embodiments of the present invention.

[0019] In a fourth aspect, an embodiment of the present invention further provides a storage medium comprising computer executable instructions, wherein the computer executable instructions are used to execute the content synchronization method as described in any one of the embodiments of the present invention when executed by a computer processor.

[0020] The technical solution of the embodiment of the present invention matches the target image including the target reading content and the book content of the electronic book, determines the target reading page number of the target reading content in the electronic book, and jumps to the target reading page number to continue reading the paper book content, thereby achieving the technical effect of synchronizing the paper book reading content and the electronic book reading content. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions of the exemplary embodiments of the present invention, the following briefly introduces the drawings required to describe the embodiments. Obviously, the drawings introduced are only drawings of a part of the embodiments to be described in the present invention, rather than all the drawings. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 A schematic diagram of a content synchronization method provided in the first embodiment of the present invention;

[0023] Figure 2 A schematic diagram of a process for obtaining basic information of electronic books and paper books provided in the second embodiment of the present invention;

[0024] Figure 3 Another schematic diagram of a process for obtaining basic information of electronic books and paper books provided in the second embodiment of the present invention;

[0025] Figure 4 A flowchart of a content synchronization method provided by Embodiment 3 of the present invention;

[0026] Figure 5 Another flowchart of a content synchronization method provided by the fourth embodiment of the present invention;

[0027] Figure 6 This is another flowchart of a content synchronization method provided by Embodiment 5 of the present invention;

[0028] Figure 7 A schematic diagram of the structure of a content synchronization device provided by Embodiment 6 of the present invention;

[0029] Figure 8 This is a schematic diagram of the structure of an electronic device provided in Embodiment 7 of the present invention. DETAILED DESCRIPTION

[0030] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0031] Embodiment 1

[0032] Figure 1 A flow chart of a content synchronization method provided in the first embodiment of the present invention is provided. This embodiment can be applied to the situation where, based on the reading content of the user in the paper book, the specific page number of the reading content in the electronic book is determined and the page number is jumped to the corresponding page number, thereby realizing the synchronization of the reading content. The method can be executed by a content synchronization device, and the device can be implemented in the form of software and / or hardware. The hardware can be an electronic device, and the electronic device can be a mobile terminal or a PC, etc.

[0033] Before introducing the present technical solution, a specific application scenario can be exemplified. With the popularity of e-books, users can not only read paper books, but also read e-books. Usually, reading software can be installed on electronic devices, such as mobile terminals. There are a large number of e-books in the reading software, and users can trigger corresponding e-book reading. In the actual reading process, users can adjust the font size in the e-book according to actual needs. Therefore, the page numbers corresponding to the same content in the e-book and the paper book are different. This embodiment can be a solution for determining the reading content corresponding to a certain page number of a paper book, the target reading page number in the e-book, and presenting the target reading content of the target reading page number.

[0034] like Figure 1 The method of this embodiment includes:

[0035] S110, acquiring a target image, and extracting target reading content from the target image.

[0036] Among them, the user can read on a paper book, and when it is necessary to determine the specific page number of the current reading content in the electronic book, an image including the current reading content can be captured based on a camera device, and this image is used as a target image. Accordingly, since the target image includes the content that the user is currently reading on the paper book, the target reading content is the content that the user is currently reading on the paper book.

[0037] For example, a user usually reads a paper book. When the user needs to read the book on an electronic device, in order to continue reading the content of the paper book on the electronic book, the content currently being read on the paper book can be obtained, such as taking a picture of the content currently being read by the user on the paper book to obtain a target image. Furthermore, the text information of the target image can be extracted and the text information can be used as the target reading content.

[0038] In this embodiment, extracting the target reading content in the target image includes: determining the row area containing text information in the target image and identifying the text information in the row area; and generating the target reading content based on the text information in each row area.

[0039] In the actual application process, there may be a situation where the text in the same text line in the target image is not on the same horizontal line. At this time, there may be a problem that the specific text content cannot be recognized. In order to avoid this problem, the target image can be preprocessed. The preprocessing can be: tilt correction of the target image so that the content of the same text line is on the same horizontal line, which is convenient for subsequent text extraction. After the correction is completed, the line area containing the text can be identified by using text detection algorithms such as MSER or CTPN, and then using text recognition algorithms such as CRNN or Seq2Seq to extract the specific content in the text line to obtain the target reading content.

[0040] S120: Determine a target reading page number of the target reading content in the target electronic book by matching the target reading content with the book content of the target electronic book corresponding to the paper book.

[0041] It should be noted that the number of words displayed per line in a paper book is usually fixed, and users can adjust the font size on an electronic book, so the number of words displayed per line is different from that displayed per line in a paper book. That is, the same content has different corresponding page numbers in an electronic book and a paper book; further, users can also adjust the font size of the electronic book, so when the same content uses different font sizes, the same content has different corresponding page numbers in the electronic book.

[0042] After determining the display font size of the electronic book, the specific page number of the target reading content in the electronic book is determined as the target reading page number.

[0043] Specifically, after extracting the target reading content in the target image, matching processing can be performed based on the target reading content and the content in the electronic book corresponding to the paper book. According to the matching processing result, the specific page number of the target reading content in the electronic book, that is, the target reading page number, can be determined.

[0044] In this embodiment, the matching process includes a matching process based on directory information and / or a matching process based on content similarity. Among them, the matching process based on directory information can be to determine whether the target reading content includes a directory. If it does, its reading position in the electronic book can be determined based on the directory information, and then the target reading page number can be determined; the content similarity process can be to determine the similarity between the target reading content and the content displayed on each page of the electronic book to determine the target reading page number. Alternatively, it can be determined first whether the target reading content includes a directory. If so, the corresponding page number to be selected for reading can be determined. Then, if the user marks the corresponding content, the similarity between the target reading content and the content of each page number can be determined from the marked position and the content corresponding to the page number to be selected for reading, thereby determining the target reading page number.

[0045] S130: Jump the target electronic book from the current reading page to the target reading page corresponding to the target reading page number.

[0046] It should be noted that if the user has previously used a mobile device to read the e-book, when the user triggers the e-book on the same terminal device, the page can be jumped to the page of the previous reading.

[0047] The page where the user stops after the previous reading is used as the current reading page. The target reading page number is the specific page number of the target reading content in the electronic book.

[0048] Specifically, the user can trigger the control of the content synchronization function on the electronic book. When the triggering of the button is detected, the page can be jumped from the current reading page to the target reading page, thereby achieving the technical effect of synchronization of reading content.

[0049] The technical solution of the embodiment of the present invention matches the target image including the target reading content and the book content of the electronic book, determines the target reading page number of the target reading content in the electronic book, and jumps to the target reading page number to continue reading the paper book content, thereby achieving the technical effect of automatic synchronization of the paper book reading content and the electronic book reading content.

[0050] Embodiment 2

[0051] Figure 2 This is a flow chart of obtaining basic information of electronic books and paper books provided in the second embodiment of the present invention. Based on the above embodiment, before determining the target page number of the target reading content in the target image in the electronic book, basic information of the paper book and the electronic book corresponding to the paper book can be obtained. The technical terms that are the same as or corresponding to the above embodiment are not repeated here.

[0052] like Figure 2 As shown, the method includes:

[0053] S210: Retrieve the book content of the target electronic book, and obtain catalog information from the book content.

[0054] The book content includes the catalog information of the electronic book, the specific content corresponding to each catalog in the catalog information, and the page number of each catalog in the electronic book.

[0055] Specifically, when it is detected that the user triggers the reading software installed on the mobile terminal, the homepage corresponding to the reading software can be entered, and the homepage can include books of multiple categories. The user can search for the corresponding electronic book according to the name of the paper book. After determining the electronic book, the book content of the electronic book can be obtained, and the directory information of the electronic book can be read from the book content. At the same time, the page number corresponding to the directory information in the electronic book is determined.

[0056] For example, the name of the paper book read by the user is A. If the user is reading the book on the terminal for the first time, the user can enter the book name A in the search control after triggering the reading software on the mobile terminal, and retrieve the electronic book corresponding to the book name A from the electronic book library; if the user has read the book named A on the electronic device, the electronic book can be obtained from the historical reading record. After obtaining the electronic book corresponding to the name of the paper book, the book content of the electronic book can be obtained, such as the directory information, the specific text information corresponding to the directory information, and the page number corresponding to the directory information.

[0057] S220. Generate a set of directory expressions corresponding to the directory information according to the directory information, so that when a directory expression exists in the target reading content, the target reading page number of the target reading content in the target electronic book is determined according to the target directory corresponding to the target expression.

[0058] Usually, the catalog of a book is written according to certain rules, and the catalog structure of the book can be determined by processing the acquired catalog information. The catalog structure can be used as a catalog expression.

[0059] The directory information includes the main directory and subdirectories. The expressions corresponding to different directory levels may be the same or different, so the determined directory expression may be one or more. Accordingly, there may be multiple elements in the directory expression set, each element corresponding to a directory expression.

[0060] Specifically, the main directory and subdirectory in the directory information can be obtained, and the composition forms of the main directory and the subdirectory can be extracted respectively to obtain at least one directory expression corresponding to the electronic book. Common directory expressions include: Chapter X XX, Chapter 1, 1.1. After determining the directory expression, it can be determined whether the target reading content includes the directory expression, and then the target reading page number of the target reading content in the electronic book is determined based on the directory expression.

[0061] S230: Using a camera device on a terminal device to which the target electronic book belongs, photograph the content currently read by the user in the paper book to obtain a target image.

[0062] The camera device may be a camera on a terminal device. The content currently read by the user on the paper book may be used as the current reading content. For example, if the user has read to page 45 of the paper book, the content presented on page 45 of the paper book may be used as the current reading content of the user. The camera device may capture the content on page 45 of the paper book, and the captured image may be used as the target image.

[0063] Specifically, after the user triggers the e-book, the content synchronization control can be triggered. After detecting that the user triggers the content synchronization control, the camera on the terminal device can be turned on, and the user's current target reading content on the paper book can be photographed based on the camera to obtain a target image including the target reading content.

[0064] S240, acquiring a target image, and extracting target reading content in the target image; the target reading content is the content that the user is currently reading on a paper book.

[0065] S250: Determine a target reading page number of the target reading content in the target electronic book by matching the target reading content with the book content of the target electronic book corresponding to the paper book.

[0066] S260: Jump the target electronic book from the current reading page to the target reading page corresponding to the target reading page number.

[0067] The technical solution of the embodiment of the present invention can extract the target reading content in the image and determine its specific reading page number in the electronic book by pre-acquiring the book information of the electronic book and the image including the content read by the user on the paper book, thereby achieving the technical effect of synchronizing the reading content of the electronic book and the paper data.

[0068] As an alternative embodiment of the above embodiment, Figure 3 This is another flow chart of obtaining basic information of electronic books and paper books provided by the second embodiment of the present invention. Figure 3 As shown, the reading software on the terminal device is triggered, and the electronic book that is the same as the paper book is found and opened in the reading software, that is, the corresponding electronic book is opened. After the electronic book is opened, the content synchronization control on the display page is triggered to turn on the camera to shoot the content in the paper book that needs to be synchronized with the electronic book, that is, shoot the content that the user is currently reading on the paper book to obtain the target image. While shooting the target image, the book information of the electronic book can be obtained. Optionally, the book information includes text content information and directory information. Based on the book information and the target image, the basic information of the paper book and the electronic book is obtained.

[0069] Embodiment 3

[0070] Figure 4This is a flow chart of a content synchronization method provided in the third embodiment of the present invention. Based on the above embodiment, the above step of "determining the target reading page number of the target reading content in the target electronic book by matching the target reading content with the book content of the target electronic book corresponding to the paper book" can be optimized. The specific implementation method can refer to the technical solution of this embodiment. Among them, the technical terms that are the same as or corresponding to the above embodiment are not repeated here.

[0071] like Figure 4 As shown, the method includes:

[0072] S410: Retrieve the book content of the target electronic book, and obtain directory information from the book content.

[0073] Exemplarily, when it is detected that a user triggers a reading software installed on a mobile device, optionally, the mobile device is a mobile phone, and the reading software can be opened. A large number of electronic books can be displayed in the reading software, and the user can enter the name of the paper book in the search control and trigger the search button to retrieve the electronic book that is the same as the paper book. Of course, if the user has read the target electronic book in the reading software, the target electronic book can be obtained from the historical reading record. After obtaining the electronic book, the book content of the electronic book can be retrieved, and the catalog information of the electronic book can be read from the book content.

[0074] S420. Generate a set of directory expressions corresponding to the directory information according to the directory information, so that when a directory expression exists in the target reading content, determine the target reading page number of the target reading content in the target electronic book according to the target directory corresponding to the target expression.

[0075] Specifically, the directory information includes a main directory and a subdirectory, and the specific forms of the main directory and the subdirectory can be extracted to obtain directory expressions of the main directory and the subdirectory. All directory expressions can be used as an element in a directory expression set.

[0076] S430: Using a camera device on a terminal device to which the target electronic book belongs, photograph the content currently read by the user in the paper book to obtain a target image.

[0077] Specifically, while determining the target expression set, the user can trigger the synchronization control on the reading software. When detecting that the user triggers the reading synchronization control, the software can call a camera, such as a camera on a terminal device, to shoot the content currently read by the user in the paper book, and the image captured by the camera can be used as the target image.

[0078] It should be noted that the target image includes the content that the user is currently reading on the paper book.

[0079] S440, acquiring a target image, and extracting target reading content in the target image; the target reading content is the content that the user is currently reading on a paper book.

[0080] Specifically, after the shooting device acquires the target image, the target image can be acquired, and the target reading content in the target image can be extracted using a text recognition algorithm.

[0081] S450: When it is determined based on the set of directory expressions that the target reading content includes at least one directory expression, a target directory of each directory expression in the target reading content is determined respectively.

[0082] It should be noted that, in the actual reading process, each reading page may include at least one directory line, or may not include a directory line.

[0083] When the reading content includes multiple directory lines, multiple directory expressions can be matched. The target directory is the specific content corresponding to the directory line, and the specific content can be used as the target directory.

[0084] Specifically, based on each directory expression in the directory expression set, it can be confirmed line by line whether the target reading content includes the directory expression in the directory expression set. If it does, it can be determined that the target reading content includes the directory line. If it does not, it means that the target reading content does not include the directory line. After determining the directory line, the content of the directory line can be obtained and the content of the directory line is used as the target directory.

[0085] S460: Determine the target reading page number of each target directory in the electronic book from the directory information.

[0086] The content corresponding to the directory line may be used as the target directory.

[0087] Specifically, when it is determined that the target reading content includes a directory line, the line content of the directory line, i.e., the target directory, can be obtained. According to the target directory and the directory information, the target reading page number corresponding to the target directory is determined. In this embodiment, if the target reading content includes multiple target directories, the target reading page number corresponding to each target directory can be determined separately.

[0088] S470: Jump the target electronic book from the current reading page to the target reading page corresponding to the target reading page number.

[0089] If the e-book is read for the first time, the current reading page may be the home page; if the e-book is not read for the first time, the current reading page may be the page corresponding to the last time the e-book was read. The page corresponding to the target reading page number is used as the target reading page.

[0090] Specifically, if the target reading content includes a target directory, the number of target reading page numbers is also one. After determining the target reading page number, the electronic book can automatically jump from the current reading page to the target reading page corresponding to the target reading page number. If the target reading content includes multiple target directory rows, the number of determined target reading page numbers can also be multiple. The electronic book can automatically jump from the current reading page to the target reading page number corresponding to the first target directory in the target reading content.

[0091] Optionally, the target electronic book jumps from the current reading page to the target reading page number corresponding to the first target directory, and presents the target reading page corresponding to the target reading page number; when a triggering page number jump control is detected, the target reading page corresponding to the current target directory is used as the current reading page, and jumps from the current reading page to the target reading page corresponding to the next target directory.

[0092] It can be understood that if the target reading page includes multiple target directories, after determining the target reading page number of each target directory respectively, the target electronic book can be jumped from the current reading page to the target reading page number corresponding to the first target directory. At this time, the target reading page corresponding to the target reading page number can be presented on the display interface of the mobile terminal. The user can browse the content on the target reading page to determine whether the content displayed is the target reading content. If not, the control for jumping to the page number corresponding to the next target directory on the display interface can be triggered to jump from the target reading page to the target reading page corresponding to the next target directory. For example, when it is detected that the user triggers the page jump control, the target reading page corresponding to the current target directory can be used as the current reading page, and the target reading page corresponding to the next target directory can be jumped from the current reading page.

[0093] The technical solution of the embodiment of the present invention, when determining that the target reading content includes a target directory through a pre-extracted set of directory expressions, can determine the target reading page of the target directory in the electronic book based on the directory information, and then jump the electronic book from the current reading page number to the target reading page number, thereby achieving the synchronization of the paper book content and the electronic book content, thereby continuing the technical effect of continuing to read the paper book content.

[0094] Embodiment 4

[0095] Figure 5This is a flow chart of a content synchronization method provided in the fourth embodiment of the present invention. Based on the above embodiment, the above step of "determining the target reading page number of the target reading content in the target electronic book by matching the target reading content with the book content of the target electronic book corresponding to the paper book" can be optimized. The specific implementation method can refer to the technical solution of this embodiment. Among them, the technical terms that are the same as or corresponding to the above embodiment are not repeated here.

[0096] like Figure 5 As shown, the method includes:

[0097] S510: Retrieve the book content of the target electronic book, and obtain directory information from the book content.

[0098] S520. Generate a set of directory expressions corresponding to the directory information according to the directory information, so that when a directory expression exists in the target reading content, determine the target reading page number of the target reading content in the target electronic book according to the target directory corresponding to the target expression.

[0099] S530: Using a camera device on a terminal device to which the target electronic book belongs, photograph the content currently read by the user in the paper book to obtain a target image.

[0100] S540, acquiring a target image, and extracting target reading content in the target image; the target reading content is the content that the user is currently reading on a paper book.

[0101] S550: If it is determined based on the target directory expression set that the target reading content does not include a directory expression, then the current page number of the currently read page of the electronic book is determined.

[0102] It can be understood that if the target reading content does not include a table of contents line, the current page number corresponding to the current reading page of the electronic book can be obtained.

[0103] S560: Acquire the current page content corresponding to the current page number, and match the current page content with the target reading content line by line to obtain a matching value between the current page number and the target reading content.

[0104] Usually, users read books starting from the current reading page and continue to read backwards, so the current page content corresponding to the current page number of the electronic book can be used as the starting point for determining the specific page number of the target reading content in the electronic book.

[0105] Among them, the matching value is used to represent the overlap between the current page content and the target reading content. The higher the matching value, the higher the overlap value.

[0106] Specifically, the current page content corresponding to the current page number is extracted, and the current page content is matched with the target reading content line by line to determine the matching value between the current page content and the target reading content.

[0107] In this embodiment, the current page content corresponding to the current page number is obtained, and the current page content is matched with the target reading content line by line to obtain a matching value between the current page number and the target reading content, including: determining the total number of text lines in the current page content, and obtaining the text content of each text line; matching the text content of each text line with the target reading content to determine the number of matching target text lines; determining the matching value between the current page number and the target reading content based on the target number of text lines and the total number of text lines.

[0108] Usually, the display screen size of a mobile terminal is smaller than that of a paper book, and the number of words displayed in each line of an e-book is also smaller than that of a paper book. Therefore, the content of the e-book can be obtained line by line and matched with the target reading content, and whether the current page number is the target reading page number can be determined based on the matching results.

[0109] The current page content is the page content corresponding to the current page number in the electronic book. The number of lines displayed on each page of the display screen can be used as the total number of text lines. The target number of text lines is how many text lines in the current page content match the target reading content. By calculating the ratio of the target number of text lines to the total number of text lines, the matching value between the current page content of the current page number and the target reading content is determined.

[0110] Exemplarily, the total number of text lines in the current page content is 20 lines, and each line of content is obtained in turn and matched with the target reading content. When the contents are consistent, the text line can be used as the target text line. Optionally, if the number of target text lines is 15, the ratio of the target text line number to the total text line number can be calculated to determine that the match degree between the current page number and the target reading content is seventy-five percent.

[0111] S570: Determine the target reading page number according to the matching value.

[0112] In this embodiment, determining the target reading page number based on the matching value includes: if the matching value is less than a preset matching threshold, obtaining the next page number of the current page number, and using the next page number as the current page number, and determining the matching value between the current page content of the current page number and the target reading content; when the matching value is greater than or equal to the preset matching threshold, using the current page number as the target reading page number.

[0113] The preset matching value is preset, and optionally, the preset matching threshold is set to 90%.

[0114] Specifically, if the matching value 75% corresponding to the current page number is less than the preset matching threshold 90%, it means that the current page may not be the target reading page number. At this time, the next page number of the current page number can be obtained, the next page number can be used as the current page number, and the matching value between the current page content of the current page number and the target reading content can be determined. When it is detected that the matching degree of the current page number is greater than or equal to the page number of the preset matching threshold, the current page number is used as the target reading page number.

[0115] In actual application, there may be a situation where after traversing all page numbers, it is determined that the matching values ​​between the page content corresponding to each page number and the target reading content are all less than the preset matching threshold. In this case, it can be: if the page contents corresponding to all page numbers are traversed and it is determined that the matching values ​​corresponding to each page number are all less than the preset matching threshold, then the page number corresponding to the maximum matching value is determined, and the page number is used as the target reading page number.

[0116] Specifically, after determining the matching value between the page content of each page number and the target reading content, if the matching value is less than a preset matching value threshold, the matching value corresponding to the page number can be recorded. After traversing the matching values ​​of all page numbers, the page number corresponding to the maximum matching value is obtained, and the page number is used as the target reading page number.

[0117] S580: Jump the target electronic book from the current reading page to the target reading page corresponding to the target reading page number.

[0118] The technical solution of the embodiment of the present invention matches the target image including the target reading content and the book content of the electronic book, determines the target reading page number of the target reading content in the electronic book, and jumps to the target reading page number to continue reading the paper book content, thereby achieving the technical effect of synchronizing the paper book reading content and the electronic book reading content.

[0119] Embodiment 5

[0120] As an alternative embodiment of the above embodiment, Figure 6 This is another flow chart of a content synchronization method provided by Embodiment 5 of the present invention, wherein the technical terms that are the same as or corresponding to the above embodiments are not described in detail here.

[0121] like Figure 6 As shown, the method includes:

[0122] S601: Acquire a target image, and extract the text line content of each text line in the target image.

[0123] Specifically, the reading software is triggered and the electronic book identical to the paper book is retrieved. When a control that triggers synchronization of reading content is detected, the camera is retrieved to capture the content currently being read by the user on the paper book to obtain a target image.

[0124] After obtaining the target image, the text line content of each text line in the target image can be extracted to determine whether the text line is a title line, that is, a directory expression. At the same time, based on the text line content, the matching value of the page content of each page number in the electronic book and the content in the target image can be determined.

[0125] S602. Determine whether the text line is a title line based on the content of the text line. If so, execute S603; if not, execute S604.

[0126] Specifically, the text line content and a pre-established set of directory expressions can be used to determine whether the text line content is a title line. If so, the target reading page number corresponding to the target image can be determined based on the title line; if not, the text line can be integrated into the target reading content.

[0127] S603: Determine the target reading page number corresponding to the title row according to the electronic book catalog information.

[0128] Specifically, the content of the title line can be obtained and the target reading page number corresponding to the title line can be determined according to the catalog information of the electronic book.

[0129] S604: Integrate text lines to obtain target reading content.

[0130] Specifically, the text line contents may be integrated to obtain target reading content.

[0131] S605: Acquire the current reading page number of the electronic book, and acquire the current reading content corresponding to the current reading page number.

[0132] Specifically, the current reading page number of the electronic book is obtained, and the current reading content corresponding to the current reading page number is extracted.

[0133] S606: The current reading content is matched with the target reading content, and a matching degree value is obtained.

[0134] Specifically, by matching the text lines of the current reading content with the target reading content, the target number of text lines in the current reading content including the target reading content can be determined. According to the target number of text lines and the total number of text lines of the current reading content, the matching value between the current reading content and the target reading content can be determined.

[0135] S607 , determine whether the matching value is greater than a preset matching threshold, if so, execute S608 ; if not, execute S609 .

[0136] Specifically, if the matching value of the current page number is greater than or equal to the preset matching value threshold, the current page number is used as the target reading page number. Otherwise, the next page number of the current page number is obtained, and the matching value between the page content of the next page number and the target reading content is determined.

[0137] S608: Obtain the current reading content corresponding to the current reading page number and present it on the display interface.

[0138] Specifically, if the matching value between the content corresponding to the current reading page number and the target reading content is greater than or equal to a preset matching threshold, the current reading content corresponding to the current reading page number may be presented on the display interface.

[0139] S609, record the current page number and the matching value, and determine whether the current page number is the last page. If so, execute S610; if not, execute S611.

[0140] Specifically, record the matching value corresponding to the current page number, and determine whether the current page number is the last page number. If so, obtain the page number corresponding to the highest matching value as the target reading page number based on the matching value corresponding to each page number; otherwise, obtain the next page number of the current page number, and determine the matching value between the page content corresponding to the next page number and the target reading content.

[0141] S610: Obtain the page number corresponding to the highest matching value and use it as the target reading page number.

[0142] Specifically, the page number corresponding to the highest matching value is determined and used as the target reading page number.

[0143] S611, obtaining the reading content of the next page number of the current page number as the current reading content, and returning to execute S606.

[0144] Specifically, the next page number of the current page number is obtained, and the reading content corresponding to the next page number is obtained as the target reading content, and the process returns to execute S606, that is, determining the matching value between the current reading content and the target reading content.

[0145] S612, jump to the target reading page number.

[0146] Specifically, jumping to the target reading page number realizes synchronization of the content of the electronic book with the reading content of the user on the paper book.

[0147] The technical solution of the embodiment of the present invention matches the target image including the target reading content and the book content of the electronic book, determines the target reading page number of the target reading content in the electronic book, and jumps to the target reading page number to continue reading the paper book content, thereby achieving the technical effect of synchronizing the paper book reading content and the electronic book reading content.

[0148] Embodiment 6

[0149] Figure 7 This is a schematic diagram of the structure of a content synchronization device provided in Embodiment 6 of the present invention. The device includes: a reading content extraction module 710 , a reading page number determination module 720 and a reading page jump module 730 .

[0150] Among them, the reading content extraction module 710 is used to obtain a target image and extract the target reading content in the target image; the target reading content is the content currently read by the user on the paper book; the reading page number determination module 720 is used to determine the target reading page number of the target reading content in the target electronic book by matching the target reading content with the book content of the target electronic book corresponding to the paper book; the reading page jump module 730 is used to jump the target electronic book from the current reading page to the target reading page corresponding to the target reading page number.

[0151] On the basis of the above technical solution, the reading content extraction module, before being used to obtain the target image and extract the target reading content in the target image, is also used to: retrieve the book content of the target electronic book and obtain directory information from the book content; generate a directory expression set corresponding to the directory information based on the directory information, so as to determine the target reading page number of the target reading content in the target electronic book according to the target directory corresponding to the target expression when a directory expression exists in the target reading content; the directory expression set includes at least one directory expression; based on the camera device on the terminal device to which the target electronic book belongs, shoot the content currently read by the user in the paper book to obtain the target image.

[0152] Based on the above technical solutions, the reading content extraction module is also used to: determine the row area containing text information in the target image and identify the text information in the row area; generate the target reading content based on the text information in each row area.

[0153] On the basis of the above technical solutions, the reading page number determination module is also used for:

[0154] When it is determined based on the set of directory expressions that the target reading content includes at least one directory expression, the target directory of each directory expression in the target reading content is determined respectively; and the target reading page number of each target directory in the electronic book is determined from the directory information.

[0155] On the basis of the above-mentioned technical solutions, the number of the target reading page numbers includes at least two, and the reading page determination module is also used to: jump the target electronic book from the current reading page to the target reading page number corresponding to the first target directory, and present the target reading page corresponding to the target reading page number; when a triggering page number jump control is detected, the target reading page corresponding to the current target directory is used as the current reading page, and jump from the current reading page to the target reading page corresponding to the next target directory.

[0156] On the basis of the above technical solutions, the reading pages also include:

[0157] The current page number acquisition unit is used to determine the current page number of the currently read page of the electronic book if it is determined based on the target directory expression set that the target reading content does not include a directory expression; the matching value determination unit is used to obtain the current page content corresponding to the current page number, and match the current page content with the target reading content row by row to obtain the matching value between the current page number and the target reading content; the target reading page number determination unit is used to determine the target reading page number according to the matching value.

[0158] On the basis of the above technical solutions, the target reading page number determination unit is further used for:

[0159] If the matching value is less than the preset matching threshold, the next page number of the current page number is obtained, and the next page number is used as the current page number to determine the matching value between the current page content of the current page number and the target reading content; when the matching value is greater than or equal to the preset matching threshold, the current page number is used as the target reading page number.

[0160] On the basis of the above technical solution, the device also includes: a target reading page number determination module, which is also used to determine the page number corresponding to the maximum matching value if the page contents corresponding to all page numbers are traversed and it is determined that the matching values ​​corresponding to each page number are less than the preset matching threshold, and use the page number as the target reading page number.

[0161] On the basis of the above technical solutions, the device further includes:

[0162] The line text content determination module is also used to determine the total number of text lines in the current page content and obtain the text content of each text line; the text line number determination module is also used to match the text content of each text line with the target reading content to determine the number of matching target text lines; the second matching value determination unit is used to determine the matching value between the current page number and the target reading content based on the target text line number and the total text line number.

[0163] The technical solution of the embodiment of the present invention matches the target image including the target reading content and the book content of the electronic book, determines the target reading page number of the target reading content in the electronic book, and jumps to the target reading page number to continue reading the paper book content, thereby achieving the technical effect of synchronizing the paper book reading content and the electronic book reading content.

[0164] The content synchronization device provided in the embodiment of the present invention can execute the content synchronization method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0165] It is worth noting that the various units and modules included in the above system are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present invention.

[0166] Embodiment 7

[0167] Figure 8 A schematic diagram of the structure of an electronic device provided in Embodiment 7 of the present invention. Figure 8 A block diagram of an exemplary electronic device 80 suitable for implementing exemplary embodiments of the present invention is shown. Figure 8 The electronic device 80 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0168] like Figure 8 As shown, the electronic device 80 is in the form of a general computing device. The components of the electronic device 80 may include but are not limited to: one or more processors or processing units 801, a system memory 802, and a bus 803 connecting different system components (including the system memory 802 and the processing unit 801).

[0169] Bus 903 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor or a local bus using any of a variety of bus structures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus and Peripheral Component Interconnect (PCI) bus.

[0170] The electronic device 80 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the electronic device 80, including volatile and non-volatile media, removable and non-removable media.

[0171] The system memory 802 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 804 and / or cache memory 805. The electronic device 80 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 806 may be used to read and write non-removable, non-volatile magnetic media ( Figure 8 not shown, usually called a "hard drive"). Although Figure 8 Not shown in the figure, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 803 via one or more data medium interfaces. The memory 802 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the embodiments of the present invention.

[0172] A program / utility 808 having a set (at least one) of program modules 807 may be stored, for example, in the memory 802, such program modules 807 including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 807 generally perform the functions and / or methods of the embodiments described herein.

[0173] The electronic device 80 may also communicate with one or more external electronic devices 809 (e.g., keyboards, pointing devices, displays 810, etc.), may communicate with one or more devices that enable a user to interact with the electronic device 80, and / or communicate with any device that enables the electronic device 80 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed through an input / output (I / O) interface 811. Furthermore, the electronic device 80 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 812. As shown, the network adapter 812 communicates with other modules of the electronic device 80 through the bus 803. It should be understood that although Figure 8 Not shown, other hardware and / or software modules may be used in conjunction with the electronic device 80, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0174] The processing unit 801 executes various functional applications and data processing by running the programs stored in the system memory 802, such as implementing the content synchronization method provided by the embodiment of the present invention.

[0175] Embodiment 8

[0176] Embodiment 8 of the present invention further provides a storage medium including computer executable instructions, wherein the computer executable instructions are used to execute a content synchronization method when executed by a computer processor.

[0177] The method includes:

[0178] Acquire a target image, and extract target reading content in the target image; the target reading content is the content that the user is currently reading on a paper book;

[0179] By matching the target reading content with the book content of the target electronic book corresponding to the paper book, a target reading page number of the target reading content in the target electronic book is determined;

[0180] The target electronic book is jumped from the current reading page to the target reading page corresponding to the target reading page number.

[0181] The computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.

[0182] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0183] Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0184] Computer program code for performing the operation of embodiments of the present invention may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0185] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A content synchronization method, characterized in that: include: Acquire a target image, and extract target reading content in the target image; The target reading content is the content that the user is currently reading on a paper book; Determine the target reading page number of the target reading content in the target electronic book by matching the target reading content with the book content of the target electronic book corresponding to the paper book; the matching process includes matching process based on catalog information, or matching process based on the catalog information and content similarity; Jumping the target electronic book from the current reading page to the target reading page corresponding to the target reading page number; Before acquiring the target image and extracting the target reading content in the target image, the method further includes: Retrieving the book content of the target electronic book and acquiring the catalog information from the book content; According to the directory information, a directory expression set corresponding to the directory information is generated; the directory expression set includes at least one directory expression; The matching process based on catalog information includes: when it is determined based on the catalog expression set that the target reading content includes at least one catalog expression, determining the target catalog of each catalog expression in the target reading content; and determining the target reading page number of each target catalog in the electronic book from the catalog information.

2. The method according to claim 1, characterized in that Before acquiring the target image and extracting the target reading content in the target image, the method further includes: The target image is obtained by photographing the content currently read by the user in the paper book based on the camera device on the terminal device to which the target electronic book belongs.

3. The method according to claim 1, characterized in that The step of extracting target reading content from the target image includes: Determine a row region containing text information in the target image, and recognize the text information in the row region; The target reading content is generated based on the text information in each line area.

4. The method according to claim 1, characterized in that: The number of the target reading page numbers includes at least two, and the step of jumping the target electronic book from the current reading page to the target reading page corresponding to the target reading page number includes: Jump the target electronic book from the current reading page to the target reading page number corresponding to the first target directory, and present the target reading page corresponding to the target reading page number; When it is detected that the page jump control is triggered, the target reading page corresponding to the current target directory is used as the current reading page, and the page jumps from the current reading page to the target reading page corresponding to the next target directory.

5. The method according to claim 1, characterized in that The matching process includes matching process based on the catalog information and content similarity, and determining the target reading page number of the target reading content in the target electronic book by matching the target reading content with the book content of the target electronic book corresponding to the paper book, including: If it is determined based on the target directory expression set that the target reading content does not include a directory expression, then determining the current page number of the currently read page of the electronic book; Acquire the current page content corresponding to the current page number, and match the current page content with the target reading content line by line to obtain a matching value between the current page number and the target reading content; The target reading page number is determined according to the matching value.

6. The method according to claim 5, characterized in that Determining the target reading page number according to the matching value includes: If the matching value is less than a preset matching threshold, the next page number of the current page number is obtained, and the next page number is used as the current page number to determine the matching value between the current page content of the current page number and the target reading content; When the matching value is greater than or equal to a preset matching threshold, the current page number is used as the target reading page number.

7. The method according to claim 6, characterized in that Also includes: If the page contents corresponding to all page numbers are traversed and it is determined that the matching values ​​corresponding to each page number are all less than the preset matching threshold, the page number corresponding to the maximum matching value is determined and used as the target reading page number.

8. The method according to any one of claims 5 to 7, characterized in that: The step of acquiring the current page content corresponding to the current page number and matching the current page content with the target reading content by line to obtain a matching value between the current page number and the target reading content includes: Determine the total number of text lines in the current page content and obtain the text content of each text line; Matching the text content of each text line with the target reading content to determine the number of matching target text lines; A matching value between the current page number and the target reading content is determined according to the target text line number and the total text line number.

9. A content synchronization device, characterized in that: include: A reading content extraction module, used to obtain a target image and extract target reading content in the target image; The target reading content is the content that the user is currently reading on a paper book; A reading page number determination module, used to determine the target reading page number of the target reading content in the target electronic book by matching the target reading content with the book content of the target electronic book corresponding to the paper book; the matching process includes matching process based on catalog information, or matching process based on the catalog information and content similarity; A reading page jump module, used to jump the target electronic book from the current reading page to the target reading page corresponding to the target reading page number; The reading content extraction module, before being used to obtain the target image and extract the target reading content in the target image, is also used to: Retrieving the book content of the target electronic book and acquiring the catalog information from the book content; According to the directory information, generating a directory expression set corresponding to the directory information; The directory expression set includes at least one directory expression; The directory information-based matching process includes: when it is determined based on the directory expression set that the target reading content includes at least one directory expression, determining the target directory of each directory expression in the target reading content respectively; The target reading page number of each target directory in the electronic book is determined from the directory information.

10. An electronic device, characterized in that: The electronic device comprises: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the content synchronization method as described in any one of claims 1-8.

11. A storage medium comprising computer executable instructions, wherein the computer executable instructions are used to perform the content synchronization method according to any one of claims 1 to 8 when executed by a computer processor.

Images