Document recording synchronization method, related device, equipment and storage medium

Abstract

The invention discloses a document recording synchronization method, a related device, equipment and a storage medium, and the method comprises the steps: recording the recording time for a document page displayed by electronic equipment during the recording of the electronic equipment; in response to a first page turning operation after recording is finished, when a target page is displayed on the electronic equipment, jumping to target time of recording the recording data by the electronic equipment, and displaying a target text of a target recording segment on the same screen as the target page; wherein the target page is a document page aimed at by the first page turning operation, the target time is represented as recording time recorded by the target page, the target recording segment is an audio clip of the target time in the recording data, and the target text is at least one of an identification text and a translation text. According to the scheme, synchronous positioning between the document and the recording can be conveniently and quickly realized during review.

Description

Technical Field

[0001] The present application relates to the field of office software technology, and in particular to a document recording synchronization method and related devices, equipment and storage media. Background Art

[0002] In scenarios such as learning and working, efficient and accurate audio recording plays a vital role in subsequent processing, for example, it can greatly facilitate review.

[0003] Currently, the main method is to store separate recording files and switch between them for subsequent processing such as review. Although this method can help with subsequent processing to a certain extent, it is relatively cumbersome and cannot achieve quick review. In view of this, how to conveniently and quickly achieve synchronous positioning between documents and recordings during review has become an urgent problem to be solved. Summary of the invention

[0004] The main technical problem solved by the present application is to provide a document recording synchronization method and related devices, equipment and storage media, which can conveniently and quickly achieve synchronous positioning between documents and recordings during review.

[0005] In order to solve the above-mentioned technical problems, the first aspect of the present application provides a document recording synchronization method, comprising: recording the recording time for the document page displayed by the electronic device when the electronic device is recording; in response to a first page turning operation after the recording ends, when the target page is displayed on the electronic device, jumping to the target time of the recording data recorded by the electronic device, and displaying the target text of the target recording segment on the same screen with the target page; wherein the target page is the document page targeted by the first page turning operation, the target time is represented by the recording time recorded on the target page, the target recording segment is the audio clip of the target time in the recording data, and the target text is at least one of a recognized text and a translated text.

[0006] In order to solve the above-mentioned technical problems, the second aspect of the present application provides a document recording synchronization device, including: a time recording module and a synchronization output module, the time recording module is used to record the recording time for the document page displayed by the electronic device when the electronic device is recording; the synchronization output module is used to respond to the first page turning operation after the recording ends, when the target page is displayed on the electronic device, jump to the target time of the recording data recorded by the electronic device, and display the target text of the target recording segment on the same screen with the target page; wherein the target page is the document page targeted by the first page turning operation, the target time is represented by the recording time recorded on the target page, the target recording segment is the audio segment of the target time in the recording data, and the target text is at least one of the recognition text and the translation text.

[0007] In order to solve the above-mentioned technical problems, the third aspect of the present application provides an electronic device, which at least includes a memory, a display screen, a microphone and a processor, the memory, the display screen and the microphone are respectively coupled to the processor, the memory at least stores program instructions, and the processor is used to execute the program instructions to implement the document recording synchronization method in the above-mentioned first aspect.

[0008] In order to solve the above technical problems, the fourth aspect of the present application provides a computer-readable storage medium, which stores program instructions that can be executed by a processor, and the program instructions are used to implement the document recording synchronization method of the first aspect above.

[0009] The above scheme records the recording time for the document page displayed by the electronic device when the electronic device is recording, responds to the first page turning operation after the recording ends, jumps to the target time of the recording data recorded by the electronic device when the target page is displayed on the electronic device, and displays the target text of the target recording segment synchronously with the target page, and the target page is the document page targeted by the first page turning operation, the target time is characterized by the recording time recorded on the target page, the target recording segment is the audio segment of the target time in the recording data, and the target text is at least one of the recognized text and the translated text, so by associating the document page displayed by the electronic device with the recording time during the recording process, so as to trigger the first page turning operation after the recording ends, according to the recorded information during the recording process, on the one hand, synchronously jumps to locate the target time associated with the target page targeted by the first page turning operation in the recording data, and on the other hand, synchronously displays the target text of the audio segment of the target time in the recording data after at least one of the recognition and translation, and then after the recording ends, the recording and the related text can be automatically and synchronously located following the first page turning operation, without the need to manually switch between different files. Therefore, it is possible to conveniently and quickly achieve synchronous positioning between the document and the recording when reviewing. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 This is a flowchart of an embodiment of a method for synchronizing document recordings in the present application; Figure 2a is a schematic diagram of an embodiment of a display interface of an electronic device; Figure 2b is a schematic diagram of another embodiment of a display interface of an electronic device; Figure 2c is a schematic diagram of another embodiment of a display interface of an electronic device; Figure 2d is a schematic diagram of another embodiment of a display interface of an electronic device; Figure 2e is a schematic diagram of an embodiment of recording time; Figure 2f is a schematic diagram of another embodiment of a display interface of an electronic device; Figure 2g is a schematic diagram of another embodiment of a display interface of an electronic device; Figure 2h is a schematic diagram of another embodiment of a display interface of an electronic device; Figure 3 It is a schematic diagram of the framework of an embodiment of a document recording synchronization device of the present application; Figure 4 It is a schematic diagram of the framework of an embodiment of the electronic device of the present application; Figure 5 It is a schematic diagram of a framework of an embodiment of a computer-readable storage medium of the present application. DETAILED DESCRIPTION

[0011] The scheme of the embodiment of the present application is described in detail below in conjunction with the drawings of the specification.

[0012] In the following description, for the purpose of explanation rather than limitation, specific details such as specific system structures, interfaces, and technologies are provided to facilitate a thorough understanding of the present application.

[0013] The terms "system" and "network" are often used interchangeably in this article. The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the fragment " / " in this article generally indicates that the associated objects before and after are in an "or" relationship. In addition, "many" in this article means two or more than two.

[0014] See also Figure 1 , Figure 1 This is a flowchart of an embodiment of the document recording synchronization method of the present application. Specifically, it may include the following steps: Step S11: when recording in the electronic device, recording the recording time for the document page displayed in the electronic device.

[0015] In one implementation scenario, the electronic device may include, but is not limited to: mobile phones, tablet computers, e-book readers, office notebooks, etc., and the specific types of electronic devices are not limited here. In addition, the electronic device may be configured with a display screen for at least displaying electronic documents (such as PPT, WORD, PDF and other electronic documents, which are not limited here). As a possible example, the display screen may be a touch screen, at least for the user to perform page turning operations on the touch screen; or, as another possible example, the electronic device may also be configured with physical buttons, at least for the user to perform page turning operations through physical buttons. Of course, the above two examples of triggering page turning operations are only possible examples in actual application processes, and other possible methods will not be given one by one here. In addition, as a possible example, the electronic device may also be configured with a microphone for recording; as a possible example, the electronic device may also be configured with a speaker for at least playing recordings.

[0016] In one implementation scenario, the electronic device may display a first control for starting recording on the same screen as the electronic document, so that when a trigger instruction for the first control is detected, the microphone of the electronic device may be controlled to start recording. Figure 2a , Figure 2a Schematic diagram of an embodiment of a display interface of an electronic device. Figure 2a As shown, the display interface of the electronic device may be provided with a display area for displaying document pages (such as the area filled with diagonal shadows), and may also be provided with a control area, and the control area may be provided with a first control for starting recording (i.e., marked with the word "recording" and shaped like a microphone icon). At the same time, the control area may also be provided with related controls for representing recording data (i.e., marked with the word "audio" as an icon). Please refer to Figure 2b , Figure 2b FIG. 1 is a schematic diagram of another embodiment of a display interface of an electronic device. Figure 2b As shown, after the first control is triggered, the first control can be Figure 2a The icon automatically changes to Figure 2b The icon shown (i.e., the recording duration is indicated by a number such as "08:00" and is shaped like a circle with a center), and the related controls representing the recording data can also automatically change to other icons (i.e., icons with text such as "transcribe" to indicate that when the control is triggered, the related operations such as the text shown in the icon (such as transcription) can be enabled for the recording. Of course, the related operations performed on the recording are not limited to transcription, and can also include but are not limited to translation, etc. Please continue to refer to Figure 2c , Figure 2c FIG. 1 is a schematic diagram of another embodiment of a display interface of an electronic device. Figure 2c As shown, Figure 2bAs shown in the example, when the related controls representing the recording data automatically change to Figure 2b As shown in the figure, the icon marked with the word "transcribe" is used as an example. When the control is triggered again, the transcribed text (i.e., recognized text) can be displayed in real time during the recording process. Of course, when the relevant control representing the recording data automatically changes to the icon marked with the word "translate", when the control is triggered again, the translated text can be displayed in real time during the recording process. For further information, please continue to refer to Figure 2d ,like Figure 2d As shown, when the first control is triggered again, the recording can be ended, and the first control can be changed back to Figure 2a In addition, the related controls representing the recorded data can also automatically change back to Figure 2a In order to indicate that the recording data has been updated, you can Figure 2a A black dot is further displayed on the icon. Of course, the above example is only a possible example of the switching change of the control icon, and other change modes of the control icon are not limited here, and other possible change modes of the control icon are not given examples one by one.

[0017] In one implementation scenario, as a possible example, the electronic device may also display a second control for triggering handwriting on the same screen as the electronic document, so that when a trigger instruction for the second control is detected, writing can be performed on the display screen of the electronic device using a stylus pen to form a handwritten record (e.g., handwritten text, hand-drawn graphics, etc.) on the document page. Figure 2a The control area may also be provided with a second control for triggering handwriting (i.e., marked with the word "ballpoint pen" and shaped like a pen tip icon).

[0018] In one implementation scenario, as a possible example, the electronic device may also display a third control for triggering rotation on the same screen as the electronic document, so that when a trigger instruction of the third control is detected, the document page displayed by the electronic device may be automatically rotated (e.g., it may be rotated 90 degrees to the left, 90 degrees to the right, etc.), so that the document page may be switched between horizontal and vertical display. Figure 2a The control area may also be provided with a third control for triggering rotation (ie, an icon marked with the word "rotate" and including a rectangle and an arrow pointing to the upper right).

[0019] In one implementation scenario, as a possible example, the electronic device can also display controls for triggering related operations such as screen projection, editing, sharing, and touch-free on the same screen as the electronic document. It should be noted that by triggering the related controls for screen projection, the display screen of the electronic device can be projected to a display device such as a TV; by triggering the related controls for editing, the user can Figure 2cThe recognized text (or other text obtained by processing the recording, such as the translated text) shown can be manually edited; by triggering the relevant control of sharing, the user can be supported to share at least one of the electronic document, the recording data, and the recording data such as the recognized text, the translated text, and other related texts; by triggering the relevant control of disabling touch, the electronic device can be controlled to ignore the touch operation on its display screen. Of course, the above examples are only several possible examples of the control displayed on the same screen with the electronic document, and the specific types of the control displayed on the same screen with the electronic document are not limited thereto, and the specific types of the control displayed on the same screen with the electronic document will not be given one by one here.

[0020] In one implementation scenario, the start time of the recording can be selected at the beginning of the recording, and the start time is recorded for the first page, and the first page is the document page currently displayed by the electronic device, that is, the document page displayed by the electronic device when the recording is turned on. On this basis, in response to the second page turning operation when the first page is displayed, the current recording time when the electronic device fully displays the second page can be obtained, and the end time is recorded for the first page, and the second page is the document page targeted by the second page turning operation, and the recording time recorded for the first page includes: at least one set of start time and end time recorded for the first page. In the above method, when the page turning operation is triggered during the recording process, the current recording time of the document page after the page turning is fully displayed is obtained as the end time recorded for the document page before the page turning, which can ensure the content integrity of the recording segment associated with the document page before the page turning as much as possible.

[0021] In a specific implementation scenario, please refer to Figure 2a to Figure 2d When the first control representing recording is triggered, the electronic device can start the recording function. At this time, the first page currently displayed by the electronic device can be obtained, and the starting time of the recording time (such as 00:00) can be recorded for the first page. The starting time is the start time of the recording.

[0022] In a specific implementation scenario, the second page turning operation may be an up page turning operation, or may be a down page turning operation, and the second page turning operation is not limited here. As a possible example, taking the second page turning operation as a down page turning operation as an example, when the down page turning operation is completed, that is, the electronic document is completely turned to the document page targeted by the down page turning operation (e.g., the next document page of the first page, etc.), the current recording time can be obtained, and the end time (e.g., 00:30) in the recording time can be recorded for the first page, and then a set of recording times (starting time 00:00~end time 00:30) can be recorded for the first page.

[0023] In a specific implementation scenario, for the second page, the start time of the recording time can be recorded for the second page based on the current recording time when the second page is fully displayed plus a preset offset time (e.g., 1 second). Still taking the above example as an example, the preset offset time of 1 second can be added to the current recording time 00:30, and recorded as the start time 00:31 in the recording time of the second page. Of course, the above example is only a possible example of the preset offset time, and the specific value of the preset offset time is not limited here. In the above method, in response to the second page turning operation when the first page is displayed, the start time is recorded for the second page based on the current recording time plus the preset offset time, so as to avoid conflicts in the recorded recording time as much as possible.

[0024] In a specific implementation scenario, during the process of displaying the second page, as a possible example, in response to a new second page turning operation when the second page is displayed, the current recording time when the electronic device fully displays the third page can be obtained, and the end time is recorded for the second page, and the third page is the document page targeted by the new second page turning operation, and the recording time recorded for the second page includes: at least one set of start time and end time recorded for the second page. Still taking the above example as an example, when the new second page turning operation is still a down page turning operation, the document page that is fully displayed when the down page turning operation is completed can be used as the third page, and the current recording time (such as 00:32) can be obtained at this time, and recorded as the end time 00:32 in the recording time of the second page, so that a set of recording times recorded for the second page can be obtained (start time 00:31 ~ end time 00:32). It should be noted that, similar to the start time in the recording time of the second page, the start time in the recording time of the third page can be obtained by adding the aforementioned current recording time (e.g., 00:32) to the preset offset time (e.g., 1 second). For example, the start time in the recording time of the third page can be 00:33, and so on and so forth, so that the recording time can be continuously recorded for each document page during the page turning process. Of course, in the actual application process, there may also be a situation of turning back the page (i.e., the second page turning operation is an up-page turning operation). In this case, the aforementioned example can be referred to to record a set of recording times for the document page again. In the above manner, in response to a new second page turning operation when the second page is displayed, the current recording time when the electronic device fully displays the third page is obtained, and the end time is recorded for the second page, and the third page is the document page targeted by the new second page turning operation, and the recording time recorded for the second page includes: at least one set of start time and end time recorded for the second page, which can avoid conflicts in the recorded recording time as much as possible.

[0025] In a specific implementation scenario, during the display of the second page, as another possible example, in response to the end recording operation when the second page is displayed, the end time of the recording can be selected, the end time can be recorded for the second page, and the recording time recorded for the second page includes: at least one set of start time and end time recorded for the second page. Still taking the above example as an example, during the display of the second page, if a new second page turning operation is not triggered, but the end recording operation is triggered, the end time of the recording can be selected (such as 00:32), and the end time in the recording time can be recorded for the second page, so that a set of recording times recorded for the second page can be obtained (start time 00:31 ~ end time 00:32). In the above method, in response to the end recording operation when the second page is displayed, the end time of the recording is selected, the end time is recorded for the second page, and the recording time recorded for the second page includes: at least one set of start time and end time recorded for the second page, which can ensure the content integrity of the recording segment associated with the document page as much as possible.

[0026] In an implementation scenario, as described above, please refer to Figure 2c , when the electronic device is recording, the processing text of the current recording is displayed on the same screen as the document page displayed by the electronic device, and the processing text is at least one of the recognition text and the translation text. That is to say, during the recording process, the recognition text of the current recording can also be displayed on the same screen as the document page displayed by the electronic device; or, during the recording process, the translation text of the current recording can also be displayed on the same screen as the document page displayed by the electronic device; or, during the recording process, the recognition text and translation text of the current recording can also be displayed on the same screen as the document page displayed by the electronic device. It should be noted that in order to ensure the real-time display of the processing text, the network connection can be detected whether it is normal when the recording is turned on. If the connection is normal, the server can be called to start real-time recording processing (such as transcription, translation, etc.), and the processing text (such as recognition text, translation text) is returned to the electronic device. In the above method, when the electronic device is recording, the processing text of the current recording is displayed on the same screen as the document page displayed by the electronic device, and the processing text is at least one of the recognition text and the translation text, which can improve the user's perception of the voice in the use scenario during the recording process.

[0027] In one implementation scenario, as described above, each group of recording time may include a start time and an end time. After the recording is finished, each recording time may be selected from the earliest to the last recording time as the current time, and then the recording duration is obtained based on the start time and the end time in the current time, and based on the recording duration, it is determined whether to merge the current time into the previous recording time of the current time. The above method detects the recording duration represented by each recording time in chronological order, and determines whether to merge the recording time into the previous recording time based on the length of the recording duration, so as to avoid as much as possible the adverse effect on the output effect of the subsequent synchronous positioning due to the recording duration represented by the recording time being too short.

[0028] In a specific implementation scenario, for any recording time, the recording duration represented by the recording time can be obtained by subtracting the start time from the end time contained therein. On this basis, when the recording duration represented by the recording time is less than the duration threshold (such as 2 seconds, 3 seconds, etc.), the recording time can be merged into its previous recording time; conversely, when the recording duration represented by the recording time is not less than the duration threshold, the recording time can be retained.

[0029] In a specific implementation scenario, when it is determined that the current time is to be incorporated into the previous recording time of the current time, the end time in the previous recording time of the current time can be updated to the end time in the current time. Still taking the above example, the recording time of the first page includes the start time 00:00 and the end time 00:30, that is, the recording duration it represents is 31 seconds, and the recording time of the next page, the second page, includes the start time 00:31 and the end time 00:32, that is, the recording duration it represents is 2 seconds. Then, when the duration threshold is set to 3 seconds, since the recording duration represented by the latter recording time is less than the duration threshold, it can be incorporated into the previous recording time. At this time, the recording time of the first page is updated to include the start time 00:00 and the end time 00:32. Of course, the above example is only one possible example based on the above example, and other possible situations will not be given examples one by one here. For example, please refer to Figure 2e , Figure 2e Schematic diagram of an embodiment of recording time. Figure 2eAs shown, the electronic document may include four document pages, respectively named as: document page 1, document page 2, document page 3, document page 4, and after recording, the recording time of document page 1 includes the start time 00:00 and the end time 00:30, the recording time of document page 2 includes the start time 00:31 and the end time 00:32, the recording time of document page 3 may include the start time 00:33 and the end time 00:35, and the recording time of document page 4 may include the start time 00:36 and the end time 00:40. Then, when the duration threshold is set to 3 seconds, the recording time of document page 2 may be incorporated into the recording time of document page 1, that is, the recording time of document page 1 may be updated to include the start time 00:00 and the end time 00:32, and the recording time of document page 3 and document page 4 may be retained. That is to say, at this time, the final recording time of each document page can be updated as: document page 1 (00:00~00:32), document page 2 (none), document page 3 (00:33~00:35), document page 4 (00:36~00:40).

[0030] Step S12: In response to the first page turning operation after the recording ends, when the target page is displayed on the electronic device, jump to the target time of the recording data recorded by the electronic device, and display the target text of the target recording segment on the same screen as the target page.

[0031] In the disclosed embodiment, the target page is the document page targeted by the first page turning operation, the target time is represented by the recording time recorded on the target page, the target recording segment is the audio segment of the target time in the recording data, and the target text is at least one of the recognized text and the translated text. It should be noted that the document page targeted by the first page turning operation can be any document page in the electronic document, such as the first document page in the electronic document, the last document page in the electronic document, or any document page between the first document page and the last document page in the electronic document, without limitation herein. Figure 2e Taking the electronic document shown as an example, when the document page targeted by the first page turning operation is document page 3, the target time is the recording time recorded on document page 3 (i.e., including the start time 00:33 and the end time 00:35), the target recording segment is the audio segment from the start time 00:33 to the end time 00:35 in the recording data, and the target text can be the recognition text obtained by transcribing the audio segment from 00:33 to 00:35 in the recording data, or the translation text obtained by translating the audio segment from 00:33 to 00:35 in the recording data, or the recognition text obtained by transcribing and translating the audio segment from 00:33 to 00:35 in the recording data. Of course, the above examples are only based on Figure 2eThe electronic document shown is a possible example of a target page, a target time, a target recording segment and a target text, and other possible situations are not given one by one here. In addition, when jumping to the target time of the recording data recorded by the electronic device, in response to the play instruction of the target recording segment, the target recording segment can be played from the start time in the target time until the end time in the target time is played. Of course, during this process, the playback of the target recording segment can also be paused at any time.

[0032] In one implementation scenario, as a possible example, the target text of the recording data can be displayed on the same screen as the target page, and the target text of the target recording segment can be fully highlighted in the target text of the recording data. Figure 2f , Figure 2f FIG. 1 is a schematic diagram of another embodiment of a display interface of an electronic device. Figure 2f As shown in FIG. 1 , taking the target text as the recognition text as an example, the target text of the recording data may include “In the morning, we have several links today. First, let’s think about it. When a person faces a problem, if he cannot think clearly or wants to explain it clearly, it is not easy. So, we”, the target recording segment is the audio segment from the start time 06:05 to the end time 06:57 in the recording data, and the target text of the target recording segment is “First, let’s think about it. When a person faces a problem, if he cannot think clearly or wants to explain it clearly, it is not easy.”, such as Figure 2f As shown, in the target text of the recording data, the target text of the target recording segment in the target text of the recording data can be highlighted in a highlighting style such as background highlighting. In other words, the target text of the target recording segment can be statically highlighted as a whole during the playback of the target recording segment.

[0033] In another implementation scenario, as another possible example, the target text of the recording data can be displayed on the same screen as the target page, and the target text of the current recording segment can be partially highlighted in the target text of the recording data, and the current recording segment is the recording sub-segment currently played in the target recording segment. Figure 2g , Figure 2g FIG. 1 is a schematic diagram of another embodiment of a display interface of an electronic device. Figure 2g As shown, taking the target text as the recognition text as an example, the target text of the recording data may include "In the morning, we have several links today. First, let's think about it. When a person faces a problem, if he can't think clearly and wants to explain it clearly, it is not easy. So, we", the target recording segment is the audio segment from the start time 06:05 to the end time 06:57 in the recording data, and the target text of the target recording segment is "First, let's think about it. When a person faces a problem, if he can't think clearly and wants to explain it clearly, it is not easy." The currently playing recording sub-segment is Figure 2gThe target text of the recording sub-segment starting at 06:21 in the upper right corner is "If he can't think clearly", Figure 2g As shown, the target text of the current recording segment can be partially highlighted in the target text of the recording data in a highlighting style such as background highlighting. That is, during the process of playing the target recording segment, the target text corresponding to the currently played recording sub-segment can be dynamically and partially highlighted as the playing progresses.

[0034] In another implementation scenario, as another possible example, the target text of the recording data can also be displayed on the same screen as the target page, and the target text of the target recording segment can be fully highlighted in the target text of the recording data in the first style, and the target text of the current recording segment can be partially highlighted in the target text of the recording data in the second style, and the current recording segment is the recording sub-segment currently played in the target recording segment, and the second style is more prominent than the first style. For ease of description, please refer to Figure 2h , Figure 2h FIG. 1 is a schematic diagram of another embodiment of a display interface of an electronic device. Figure 2h As shown, taking the target text as the recognition text as an example, the target text of the recording data may include "In the morning, we have several links today. First, let's think about it. When a person faces a problem, if he can't think clearly and wants to explain it clearly, it is not easy. So, we", the target recording segment is the audio segment from the start time 06:05 to the end time 06:57 in the recording data, and the target text of the target recording segment is "First, let's think about it. When a person faces a problem, if he can't think clearly and wants to explain it clearly, it is not easy." The currently playing recording sub-segment is Figure 2h The target text of the recording sub-segment starting at 06:21 in the upper right corner is "If he can't think clearly", Figure 2g As shown, the target text of the target recording segment is fully highlighted in the target text of the recording data in the first style (such as background highlighting with the first color depth), and the target text of the current recording segment is partially highlighted in the target text of the recording data in the second style (such as background highlighting with the second color depth), and the second color depth is deeper than the first color depth. In other words, during the process of playing the target recording segment, on the one hand, the target text of the target recording segment can be statically highlighted as a whole, and on the other hand, the target text corresponding to the currently played recording sub-segment can be dynamically highlighted locally as the playback progresses.

[0035] The above scheme records the recording time for the document page displayed by the electronic device when the electronic device is recording, responds to the first page turning operation after the recording ends, jumps to the target time of the recording data recorded by the electronic device when the target page is displayed on the electronic device, and displays the target text of the target recording segment synchronously with the target page, and the target page is the document page targeted by the first page turning operation, the target time is characterized by the recording time recorded on the target page, the target recording segment is the audio segment of the target time in the recording data, and the target text is at least one of the recognized text and the translated text, so by associating the document page displayed by the electronic device with the recording time during the recording process, so as to trigger the first page turning operation after the recording ends, according to the recorded information during the recording process, on the one hand, synchronously jumps to locate the target time associated with the target page targeted by the first page turning operation in the recording data, and on the other hand, synchronously displays the target text of the audio segment of the target time in the recording data after at least one of the recognition and translation, and then after the recording ends, the recording and the related text can be automatically and synchronously located following the first page turning operation, without the need to manually switch between different files. Therefore, it is possible to conveniently and quickly achieve synchronous positioning between the document and the recording when reviewing.

[0036] See also Figure 3 , Figure 3 It is a schematic diagram of the framework of an embodiment of the document recording synchronization device of the present application. The document recording synchronization device 30 includes: a time recording module 31 and a synchronization output module 32. The time recording module 31 is used to record the recording time for the document page displayed by the electronic device when the electronic device is recording; the synchronization output module 32 is used to respond to the first page turning operation after the recording ends, when the target page is displayed on the electronic device, jump to the target time of the recording data recorded by the electronic device, and display the target text of the target recording segment on the same screen with the target page; wherein the target page is the document page targeted by the first page turning operation, the target time is represented by the recording time recorded on the target page, the target recording segment is the audio segment of the target time in the recording data, and the target text is at least one of the recognition text and the translation text.

[0037] In the above scheme, the document recording synchronization device 30 records the recording time for the document page displayed by the electronic device when the electronic device is recording, and in response to the first page turning operation after the recording ends, when the target page is displayed on the electronic device, it jumps to the target time of the recording data recorded by the electronic device, and displays the target text of the target recording segment synchronously with the target page, and the target page is the document page targeted by the first page turning operation, the target time is characterized by the recording time recorded by the target page, the target recording segment is the audio segment of the target time in the recording data, and the target text is at least one of the recognized text and the translated text, so by associating the document page displayed by the electronic device with the recording time during the recording process, so as to trigger the first page turning operation after the recording ends, according to the recorded information during the recording process, on the one hand, the target time associated with the target page targeted by the first page turning operation in the recording data is synchronously jumped, and on the other hand, the target text of the audio segment of the target time in the recording data after identification and translation is synchronously displayed, and then after the recording ends, the recording and the related text can be automatically and synchronously located following the first page turning operation, without the need to manually switch between different files. Therefore, it is possible to conveniently and quickly achieve synchronous positioning between the document and the recording when reviewing.

[0038] In some disclosed embodiments, the time recording module 31 includes a first recording submodule, which is used to select the start time of the recording when the recording starts, and record the start time for the first page; wherein the first page is the document page currently displayed by the electronic device; the time recording module 31 includes a second recording submodule, which is used to respond to the second page turning operation when the first page is displayed, obtain the current recording time when the electronic device fully displays the second page, and record the end time for the first page; wherein the second page is the document page targeted by the second page turning operation, and the recording time recorded for the first page includes: at least one set of start time and end time recorded for the first page.

[0039] In some disclosed embodiments, the time recording module 31 includes a third recording submodule for recording a start time for a second page based on a current recording time plus a preset offset duration in response to a second page turning operation when the first page is displayed.

[0040] In some disclosed embodiments, the time recording module 31 includes a fourth recording sub-module, which is used to respond to a new second page turning operation when the second page is displayed, obtain the current recording time when the electronic device fully displays the third page, and record the end time for the second page; wherein the third page is the document page targeted by the new second page turning operation, and the recording time recorded for the second page includes: at least one set of start time and end time recorded for the second page.

[0041] In some disclosed embodiments, the time recording module 31 includes a fifth recording submodule, which is used to select the end time of the recording in response to the end recording operation when the second page is displayed, and record the end time for the second page; wherein the recording time recorded for the second page includes: at least one set of start time and end time recorded for the second page.

[0042] In some disclosed embodiments, the recording time includes a start time and an end time, and the document recording synchronization device 30 also includes a time selection module for selecting each recording time from the earliest to the latest according to the recording time, and respectively using them as the current time; the document recording synchronization device 30 also includes a duration calculation module for obtaining the recording duration based on the start time and the end time in the current time; the document recording synchronization device 30 also includes a time merging module for determining whether to merge the current time into the previous recording time of the current time based on the recording duration.

[0043] In some disclosed embodiments, when it is determined that the current time is to be incorporated into the last recording time of the current time, the end time of the last recording time of the current time is updated to the end time of the current time.

[0044] In some disclosed embodiments, the document recording synchronization device 30 also includes a simultaneous display module for displaying a processed text of the current recording on the same screen as the document page displayed by the electronic device when the electronic device is recording; wherein the processed text is at least one of a recognized text and a translated text.

[0045] In some disclosed embodiments, the synchronous output module 32 is specifically used to display the target text of the recording data on the same screen as the target page, and to highlight the target text of the target recording segment in the target text of the recording data.

[0046] In some disclosed embodiments, the synchronous output module 32 is specifically used to display the target text of the recording data on the same screen as the target page, and to partially highlight the target text of the current recording segment in the target text of the recording data; the current recording segment is the recording sub-segment currently being played in the target recording segment.

[0047] In some disclosed embodiments, the synchronous output module 32 is specifically used to display the target text of the recorded data on the same screen as the target page, and to fully highlight the target text of the target recorded segment in the target text of the recorded data with a first style, and to partially highlight the target text of the current recorded segment in the target text of the recorded data with a second style; wherein the current recorded segment is the recorded sub-segment currently being played in the target recorded segment, and the second style is more prominent than the first style.

[0048] See also Figure 4 , Figure 4It is a schematic diagram of the framework of an embodiment of an electronic device of the present application. The electronic device 40 includes at least a memory 41, a display screen 42, a microphone 43 and a processor 44. The memory 41, the display screen 42 and the microphone 43 are respectively coupled to the processor 44. The memory 41 at least stores program instructions. The processor 44 is used to execute the program instructions to implement the steps in any of the above-mentioned document recording synchronization method embodiments. For details, please refer to the aforementioned disclosed embodiments, which will not be repeated here. As a possible example, the electronic device 40 may include but is not limited to an office notebook, an e-book reader, a smart phone, a tablet computer, etc., and the specific type of the electronic device 40 is not limited here.

[0049] Specifically, the processor 44 is used to control itself and the memory 41 to implement the steps in any of the above-mentioned document recording synchronization method embodiments. The processor 44 can also be called a CPU (Central Processing Unit). The processor 44 may be an integrated circuit chip with signal processing capabilities. The processor 44 can also be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field-programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. In addition, the processor 44 can be implemented by an integrated circuit chip.

[0050] In the above scheme, the electronic device 40 records the recording time for the document page displayed by the electronic device when the electronic device is recording, and in response to the first page turning operation after the recording ends, when the target page is displayed on the electronic device, it jumps to the target time of the recording data recorded by the electronic device, and displays the target text of the target recording segment synchronously with the target page, and the target page is the document page targeted by the first page turning operation, the target time is characterized by the recording time recorded by the target page, the target recording segment is the audio segment of the target time in the recording data, and the target text is at least one of the recognized text and the translated text, so by associating the document page displayed by the electronic device with the recording time during the recording process, so as to trigger the first page turning operation after the recording ends, according to the recorded information during the recording process, on the one hand, the target time associated with the target page targeted by the first page turning operation in the recording data is synchronously jumped and located, and on the other hand, the target text of the audio segment of the target time in the recording data after being identified and translated is synchronously displayed, and then after the recording ends, the recording and the related text can be automatically and synchronously located following the first page turning operation, without the need to manually switch between different files. Therefore, it is possible to conveniently and quickly achieve synchronous positioning between the document and the recording when reviewing.

[0051] See also Figure 5 , Figure 5 The schematic diagram is a schematic diagram of a computer-readable storage medium 50 of the present application. The computer-readable storage medium 50 stores program instructions 51 that can be executed by a processor, and the program instructions 51 are used to implement the steps in any of the above document recording synchronization method embodiments.

[0052] In the above scheme, the computer-readable storage medium 50 records the recording time for the document page displayed by the electronic device when the electronic device is recording, and in response to the first page turning operation after the recording ends, when the target page is displayed on the electronic device, it jumps to the target time of the recording data recorded by the electronic device, and displays the target text of the target recording segment synchronously with the target page, and the target page is the document page targeted by the first page turning operation, the target time is characterized by the recording time recorded by the target page, the target recording segment is the audio segment of the target time in the recording data, and the target text is at least one of the recognized text and the translated text, so by associating the document page displayed by the electronic device with the recording time during the recording process, so as to trigger the first page turning operation after the recording ends, according to the recorded information during the recording process, on the one hand, the target time associated with the target page targeted by the first page turning operation in the recording data is synchronously jumped and located, and on the other hand, the target text of the audio segment of the target time in the recording data after being identified and translated is synchronously displayed, and then after the recording ends, the recording and the related text can be automatically and synchronously located following the first page turning operation, without the need to manually switch between different files. Therefore, it is possible to conveniently and quickly achieve synchronous positioning between the document and the recording when reviewing.

[0053] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0054] The above description of various embodiments tends to emphasize the differences between the various embodiments. The same or similar aspects can be referenced to each other, and for the sake of brevity, they will not be repeated herein.

[0055] In the several embodiments provided in the present application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device implementation described above is only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0056] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0057] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0058] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of each implementation method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code.

[0059] If the technical solution of this application involves personal information, the product using the technical solution of this application has clearly informed the personal information processing rules and obtained the individual's voluntary consent before processing the personal information. If the technical solution of this application involves sensitive personal information, the product using the technical solution of this application has obtained the individual's separate consent before processing the sensitive personal information, and at the same time meets the "explicit consent" requirement. For example, on personal information collection devices such as cameras, clear and prominent signs are set to inform that the personal information collection scope has been entered and personal information will be collected. If the individual voluntarily enters the collection scope, it is deemed that he or she agrees to the collection of his or her personal information; or on the device that processes personal information, the personal information processing rules are notified by obvious signs / information, and the individual's authorization is obtained through pop-up information or by asking the individual to upload his or her personal information; among them, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the type of personal information processed.

Claims

1. A document recording synchronization method, characterized in that: include: When an electronic device records a recording, recording a recording time for a document page displayed by the electronic device; In response to the first page turning operation after the recording ends, when the target page is displayed on the electronic device, it jumps to the target time of the recording data recorded by the electronic device, and displays the target text of the target recording segment on the same screen as the target page; wherein the target page is the document page targeted by the first page turning operation, the target time is represented by the recording time recorded on the target page, the target recording segment is the audio clip of the target time in the recording data, and the target text is at least one of a recognized text and a translated text.

2. The method according to claim 1, characterized in that The step of recording the recording time for the document page displayed by the electronic device when recording by the electronic device includes: When recording starts, selecting a start time for recording, and recording the start time for the first page; wherein the first page is a document page currently displayed by the electronic device; In response to a second page turning operation when the first page is displayed, the current recording time when the electronic device fully displays the second page is obtained, and the end time is recorded for the first page; wherein, the second page is the document page targeted by the second page turning operation, and the recording time recorded for the first page includes: at least one set of the start time and the end time recorded for the first page.

3. The method according to claim 2, characterized in that The method further comprises: In response to a second page turning operation when the first page is displayed, a start time is recorded for the second page based on the current recording time plus a preset offset duration.

4. The method according to claim 2, characterized in that: The method further comprises: In response to a new second page turning operation when the second page is displayed, the current recording time when the electronic device fully displays the third page is obtained, and the end time is recorded for the second page; wherein the third page is the document page targeted by the new second page turning operation, and the recording time recorded for the second page includes: at least one set of the start time and the end time recorded for the second page.

5. The method according to claim 2, characterized in that: The method further comprises: In response to the end recording operation when the second page is displayed, the end time of the recording is selected and the end time is recorded for the second page; wherein the recording time recorded for the second page includes: at least one set of the start time and the end time recorded for the second page.

6. The method according to claim 1, characterized in that The recording time includes a start time and an end time, and the method further includes: Select each recording time from earliest to latest according to the recording time, and use them as the current time respectively; Based on the start time and the end time in the current time, obtain the recording duration; Based on the recording duration, determine whether to merge the current time into the previous recording time of the current time.

7. The method according to claim 6, characterized in that In the case where it is determined to merge the current time into the last recording time of the current time, the end time in the last recording time of the current time is updated to the end time in the current time.

8. The method according to claim 1, characterized in that: When the electronic device is recording, the method further includes: The processed text of the current recording is displayed on the same screen as the document page displayed by the electronic device; wherein the processed text is at least one of a recognized text and a translated text.

9. The method according to claim 1, characterized in that: The target text of the target recording segment is displayed on the same screen as the target page, including: The target text of the recording data is displayed on the same screen as the target page, and the target text of the target recording segment is fully highlighted in the target text of the recording data.

10. The method according to claim 1, characterized in that The target text of the target recording segment is displayed on the same screen as the target page, including: The target text of the recording data is displayed on the same screen as the target page, and the target text of the current recording segment is partially highlighted in the target text of the recording data; the current recording segment is the recording sub-segment currently being played in the target recording segment.

11. The method according to claim 1, characterized in that The target text of the target recording segment is displayed on the same screen as the target page, including: The target text of the recording data is displayed on the same screen as the target page, and the target text of the target recording segment is fully highlighted in the target text of the recording data in a first style, and the target text of the current recording segment is partially highlighted in the target text of the recording data in a second style; wherein the current recording segment is the recording sub-segment currently being played in the target recording segment, and the second style is more prominent than the first style.

12. A document recording synchronization device, characterized in that: include: A time recording module, used for recording the recording time for the document page displayed by the electronic device when the electronic device is recording; A synchronous output module is used to respond to the first page turning operation after the recording ends, jump to the target time of the recording data recorded by the electronic device when the target page is displayed on the electronic device, and display the target text of the target recording segment on the same screen with the target page; wherein the target page is the document page targeted by the first page turning operation, the target time is represented by the recording time recorded on the target page, the target recording segment is the audio clip of the target time in the recording data, and the target text is at least one of a recognized text and a translated text.

13. An electronic device, characterized in that: The device at least comprises a memory, a display screen, a microphone and a processor, wherein the memory, the display screen and the microphone are respectively coupled to the processor, the memory at least stores program instructions, and the processor is used to execute the program instructions to implement the document recording synchronization method according to any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that: Program instructions that can be executed by a processor are stored, and the program instructions are used to implement the document recording synchronization method described in any one of claims 1 to 11.

Images