Abstract Generation Method, Apparatus, Electronic Device, and Storage Medium

Abstract

The present application discloses a method, apparatus, electronic device, and storage medium for generating an abstract. Among them, the method for generating an abstract includes: receiving a first input from a user; based on the first input, obtaining the operation behavior of the user on the playback object and / or the playback content of the playback object; generating an abstract based on the operation behavior and / or the playback content, where the abstract includes partial playback content of the playback object. In the embodiments of the present application, an abstract can be generated in real time while the playback content is being played for viewers to view and summarize, enabling viewers to quickly understand the key points, themes, etc. of the learning content, thereby improving the viewing efficiency and viewing experience.

Description

Technical Field

[0001] This application relates to the technical field of data processing, and in particular, to a method, apparatus, electronic device, and storage medium for generating abstracts. Background Art

[0002] In related technologies, in scenarios such as meetings, lectures, auditoriums, presentations, exhibitions, etc., the content of the meeting is usually displayed to the participants through a large screen. Although the attention of the participants can be attracted by marking some key content or the main content. However, this requires manual marking, which is time-consuming and laborious. In addition, if there are too many markings, it will have the opposite effect, resulting in a cluttered meeting content and affecting the viewing experience. Summary of the Invention

[0003] In view of the above-mentioned defects or deficiencies in the prior art, it is desired to provide a method, apparatus, electronic device, and storage medium for generating abstracts, which can generate abstracts in real time while playing the content for viewers to view and summarize, so that viewers can quickly understand the key points, themes, etc. of the learning content, thereby improving the viewing efficiency and viewing experience.

[0004] In a first aspect, an embodiment of the present application provides a method for generating an abstract, including:

[0005] Receiving a first input from a user;

[0006] Based on the first input, obtaining the operation behavior of the user on the playback object and / or the playback content of the playback object;

[0007] Generating an abstract based on the operation behavior and / or the playback content, where the abstract includes part of the playback content of the playback object.

[0008] In a second aspect, an embodiment of the present application provides an apparatus for generating an abstract, including:

[0009] A receiving module, configured to receive a first input from a user;

[0010] An obtaining module, configured to obtain the operation behavior of the user on the playback object and / or the playback content of the playback object based on the first input;

[0011] An abstract generating module, configured to generate an abstract based on the operation behavior and / or the playback content, where the abstract includes part of the playback content of the playback object.

[0012] In a third aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the method for generating an abstract as described in the first aspect above is implemented.

[0013] Fourthly, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and the computer program is used to implement the abstract generation method described in the first aspect above.

[0014] Fifthly, an embodiment of the present application provides a computer program product, on which a computer program is stored, and the computer program is used to implement the abstract generation method described in the first aspect above.

[0015] For the abstract generation method, device, electronic device and storage medium provided by the embodiments of the present application, when an abstract of a playback object needs to be obtained, by acquiring the operation behavior of the user on the playback object and obtaining the playback content of the playback object, etc., the abstract of the playback object can be automatically generated according to the operation behavior, playback content, etc. In this way, an abstract can be generated in real time while playing the content for viewers to view and summarize, so that viewers can quickly understand the key points, themes, etc. of the learning content, thereby improving the viewing efficiency and viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Other features, objects, and advantages of the present application will become more apparent by reading the detailed description of the non-limiting embodiments with reference to the following drawings:

[0017] Figure 1 It is a flowchart of the abstract generation method for the embodiment of the present application;

[0018] Figure 2 It is a schematic diagram of abstract display for the abstract generation method of the embodiment of the present application;

[0019] Figure 3 It is a schematic diagram of marking in a playback object in the abstract generation method of the embodiment of the present application;

[0020] Figure 4 It is a schematic diagram of the structure of the abstract generation device for the embodiment of the present application;

[0021] Figure 5 It is a schematic diagram of the structure of the electronic device for the embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0022] The present application will be further described in detail below with reference to the drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the related disclosure, rather than limiting the disclosure. Additionally, it should be noted that for the convenience of description, only parts related to the disclosure are shown in the drawings.

[0023] It should be noted that, without conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the drawings and embodiments.

[0024] Figure 1 is a flowchart of a method for generating an abstract according to an embodiment of the present application. As Figure 1 shown, according to a method for generating an abstract according to an embodiment of the present application, the following steps are included:

[0025] S101: Receive a first input from the user.

[0026] Among them, the first input is, for example, an abstract generation operation. Assuming that an abstract of the playback object displayed on the display screen needs to be obtained, at this time, the pre-set abstract generation function can be triggered in the playback object. For example, when the playback object is playing, the abstract generation function can be opened through a pre-set physical key, or the abstract generation function icon pre-set in the toolbar of the playback object can be used to open the abstract generation function.

[0027] Of course, in addition to opening the abstract generation function, the first input can also include operations such as selecting the abstract generation type. For example: selecting the type of automatically generating an abstract, the type of generating an abstract based on the user's operation behavior. Among them, automatically generating an abstract means: as long as the abstract generation function is opened, the abstract of the playback object can be automatically generated; generating an abstract based on the user's operation behavior means: generating the abstract of the playback object according to the content selected by the user.

[0028] The playback object includes, but is not limited to: word documents, picture files, video files, pdf documents, or audio files, etc.

[0029] The display screen usually refers to a display screen with a relatively large size. For example: a large-size display screen for meetings, a large-size display screen for exhibitions, a large-size display screen for teaching, and a large-size display screen for auditoriums, etc.

[0030] S102: Based on the first input, obtain the user's operation behavior on the playback object and / or the playback content of the playback object.

[0031] Assume that the user selects to automatically generate an abstract, then obtain all the playback content of the playback object. For example: all the playback content displayed in the current playback interface of the playback object; assume that the user selects to generate an abstract based on the user's operation behavior, then obtain the user's operation behavior on the playback object. For example: touch operation or marking operation, etc. Among them, marking means: making annotations, box selections, underlining, etc. in the current playback interface. Of course, the user can also select to automatically generate an abstract and generate an abstract based on the user's operation behavior at the same time, that is: obtain the user's operation behavior on the playback object and obtain the playback content of the playback object.

[0032] In the above example, obtaining the user's operation behavior on the playback object includes: obtaining the touch area and / or marking area of the user on the playback object. As Figure 3As shown, the marked area is determined by a quadrilateral frame, a wavy underline, an oval frame, etc.

[0033] In this example, obtaining the touch area and / or marked area of the user on the playback object includes: obtaining the touch image and / or marked image of the user on the playback object, and performing image recognition on the touch image and / or marked image to obtain the touch area and / or marked area of the user on the playback object; or, obtaining the touch area based on touch sensing on the playback object and / or obtaining the marked area based on the marked event triggered on the playback object

[0034] Specifically, the display screen can be photographed in real time. In this way, whether the user touches the display screen or marks on the playback object, the corresponding touch image or the marked image with marks in the playback object can be photographed. Then, using image recognition technology, the touch area or the marked area can be determined.

[0035] Of course, if the display screen is a touch screen, the position touched by the user can also be determined through touch detection technology, so as to determine the touch area on the playback object. For the marking function, an event, that is, a marked event, is triggered each time a mark is made. Furthermore, the marked area on the playback object can also be determined through this marked event.

[0036] S103: Generate a summary based on the operation behavior and / or the playback content, where the summary includes part of the playback content of the playback object.

[0037] In an embodiment of the present application, generating a summary based on the operation behavior and / or the playback content includes: extracting the first content in the playback object corresponding to the touch area and / or the marked area, and using the first content as the summary; and / or, obtaining the words that appear more than a predetermined number of times in the playback content, and using the words as the summary.

[0038] Taking a word document as an example, if an automatic summary is generated, all the content on the currently displayed page of the word document, that is, all the playback content, is obtained. Then, the words that appear more than a predetermined number of times in the playback content are obtained, and the words are used as the summary. For example: The key words and sentences that appear more than a predetermined number of times in each paragraph of the playback content are automatically extracted as the summary. Assuming that the phrase "optimization method of the server" appears repeatedly many times in the article, then this "optimization method of the server" can be used as the summary of the article, that is: it shows that the article mainly specifically introduces the "optimization method of the server".

[0039] In this example, if a summary is generated based on the user's operation behavior, assuming that the touch area and / or the marked area is the position of "the optimized way of the server", then this "optimized way of the server" can be extracted as the summary.

[0040] It can be understood that in the above example, whether the summary is generated automatically or based on the user's operation behavior, it is described by taking "the optimized way of the server" as an example. However, in other examples, the automatically generated summary and the summary generated based on the user's operation behavior can be different summaries, that is, there can be multiple summaries for a playback object. Additionally, there can be multiple automatically generated summaries, and there can also be multiple summaries generated based on the user's operation behavior.

[0041] In an embodiment of the present application, when there are multiple summaries, the multiple summaries can be typeset in a manner such as the order of the summaries in the playback object.

[0042] Furthermore, if the summary is not text but a graphic or the like, then a screenshot of the graphic can be taken to obtain the graphic summary. And the graphic summary and the text summary can be typeset separately.

[0043] According to the summary generation method of the embodiments of the present application, when it is necessary to obtain the summary of a playback object, by acquiring the user's operation behavior on the playback object, obtaining the playback content of the playback object, etc., the summary of the playback object can be automatically generated according to the operation behavior, playback content, etc. In this way, the summary can be generated in real time while playing the content for the viewers to view and summarize, enabling the viewers to quickly understand the key points, themes, etc. of the learning content, thereby improving the viewing efficiency and viewing experience.

[0044] The summary generation method of the embodiments of the present application can be applied in meeting, exhibition, auditorium, and teaching scenarios. In this way, during the playback process, the summary of the document can be automatically generated. By viewing the summary, the participants can improve their understanding efficiency of the document, enabling the participants to quickly understand the spirit of the meeting and enhancing the user experience.

[0045] After generating the summary based on the operation behavior and / or the playback content, it further includes: correspondingly displaying the summary of the playback object in a preset summary display area. As Figure 2 shown, the summary of the playback content of the playback object can be displayed in the summary real-time generation interface on the left side of the display screen, and the playback content of the playback object can be displayed on the right side of the display screen. Thus, the personnel can view the corresponding summary while viewing the playback object, improving the personnel's understanding efficiency of the document and enabling the personnel to quickly understand and learn the document.

[0046] In the above description, the abstract generation can also be implemented on a mobile terminal, that is, the mobile terminal is displayed on the same screen as the display screen. In this way, the abstract can be generated on the mobile terminal, and the display screen only needs to be displayed on the same screen. Among them, the method of generating the abstract on the mobile terminal is similar to the method of generating the abstract in the above embodiments, and will not be elaborated.

[0047] Among them, the mobile terminal includes but is not limited to smartphones, tablets, etc.

[0048] In an embodiment of the present application, after generating the abstract based on the operation behavior and / or the playback content, it further includes: receiving a second input from the user; based on the second input, saving the abstract to obtain an abstract file, and sharing the abstract file, where the sharing method includes at least one of the following: sharing the abstract file by email; sharing the abstract file by a QR code.

[0049] In this example, the second input is, for example, a sharing operation. In this way, after the abstract is saved as an abstract file, it can be sent to relevant personnel by email, or a QR code is generated, and the personnel scan the QR code to obtain the abstract. Of course, the second input may also include a page-turning operation of the playback object. When turning the page, the previous abstract is automatically saved. Through emails and QR codes, etc., the abstract can be quickly shared with relevant personnel, which is convenient for relevant personnel to view and record.

[0050] On the other hand, as Figure 4 shown, an embodiment of the present application provides an abstract generation device, including: a receiving module 410, an obtaining module 420, and an abstract generation module 430, where:

[0051] The receiving module 410 is configured to receive a first input from the user;

[0052] The obtaining module 420 is configured to obtain the operation behavior of the user on the playback object and / or the playback content of the playback object based on the first input;

[0053] The abstract generation module 430 is configured to generate an abstract based on the operation behavior and / or the playback content, where the abstract includes part of the playback content of the playback object.

[0054] In an embodiment of the present application, the obtaining module 420 is specifically configured to: obtain the touch area and / or the marked area of the user on the playback object.

[0055] In one embodiment of the present application, the acquisition module 420 is specifically configured to: acquire a touch image and / or a marked image of the user on the playback object, perform image recognition on the touch image and / or the marked image, and obtain a touch area and / or a marked area of the user on the playback object; or, obtain the touch area based on touch sensing on the playback object and / or obtain the marked area based on a marking event triggered on the playback object.

[0056] In one embodiment of the present application, the abstract generation module 430 is specifically configured to: extract first content in the playback object corresponding to the touch area and / or the marked area, and use the first content as the abstract; and / or, obtain words that appear more than a predetermined number of times in the playback content, and use the words as the abstract.

[0057] In one embodiment of the present application, after generating an abstract based on the operation behavior and / or the playback content, it further includes: correspondingly displaying the abstract of the playback object in a preset abstract display area.

[0058] In one embodiment of the present application, after generating an abstract based on the operation behavior and / or the playback content, it further includes: receiving a second input from the user; based on the second input, saving the abstract to obtain an abstract file, and sharing the abstract file, where the sharing method includes at least one of the following: sharing the abstract file by email; sharing the abstract file by a QR code.

[0059] According to the abstract generation device of the embodiments of the present application, when an abstract of a playback object needs to be obtained, by acquiring the operation behavior of the user on the playback object, obtaining the playback content of the playback object, etc., the abstract of the playback object can be automatically generated according to the operation behavior, playback content, etc. In this way, an abstract can be generated in real time while the playback content is being played for viewers to view and summarize, enabling viewers to quickly understand the key points, themes, etc. of the learning content, thereby improving the viewing efficiency and viewing experience.

[0060] It should be noted that the specific implementation manner of the abstract generation device of the embodiments of the present application is similar to the specific implementation manner of the abstract generation method of the embodiments of the present application. For details, please refer to the description in the method part and will not be elaborated here.

[0061] Figure 5 It is a schematic structural diagram of an electronic device according to an embodiment of the present application.

[0062] As Figure 5As shown, the electronic device 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes according to the programs stored in the read-only memory (ROM) 602 or the programs loaded from the storage section 602 into the random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic device 600 are also stored. The CPU 601, ROM 602, and RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0063] The following components are connected to the I / O interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including such as a cathode ray tube (CRT), a liquid crystal display (LCD), etc. and a speaker, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN card, a modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I / O interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed so that a computer program read from it can be installed into the storage section 608 as needed.

[0064] In particular, according to an embodiment of the present application, the processes described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a machine-readable medium, and the computer program contains program codes for performing the methods shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication section 609, and / or installed from the removable medium 611. When the computer program is executed by the central processing unit (CPU) 601, the above functions defined in the electronic device of the present application are executed.

[0065] It should be noted that the computer-readable medium shown in this application can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example, but not limited to, an electronic device, apparatus, or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples of a computer-readable storage medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this application, a computer-readable storage medium can be any tangible medium that contains or stores a program, which can be used by or in conjunction with an instruction-executing electronic device, apparatus, or device. And in this application, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction-executing electronic device, apparatus, or device. The program code contained on a computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0066] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of a processing receiving device, method, and computer program product according to various embodiments of this application. In this regard, each block in a flowchart or block diagram can represent a module, a program segment, or a part of code, and the aforementioned module, program segment, or part of code contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in a block can occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, can be implemented by a dedicated hardware-based electronic device that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0067] The units or modules involved in the embodiments described in this application can be implemented in software or in hardware. The described units or modules can also be provided in a processor, and when the processor executes the program, a summary generation method is implemented: receiving a first input from a user; based on the first input, obtaining the operation behavior of the user on the playback object and / or the playback content of the playback object; generating a summary based on the operation behavior and / or the playback content, where the summary includes partial playback content of the playback object.

[0068] As another aspect, the present application also provides a computer-readable storage medium, which can be included in the electronic device described in the above embodiments; or can exist alone without being assembled into the electronic device. The above computer-readable storage medium stores one or more programs, and when the foregoing programs are executed by one or more processors, a summary generation method described in the present application is implemented: based on the first input, obtaining the operation behavior of the user on the playback object and / or the playback content of the playback object; generating a summary based on the operation behavior and / or the playback content, where the summary includes partial playback content of the playback object.

[0069] As another aspect, the present application also provides a computer program product, which can be included in the electronic device described in the above embodiments; or can exist alone without being assembled into the electronic device. The above computer program product stores one or more programs, and when the foregoing programs are executed by one or more processors, a summary generation method described in the present application is implemented: based on the first input, obtaining the operation behavior of the user on the playback object and / or the playback content of the playback object; generating a summary based on the operation behavior and / or the playback content, where the summary includes partial playback content of the playback object.

[0070] The above description is only a preferred embodiment of the present application and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of disclosure involved in the present application is not limited to the technical solutions formed by the specific combination of the above technical features, but also covers other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the foregoing disclosure concept. For example, technical solutions formed by mutually replacing the above features with (but not limited to) technical features with similar functions disclosed in the present application.

Claims

1. A method for generating an abstract, characterized in that Including: Receiving a first input from a user; The first input corresponds to an abstract generation operation and an operation of selecting an abstract generation type, and the abstract generation type includes: a type of automatically generating an abstract and / or a type of generating an abstract based on the operation behavior of the user; Based on the first input, obtaining the operation behavior of the user on the playback object and / or the playback content of the playback object; obtaining the operation behavior of the user on the playback object includes: obtaining the touch image and / or the marked image of the user on the playback object, and performing image recognition on the touch image and / or the marked image to obtain the touch area and / or the marked area of the user on the playback object, and the marking form of the marked area includes at least one of the following: a quadrilateral frame, a wavy underline, or an oval frame; or, obtaining the touch area according to the touch sensing on the playback object and / or obtaining the marked area according to the marked event triggered on the playback object; Generating an abstract based on the operation behavior and / or the playback content, where the abstract includes partial playback content of the playback object; specifically including: extracting the first content in the playback object corresponding to the touch area and / or the marked area, and using the first content as the abstract; and / or, obtaining words that appear more than a predetermined number of times in the playback content, and using the words as the abstract; when there are multiple abstracts, typesetting the multiple abstracts according to the order of each abstract in the playback object; After generating the abstract based on the operation behavior and / or the playback content, the method further includes: Receiving a second input from the user; based on the second input, saving the abstract to obtain an abstract file, and sharing the abstract file, where the sharing method includes at least one of the following: sharing the abstract file by email; sharing the abstract file by a QR code.

2. The abstract generation method according to claim 1, wherein, After generating the abstract based on the operation behavior and / or the playback content, it further includes: Correspondingly displaying the abstract of the playback object in a preset abstract display area.

3. An abstract generation device, characterized in that, Adopting the abstract generation method as described in any one of claims 1-2, including: A receiving module, configured to receive a first input from a user; the first input corresponds to an abstract generation operation and an operation of selecting an abstract generation type, and the abstract generation type includes: a type of automatically generating an abstract and / or a type of generating an abstract based on the operation behavior of the user; An obtaining module, configured to obtain the operation behavior of the user on the playback object and / or the playback content of the playback object based on the first input; obtaining the operation behavior of the user on the playback object includes: obtaining the touch image and / or the marked image of the user on the playback object, and performing image recognition on the touch image and / or the marked image to obtain the touch area and / or the marked area of the user on the playback object, and the marking form of the marked area includes at least one of the following: a quadrilateral frame, a wavy underline, or an oval frame; or, obtaining the touch area according to the touch sensing on the playback object and / or obtaining the marked area according to the marked event triggered on the playback object; An abstract generation module, configured to generate an abstract based on the operation behavior and / or the played content, where the abstract includes partial played content of the played object; specifically including: extracting first content in the played object corresponding to the touched area and / or the marked area, and using the first content as the abstract; and / or, obtaining words that appear more than a predetermined number of times in the played content, and using the words as the abstract; when there are multiple abstracts, typesetting the multiple abstracts according to the order of each abstract in the played object. After generating the abstract based on the operation behavior and / or the played content, the abstract generation device is further configured to: Receive a second input from the user; based on the second input, save the abstract to obtain an abstract file, and share the abstract file, where the sharing method includes at least one of the following: sharing the abstract file by email; sharing the abstract file by QR code.

4. An electronic device, characterized in that, The electronic device includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor is configured to implement the abstract generation method according to any one of claims 1-2 when executing the program.

5. A computer-readable storage medium, on which a computer program is stored, and the computer program is configured to implement the abstract generation method according to any one of claims 1-2.

6. A computer program product, characterized in that, On which a computer program is stored, and the computer program is configured to implement the abstract generation method according to any one of claims 1-2.

Images