A video note generation method based on infinite screen system and related equipment
Through the video note generation method of the infinite screen system, voice recognition and text recognition technology are used to generate video notes on the TV side, which solves the convenience of note recording and review in TV side learning, and realizes efficient video note generation and review functions.
Patent Information
- Application Number
- CN202210673061.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-15
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2042-06-15
AI Technical Summary
When studying video courses on the TV side, it is difficult for users to record and review notes quickly and efficiently, and the existing technology is not enough to meet the needs of convenient video notes generation.
Using the video notes generation method based on the infinite screen system, a new target window is created by receiving signals to obtain video information to determine whether there are video notes. If not, a note will be generated. The video content is recognized by voice recognition, text recognition and two-way text correction technology, combined with Screenshot function, record video content and label it with a review tag to achieve the generation and review of video notes.
It provides users with a method to easily generate video notes on the TV side, which improves the efficiency and convenience of video learning and simplifies the process of notes generation and review.
Smart Images

Figure CN115119061B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of televisions, and in particular to a video note generation method based on an infinite screen system and related equipment. Background Art
[0002] With the development of network technology, online courses have become a new channel for acquiring knowledge. Learning from videos and taking notes is a good learning habit. Usually, we use pens and notebooks to record, but with the development of technology, people are used to recording teachers' courses by video or audio recording, or recording with pen, paper, mobile phone, computer, etc. while watching videos.
[0003] Currently, when learning online courses based on devices such as televisions or computers, it is not convenient enough to organize notes. How to record quickly and efficiently and how to quickly review through notes have become difficulties when learning video courses on TV. Users are in urgent need of a fast and efficient way to record online course notes on TV.
[0004] Therefore, the prior art still needs to be improved and enhanced. Summary of the invention
[0005] The present invention provides a video note generation method and related equipment based on an infinite screen system, aiming to solve the problem in the prior art that users cannot conveniently conduct video learning and generate video notes on smart TVs.
[0006] A first aspect of the present invention provides a method for generating video notes based on an infinite screen system, comprising:
[0007] When playing a target video, receiving a first signal, and creating a new target window according to the first signal;
[0008] The target video information is obtained, and whether there is a video note corresponding to the target video is determined according to the target video information; if the target video has no corresponding video note, a target video note is generated according to the target video in the target window.
[0009] The acquiring target video information and determining whether there is a video note corresponding to the target video according to the target video information comprises:
[0010] Obtain the video name and attribute information of the target video;
[0011] Extracting a first note in the note library according to the video name, where the note name of the first note is consistent with the video name;
[0012] It is determined whether the paragraph information of the first note matches the attribute information of the target video.
[0013] After determining whether there is a video note corresponding to the target video according to the target video information, the method further includes:
[0014] If the target video has a corresponding video note, a prompt window pops up to ask whether the video note corresponding to the target video needs to be opened;
[0015] A second signal is received, and when the option corresponding to the second signal is the first option, the video note corresponding to the target video is directly opened in the target window; when the option corresponding to the second signal is the second option, a new target video note is created in the target window.
[0016] Generating a target video note according to the target video in the target window includes:
[0017] Obtain the video name and attribute information of the target video;
[0018] Generate a note name of the target video note according to the video name;
[0019] The paragraph information of the target video note is generated according to the attribute information.
[0020] Generating a target video note according to the target video in the target window includes:
[0021] Recognize the speech content in the target video by speech recognition technology to generate a first text;
[0022] Recognize the subtitle content in the target video by using a text recognition technology to generate a second text;
[0023] generating a target text according to the first text and the second text by using a bidirectional text correction technology;
[0024] The target text is recorded in the target video note in chronological order.
[0025] Generating a target video note according to the target video in the target window further includes:
[0026] Identifying target content in the target video;
[0027] When it is identified that the target video is playing the target content, a screenshot is taken of the play window of the target video to generate a target content image;
[0028] The target content picture and the target text are recorded in the target video note in chronological order.
[0029] The step of recording the target content image and the target text in the target video note in chronological order includes:
[0030] Tagging the target content image and the target text with a review tag;
[0031] The review tag carries target information, including the playback address of the target video, the target text and / or the playback progress timestamp corresponding to the target content image;
[0032] When the review tag in the target video note is clicked, the video jumps to the corresponding position in the target video for playback according to the playback progress timestamp in the target information.
[0033] A second aspect of the present invention is a video note generation device based on an infinite screen system, comprising:
[0034] A first signal receiving module, the first signal receiving module is used to receive a first signal when playing a target video, and create a new target window according to the first signal;
[0035] A judgment module is used to obtain target video information, and judge whether there is a video note corresponding to the target video according to the target video information; if the target video has no corresponding video note, a target video note is generated according to the target video in the target window.
[0036] According to a third aspect of the present invention, a television set is provided, wherein the television set comprises: a memory, a processor, and a video note generation program based on an infinite screen system stored in the memory and executable on the processor, wherein the video note generation program based on an infinite screen system implements the steps of the video note generation method based on an infinite screen system as described above when the video note generation program based on an infinite screen system is executed by the processor.
[0037] A fourth aspect of the present invention provides a computer-readable storage medium, wherein the computer storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of any of the above-mentioned methods for generating video notes based on the infinite screen system.
[0038] Beneficial effects: Compared with the prior art, the present invention provides a method for generating video notes based on an infinite screen system and related equipment. In the method for generating video notes based on an infinite screen system provided by the present invention, when playing a target video, a first signal is received, a new target window is created according to the first signal, and then the target video information is obtained. According to the target video information, it is determined whether there is a video note corresponding to the target video. If the target video does not have a corresponding video note, a target video note is generated according to the target video in the target window. This provides users with a method for generating video notes conveniently on the TV side, which improves the convenience of generating video notes for video learning on the TV side. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 A flowchart of an embodiment of a method for generating video notes based on an infinite screen system provided by the present invention;
[0040] Figure 2 A schematic diagram of a note generation window in an embodiment of a video note generation method based on an infinite screen system provided by the present invention;
[0041] Figure 3 A note content format diagram in an embodiment of a video note generation method based on an infinite screen system provided by the present invention;
[0042] Figure 4 A user usage flow chart of an embodiment of a method for generating video notes based on an infinite screen system provided by the present invention;
[0043] Figure 5 A structural principle diagram of an embodiment of a video note generation device based on an infinite screen system provided by the present invention;
[0044] Figure 6 A schematic diagram of an operating environment of a television set according to an embodiment of the present invention. DETAILED DESCRIPTION
[0045] In order to make the purpose, technical solution and effect of the present invention clearer and more specific, the present invention is further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
[0046] Embodiment 1
[0047] The video note generation method based on the infinite screen system provided in this embodiment can be executed by a terminal, which can be, but is not limited to, a smart TV, a computer, etc. The following description will be made using a smart TV as an example. Figure 1 As shown, the video note generation method based on the infinite screen system provided in this embodiment includes the steps of:
[0048] S100: When playing a target video, receiving a first signal, and creating a new target window according to the first signal.
[0049] Figure 4 The user usage flow chart in the embodiment of the video note generation method based on the infinite screen system provided by the present invention, the first signal is a signal sent by the user to open the target application. In this embodiment, the target application can be a smart note application. Before receiving the first signal, it also includes: turning on the smart TV, logging in to the TV user account, and opening the target video. In this embodiment, the target video can be an online course video. For example, the name of the online course video is: Second grade of elementary school (Chinese)-Spring Story.
[0050] Reference Figure 2 , while playing the online course video, a first signal sent by the user is received, the first signal is a signal to open the smart note application, and the smart note application is opened according to the first signal. When the smart note application is opened, it automatically detects whether an application window is already opened and working in the TV system. When it is detected that the target video is already opened in the TV system, a prompt window pops up to prompt whether to use the splicing window function to open the smart note application. The user can choose whether to use the splicing window function to open the smart note application by sending a third signal. The TV receives the third signal, and when the option corresponding to the third signal is yes, the smart note application is opened using the splicing window function, the target video is placed in window 1, and a new target window is created on the TV screen, and the smart note application is opened in the target window. In this embodiment, the target window is window 2.
[0051] S200, obtaining target video information, and determining whether there is a video note corresponding to the target video according to the target video information; if the target video has no corresponding video note, generating a target video note according to the target video in the target window.
[0052] After the smart note application is opened in the target window, the smart note application obtains target video information and determines whether a video note corresponding to the target video already exists in the note library in the smart note application based on the target video information; if the target video does not have a corresponding video note, a target video note is generated based on the target video in the target window.
[0053] The step of obtaining target video information and determining whether there is a video note corresponding to the target video according to the target video information includes:
[0054] S201, obtaining the video name and attribute information of the target video;
[0055] S202, extracting a first note in the note library according to the video name, where the note name of the first note is consistent with the video name;
[0056] S203: Determine whether the paragraph information of the first note matches the attribute information of the target video.
[0057] The target video information includes the video name and attribute information of the target video. In the present embodiment, the target video is an online course video. The video name of the target video is: Second Grade of Primary School (Chinese Language and Literature) - Spring Story. The attribute information of the target video includes: the playback address of the target video, the name of the online course, the name of the teacher, the name of the school, etc.
[0058] If there is no video note with the same name as the video in the note library in the smart note application, it is deemed that the target video has no corresponding video note, and a target video note is generated in the target window according to the target video.
[0059] If the first note in the note library of the smart note application has the same name as the video, the first note in the note library is extracted. Specifically, according to the video name of the target video: Second Grade of Primary School (Chinese Language and Literature) - Spring Story, the first note is extracted, and the first note is a note file with the same name as the video name of the target video, that is, the file name of the first note is also: Second Grade of Primary School (Chinese Language and Literature) - Spring Story.
[0060] In this embodiment, the target video is an online course video. In actual applications, teachers from different schools may explain the same course. Therefore, the first note may be one or more. To ensure that the first note is the note file corresponding to the target video, the paragraph information of each first note needs to be extracted. Figure 3 The paragraph information includes the playback address, online course name, teacher name, and school name of the video corresponding to the first note. It is determined whether the paragraph information of the first note matches the attribute information of the target video. If so, the first note is the video note corresponding to the target video.
[0061] After determining whether there is a video note corresponding to the target video according to the target video information, the method further includes:
[0062] S204: If the target video has a corresponding video note, a prompt window pops up to ask whether the video note corresponding to the target video needs to be opened;
[0063] S205. Receive a second signal. When the option corresponding to the second signal is the first option, directly open the video note corresponding to the target video in the target window; when the option corresponding to the second signal is the second option, create a new target video note in the target window.
[0064] When the system detects that the target video has a corresponding video note, an inquiry window pops up on the TV screen, prompting the user that there is a video note corresponding to the target video in the current self-note application and asking whether to open it. The user chooses yes or no by sending a second signal.
[0065] Specifically, in this embodiment, the first option is yes, and the second option is no. The television receives the second signal, and when the option corresponding to the second signal is the first option, the video note corresponding to the target video is opened in the target window, and when the option corresponding to the second signal is the second option, a new video note is created in the target window, and the new video note is the target video note mentioned above.
[0066] Specifically, the target video note file is newly created, then the process returns to step 200, and a target video note is generated according to the target video in the target window.
[0067] Wherein, generating a target video note according to the target video in the target window includes:
[0068] S206, obtaining the video name and attribute information of the target video;
[0069] S207, generating a note name of the target video note according to the video name;
[0070] S208. Generate paragraph information of the target video note according to the attribute information.
[0071] In this embodiment, the target video is an online course video, and the video name of the target video is: Second Grade of Primary School (Chinese Language and Literature) - Spring Story. The attribute information of the target video includes: the playback address of the target video, the name of the online course, the name of the teacher, the name of the school, etc.
[0072] The note name of the target video note is generated according to the video name, that is, the note name of the target video note is: Second grade of primary school (Chinese language, lower part) - Spring Story.
[0073] Generate the paragraph information of the target video note according to the attribute information, refer to Figure 3The paragraph information layout of the target video notes is generated according to the playback address of the target video, the name of the online course, the name of the teacher, and the name of the school.
[0074] Generating a target video note according to the target video in the target window includes:
[0075] S209, generating a first text by recognizing the voice content in the target video through voice recognition technology;
[0076] S210, generating a second text by recognizing the subtitle content in the target video through a text recognition technology;
[0077] S211, generating a target text according to the first text and the second text by using a bidirectional text correction technology;
[0078] S212: Record the target text in the target video note in chronological order.
[0079] Generating a target video note according to the target video in the target window includes generating a target text of the target video note according to the target video.
[0080] Specifically, in this embodiment, the target video is an online course video. First, the teacher's course explanation content in the online course video is converted into a text format by voice recognition through voice recognition technology to obtain the first text, and then the letters in the online course video are obtained by text recognition technology equipment to obtain the second text. Then, according to the first text and the second text, through NLP (natural language processing) and semantic understanding, the text with ambiguous semantic understanding is eliminated, and the accurate learning note text record is output according to the semantic understanding to obtain the target text. For example, when the actual content of the teacher's explanation is: Spring is a beautiful season, the conversion result recognized by voice recognition technology is: Spring is a weak season; the text result recognized by text recognition technology is: Spring is a beautiful season. Through the two-way text correction technology, that is, through NLP (natural language processing) and semantic understanding, the text with ambiguous semantic understanding is eliminated, and the text result generated after semantic understanding is: Spring is a beautiful season. It can be seen that the text results after bidirectional correction are more accurate than those recognized only by speech recognition technology or only by text recognition technology. It effectively corrects the incorrect recognition parts and obtains the correct semantics and target text.
[0081] After the target text is identified, the target text is recorded in the target video note in chronological order.
[0082] Generating a target video note according to the target video in the target window further includes:
[0083] S213, identifying target content in the target video;
[0084] S214, when it is recognized that the target video is playing the target content, automatically taking a screenshot of the first window to generate a target content image;
[0085] S215. Record the target content image and the target text in the target video note in chronological order.
[0086] The method for acquiring the target content may be set in the smart note application, or may be intelligently identified through an image recognition algorithm, which is not limited here.
[0087] In this embodiment, the identification of the target content in the target video may be to identify the text in a preset area. When the text in the preset area changes, the current first window is identified as the target content, a screenshot of the current first window is taken, and a target content image is generated. For example, the target content is the knowledge point of the online course video. During the playback of the online course video, the display position of the knowledge point is obtained. When obtaining the display position of the knowledge point, for the upper left corner area of the video playback window, the area coordinates are x1, x2: z1z2: y1, y2: n1, n2. The text in the area is identified and obtained through text recognition technology. If the text in the area changes, it is considered that the knowledge point has switched and entered a new knowledge point. At this time, it is considered that the target content in the target video is identified. A screenshot of the playback window of the target video is taken to generate a target content image. The target content image and the target text are recorded in the target video notes in chronological order, such as Figure 3 shown.
[0088] In this embodiment, the user can also click the video screenshot button to send a fourth signal to manually take a screenshot of the target video's playback window. The TV receives the fourth signal, takes a screenshot of the current target video's playback window, generates the target content image, and records the target content image and the target text in chronological order in the target video note.
[0089] The step of recording the target content image and the target text in the target video note in chronological order includes:
[0090] S216, marking the target content image and the target text with a review tag;
[0091] S217, wherein the review tag carries target information, and the target information includes the playback address of the target video, the target text and / or the playback progress timestamp corresponding to the target content picture;
[0092] S218. When the review tag in the target video note is clicked, jump to the corresponding position in the target video for playback according to the playback progress timestamp in the target information.
[0093] While the target content picture and the target text are recorded in the target video notes in chronological order, the target content picture and the target text are marked with review tags, and the review tags carry target information, and the target information includes the playback address of the target video, the target text and / or the playback progress timestamp corresponding to the target content picture.
[0094] Specifically, the review tag also carries the application name and video name corresponding to the target video.
[0095] The application name and video name are used to confirm whether the recorded target text and / or the target content image are stored in the correct note. For example, in the window, the smart note application window opens a record of course A, while the video playback window plays the video content of course B. At this time, they can be distinguished by the course name. When it is recognized that the name of the video playback window is inconsistent with the name of the smart note application window, a prompt box pops up to prompt to open the video corresponding to the current note or open the note corresponding to the current video.
[0096] The playback address of the target video, the target text and / or the playback progress timestamp corresponding to the target content image are used to facilitate the subsequent review of the course content. When the review tag in the target video note is clicked, the corresponding position in the target video is jumped to play according to the playback progress timestamp in the target information. This includes jumping to the corresponding position in the target video being played or jumping to the corresponding position in the target video after opening the target video.
[0097] S219, receiving a fifth signal, and outputting the target video note into a file in a target format according to the fifth signal;
[0098] S220. Receive a sixth signal, and save the target video note according to the sixth signal.
[0099] S220: Receive a seventh signal, and store the target video in a mobile device according to the seventh signal.
[0100] Specifically, the user can output the target video note into a file in a target format by clicking an output button, and the file in the target format includes files in doc, wps, pdf and other formats.
[0101] The user can also save the target format file in the note library of the smart note application by clicking a save button, and the note library is in the cloud platform of the smart note application. The target format file can be stored in the mobile device by scanning a QR code or the like.
[0102] This embodiment provides a method for generating video notes based on an infinite screen system. When a target video is playing, a new target window is created, a target application is opened in the target window, and the target application window and the target video playback window are combined to form a mosaic display; after the target application is identified according to speech recognition technology and text recognition technology, the content explained by the teacher in the target video is identified through a two-way text correction technology, and the content explained by the teacher is converted into a target text, and the target text is recorded in the target video note in chronological order; the target video playback window is identified through a screenshot function to obtain a target content image by a knowledge point identification and screenshot, and the target content image and the target text are recorded in the target video note in chronological order. When the target content image and the target text are generated, a review tag will be added to record the playback address of the target video, the target text and / or the playback progress timestamp corresponding to the target content image. When the review tag in the target video note is clicked, it will jump to the corresponding position in the target video for playback according to the playback progress timestamp in the target information. Finally, when the target video note is generated, the user can click the output button to output the target video note as a file in the target format, and the file in the target format can be stored in a mobile device by scanning a QR code or the like.
[0103] In summary, this embodiment provides a method for generating video notes based on an infinite screen system. When playing a target video, a first signal is received, and a new target window is created according to the first signal; target video information is obtained, and it is determined whether there is a video note corresponding to the target video according to the target video information. If the target video does not have a corresponding video note, a target video note is generated according to the target video in the target window. The present invention provides a method for users to conveniently generate video notes on a TV, which improves the convenience of video learning and generating video notes on a TV.
[0104] It should be understood that, although the various steps in the flowcharts given in the accompanying drawings of the present invention are displayed in sequence according to the indications of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless there is a clear description in this article, the execution of the steps in the present invention is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps of the present invention may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.
[0105] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by signaling related hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0106] Embodiment 2
[0107] Based on the above embodiment, the present invention also provides a video note generation device based on an infinite screen system, and its functional module schematic diagram is as follows: Figure 5 As shown, the video note generating device based on the infinite screen system includes:
[0108] A first signal receiving module, the first signal receiving module is used to receive a first signal when playing a target video, and create a new target window according to the first signal;
[0109] A judgment module is used to obtain target video information, and judge whether there is a video note corresponding to the target video according to the target video information; if the target video has no corresponding video note, a target video note is generated according to the target video in the target window.
[0110] Embodiment 3
[0111] like Figure 6 As shown, based on the above-mentioned video note generation method based on the infinite screen system, the present invention also provides a television set accordingly, and the television set includes a processor 10, a memory 20 and a display 30. Figure 6 Only some of the components of the television are shown, but it should be understood that implementation of all of the components shown is not a requirement, and more or fewer components may be implemented instead.
[0112] In some embodiments, the memory 20 may be an internal storage unit of the TV, such as a hard disk or memory of the TV. In other embodiments, the memory 20 may also be an external storage device of the TV, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the TV. Furthermore, the memory 20 may also include both an internal storage unit of the TV and an external storage device. The memory 20 is used to store application software and various types of data installed on the TV, such as the program code of the TV installation. The memory 20 may also be used to temporarily store data that has been output or is to be output. In one embodiment, a video note generation program 40 based on an infinite screen system is stored on the memory 20, and the video note generation program 40 based on an infinite screen system can be executed by the processor 10, thereby realizing the video note generation method based on an infinite screen system in the present application.
[0113] In some embodiments, the processor 10 may be a central processing unit (CPU), a microprocessor or other data processing chip, used to run the program code or process data stored in the memory 20, such as executing the video note generation method based on the infinite screen system.
[0114] In some embodiments, the display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, etc. The display 30 is used to display information on the television and to display a visual user interface. The components 10-30 of the television communicate with each other via a system bus.
[0115] In one embodiment, when the processor 10 executes the video note generation program 40 based on the infinite screen system in the memory 20, the following steps are implemented:
[0116] When playing a target video, receiving a first signal, and creating a new target window according to the first signal;
[0117] The target video information is obtained, and whether there is a video note corresponding to the target video is determined according to the target video information; if the target video has no corresponding video note, a target video note is generated according to the target video in the target window.
[0118] The step of obtaining target video information and determining whether there is a video note corresponding to the target video according to the target video information includes:
[0119] Obtain the video name and attribute information of the target video;
[0120] Extracting a first note in the note library according to the video name, where the note name of the first note is consistent with the video name;
[0121] It is determined whether the paragraph information of the first note matches the attribute information of the target video.
[0122] Wherein, after determining whether there is a video note corresponding to the target video according to the target video information, the method further includes:
[0123] If the target video has a corresponding video note, a prompt window pops up to ask whether the video note corresponding to the target video needs to be opened;
[0124] A second signal is received, and when the option corresponding to the second signal is the first option, the video note corresponding to the target video is directly opened in the target window; when the option corresponding to the second signal is the second option, a new target video note is created in the target window.
[0125] Wherein, generating a target video note according to the target video in the target window includes:
[0126] Obtain the video name and attribute information of the target video;
[0127] Generate a note name of the target video note according to the video name;
[0128] The paragraph information of the target video note is generated according to the attribute information.
[0129] Wherein, generating a target video note according to the target video in the target window includes:
[0130] Recognize the speech content in the target video by speech recognition technology to generate a first text;
[0131] Recognize the subtitle content in the target video by using a text recognition technology to generate a second text;
[0132] generating a target text according to the first text and the second text by using a bidirectional text correction technology;
[0133] The target text is recorded in the target video note in chronological order.
[0134] Wherein, generating a target video note according to the target video in the target window further includes:
[0135] Identifying target content in the target video;
[0136] When it is identified that the target video is playing the target content, a screenshot is taken of the play window of the target video to generate a target content image;
[0137] The target content picture and the target text are recorded in the target video note in chronological order.
[0138] The step of recording the target content image and the target text in the target video note in chronological order includes:
[0139] Tagging the target content image and the target text with a review tag;
[0140] The review tag carries target information, including the playback address of the target video, the target text and / or the playback progress timestamp corresponding to the target content image;
[0141] When the review tag in the target video note is clicked, the video jumps to the corresponding position in the target video for playback according to the playback progress timestamp in the target information.
[0142] Embodiment 4
[0143] The present invention also provides a computer-readable storage medium on which one or more programs are stored. The one or more programs can be executed by one or more processors to implement the steps of the video note generation method based on the infinite screen system described in the above embodiment.
[0144] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A video note generation method based on an infinite screen system, characterized in that: include: When playing a target video, receiving a first signal, and creating a new target window according to the first signal; Obtain target video information, and determine whether there is a video note corresponding to the target video according to the target video information; if the target video does not have a corresponding video note, generate a target video note according to the target video in the target window; Generating a target video note according to the target video in the target window includes: Recognize the speech content in the target video by speech recognition technology to generate a first text; Recognize the subtitle content in the target video by using a text recognition technology to generate a second text; generating a target text according to the first text and the second text by using a bidirectional text correction technology; Recording the target text in the target video note in chronological order; The step of generating a target text according to the first text and the second text by using a bidirectional text correction technology includes: By using NLP and semantic understanding technology, ambiguous words in the first text and the second text are removed to obtain the target text; Generating a target video note according to the target video in the target window further includes: Identifying target content in the target video; When it is identified that the target video is playing the target content, a screenshot is taken of the play window of the target video to generate a target content image; Recording the target content picture and the target text in the target video note in chronological order; The identifying target content in the target video includes: Identify text in a preset area, and when the text in the preset area changes, identify the content in the current target window as the target content; Generating a target video note according to the target video in the target window further includes: receiving a fourth signal, taking a screenshot of the current playback window of the target video, generating the target content picture, and recording the target content picture and the target text in the target video note in chronological order; The step of recording the target content image and the target text in the target video note in chronological order includes: Tagging the target content image and the target text with a review tag; The review tag carries target information, including the playback address of the target video, the target text and / or the playback progress timestamp corresponding to the target content picture; When the review tag in the target video note is clicked, the video jumps to the corresponding position in the target video for playback according to the playback progress timestamp in the target information, including jumping to the corresponding position in the target video being played or jumping to the corresponding position in the target video after opening the target video.
2. The method for generating video notes based on the infinite screen system according to claim 1, characterized in that: The acquiring target video information and determining whether there is a video note corresponding to the target video according to the target video information comprises: Obtain the video name and attribute information of the target video; Extracting a first note in the note library according to the video name, where the note name of the first note is consistent with the video name; It is determined whether the paragraph information of the first note matches the attribute information of the target video.
3. The method for generating video notes based on the infinite screen system according to claim 1, characterized in that: After determining whether there is a video note corresponding to the target video according to the target video information, the method further includes: If the target video has a corresponding video note, a prompt window pops up to ask whether the video note corresponding to the target video needs to be opened; A second signal is received, and when the option corresponding to the second signal is the first option, the video note corresponding to the target video is directly opened in the target window; when the option corresponding to the second signal is the second option, a new target video note is created in the target window.
4. The video note generation method based on the infinite screen system according to claim 2 is characterized in that: Generating a target video note according to the target video in the target window includes: Obtain the video name and attribute information of the target video; Generate a note name of the target video note according to the video name; The paragraph information of the target video note is generated according to the attribute information.
5. A video note generation device based on an infinite screen system, characterized in that: The device comprises: A first signal receiving module, the first signal receiving module is used to receive a first signal when playing a target video, and create a new target window according to the first signal; A judgment module, the judgment module is used to obtain target video information, and judge whether there is a video note corresponding to the target video according to the target video information; if the target video has no corresponding video note, a target video note is generated according to the target video in the target window; Generating a target video note according to the target video in the target window includes: Recognize the speech content in the target video by speech recognition technology to generate a first text; Recognize the subtitle content in the target video by using a text recognition technology to generate a second text; generating a target text according to the first text and the second text by using a bidirectional text correction technology; Recording the target text in the target video note in chronological order; The step of generating a target text according to the first text and the second text by using a bidirectional text correction technology includes: By using NLP and semantic understanding technology, ambiguous words in the first text and the second text are removed to obtain the target text; Generating a target video note according to the target video in the target window further includes: Identifying target content in the target video; When it is identified that the target video is playing the target content, a screenshot is taken of the play window of the target video to generate a target content image; Recording the target content picture and the target text in the target video note in chronological order; The identifying target content in the target video includes: Identify text in a preset area, and when the text in the preset area changes, identify the content in the current target window as the target content; Generating a target video note according to the target video in the target window further includes: receiving a fourth signal, taking a screenshot of the current playback window of the target video, generating the target content picture, and recording the target content picture and the target text in the target video note in chronological order; The step of recording the target content image and the target text in the target video note in chronological order includes: Tagging the target content image and the target text with a review tag; The review tag carries target information, including the playback address of the target video, the target text and / or the playback progress timestamp corresponding to the target content picture; When the review tag in the target video note is clicked, the video jumps to the corresponding position in the target video for playback according to the playback progress timestamp in the target information, including jumping to the corresponding position in the target video being played or jumping to the corresponding position in the target video after opening the target video.
6. A television set, characterized in that: The television includes: a memory, a processor, and a video note generation program based on an infinite screen system stored in the memory and executable on the processor. When the video note generation program based on an infinite screen system is executed by the processor, the steps of the video note generation method based on an infinite screen system as described in any one of claims 1 to 4 are implemented.
7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the video note generation method based on the infinite screen system as described in any one of claims 1-4.
