Video-based Learning Assistance Method and Device

Abstract

The present application provides a video-based learning assistance method and device. The video-based learning assistance method is applied to a video player and includes: when playing a target video, receiving a learning instruction for the target video; in response to the learning instruction, playing the target video in a first display area of the video player, and displaying a learning toolbar corresponding to the target video in a second display area of the video player; displaying learning content corresponding to the target video in the learning toolbar, where the learning content is related to subtitle information corresponding to the target video. The method provided by the present application combines the playing scenario with the learning scenario according to the user's demand for learning a language by watching videos, displays learning content corresponding to the watched video in the learning toolbar, and while helping the user watch the video content, enables the user to learn more easily and conveniently, playing a role of combining education with entertainment.

Description

Technical Field

[0001] This application relates to the field of Internet technologies, and particularly to a video-based learning assistance method. This application also relates to a video-based learning assistance device, a computing device, and a computer-readable storage medium. Background Art

[0002] Generally, learning a related language by watching videos is one of the effective ways to learn a language. For example, learning English by watching American TV series, learning Japanese by watching Japanese anime, etc. However, the current subtitles of videos can only provide users with a basic translation correspondence, and cannot help users deeply understand the usage of slang in the content, nor can they effectively learn some difficult words. For users who understand the usage of relevant slang or words, they cannot share their learning experience with other users. Therefore, there is an urgent need for a learning assistance method to help users better utilize videos for language learning. Summary of the Invention

[0003] In view of this, embodiments of this application provide a video-based learning assistance method. This application also relates to a video-based learning assistance device, a computing device, and a computer-readable storage medium to solve the situation in the prior art that video platforms are not suitable for learning and users cannot conveniently and quickly learn based on videos.

[0004] According to the first aspect of the embodiments of this application, a video-based learning assistance method is provided, which is applied to a video player and includes:

[0005] When playing a target video, receiving a learning instruction for the target video;

[0006] In response to the learning instruction, playing the target video in a first display area of the video player, and displaying a learning toolbar corresponding to the target video in a second display area of the video player;

[0007] Displaying learning content corresponding to the target video in the learning toolbar, where the learning content is related to the subtitle information corresponding to the target video.

[0008] According to the second aspect of the embodiments of this application, a video-based learning assistance device is provided, which is applied to a video player and includes:

[0009] A receiving module, configured to receive a learning instruction for the target video when playing the target video;

[0010] A display module, configured to play the target video in a first display area of the video player and display a learning toolbar corresponding to the target video in a second display area of the video player in response to the learning instruction;

[0011] A display module, configured to display learning content corresponding to the target video in the learning toolbar, where the learning content is related to subtitle information corresponding to the target video.

[0012] According to a third aspect of an embodiment of the present application, a computing device is provided, including a memory, a processor, and computer instructions stored on the memory and executable on the processor. When the processor executes the computer instructions, the steps of the video-based learning assistance method are implemented.

[0013] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, which stores computer instructions. When the computer instructions are executed by a processor, the steps of the video-based learning assistance method are implemented.

[0014] The video-based learning assistance method provided by the present application is applied to a video player and includes: when playing a target video, receiving a learning instruction for the target video; in response to the learning instruction, playing the target video in a first display area of the video player and displaying a learning toolbar corresponding to the target video in a second display area of the video player; displaying learning content corresponding to the target video in the learning toolbar, where the learning content is related to subtitle information corresponding to the target video. According to the demands of users to learn languages by watching videos in an embodiment of the present application, the playing scenario is combined with the learning scenario, and learning content corresponding to the watched video is displayed in the learning toolbar, which can help users watch video content and learn more easily and conveniently, playing the role of combining education with entertainment. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a flowchart of a video-based learning assistance method provided by an embodiment of the present application;

[0016] Figure 2 is a schematic diagram of the interface of a video player in a learning mode provided by an embodiment of the present application;

[0017] Figure 3 is a schematic diagram of the interface of a video player under a subtitle control provided by an embodiment of the present application;

[0018] Figure 4 is a schematic diagram of the interface of a video player under a vocabulary control provided by an embodiment of the present application;

[0019] Figure 5It is a schematic diagram of the interface of the video player provided by another embodiment of the present application under the vocabulary control;

[0020] Figure 6 It is a schematic diagram of the annotation interface for the video player to send learning bullet screens provided by an embodiment of the present application;

[0021] Figure 7 It is a processing flow chart of the video-based learning assistance method applied to video L provided by the present application;

[0022] Figure 8 It is a schematic structural diagram of a video-based learning assistance device provided by an embodiment of the present application;

[0023] Figure 9 It is a structural block diagram of a computing device provided by an embodiment of the present application. Detailed implementation manners

[0024] In the following description, many specific details are set forth in order to provide a thorough understanding of the present application. However, the present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar generalizations without departing from the connotation of the present application. Therefore, the present application is not limited by the specific implementations disclosed below.

[0025] The terms used in one or more embodiments of the present application are for the purpose of describing specific embodiments only and are not intended to limit one or more embodiments of the present application. The singular forms "a", "the", and "said" used in one or more embodiments of the present application and the appended claims are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of the present application refers to and includes any or all possible combinations of one or more of the associated listed items.

[0026] It should be understood that although the terms first, second, etc. may be used in one or more embodiments of the present application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of the present application, the first may also be referred to as the second, and similarly, the second may also be referred to as the first. Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to determining".

[0027] First, the noun terms involved in one or more embodiments of the present application are explained.

[0028] Treasure Chest Subtitles: A type of subtitle in the learning mode. The subtitle file is embedded in the function bar of the player, supporting dragging the subtitle up and down to jump to the playback progress. Clicking on the subtitle can view the definitions of key words in the subtitle and the content of public annotations by users.

[0029] Learning Danmaku: A unique danmaku form in the learning mode, including official presets and user co-construction. Among them, the official presets are that the administrator compares the subtitle file of key high-frequency words with the content. User co-construction means that users send real-time danmaku for the words in the subtitle to support learning relevant content.

[0030] Danmaku Technology: Comment information that pops up when watching videos on the Internet.

[0031] External Subtitle: A subtitle file corresponding to the video. There is no need to suppress the subtitle into the video. Just associate the subtitle with the video.

[0032] All along, watching American dramas, British dramas, Japanese dramas, Korean dramas, etc. has always been one of the effective ways for us to learn relevant languages. However, the current subtitle suppression and external subtitle technologies can only provide the basic Chinese translations corresponding to the lines in the drama, and cannot help users understand the usage of slang in the content more deeply. Moreover, the danmaku content in the video is too numerous, and among them, the content helpful for language learning is very little and difficult to screen, so it is inconvenient to be used as a learning tool.

[0033] Based on this, in this application, a video-based learning assistance method is provided. This application also involves a video-based learning assistance device, a computing device, and a computer-readable storage medium, which will be described in detail one by one in the following embodiments.

[0034] Figure 1 The flowchart of a video-based learning assistance method provided according to an embodiment of the present application is shown. The method is applied to a video player and specifically includes the following steps:

[0035] Step 102: When playing the target video, receive a learning instruction for the target video.

[0036] The target video specifically refers to the video that the user is currently playing. The learning instruction for the target video is the learning instruction issued by the user who hopes to learn the content in the target video. For example, when the user is watching American drama L through the player, and at this time, the user hopes to learn Japanese by following Japanese drama J, then the user sends a learning instruction for Japanese drama J to the video player. In this case, Japanese drama J is the target video, and the video player will receive the learning instruction for Japanese drama J.

[0037] In practical applications, not every video may have the function of the learning mode. The administrator needs to preprocess the videos that can enter the learning mode in advance and add corresponding identifiers to the target videos that support the learning mode. Based on this, receiving a learning instruction for the target video includes:

[0038] When the target video supports the learning mode, display the learning mode control;

[0039] Receive the learning instruction sent by the user for the learning mode control.

[0040] Among them, only when the administrator adds the corresponding learning mode identifier to the target video in advance can the learning instruction for the target video be received. In practical applications, it is necessary to first determine whether the target video supports the learning mode, that is, whether the target video has a learning mode identifier. If the target video does not have a learning mode identifier, the learning instruction for the target video cannot be received; if the target video has a learning mode identifier, that is, the target video supports the learning mode, then the learning mode control is displayed in the video player. The learning mode control provides an entrance to enter the learning mode. The user can click on the learning mode control to send a learning instruction to the video player. At this time, the video player receives the learning instruction sent by the user for the learning mode control.

[0041] In a specific embodiment provided by the present application, taking the user watching the American drama L through the video player as an example, where the American drama L is the target video. The player determines whether the American drama L has a corresponding learning mode identifier by detecting. When it is detected that the American drama L has a learning mode identifier, it is determined that the American drama L supports the learning mode, that is, the learning mode control is displayed. During the process of the user watching the American drama L, if the user hopes to learn English through the American drama L, the user can click on the learning mode control to send a learning instruction for the American drama L to the video player.

[0042] Step 104: In response to the learning instruction, play the target video in the first display area of the video player, and display the learning toolbar corresponding to the target video in the second display area of the video player.

[0043] After receiving the learning instruction for the target video, in response to the learning instruction, divide the video player into a first display area and a second display area. In the first display area, shrink the target video according to a preset ratio and play it in the first display area; in the second display area, display the learning toolbar for learning the target video, and the user can perform corresponding learning through the learning toolbar.

[0044] See Figure 2 , Figure 2 shows a schematic diagram of the interface of the video player provided by an embodiment of the present application in the learning mode. AsFigure 2 As shown, on the left side of the player is the first display area, and on the right side of the player is the second display area. At the same time, the target video is played in the first display area, and the learning toolbar corresponding to the target video is shown in the second display area. It should be noted that Figure 2 What is shown is only a specific implementation manner of the video player in the learning mode. In practical applications, the specific positions and specific display forms of the first display area and the second display area are not limited. It can also be that the first display area and the second display area are arranged vertically, etc. In this application, the specific position information of the first display area and the second display area is not limited, and it shall be subject to the actual application.

[0045] In a specific implementation manner provided by this application, following the above example, the user watches the American drama L through the video player and issues a learning instruction for the American drama L to the video player. The video player shrinks the American drama L according to a preset ratio and then displays it in the first display area on the left side of the screen to continue playing, and at the same time, the learning toolbar of the American drama L is shown in the second display area on the right side of the screen.

[0046] Step 106: Display the learning content corresponding to the target video in the learning toolbar, where the learning content is related to the subtitle information corresponding to the target video.

[0047] The learning toolbar is a toolbar for the user to learn according to the target video, and the specific learning content corresponding to the target video is shown in the learning toolbar.

[0048] Specifically, the learning toolbar includes a subtitle control;

[0049] Displaying the learning content corresponding to the target video in the learning toolbar includes:

[0050] Display the subtitle information list of the target video in the subtitle control, where the subtitle information list shows the subtitle information of the target video.

[0051] See Figure 3 , Figure 3 shows the interface schematic diagram of the video player provided by an embodiment of this application under the subtitle control. There is a subtitle control, namely the treasure chest subtitle, in the learning toolbar, and the subtitle information list of the target video is shown in the subtitle control. The subtitles in the subtitle information list will automatically scroll according to the playback of the target video. The Chinese and English subtitles of the target video will be shown in the subtitle list. In another specific implementation manner provided by this application, there can also be simple paraphrase information of a certain word or phrase in the subtitle information of the subtitle information list. Such as Figure 3As shown, after the word "define" in the sentence "It's important to not let your past define (vt. define, make clear) your future", there will be the simple paraphrase information of "define" in this sentence. Users can obtain the Chinese translation of the current line through the subtitle information list, and can also determine the simple paraphrase of the keyword. It should be noted that the simple paraphrase of a word or phrase is pre-configured by the administrator for each word or phrase in advance.

[0052] Display the subtitle information list in the subtitle control. To obtain this subtitle information list, therefore, the method further includes:

[0053] Obtain the subtitle information list pre-set for the target video; or

[0054] Obtain the audio data of the target video, and identify the audio data to generate a subtitle information list.

[0055] Specifically, the subtitle information list can be a subtitle file pre-set for the target video. Sometimes, the target video has no subtitles. It is also possible to obtain the audio data of the target video and identify the audio data through AI speech recognition to generate the corresponding subtitle information list.

[0056] The subtitle information list can be in the form of external subtitles. Users can independently choose to display or hide the subtitle information list. When the user chooses to display the subtitle information list, they can listen to the audio part in the video while comparing it with the subtitle information list; when the user chooses to hide the subtitle information list, they can only practice listening.

[0057] In practical applications, when users practice listening by watching videos, they usually listen to a certain conversation repeatedly. If it is achieved by dragging the video progress bar every time, the progress bar cannot be accurately dragged to the corresponding time point, which will cause a waste of time. Based on this, the method provided in this application further includes:

[0058] Receive a subtitle dragging instruction for the subtitle information list;

[0059] Determine the subtitle to be played based on the subtitle dragging instruction;

[0060] Determine the dragging play time point of the target video according to the subtitle to be played, and play the target video from the dragging play time point.

[0061] In the case where a user hopes to repeatedly watch a certain segment of content, it can be achieved by dragging the subtitles in the subtitle information list. That is, the user can drag the subtitles in the subtitle information list to the part they want to watch, which means sending a subtitle dragging instruction to the video player. When the video player receives the subtitle dragging instruction for the subtitles in the subtitle information list, it will slide the subtitle information list until it slides to the position where the user hopes to stop, and determine the corresponding subtitle at this time as the subtitle to be played. And each subtitle has a fixed playing time period in the video. Therefore, the start time of the subtitle to be played is used as the dragging playing time of the target video. That is to say, the dragging playing time is the start time of the subtitle to be played. After determining the dragging playing time point of the target video, the target video can be played starting from this dragging playing time point.

[0062] In a specific embodiment provided by the present application, taking the example that a user wants to repeatedly watch a certain conversation in video V to practice listening, the user drags the subtitle information list to the subtitle they want to play, determines the subtitle to be played, and the playing time interval of this subtitle to be played in the video is "1 minute and 30 seconds to 1 minute and 35 seconds". If the determined dragging playing time point is 1 minute and 30 seconds, then the video V starts playing from the 1 minute and 30 second mark.

[0063] By sliding in the subtitle information list, the user drags the subtitle to the time they hope to start playing, which can accurately jump the progress, save the user's adjustment time, and facilitate the user to repeatedly watch a certain segment. In addition, corresponding special processing can be performed on key words in the subtitles, such as bolding, coloring red, adding simple interpretations, etc., which is convenient for the user to directly obtain information about relevant words and facilitates the user's learning.

[0064] In another specific scenario provided by the present application, if the user discovers a specially marked word or phrase in a certain subtitle in the subtitle information list and hopes to further study and understand it, they can further learn the specific content of the relevant word in the learning toolbar.

[0065] Specifically, the learning toolbar includes a vocabulary control.

[0066] The method further includes S1082 - S1084:

[0067] S1082. Determine the target subtitle and determine the target vocabulary of the target subtitle.

[0068] The target subtitle is the subtitle that the user determines to hope to learn. Obtaining the target subtitle includes:

[0069] Receiving a vocabulary learning instruction for the subtitle information list of the target video and determining the target subtitle according to the vocabulary learning instruction; or

[0070] Obtain the target subtitle of the current video frame of the target video.

[0071] When the user views the subtitle information in the subtitle information list and finds that a certain specially marked word or phrase in the subtitle information is not very familiar and wants to learn more, the user can issue a vocabulary learning instruction for the subtitle information list. At this time, the video editor can receive the vocabulary learning instruction issued by the user for the subtitle information list. The subtitle information pointed to by the vocabulary learning instruction is the target subtitle. For example, if there are 5 subtitle information items displayed in the subtitle information list and the user hopes to learn the vocabulary in the 2nd subtitle information item, then a vocabulary learning instruction is issued to the 2nd subtitle in the subtitle information list. The vocabulary learning instruction corresponds to the 2nd subtitle, so the 2nd subtitle is the target subtitle.

[0072] In another specific implementation scenario provided by this application, during the process of the user watching the video, the subtitle in the currently watched current video frame can also be used as the target subtitle.

[0073] The words specially marked in the target subtitle are the target words. In practical applications, the target words in the target subtitle can be one, two, or more. In this application, the number of target words is not limited and is subject to actual applications. The target words can be high-frequency words, key words in language exams, rare words, slang, etc. In this application, the specific content of the target words is not limited either.

[0074] In a specific implementation manner provided by this application, continuing with the above example, if the user hopes to learn more about the word "define" in the subtitle "It's important to not let your past define (vt. define, make clear) your future", the user can click on this subtitle. At this time, this subtitle is the target subtitle, and "define" in the target subtitle is the target word.

[0075] S1084. Obtain the preset vocabulary information and / or custom vocabulary information of the target word, and display the preset vocabulary information and / or the custom vocabulary information in the vocabulary control.

[0076] The preset vocabulary information of the target word specifically refers to the information of this word preset by the official. For example, for the word "define", its officially preset preset vocabulary information is "Key word in CET-4 and CET-6, Vt: define; make clear; stipulate. n. (Define) Name of a person; (Eng) Defarne; (Por) Defene". Then the preset vocabulary information of this word can be displayed in the vocabulary control. See Figure 4 , Figure 4 shows the schematic interface diagram of the video player provided by an embodiment of this application under the vocabulary control. AsFigure 4 As shown Figure 4 It shows the preset vocabulary information of the define.

[0077] There are many sources of preset vocabulary information. Therefore, obtaining the preset vocabulary information of the target vocabulary includes:

[0078] Obtaining the preset vocabulary information of the target vocabulary through a third-party dictionary interface; or

[0079] Obtaining the preset vocabulary information predefined for the target vocabulary.

[0080] Through the third-party dictionary interface, the preset vocabulary information of each word or phrase can be obtained by means of screen word picking; the administrator can also pre-enter the preset vocabulary information of some key words into the vocabulary library and obtain the preset vocabulary information of each target vocabulary from the vocabulary library. The key words can be high-frequency words in daily use, high-frequency words in language tests, slang in daily life, etc. In this application, there is no limitation on this.

[0081] In actual applications, the preset vocabulary information of the target vocabulary is sometimes inaccurate. For example, for some slang in daily life, some users will have a deeper understanding or knowledge when living locally. When watching a video, it is found that the preset vocabulary information is not very accurate; or other users also hope to give some content related to the target vocabulary, such as confusing words, synonyms, related words, etc., which cannot be given by the preset vocabulary information. Based on this, the corresponding custom vocabulary information of the target vocabulary can also be obtained. The custom vocabulary information is the vocabulary information related to the target vocabulary spontaneously marked by users, such as the usage of slang, correct interpretations, synonyms, confusing words, related words, etc. The preset vocabulary information and custom vocabulary information of the target vocabulary can be displayed in the vocabulary control. See Figure 5 , Figure 5 It shows the schematic diagram of the interface of the video player provided by another embodiment of the present application under the vocabulary control. As Figure 5 shown, in addition to the preset vocabulary information, the custom vocabulary information sent by user A and user B is also displayed in the vocabulary control, which is convenient for other users to collect the suggestions of different users in the vocabulary control, and can better learn and understand the interpretations and usages of the vocabulary, improving the user experience.

[0082] The source of the custom vocabulary information is usually the learning barrage sent by users, that is, users can display the custom vocabulary information of the target vocabulary to other users in the form of sending learning barrages. Based on this, the method further includes:

[0083] Receiving the learning barrage, where the learning barrage carries the custom vocabulary information of the target vocabulary.

[0084] A learning bullet comment is bullet comment information sent by a user, and custom word information of a target word is carried in the learning bullet comment. In practical applications, receiving a learning bullet comment includes:

[0085] Receiving a learning bullet comment sending instruction;

[0086] In response to the learning bullet comment sending instruction, displaying an annotation interface of the target word;

[0087] Collecting custom word information of the target word filled in by the user in the annotation interface.

[0088] A learning bullet comment is different from a non-learning bullet comment and needs to have a certain degree of academicity. Therefore, corresponding formats need to be specified for learning bullet comments. The user can click the send bullet comment button in the learning mode to send a learning bullet comment sending instruction. The video player receives the learning bullet comment sending instruction and, in response to the learning bullet comment sending instruction, displays an annotation interface of the target word for the user. See Figure 6 , Figure 6 shows a schematic diagram of an annotation interface for a video player to send a learning bullet comment provided by an embodiment of the present application. As Figure 6 shown, after clicking the send bullet comment button in the learning mode, the annotation interface of the target word can be entered. The user can fill in the custom word information of the target word in the annotation interface and click the submit edit button to send the learning bullet comment. The editor can then receive the learning bullet comment.

[0089] Both learning bullet comments and non-learning bullet comments can be normally displayed in the target video. Different from non-learning bullet comments, the sending time point of a learning bullet comment needs to be related to the target subtitle, that is, the learning bullet comment needs to be displayed in the corresponding time interval of the target subtitle in the target video to facilitate the user to learn the corresponding word information based on the target subtitle. Based on this, the method further includes:

[0090] Determining the playing time interval of the target subtitle in the target video;

[0091] Determining a bullet comment time point in the playing time interval;

[0092] Generating a learning bullet comment of the target word according to the target word and the custom word information of the target word;

[0093] Displaying the learning bullet comment of the target word at the bullet comment time point.

[0094] After submitting the edit on the vocabulary annotation interface, it is necessary to determine the playing time interval of the target subtitle corresponding to the target vocabulary in the target video, that is, to determine in which time interval the target vocabulary is displayed in the target video, and then randomly select a bullet screen time point for learning bullet screens from the playing time interval as the display time point of the learning bullet screen. Then, generate the learning bullet screen corresponding to the target vocabulary with the target vocabulary and the corresponding custom vocabulary information, and display the learning bullet screen corresponding to the target vocabulary when the target video plays to this bullet screen time point.

[0095] The learning bullet screens and non-learning bullet screens can be saved together in the bullet screen pool of the target video and displayed together. To show the difference, different display forms can be used to distinguish the learning bullet screens from the non-learning bullet screens. At the same time, to improve the learning efficiency of users, a specific learning bullet screen switch can also be provided to only display the learning bullet screens separately and block the non-learning bullet screens, enhancing the user experience. In another specific implementation manner provided by this application, in the learning mode, only the learning bullet screens can be displayed to improve the learning efficiency of users. The above is only a schematic description of the display methods of the learning bullet screens and non-learning bullet screens in this application. In actual applications, there may be various display forms for distinguishing the learning bullet screens and non-learning bullet screens, which are not limited in this application.

[0096] In actual applications, when users cannot quickly understand or remember a certain vocabulary or phrase, in order not to affect the progress, the vocabulary or phrase can also be added to the learning notes for subsequent re-study. Based on this, the method further includes:

[0097] Receiving a note addition instruction for the target vocabulary;

[0098] In response to the note addition instruction, adding the target vocabulary to the learning notebook.

[0099] Receiving a note addition instruction issued by the user for the target vocabulary, and in response to this note addition instruction, adding the target vocabulary to the learning notebook. In the learning notebook, the corresponding preset vocabulary information and custom vocabulary information can be associated according to the target vocabulary. After the user finishes watching the target video, the vocabulary in the target video can be re-studied from the learning notebook, enhancing the user experience.

[0100] The learning assistance method based on video provided by the embodiments of the present application is applied to a video player, and includes receiving a learning instruction for the target video when playing the target video; in response to the learning instruction, playing the target video in the first display area of the video player, and displaying a learning toolbar corresponding to the target video in the second display area of the video player; displaying learning content corresponding to the target video in the learning toolbar, where the learning content is related to the subtitle information corresponding to the target video. According to the user's demand for learning a language by watching videos, the playing scenario is combined with the learning scenario, and the learning content corresponding to the watched video is displayed in the learning toolbar, which can help the user watch the video content and learn more easily and conveniently at the same time, playing the role of combining education with entertainment.

[0101] The following combines the attached Figure 7 , taking the application of the learning assistance method based on video provided by the present application in Video L as an example, to further illustrate the learning assistance method based on video. Among them, Figure 7 FIG. shows a processing flowchart of a learning assistance method based on video applied to Video L provided by an embodiment of the present application, which specifically includes the following steps:

[0102] Step 702: Play Video L in the video player.

[0103] In a specific embodiment provided by the present application, the user watches Video L through the video player.

[0104] Step 704: Determine whether Video L supports the learning mode. If not, execute step 706; if so, execute step 708.

[0105] In a specific embodiment provided by the present application, following the above example, the video player determines whether Video L has a learning mode identifier, that is, determines whether Video L supports the learning mode. If not, execute step 706; if so, execute step 708.

[0106] Step 706: Hide the learning mode control.

[0107] In a specific embodiment provided by the present application, following the above example, if Video L does not support the learning mode, hide the learning mode control.

[0108] Step 708: Display the learning mode control.

[0109] In a specific embodiment provided by the present application, following the above example, if Video L supports the learning mode, display the learning mode control to provide an entry for the learning mode.

[0110] Step 710: Receive a learning instruction for Video L.

[0111] In a specific embodiment provided by the present application, following the previous example, the user clicks on the displayed learning mode control to issue a learning instruction for Video L, and the video player receives this learning instruction.

[0112] Step 712: Play Video L in the first display area of the video player, and display the learning toolbar corresponding to Video L in the second display area of the video player.

[0113] In a specific embodiment provided by the present application, following the previous example, after receiving the learning instruction, play Video L in the first display area of the video player, display the learning toolbar in the second display area, and display the learning content of Video L in the learning toolbar.

[0114] Step 714: Display the subtitle information list of Video L in the subtitle control of the learning toolbar.

[0115] In a specific embodiment provided by the present application, following the previous example, there is a subtitle control in the learning toolbar, and there is a subtitle information list of Video L in the subtitle control. The subtitle information slides as Video L plays. The user can control the playback of Video L by sliding the subtitle information list up and down, and can quickly locate the actual playback point corresponding to a specific subtitle, facilitating the user to repeatedly watch a certain video clip.

[0116] Step 716: Receive a vocabulary learning instruction for the subtitle information list.

[0117] In a specific embodiment provided by the present application, following the previous example, it is also possible to receive a vocabulary learning instruction issued by the user for the subtitle information list to further learn the usage of specific words or phrases in the subtitle.

[0118] Step 718: Determine the target vocabulary of the target subtitle.

[0119] In a specific embodiment provided by the present application, following the previous example, the specific subtitle pointed to by the vocabulary learning instruction is the target subtitle, and further determine the target vocabulary in the target subtitle.

[0120] Step 720: Obtain the preset vocabulary information and custom vocabulary information of the target vocabulary, and display the preset vocabulary information and custom vocabulary information in the vocabulary control of the learning toolbar.

[0121] In a specific embodiment provided by the present application, following the previous example, obtain the preset vocabulary information and custom vocabulary information of the target vocabulary, and display the preset vocabulary information and custom vocabulary information of the target vocabulary in the vocabulary control of the learning toolbar, facilitating the user to more deeply learn the relevant learning content of the target vocabulary. Improve the user experience.

[0122] Step 722: Receive a learning barrage sending instruction.

[0123] In a specific embodiment provided by the present application, following the above example, when the user has their own understanding and ideas about the target vocabulary, they can issue a learning barrage sending instruction, and the video player receives this learning barrage sending instruction.

[0124] Step 724: Display an annotation interface for the target vocabulary in response to the learning barrage sending instruction.

[0125] In a specific embodiment provided by the present application, following the above example, an annotation interface corresponding to the target vocabulary is displayed in response to the learning barrage sending instruction, facilitating the user to fill in relevant content about the target vocabulary on the annotation interface.

[0126] Step 726: Collect the custom vocabulary information filled in by the user for the target vocabulary in the annotation interface and send it to the server.

[0127] In a specific embodiment provided by the present application, following the above example, the information filled in by the mobile phone user in the annotation interface is used to generate custom vocabulary information for the target vocabulary, and this custom vocabulary information is sent to the server. Different users can co - build the same target vocabulary, complete more content, and form a more perfect database, which can effectively help subsequent users further understand the relevant content of the target vocabulary.

[0128] Step 728: Receive a note - adding instruction for the target vocabulary.

[0129] In a specific embodiment provided by the present application, following the above example, when the user hopes to add the target vocabulary to their learning notes, they issue a note - adding instruction for the target vocabulary, and the video editor receives this note - adding instruction.

[0130] Step 730: Add the target vocabulary to the learning notebook in response to the note - adding instruction.

[0131] In a specific embodiment provided by the present application, following the above example, according to this note - adding instruction, the target vocabulary is added to the user's learning notebook, facilitating the user to repeat learning this target vocabulary during subsequent learning processes and enhancing the learning experience.

[0132] The learning assistance method based on video provided by the embodiments of the present application is applied to a video player, and includes receiving a learning instruction for the target video when playing the target video; in response to the learning instruction, playing the target video in the first display area of the video player, and displaying a learning toolbar corresponding to the target video in the second display area of the video player; and displaying learning content corresponding to the target video in the learning toolbar, where the learning content is related to the subtitle information corresponding to the target video. According to the user's demand for learning a language by watching videos, the playing scenario is combined with the learning scenario, and the learning content corresponding to the watched video is displayed in the learning toolbar, which can help the user watch the video content and learn more easily and conveniently, playing the role of combining education with entertainment.

[0133] Corresponding to the above embodiments of the learning assistance method based on video, the present application also provides an embodiment of a learning assistance device based on video. Figure 8 The structural schematic diagram of a learning assistance device based on video provided by an embodiment of the present application is shown. As Figure 8 shown, the device includes:

[0134] A receiving module 802, configured to receive a learning instruction for the target video when playing the target video;

[0135] A display module 804, configured to play the target video in the first display area of the video player and display a learning toolbar corresponding to the target video in the second display area of the video player in response to the learning instruction;

[0136] A display module 806, configured to display learning content corresponding to the target video in the learning toolbar, where the learning content is related to the subtitle information corresponding to the target video.

[0137] Optionally, the learning toolbar includes a subtitle control;

[0138] The display module 806 is further configured to:

[0139] Display a subtitle information list of the target video in the subtitle control, where the subtitle information list displays the subtitle information of the target video.

[0140] The display module 806 is further configured to:

[0141] Obtain a subtitle information list preset for the target video; or

[0142] Obtain the audio data of the target video and identify the audio data to generate a subtitle information list.

[0143] Optionally, the device further includes:

[0144] A subtitle dragging instruction receiving module, configured to receive a subtitle dragging instruction for the subtitle information list;

[0145] A subtitle determining module, configured to determine the subtitle to be played based on the subtitle dragging instruction;

[0146] A playback module, configured to determine the dragging playback time point of the target video according to the subtitle to be played, and play the target video from the dragging playback time point.

[0147] Optionally, the learning toolbar includes a vocabulary control;

[0148] The device further includes:

[0149] A vocabulary determining module, configured to determine a target subtitle and determine the target vocabulary of the target subtitle;

[0150] A vocabulary information obtaining module, configured to obtain the preset vocabulary information and / or custom vocabulary information of the target vocabulary, and display the preset vocabulary information and / or the custom vocabulary information in the vocabulary control.

[0151] Optionally, the vocabulary determining module is further configured to:

[0152] Receive a vocabulary learning instruction for the subtitle information list of the target video, and determine the target subtitle according to the vocabulary learning instruction; or

[0153] Obtain the target subtitle of the current video frame of the target video.

[0154] Optionally, the vocabulary information obtaining module is further configured to:

[0155] Obtain the preset vocabulary information of the target vocabulary through a third-party dictionary interface; or

[0156] Obtain the preset vocabulary information predefined for the target vocabulary.

[0157] Optionally, the device further includes:

[0158] A learning bullet screen receiving module, configured to receive learning bullet screens, where the learning bullet screens carry the custom vocabulary information of the target vocabulary.

[0159] Optionally, the device further includes:

[0160] A playback time interval determining module, configured to determine the playback time interval of the target subtitle in the target video;

[0161] A bullet screen time point determination module, configured to determine bullet screen time points in the playing time interval;

[0162] A learning bullet screen generation module, configured to generate learning bullet screens for the target vocabulary according to the target vocabulary and the custom vocabulary information of the target vocabulary;

[0163] A learning bullet screen display module, configured to display the learning bullet screens of the target vocabulary at the bullet screen time points.

[0164] Optionally, the learning bullet screen receiving module is further configured to:

[0165] Receive a learning bullet screen sending instruction;

[0166] In response to the learning bullet screen sending instruction, display an annotation interface for the target vocabulary;

[0167] Collect the custom vocabulary information for the target vocabulary filled in by the user in the annotation interface.

[0168] Optionally, the device further includes:

[0169] A note addition instruction receiving module, configured to receive a note addition instruction for a target vocabulary;

[0170] A vocabulary addition module, configured to add the target vocabulary to a learning notebook in response to the note addition instruction.

[0171] Optionally, the receiving module 802 is further configured to:

[0172] When the target video supports the learning mode, display a learning mode control;

[0173] Receive a learning instruction issued by the user for the learning mode control.

[0174] The video-based learning assistance device provided by the embodiments of the present application is applied to a video player and includes, when playing a target video, receiving a learning instruction for the target video; in response to the learning instruction, playing the target video in a first display area of the video player, and displaying a learning toolbar corresponding to the target video in a second display area of the video player; displaying learning content corresponding to the target video in the learning toolbar, where the learning content is related to the subtitle information corresponding to the target video. According to the user's appeal to learn a language by watching videos, the playing scene is combined with the learning scene, and the learning content corresponding to the watched video is displayed in the learning toolbar, which can help the user watch the video content while making it easier and more convenient to learn, playing the role of combining education with entertainment.

[0175] The above is a schematic solution of a video-based learning assistance device according to this embodiment. It should be noted that the technical solution of the video-based learning assistance device and the technical solution of the above-mentioned video-based learning assistance method belong to the same concept. For the details not described in the technical solution of the video-based learning assistance device, reference can be made to the description of the technical solution of the above-mentioned video-based learning assistance method.

[0176] Figure 9 FIG. shows a block diagram of a computing device 900 according to an embodiment of the present application. The components of the computing device 900 include, but are not limited to, a memory 910 and a processor 920. The processor 920 is connected to the memory 910 through a bus 930, and a database 950 is used to store data.

[0177] The computing device 900 further includes an access device 940, and the access device 940 enables the computing device 900 to communicate via one or more networks 960. Examples of these networks include the Public Switched Telephone Network (PSTN), Local Area Network (LAN), Wide Area Network (WAN), Personal Area Network (PAN), or a combination of communication networks such as the Internet. The access device 940 may include one or more of any type of wired or wireless network interfaces (e.g., Network Interface Card (NIC)), such as IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, Worldwide Interoperability for Microwave Access (Wi-MAX) interface, Ethernet interface, Universal Serial Bus (USB) interface, cellular network interface, Bluetooth interface, Near Field Communication (NFC) interface, and so on.

[0178] In an embodiment of the present application, the above components of the computing device 900 and Figure 9 other components not shown in Figure 9 may also be connected to each other, for example, through a bus. It should be understood that

[0179] the block diagram of the computing device shown is only for illustrative purposes and is not a limitation on the scope of the present application. Those skilled in the art can add or replace other components as needed.

[0180] Among them, when the processor 920 executes the computer instructions, it implements the steps of the above-mentioned video-based learning assistance method.

[0181] The above is a schematic solution of a computing device according to this embodiment. It should be noted that the technical solution of this computing device and the technical solution of the above video-based learning assistance method belong to the same concept. For the details not described in detail in the technical solution of the computing device, reference can be made to the description of the technical solution of the above video-based learning assistance method.

[0182] An embodiment of the present application further provides a computer-readable storage medium storing computer instructions, which, when executed by a processor, implement the steps of the video-based learning assistance method as described above.

[0183] The above is a schematic solution of a computer-readable storage medium according to this embodiment. It should be noted that the technical solution of this storage medium and the technical solution of the above video-based learning assistance method belong to the same concept. For the details not described in detail in the technical solution of the storage medium, reference can be made to the description of the technical solution of the above video-based learning assistance method.

[0184] The above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve the desired result. Additionally, the processes depicted in the figures do not necessarily require the specific order or sequential order shown to achieve the desired result. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0185] The computer instructions include computer program code, which may be in the form of source code, object code, executable files, or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the content included in the computer-readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electrical carrier signals and telecommunication signals.

[0186] It should be noted that, for the foregoing method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations. However, those skilled in the art should be aware that this application is not limited by the described action sequence, because according to this application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0187] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0188] The preferred embodiments of the present application disclosed above are only used to help explain the present application. The alternative embodiments do not describe all the details in detail, nor do they limit the invention to the specific embodiments described. Obviously, many modifications and variations can be made according to the content of the present application. The present application selects and specifically describes these embodiments in order to better explain the principle and practical application of the present application, so that those skilled in the art can well understand and utilize the present application. The present application is only limited by the claims and their full scope and equivalents.

Claims

1. A video-based learning assistance method, characterized in that, Applied to a video player, including: When playing a target video, receiving a learning instruction for the target video; In response to the learning instruction, playing the target video in a first display area of the video player and displaying a learning toolbar corresponding to the target video in a second display area of the video player; Displaying learning content corresponding to the target video in the learning toolbar, where the learning content is related to subtitle information corresponding to the target video; Wherein, the learning toolbar includes a vocabulary control; Displaying learning content corresponding to the target video in the learning toolbar includes: Determining a target subtitle and determining target vocabulary of the target subtitle; Obtaining preset vocabulary information and custom vocabulary information of the target vocabulary and displaying the preset vocabulary information and the custom vocabulary information in the vocabulary control; the custom vocabulary information includes vocabulary information marked by the user related to the target vocabulary.

2. The video-based learning assistance method according to claim 1, wherein The learning toolbar includes a subtitle control; Displaying learning content corresponding to the target video in the learning toolbar includes: Displaying a list of subtitle information of the target video in the subtitle control, where the list of subtitle information displays the subtitle information of the target video.

3. The video-based learning assistance method according to claim 2, wherein Before displaying the list of subtitle information of the target video in the subtitle control, further including: Obtaining a list of subtitle information preset for the target video; or Obtaining audio data of the target video and identifying the audio data to generate a list of subtitle information.

4. The video-based learning assistance method according to claim 2, wherein, The method further includes: Receiving a subtitle dragging instruction for the list of subtitle information; Determining a subtitle to be played based on the subtitle dragging instruction; Determining a dragging playback time point of the target video according to the subtitle to be played and playing the target video from the dragging playback time point.

5. The video-based learning assistance method according to claim 1, wherein Determining a target subtitle includes: Receiving a vocabulary learning instruction for the list of subtitle information of the target video and determining a target subtitle according to the vocabulary learning instruction; or Obtaining a target subtitle of the current video frame of the target video.

6. The video-based learning assistance method according to claim 4, wherein Obtaining preset vocabulary information of the target vocabulary includes: Obtaining the preset vocabulary information of the target vocabulary through a third-party dictionary interface; or Obtaining preset vocabulary information predefined for the target vocabulary.

7. The video-based learning assistance method according to claim 1, wherein The method further includes: Receiving a learning barrage, where the learning barrage carries custom vocabulary information of a target vocabulary.

8. The video-based learning assistance method according to claim 7, wherein The method further includes: Determining a playback time interval of the target subtitle in the target video; Determining a barrage time point in the playback time interval; Generating a learning barrage of the target vocabulary according to the target vocabulary and the custom vocabulary information of the target vocabulary; Displaying the learning barrage of the target vocabulary at the barrage time point.

9. The video-based learning assistance method according to claim 7, wherein Receiving a learning barrage includes: Receiving a learning barrage sending instruction; Responding to the learning barrage sending instruction to display an annotation interface for the target vocabulary; Collecting custom vocabulary information filled in by the user for the target vocabulary in the annotation interface.

10. The video-based learning assistance method according to claim 4, characterized in that, The method further includes: Receiving a note adding instruction for a target vocabulary; Responding to the note adding instruction and adding the target vocabulary to a learning notebook.

11. The video-based learning assistance method according to any one of claims 1 to 10, characterized in that Receive a learning instruction for the target video, including: When the target video supports the learning mode, display learning mode controls; Receive the learning instruction issued by the user for the learning mode controls.

12. A video-based learning assistance device, characterized in that, Applied to a video player, including: A receiving module, configured to receive a learning instruction for the target video when playing the target video; A display module, configured to, in response to the learning instruction, play the target video in a first display area of the video player and display a learning toolbar corresponding to the target video in a second display area of the video player; A showing module, configured to show learning content corresponding to the target video in the learning toolbar, where the learning content is related to subtitle information corresponding to the target video; Wherein, the learning toolbar includes a vocabulary control; Showing the learning content corresponding to the target video in the learning toolbar includes: Determine the target subtitle and determine the target vocabulary of the target subtitle; Obtain preset vocabulary information and custom vocabulary information of the target vocabulary, and display the preset vocabulary information and the custom vocabulary information in the vocabulary control; the custom vocabulary information includes vocabulary information marked by the user related to the target vocabulary.

13. A computing device, comprising a memory, a processor, and computer instructions stored on the memory and executable on the processor, characterized in that, When the processor executes the computer instruction, the steps of the method according to any one of claims 1 to 11 are implemented.

14. A computer-readable storage medium storing computer instructions, characterized in that, When the computer instruction is executed by the processor, the steps of the method according to any one of claims 1 to 11 are implemented.

Images