Online course sending feedback content editing system

Abstract

The system described in the document consists of a student terminal, a lecturer terminal and a content server which are connected through a wide area network. The content server contains curriculum content multimedia which is downloaded and displayed on a digital display of the student terminal. During a course, a server may receive and store upload data from student terminals, which may include images or videos. The upload data may then be used for a lecturer terminal. The lecturer terminal has a multimedia editing user interface that displays the upload data and allows a lecturer to add tag data at specific XY coordinates on the screen. The student terminal may display the upload data with the added indicia. The system is designed to regenerate the enhanced video in a native format to allow the student terminal to download and display the enhanced video without the need for additional plug-ins or software.

Description

Technical Field

[0001] The present invention generally relates to a system for multimedia editing for sending feedback in an online course. Background Art

[0002] Multimedia-based educational systems are increasingly used in distance learning scenarios, where teachers and students interact virtually using their respective electronic devices.

[0003] For example, a teacher may use a device with a camera to record a lecture video, and then upload the lecture video to cloud storage for retrieval and display on multiple student electronic devices (such as mobile devices, tablets, personal computing devices, etc.).

[0004] CN 105844987 B (Shenzhen Kerun Video Technology Co., Ltd.) disclosed a system for enhancing multimedia teaching by incorporating interactive features on October 8, 2019. The system enables students to actively participate in educational content, thereby creating a more dynamic and effective learning environment.

[0005] The present invention seeks to provide a way to overcome or substantially improve at least some of the deficiencies of the prior art, or at least provide an alternative. Summary of the invention

[0006] A system is provided herein, comprising a student terminal authenticated with a student profile, a lecturer terminal authenticated with a lecturer profile, and a content server operatively communicating over a wide area network, each comprising a processor that retrieves, interprets, and executes computer program code instructions from a memory device.

[0007] The content server includes a series of course content multimedia, which are downloaded by the student terminals and displayed on their digital displays.

[0008] In at least one stage of the series, the server is configured to receive and store uploaded data from the student terminal, the uploaded data including at least one of image and video data.

[0009] The server is configured to provide the uploaded data to the lecturer terminal.

[0010] The instructor terminal is configured to display a multimedia editing user interface that displays the uploaded data and includes on-screen controls for augmenting the uploaded data with markup data at associated XY coordinates.

[0011] The student terminal is configured to display at least a portion of the uploaded data enhanced with the markup data.

[0012] The system is configured to regenerate the enhanced video in a native format using the marker data, the marker data being encoded in the enhanced video.

[0013] In this way, the regenerated enhanced video file can be downloaded and displayed by the student terminal in a native format without the need for additional plug-ins, etc. to display the tagged data. Even standard web browsers with traditional video player format capabilities can natively display the enhanced video native format, thereby increasing the types of devices that can interact with the server. For example, the system can be configured to generate enhanced video data in MP4 format.

[0014] In an embodiment, the system may be configured to regenerate the enhanced video in the original format in which the enhanced video was uploaded. According to this embodiment, the system will detect the format of the video uploaded from the student terminal to detect its format (such as, MP4 format) so that the enhanced video can be generated in the same format.

[0015] The system can be configured to detect the performance of the student terminal and generate enhanced video data accordingly. For example, in the case where the user interface of the student terminal is presented by a web browser application, the system can be configured to detect its performance. These performances may include video format performance, screen resolution and / or aspect ratio.

[0016] The system can be configured to generate more than one enhanced video data file in different formats. As such, the system can be configured to generate an enhanced video data file on the fly upon a request from a student terminal, or to generate more than one enhanced video data file prior to a request from a student terminal for storage, so that the system can determine the user terminal capabilities on the fly upon a request from a student terminal for enhanced video data, and retrieve the appropriate enhanced video data file from storage accordingly.

[0017] The system may be configured to generate more than one enhanced video data file having different screen resolutions or aspect ratios, including based on those capabilities detected from client terminals registered with the server.

[0018] The system may be configured to overlay the position of the marker data according to the aspect ratio of the user terminal screen or adjust the size of the multimedia data according to the resolution of the user terminal screen.

[0019] The uploaded data may include video data, and wherein the user interface may be configured to allow snapshot image data to be taken at a timestamp location of the video data, and wherein the user interface may be configured to enhance the snapshot image data.

[0020] The on-screen control may be a drawing control configured to place a drawing mark at the XY-related coordinates of the uploaded data. The on-screen control may be a drawing control configured to place a shape mark at the XY-related coordinates of the uploaded data.

[0021] The on-screen control may be configured to initiate audio recording using a microphone of the lecturer terminal, and wherein the marking data may be the recorded audio data.

[0022] The user interface may include a position control for controlling at least one of zooming and panning a display of at least one of the image data and the video data of the uploaded data.

[0023] The upload data may include image data, and wherein at least one of the lecturer terminal and the content server may be configured to generate enhanced image data with the tag data, wherein the tag data is encoded in the enhanced image data.

[0024] In an embodiment, the server may be configured to store the tag data separately from the uploaded data.

[0025] The student terminal may be configured to display the uploaded data enhanced with the tagged data in real time.

[0026] In an embodiment, the student terminal may include a client-side plug-in that enhances the uploaded data in real time. The student terminal only obtains the marked data from the server and enhances the locally stored copy of the uploaded data.

[0027] The upload data may include video data, and wherein the marking data may include timing data, and wherein the student terminal may be configured to enhance the video data with the marking data at a location according to the timing data.

[0028] The student terminals can be configured to jump to the video position according to the timing data.

[0029] Other aspects of the invention are also disclosed. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Although any other forms may fall within the scope of the invention, preferred embodiments of the present disclosure will now be described by way of example only with reference to the accompanying drawings, in which:

[0031] Figure 1 An online course feedback content editing system 100 according to an embodiment is shown;

[0032] Figure 2 An exemplary process of a system according to an embodiment is shown;

[0033] Figure 3 shows an exemplary graphical user interface displayed by a lecturer terminal of the system according to an embodiment; and

[0034] Figure 4 An exemplary encoding of tag data is shown. DETAILED DESCRIPTION

[0035] Figure 1 The online course delivery feedback content editing system 100 according to the embodiment is shown. The system 100 comprises: a student terminal 101 authenticated with a student profile and an instructor terminal 101 authenticated with an instructor profile.

[0036] The system 100 further includes a content server 102 .

[0037] The terminal 101 is in operable communication with a content server 102 via a wide area network 103 such as the Internet.

[0038] Terminal 101 and server 102 include a processor 104 for processing digital data. Processor 104 retrieves, decodes and executes computer program code instructions from a memory device via system bus 105 to implement the functions described herein.

[0039] The computer program code instructions may be logically divided into a plurality of computer program code instruction controllers 106 .

[0040] In the illustrated embodiment, terminal 101 may execute browser application 107 which may control digital display 108 to display user interface 109. Browser 107 may include plug-in 110 for enhancing image and / or video content with feedback content data in real time, as will be described in further detail below.

[0041] The memory device of the terminal may store data 111 including captured image or video data 112. The image and / or video data may be captured using a camera device 113 and / or a microphone 114.

[0042] The content server 102 may store image and video data 112 received from the terminal 101. In addition, the content server 102 may store course content multimedia 113. The content server 102 and the terminal 101 may include an I / O interface 114 for sending and receiving data via the wide area network 103.

[0043] Figure 2 An exemplary process 115 of the system 100 is shown and will be described with reference to the system being configured to deliver online course content related to beauty treatments, although the system 100 is not necessarily limited to this particular application.

[0044] Process 105 includes user registration at step 116, where one or more students and one or more instructors will register with system 100 and provide relevant profile data. Content server 102 creates the associated user profiles.

[0045] At step 117, the user may log in, such that the system comprises at least one terminal 101 authenticated with a student profile and at least one lecturer terminal 101 authenticated with a lecturer profile.

[0046] As described above, server 102 includes a series of multimedia course content 113. At step 118, the multimedia course content 113 is displayed on digital display 108 of student terminal 101. In an embodiment, multimedia course content 113 includes a series of web pages, which are displayed successively by web browser 107 when the student is studying the course.

[0047] These web pages may include instructional text, images and / or video data.

[0048] In step 120, the content server is configured to receive and store uploaded data from the student terminal 101. The uploaded data may include at least one of image and / or video data.

[0049] For example, the course content instructions may instruct the student to upload an image or video of the student's progress. For example, in the case of a beauty therapy course involving nail cosmetics, the student may be instructed to upload an image or video of the student's work, which may be an image or video of nails prepared by the student. In an embodiment, the course content instructions may include an exemplary image to be uploaded.

[0050] For example, the first stage of the course content may be to apply glue to secure the nail extensions. At this stage of the course content 113, the course content 113 may instruct the student to upload an image or video showing the student's progress in the application of the nail extensions.

[0051] At step 119, the student may use the student terminal 101 to capture images and video data using the camera 113 and / or microphone 114 of the terminal 101. In the case where the terminal 101 is a computer terminal, the camera 121 may take the form of an attached web camera. Alternatively, in the case where the terminal 101 takes the form of a mobile communication device, the camera 121 may be an image sensor built into it.

[0052] At step 122, the content server 102 may be configured to store and queue the uploaded content received from the plurality of students. Thus, at step 122, the instructor may browse the uploaded content.

[0053] The lecturer may select one of the uploaded data, causing the content server 102 to provide the uploaded data to the terminal 101 for display using its digital display 108 .

[0054] In step 123, the lecturer terminal 101 may be configured to mark the uploaded content 123. Specifically, the lecturer terminal 101 may be configured to display Figure 3 The multimedia editing user interface 127 shown in .

[0055] The interface 127 may include a display 128 for the uploaded content. In the case where the uploaded content includes image data, the display 128 will display its digital image. When the uploaded content is video data, the display 128 will be in the form of a video player for displaying the content. In this regard, the video player may include video controls 129, which include pause 130, fast forward 131, and rewind controls 132.

[0056] In an embodiment, the video control 129 includes a screen capture control 133, wherein snapshot image data can be captured from a timed position of the video data. Thereafter, the snapshot image data can be marked.

[0057] Interface 127 may include position controls including zoom control 134 and pan control 135 .

[0058] In addition, the interface 127 may include a marking control 137. The marking control 137 may include a drawing control for making a drawing mark with reference to the XY coordinates of the display 128. The marking control 137 may include a drawing control for placing a shape with reference to the XY coordinates of the display 128. The marking control may include a control for placing text with reference to the XY of the display. In addition, the marking control may allow an area of ​​the display 128 to be highlighted.

[0059] The interface 127 may include a text field input 138 in which associated free text may be entered.

[0060] The interface 127 may further include an audio recording control 139 , wherein audio may be recorded using the microphone 114 of the student terminal 101 .

[0061] The interface 127 may include a save control 140 to save the provided markup.

[0062] For example, the instructor can use the position controls 134, 135 to pan and zoom to a particular nail, then draw an arrow with reference to its on-screen XY display coordinates, and include text to the effect that too much glue has been applied to the nail. In addition, the instructor uses the audio controls 139 to record audio explaining that too much glue has been applied.

[0063] At step 124 , content server 101 is configured to receive and store tag data 124 .

[0064] At step 125 , the student terminal 101 downloads the marked data and at step 126 displays the uploaded data enhanced with the marked data 141 .

[0065] Figure 4 An embodiment of the marked data 141 is shown, which is divided into a plurality of channels 144 and has timing associated with the video data 142 of the uploaded data. In the embodiment shown, the channels 144 may include channel 2, which includes audio data 143 recorded by the lecturer terminal 101.

[0066] Channels 144 may further include channel 3 related to the display of text on the screen. A channel may include: a start time and an end time, and the text to be displayed, along with any effects thereof, such as font, color, etc.

[0067] Channels 144 may further include channel 4 associated with the display of shapes on the screen. Similarly, the display of shapes on the screen may have a start time, an end time, and shape data describing the shape.

[0068] At least one of the lecturer terminal 101 and the server 102 may be configured to regenerate the enhanced video in a native video format using the tagged data (wherein the tagged data is encoded in the enhanced video) in order to improve compatibility with different types of student terminals 101 and avoid having to use custom software or plug-ins. Such video regeneration may be accomplished using commercially available or open source software.

[0069] For example, in the case where the uploaded data includes video data, at least one of the lecturer terminal 101 and the server 102 can generate a new enhanced video file in a native format, the new enhanced video file having the markup data encoded as the video data. In this way, the student terminal 101 can download and display the new enhanced video file in a native format without the need for an additional plug-in or the like to display the markup data.

[0070] In this way, the user interface 109 can be presented by a standard web browser with standardized video format capabilities without the need to install specialized software on the student terminal 101 .

[0071] In an embodiment, the system 100 may generate the new enhanced video file in MP4 format, which is one of the most popular video file formats due to its universal compatibility with multimedia players including web browsers.

[0072] In an embodiment, the system 100 can detect the capabilities of the student terminal 101. For example, where the user interface 109 is presented by a web browser application, the system 100 can use web browser capability detection (such as by inspecting the HTTP user-agent request header) to detect browser capabilities, including video format capabilities, screen resolution, and / or aspect ratio (such as portable or landscape orientation).

[0073] In this way, the system 100 can generate a new enhanced video file according to the browser performance. For example, if the browser detection detects that the student terminal 101 browser can play video files in MP4 format, the system can be configured to generate a new enhanced video file in MP4 format.

[0074] In an embodiment, multiple user terminals 101 with different capabilities can interface with the content server 102, wherein the system 100 generates multiple new enhanced video files in different formats. For example, the system 100 can generate a first video file in MP4 format and a second video file in MOV format, which are provided to the corresponding student terminals 101 according to the capabilities of the student terminals 101.

[0075] In an embodiment, the system 100 may be configured to regenerate into a new enhanced video file on the fly according to a request from the student terminal 101 .

[0076] However, in other embodiments, given that video file regeneration may take some time, the system 100 may generate these new enhanced video files in a different format before they are requested by the student terminal 101. As such, when a request for a video file is received, the system 100 may determine its video performance in substantially real time and retrieve the appropriate video file from the storage device 111.

[0077] In an embodiment, the system 100 may be configured to regenerate the enhanced video in the original format in which the enhanced video was uploaded. According to this embodiment, the system 100 will detect the format of the video uploaded from the student terminal 101 to detect its format (such as MP4 format), so that the enhanced video can be generated in the same format. In other words, if the student terminal 101 uploads a video in MP4 format, the system 100 will regenerate the enhanced video in the same MP4 format.

[0078] In further embodiments, the system 100 may generate video files for different screen resolutions and / or screen formats.

[0079] For example, for a portrait aspect ratio mobile phone device, the system 100 may generate a new enhanced video file at a resolution of 1080 x 1920, and for a landscape aspect ratio computer device, the system 100 may generate a new enhanced video file at a resolution of 1920 x 1080. Similarly, the system 100 may generate a new enhanced video file on the fly based on aspect and / or resolution upon request from the terminal 101, or alternatively, pre-generate a new enhanced video file in a different format to be retrieved from a storage device upon request.

[0080] In an embodiment, the system 100 may be configured to overlay the location of the markup data according to the capabilities of the user terminal 101 registered with the server 102. For example, for a horizontal aspect ratio, the text may be overlaid horizontally along the lower long side of the aspect ratio, while for a vertical aspect ratio, the text may be overlaid horizontally along the lower short side.

[0081] In an embodiment, the system 100 can be configured to adjust the size of the multimedia data according to the screen resolution. For example, for a low-resolution screen such as on a mobile device, the system 100 can be configured to increase the text size so that the text remains clearly visible on the small screen format.

[0082] In an embodiment, at least one of the lecturer terminal 101 and the server 102 is configured to regenerate the enhanced image data with the tag data, wherein the tag data is encoded in the enhanced image data. For example, when the uploaded data includes image data, at least one of the server 102 and the lecturer terminal 101 can generate a new image file, the new image file having the tag data encoded as the image data. As such, the new image file can be displayed locally by the browser 107 or other image viewer of the student terminal 101.

[0083] In an embodiment, server 102 is configured to store tagged data 101 separately from uploaded data.

[0084] According to this embodiment, the student terminal 101 may be configured to augment separately stored marked data 101 with uploaded data substantially in real time.

[0085] For example, the browser 107 may include a plug-in 110 having a video display control that displays the video data. Figure 4 At timed intervals indicated by the markup data 141 shown in , the display of the image data is enhanced with associated text, drawing shapes, audio, etc.

[0086] In an embodiment, the student terminal 101 is configured to download only the marked data 141 from the server 102 and to enhance a locally stored copy of the uploaded data, thereby reducing bandwidth requirements and associated delays when interacting with the server 102 .

[0087] In an embodiment, the plugin 110 may be configured to skip locations of the video file having feedback data.

[0088] For the purpose of explanation, the above description uses specific terms to provide a thorough understanding of the present invention. However, it is obvious to those skilled in the art that, in order to implement the present invention, specific details are not required. Therefore, the above description of specific embodiments of the present invention is presented for the purpose of illustration and description. They are not intended to be exhaustive or to limit the present invention to the precise form disclosed, because in view of the above teachings, many modifications and variations are obviously possible. The embodiments are selected and described in order to best explain the principles of the present invention and its practical application, so that other technical personnel in the field can best utilize the present invention and different embodiments with different modifications suitable for the intended specific use. The following claims and their equivalents are intended to limit the scope of the present invention.

Claims

1. A system comprising: A student terminal authenticated with a student profile, a lecturer terminal authenticated with a lecturer profile, and a content server operable to communicate via a wide area network, each comprising a processor for retrieving, interpreting, and executing computer program code instructions from a memory device, wherein: The content server includes a series of course content multimedia, which is downloaded by the student terminal and displayed on its digital display; In at least one stage of the series, the server is configured to receive and store uploaded data from the student terminal, the uploaded data including at least one of image and video data; The server is configured to provide the uploaded data to the lecturer terminal; the instructor terminal being configured to display a multimedia editing user interface displaying the uploaded data and including on-screen controls for augmenting the uploaded data with markup data at associated XY coordinates; and The student terminal is configured to display at least a portion of the uploaded data enhanced with the tag data, wherein the uploaded data includes video data, and wherein at least one of the lecturer terminal and the content server is configured to generate enhanced video data in a native video format using the tag data, wherein the tag data is encoded in the enhanced video data.

2. The system according to claim 1, wherein: The uploaded data includes video data, and wherein the user interface is configured to allow snapshot image data to be taken at a timestamp location of the video data, and wherein the user interface is configured to enhance the snapshot image data.

3. The system according to claim 1, wherein: The on-screen control is a drawing control configured to place drawing marks at XY-related coordinates of the uploaded data.

4. The system according to claim 1, wherein: The on-screen control is a drawing control configured to place a shape marker at the XY relative coordinates of the uploaded data.

5. The system according to claim 1, wherein: The on-screen control is configured to initiate audio recording using a microphone of the lecturer terminal, and wherein the markup data is recorded audio data.

6. The system according to claim 1, wherein: The user interface includes a position control for controlling at least one of zooming and panning of display of at least one of image data and video data of the uploaded data.

7. The system according to claim 1, wherein: The uploaded data includes image data, and wherein at least one of the lecturer terminal and the content server is configured to generate enhanced image data using the tag data, wherein the tag data is encoded in the enhanced image data.

8. The system according to claim 1, wherein: The server is configured to store the marking data separately from the uploaded data.

9. The system according to claim 8, wherein: The student terminal is configured to display the uploaded data enhanced with the marking data in real time.

10. The system according to claim 9, wherein: The student terminal includes a client-side plug-in, and the client-side plug-in enhances the uploaded data in real time.

11. The system according to claim 9, wherein: The student terminal only obtains the marked data from the server and enhances the locally stored copy of the uploaded data.

12. The system according to claim 8, wherein: The upload data comprises video data, and wherein the marking data comprises timing data, and wherein the student terminal is configured to enhance the video data with the marking data at a location according to the timing data.

13. The system according to claim 12, wherein: The student terminal is configured to jump to a video position according to the timing data.

14. The system of claim 1, wherein: The system is configured to generate the enhanced video data in MP4 format.

15. The system of claim 1, wherein: The system is configured to detect the capabilities of the student terminal and generate the enhanced video data accordingly.

16. The system of claim 1, wherein: The user interface of the student terminal is presented by a web browser application, and wherein the system is configured to detect the performance of the web browser application.

17. The system of claim 1, wherein: The capability includes at least one of video format capability, screen resolution, and aspect ratio.

18. The system of claim 1, wherein: The system is configured to generate more than one enhanced video data file in different formats.

19. The system of claim 18, wherein: The system is configured to generate the enhanced video data file on the fly based on a request from the student terminal.

20. The system of claim 18, wherein: The system is configured to generate the one or more enhanced video data files prior to a request for storage from the student terminal.

21. The system of claim 20, wherein: The system is configured to determine the user terminal performance in real time according to the request for the enhanced video data from the student terminal, and to obtain the appropriate enhanced video data file from the storage accordingly.

22. The system of claim 1, wherein: The system is configured to generate more than one enhanced video data file at different screen resolutions.

23. The system of claim 1, wherein: The system is configured to generate more than one enhanced video data file having different aspect ratios.

24. The system of claim 1, wherein: The system is configured to superimpose the position of the mark data according to the aspect ratio of the user terminal screen.

25. The system of claim 1, wherein: The system is configured to adjust the size of the multimedia data according to the screen resolution of the user terminal.

26. The system of claim 1, wherein: The system is configured to detect the format of the video data uploaded from the student terminal and generate the enhanced video in the same format.

Images