VIDEO PROCESSING METHOD, VIDEO PROCESSING APPARATUS AND COMPUTER-READABLE STORAGE MEDIUM

The video processing method and apparatus address the need for improved subtitle translations by crowdsourcing translations based on user language and video content preferences, enhancing translation quality and efficiency.

JP2024543970AActive Publication Date: 2024-11-26DOUYIN VISION CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024532477
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-11-30
Filing Date
2022-11-23
Publication Date
2024-11-26
Estimated Expiration
2042-11-23

AI Technical Summary

Technical Problem

The increasing user dependence on social networks necessitates improved quality of subtitle translations in videos, as existing systems only allow video posters to edit and post subtitle information, lacking effective mechanisms for enhancing translation quality.

Method used

A video processing method and apparatus that utilizes crowdsourcing by selecting translators based on user language and video content preferences, providing an interaction interface for translation, and displaying checked subtitle translations.

Benefits of technology

Enhances the quality and efficiency of subtitle translations by leveraging community translators, improving user experience on social networks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024543970000001_ABST
    Figure 2024543970000001_ABST
Patent Text Reader

Abstract

The present disclosure relates to a video processing method, a video processing device, and a computer-readable storage medium. The video processing method includes receiving original subtitles added to a video waiting to be translated by a creator of the video, selecting a translator based on the original subtitles and a language used by a user on a social network, providing the video waiting to be translated to the selected translator and providing an interaction interface in the video for the translator to translate the original subtitles in the video, receiving a subtitle translation returned by the translator from the interaction page, and displaying the subtitle translation that has passed the check in the video.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] [CROSS REFERENCE TO RELATED APPLICATIONS] This application claims priority from the Chinese application having application number 202111447076.5, filed on November 30, 2021, and entitled "Video Processing Method, Video Processing Device, and Computer-Readable Storage Medium," the disclosure of which is hereby incorporated by reference in its entirety into this application.

[0002] The present disclosure relates to the field of computer technology, and in particular to a video processing method, a video processing device, and a computer-readable storage medium. [Background technology]

[0003] Depending on user input, social networks may provide various services, such as photo or video sharing, messaging, etc., to facilitate social interaction among users.

[0004] Through interaction with a social network, a user can upload digital media to the system for others to view. Digital media may include images, video, audio, text, etc. For example, a user can post a video that he or she creates to a social network. Other users on the social network can interact with the video creator by viewing, liking, commenting, etc.

[0005] As users become more and more dependent on social networks, their social network experience requirements are also increasing, especially the quality of subtitle translations in videos. Summary of the Invention [Means for solving the problem]

[0006] According to some embodiments of the present disclosure, there is provided a video processing method, the method comprising: receiving original subtitles added to the video waiting to be translated by the creator of the video; Selecting a translator based on the original subtitle text and the language used by the user on the social network; providing a selected translator with a video to be translated and providing an interaction interface in the video for the translator to translate original subtitles in the video; receiving a subtitle translation returned by a translator from the interaction page; and displaying the successfully verified subtitle translation on the video.

[0007] According to some further embodiments of the present disclosure, there is provided a video processing device, the device comprising: receiving original subtitles added to the video waiting to be translated by the creator of the video; Selecting a translator based on the original subtitle text and the language used by the user on the social network; providing a selected translator with a video to be translated and providing an interaction interface in the video for the translator to translate original subtitles in the video; receiving a subtitle translation returned by a translator from the interaction page; a processor configured as and a display configured to display the successfully checked subtitle translation over the video.

[0008] According to still further embodiments of the present disclosure, there is provided a video processing device, the device comprising: Memory, and a processor coupled to the memory, the processor configured to perform one or more steps of the video processing method of any one of the embodiments described in the present disclosure based on instructions stored in the memory.

[0009] According to further some embodiments of the present disclosure, a computer-readable storage medium having a computer program stored thereon is provided, which, when executed by a processor, performs one or more steps of a video processing method according to any one of the embodiments described in the present disclosure.

[0010] This Summary is provided to introduce concepts in a simplified form that are described in detail later in the Detailed Description section. This Summary is not intended to identify key features or necessary features of the proposed technical solution, nor is it intended to limit the scope of the proposed technical solution.

[0011] Other features, aspects and advantages of the present disclosure will become more apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the drawings. [Brief description of the drawings]

[0012] The following describes preferred embodiments of the present disclosure with reference to the drawings. The drawings described herein are for providing further understanding of the present disclosure, and each drawing, together with the following specific description, is included in this specification, forms a part of the specification, and is used to interpret the present disclosure. It should be understood that the drawings in the following description relate only to some embodiments of the present disclosure, and are not intended to limit the present disclosure. In the drawings, [Figure 1] 1 shows a flowchart of a video processing method according to some embodiments of the present disclosure. [Figure 2A] 1 illustrates a schematic diagram of an interaction interface for subtitle management according to some embodiments of the present disclosure. [Figure 2B] 1 illustrates a schematic diagram of an interaction interface for subtitle management according to some embodiments of the present disclosure. [Figure 2C] 1 illustrates a schematic diagram of an interaction interface for subtitle management according to some embodiments of the present disclosure. [Figure 2D]1 illustrates a schematic diagram of an interaction interface for subtitle management according to some embodiments of the present disclosure. [Figure 2E] 1 illustrates a schematic diagram of an interaction interface for subtitle management according to some embodiments of the present disclosure. [Figure 2F] 1 illustrates a schematic diagram of an interaction interface for subtitle management according to some embodiments of the present disclosure. [Figure 2G] 1 illustrates a schematic diagram of an interaction interface for subtitle management according to some embodiments of the present disclosure. [Figure 3A] 1 illustrates a schematic diagram of an interaction interface for original subtitles in a translated video according to some embodiments of the present disclosure. [Figure 3B] 1 illustrates a schematic diagram of an interaction interface for original subtitles in a translated video according to some embodiments of the present disclosure. [Figure 3C] 1 illustrates a schematic diagram of an interaction interface for original subtitles in a translated video according to some embodiments of the present disclosure. [Figure 3D] 1 illustrates a schematic diagram of instructions for registering as a community translator according to some embodiments of the present disclosure. [Figure 4A] 1 illustrates a schematic diagram of a subtitle translation viewing page according to some embodiments of the present disclosure. [Figure 4B] 1 illustrates a schematic diagram of a translator information page according to some embodiments of the present disclosure. [Figure 5A] 1 illustrates a schematic diagram of a video playback page according to some embodiments of the present disclosure. [Figure 5B] 1 illustrates a schematic diagram of a subtitle language management page according to some embodiments of the present disclosure. [Figure 5C] 13 shows a schematic diagram of a subtitle translation viewing page according to some further embodiments of the present disclosure. [Figure 6A] 13 shows a schematic diagram of a video playback page according to some further embodiments of the present disclosure. [Figure 6B] 1 shows a schematic diagram of an interaction interface for a translator and a viewer to interact with each other according to some embodiments of the present disclosure. [Figure 7] 1 shows a block diagram of a video processing device according to some embodiments of the present disclosure. [Figure 8] 2 shows a block diagram of a video processing device according to some further embodiments of the present disclosure. [Figure 9] FIG. 1 illustrates a block diagram of an electronic device according to some embodiments of the present disclosure.

[0013] It should be understood that for ease of description, the sizes of the parts shown in the drawings are not necessarily drawn to scale. The same or similar reference numerals are used to represent the same or similar parts in each drawing. Therefore, once an item is defined in one drawing, it may not be further discussed in a subsequent drawing. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] The following clearly and completely describes the technical solutions in the embodiments of the present disclosure in conjunction with the drawings in the embodiments of the present disclosure, but obviously, the described embodiments are only some embodiments of the present disclosure, not all embodiments. The following description of the embodiments is also only explanatory in nature, and is never used as any restriction on the present disclosure and its application or use. It should be understood that the present disclosure can be realized in various forms, and should not be construed as being limited to the embodiments described herein.

[0015] It should be understood that the steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. Additionally, the method embodiments may include additional steps and / or omit performing steps as shown. The scope of the present disclosure is not limited in this respect. Unless specifically described otherwise, the relative arrangement of the components and steps, the formulas and numerical values ​​described in these examples should be interpreted as merely illustrative, and not limiting the scope of the present disclosure.

[0016] As used in this disclosure, the term "comprises" and variations thereof means open-ended term including at least the subsequent element / feature but not excluding other elements / features, i.e., "including, but not limited to." As used in this disclosure, the term "comprises" and variations thereof means open-ended term including at least the subsequent element / feature but not excluding other elements / features, i.e., "including, but not limited to." Thus, "comprises" and "comprises" are synonymous. The term "based on" means "based at least in part on."

[0017] The term "in one embodiment," "in some embodiments," or "in an embodiment" used throughout the specification means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. For example, the term "in one embodiment" refers to "at least one embodiment," the term "another embodiment" refers to "at least one other embodiment," and the term "in some embodiments" refers to "at least some embodiments." And, appearances of the phrases "in one embodiment," "in some embodiments," or "in an embodiment" in various locations throughout the specification are not necessarily all referring to the same embodiment, but may.

[0018] It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not intended to limit the order or mutual dependency of the functions performed by these devices, modules or units. Unless otherwise specified, the concepts of "first", "second", etc. are not intended to imply that the objects described in this manner must follow a given order in time, space, precedence, or in any other manner.

[0019] It should be noted that the modifications "a" and "a plurality" referred to in the present disclosure are intended to be general and not limiting, and as would be understood by one of ordinary skill in the art, should be understood as "one or more" unless the context clearly indicates otherwise.

[0020] The names of messages or information exchanged between devices in the embodiments of the present disclosure are used for explanatory purposes only and are not intended to limit the scope of these messages or information.

[0021] In the following, the embodiments of the present disclosure will be described in detail with reference to the drawings, but the present disclosure is not limited to these specific embodiments. These specific embodiments may be combined with each other, and the same or similar concepts or processes may not be detailed in some embodiments. In addition, in one or more embodiments, specific features, structures, or characteristics may be combined in any suitable manner that is apparent to a person skilled in the art from the present disclosure.

[0022] It should be understood that the present disclosure does not limit how to obtain the image or video to be applied / processed. In one embodiment of the present disclosure, it may be obtained from a storage device, such as an internal memory or an external storage device, and in another embodiment of the present disclosure, it may be captured by activating a capture assembly. It should be noted that the type of image or video is not specifically limited in the context of this specification. It should be noted that the image or video may be an original image or video obtained by an imaging device, or may be an image or video that has already been subjected to specific processing on the original image or video, such as rudimentary filtering, de-aliasing, color adjustment, contrast adjustment, normalization, etc. It should be noted that the pre-processing operation may further include other types of pre-processing operations known in the art, which will not be described in detail here.

[0023] As users become more and more dependent on social networks, their social networking experience requirements are also increasing, especially the quality of subtitle translations in videos. In the related art, only the video contributor can edit and post the subtitle information of the video. In order to further improve the quality of the subtitle translations in the video, crowdsourcing translation is used to provide the subtitle translations in the video.

[0024] FIG. 1 shows a flowchart of a video processing method according to some embodiments of the present disclosure.

[0025] As shown in FIG. 1, the video processing method includes the steps of: receiving original subtitle text added to the video waiting to be translated by the creator of the video S1; selecting a translator based on the original subtitle text and the language used by the user on the social network S3; providing the video waiting to be translated to the selected translator and providing an interaction interface in the video for the translator to translate the original subtitle text in the video S5; receiving a subtitle translation returned by the translator from the interaction page S7; and displaying the subtitle translation that has passed the check in the video S9.

[0026] In step S1, a subtitle management interaction interface is provided for the video creator to receive subtitle originals added to a video waiting to be translated by the video creator.

[0027] 2A-2G show schematic diagrams of interaction interfaces for subtitle management according to some embodiments of the present disclosure.

[0028] As shown in FIG. 2A, when a video creator plays a video waiting to be translated, the video will be displayed with a "Generate subtitles" option, for example, in the form of a banner. FIG. 2A may also show the amount of play and the share status of the video waiting to be translated. In FIG. 2A, a prompt to generate subtitles may be shown above the "Generate subtitles" option. The prompt to generate subtitles will disappear when the video creator clicks the "Close" button. After the video creator successfully adds subtitles, the prompt will also disappear automatically.

[0029] Clicking the "Generate Subtitles" button will enter the "Add Subtitles" page. In the "Add Subtitles" page, the video creator can upload the subtitle source text, as shown in FIG. 2B. FIG. 2B may also show the subtitle upload progress, e.g., 20% has been uploaded. FIG. 2B also provides a cancel option, and the video creator can click the cancel button when he / she wants to cancel the subtitle upload operation.

[0030] For creators who are not familiar with Subtitle Management, such as creators who use Subtitle Management for the first time, they can open the operation guide provided by the platform before adding subtitles and learn how to add subtitles. For example, the operation guide may inform the video creator that they should first generate original subtitles, and then the original subtitles can be automatically translated by translators (e.g., global viewers), and community translators can help optimize the automatically translated subtitle translations.

[0031] After the creator of the video adds the subtitles, a further indication may be presented that the subtitles will be translated automatically.

[0032] After the video creator uploads the original subtitle text, he can enter the preview page as shown in FIG. 2C. As shown in FIG. 2C, the preview page displays multiple subtitles, and the subtitles are displayed one by one (e.g., sentence by sentence). In response to a playback request for the video, the video can be played in a manner in which the audio and subtitles are synchronized. The preview page of FIG. 2C further provides options such as edit, cancel, and save. The video creator can click the corresponding option button to perform operations such as edit, cancel, or save according to specific situations.

[0033] The subtitles added by the creator will be displayed on the corresponding video playback page, as shown in Fig. 2D. In Fig. 2D, the position of the subtitles can also be adjusted. The video creator can adjust the position of the subtitles on the video playback page, for example, by dragging it.

[0034] Once the subtitle positioning is complete, the subtitle addition is complete and the page will display a notification "Subtitles Added Completed" as shown in Figure 2E, and provide entry for the video creator to enter the subtitle management page via the "Creator Tools" option in "Settings".

[0035] FIG. 2F shows the "Creator Tools" page. Clicking "Manage Subtitles" in it will enter the subtitle management page, as shown in FIG. 2G. The subtitle management page in FIG. 2G displays the subtitle status of the video. The subtitle status of the video includes "Waiting for subtitle generation" and "Subtitles added successfully".

[0036] For videos that are waiting to have subtitles generated, sort the videos according to the amount of video views. In some embodiments, the video cover on the subtitle management page displays the amount of video views, for example, in languages ​​other than the creator's language.

[0037] For a video that has subtitles added, the subtitle management page may display the type of subtitle translation, for example whether it belongs to automatic translation or community translation. In some embodiments, for a video that has subtitles added, the subtitle management page may display the number of automatic translations and the number of community translations, respectively.

[0038] In some embodiments, the subtitle management page can sort videos according to update time, for example, after adding a subtitle translation, when the subtitle is translated by a translator, when the creator deletes the translator's subtitle translation.

[0039] In the above embodiment, a path to enter the "Add subtitles" page is provided from the notification box "Generate subtitles" in the playing video. Video creation can also be done directly from the "Creator Tools" page shown in FIG. 2F. Clicking "Manage subtitles" in the page will enter the subtitle management page. After entering the subtitle management page, subtitles can be added by clicking the "Generate subtitles" button on the video waiting for translation, or by clicking the cover of the video waiting for translation, viewing the video and clicking the "Generate subtitles" button on the video.

[0040] For video creators, even if the added subtitles have already been submitted, they can still edit the subtitles again from the subtitle management page.

[0041] In step S3, the language used by the user may include at least one of the system language used by the user, the video language viewed by the user, and the language input by the user. For example, if the original subtitles of a video are in English and are to be translated into Chinese or Japanese, a user whose system language used by the user, the video language viewed by the user, and the language input by the user include English and Chinese or Japanese may be selected as a translator. Selecting a translator that matches the language of the original subtitles and the translation according to the language used by the user can more effectively improve the quality of the translation and the efficiency of the translation check.

[0042] The translator may be a registered community translator or an unregistered translator. For an unregistered translator, a guide to register as a community translator may be provided. Selecting a registered translator to provide a translation can further and more effectively improve the quality of the translation and the efficiency of the translation check.

[0043] In some embodiments, a translator may be selected according to the video type waiting for translation and the video type that the user is interested in. For example, the user's expected interest value for different types of videos is determined based on the user's historical behavior data, the video type that the user is interested in is determined based on the user's expected interest value for different types of videos, and the user whose interested video type matches the video type waiting for translation is selected as the translator. Providing the translator with the video type that he / she likes can improve the translator's translation enthusiasm, which is also advantageous to improving the translation quality and reducing the cost of checking the translation.

[0044] The following describes step S5 in conjunction with Figures 3A-3D. Figures 3A-3C show schematic diagrams of an interaction interface for translating original subtitles in a video according to some embodiments of the present disclosure. Figure 3D shows a schematic diagram of a guide for registering as a community translator according to some embodiments of the present disclosure.

[0045] In step S5, as shown in Fig. 3A, the video to be translated is provided only to the selected translator, and an interaction interface for translating the original subtitle text in the video is provided to the translator in the video. In Fig. 3A, the translation of the original subtitle text in the video is provided to the translator in the form of an information stream in the video. Fig. 3A may show the original subtitle text. Except for the selected translator, no interaction interface for translating the original subtitle text in the video is provided to other users.

[0046] As shown in Fig. 3B, in response to a request from the translator to edit the translation, a proofreading page is entered. In Fig. 3B, the proofreading page displays the original subtitles one by one (e.g., sentence by sentence), displays the translations below each original subtitle, and the editing position is positioned at the translation of the subtitle selected by the translator. The translations may be machine translations or subtitle translations provided by other translators.

[0047] The editing interface may include a pop-up keyboard, as shown in FIG. 3C. The translator can clear the translation and input his / her own subtitle translation. After completing the subtitle translation, the translator can submit it to the platform and wait for checking. After passing the checking, receive a notification from the platform. That is, the video processing method further includes sending a notification to the translator after the translator's subtitle translation passes the checking. Of course, the translator can also enter a corresponding task management interface to view the status of the subtitle translation, such as being checked, checked, checked and not checked.

[0048] In some embodiments, providing an interaction interface in the video to a translator to translate original subtitle text in the video further includes providing instructions to the translator to register as a community translator, as shown in FIG. 3D.

[0049] The following describes step S7 in conjunction with Figures 4A-5C. Figure 4A shows a schematic diagram of a subtitle translation view page according to some embodiments of the present disclosure. Figure 4B shows a schematic diagram of a translator information page according to some embodiments of the present disclosure. Figure 5A shows a schematic diagram of a video playback page according to some embodiments of the present disclosure. Figure 5B shows a schematic diagram of a subtitle language management page according to some embodiments of the present disclosure. Figure 5C shows a schematic diagram of a subtitle translation view page according to some other embodiments of the present disclosure.

[0050] In step S7, the subtitle translation returned by the translator from the interaction page is received and checked. In some embodiments, the video creator may be notified that there is a subtitle translation that has already passed the check. The video creator can view the subtitle translation by following the path provided by the notification, such as the subtitle translation viewing page shown in FIG. 4A. The video creator can also enter the translator information page, as shown in FIG. 4B, by clicking the "Check Translator" button shown in FIG. 4A, to view and understand the translator's related information. FIG. 4B may also show the translator's status, such as whether it belongs to the community translators, and the languages ​​he / she is good at, as well as thumbnails of the translator's other translation works (e.g., video covers).

[0051] The video creator can also jump to the video playback page by clicking the video, as shown in FIG. 5A. In FIG. 5A, the video playback page displays the subtitle original by default, but provides a language option. Clicking the language option enters the subtitle language management page, as shown in FIG. 5B. In FIG. 5B, the language of the subtitle original and the language of the subtitle translation in various versions are presented. The video creator can select the subtitle translation of the corresponding language to view the corresponding subtitle translation, as shown in FIG. 5C. Similar to FIG. 4A, FIG. 5C shows the subtitle translation and displays the "Check Translator" button. As mentioned above, the video creator can click the "Check Translator" button shown in FIG. 5C to enter the translator information page, as shown in FIG. 4B, to view and understand the translator's related information. The video creator can also remove the translator's subtitle translation by the "Remove Translator's Edit" button shown in FIG. 5C. The subtitle translation adopted by the video creator is published.

[0052] The following describes step S9 in conjunction with Figures 6A-6B. Figure 6A shows a schematic diagram of a video playback page according to another embodiment of the present disclosure. Figure 6B shows a schematic diagram of an interaction interface for a translator and a viewer to interact according to some embodiments of the present disclosure.

[0053] In step S9, the subtitle translation that passes the check is displayed in the video. As shown in Figure 6A, the original subtitle of the video and the published subtitle translation are synchronized with the audio of the video.

[0054] In some embodiments, the video processing method further includes providing an interaction interface for a translator and a viewer to interact in the video, as shown in Fig. 6B. In Fig. 6B, the subtitle translation that has passed the check is displayed in the video, and the signature of the translator corresponding to the subtitle translation, for example, the user name of the translator, is displayed. The viewer can interact with the translator shown in Fig. 6B, such as giving a "like".

[0055] In the above embodiment, a complete solution for crowdsourcing video translation is provided, which can more effectively improve the quality of the translation and the efficiency of translation checking.

[0056] 7 shows a block diagram of a video processing device according to some embodiments of the present disclosure. As shown in FIG. 7, the video processing device 7 includes a processor 71 and a display 72.

[0057] The processor 71 is configured to receive original subtitle text added to the video waiting to be translated by an author of the video, select a translator based on the original subtitle text and a language used by the user on the social network, provide the video waiting to be translated to the selected translator and provide an interaction interface in the video for the translator to translate the original subtitle text in the video, and receive the subtitle translation returned by the translator from the interaction page. For example, the processor 71 is configured to perform steps S1-S7.

[0058] Display 72 is configured to display subtitle translations that pass the check in the video, for example to perform step S9.

[0059] Although not shown, the device may include a video processing device, a memory for storing various information generated during operation of each unit included in the video processing device, programs and data for operation, etc. The memory may be a volatile memory and / or a non-volatile memory. For example, the memory may include, but is not limited to, a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a read-only memory (ROM), and a flash memory. Of course, the memory may be located outside the video processing device.

[0060] FIG. 8 illustrates a block diagram of a video processing device according to some further embodiments of the present disclosure.

[0061] In some embodiments, the video processing device 8 may be various types of devices, including, but not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Personal Computers), PMPs (Portable Multimedia Players), in-car terminals (e.g., in-car navigation terminals), and fixed terminals such as digital TVs and desktop computers.

[0062] As shown in Fig. 8, the video processing device 8 includes a memory 81 and a processor 82 coupled to the memory 81. It should be noted that the assemblies of the video processing device 8 shown in Fig. 8 are merely exemplary and not limiting, and the video processing device 8 may have other assemblies according to actual application needs. The processor 82 can control other assemblies in the video processing device 8 to perform desired functions.

[0063] In some embodiments, the memory 81 is used to store one or more computer-readable instructions. When the processor 82 is used to execute the computer-readable instructions, the method according to any one of the above embodiments is realized when the computer-readable instructions are executed by the processor 82. For the specific implementation and related interpretation content of each step of the method, reference may be made to the above embodiments, and the repeated content will not be described here.

[0064] For example, the processor 82 and the memory 81 can communicate with each other directly or indirectly. For example, the processor 82 and the memory 81 can communicate with each other via a network. The network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 82 and the memory 81 can also communicate with each other via a system bus, and the present disclosure is not limited thereto.

[0065] For example, the processor 82 may be embodied as various suitable processors, processing devices, and the like, such as a central processor (CPU), a graphics processor (Graphics Processing Unit, GPU), a network processor (NP), and the like, and may be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware assembly. The central processing unit (CPU) may be an X86 or ARM architecture, and the like. For example, the memory 81 may include any combination of various types of computer-readable storage media, such as volatile memory and / or non-volatile memory. The memory 81 may include, for example, a system memory, in which, for example, an operating system, an application program, a boot loader program (Boot Loader), a database, and other programs are stored. The storage medium may store various application programs and various data, and the like.

[0066] Furthermore, according to some embodiments of the present disclosure, when various operations / processing according to the present disclosure are realized by software and / or firmware, the programs constituting this software may be installed from a storage medium or a network into a computer system having a dedicated hardware structure, such as the computer system of electronic device 900 shown in FIG. 9, and when the various programs are installed into this computer system, various functions including, for example, the functions described above, can be executed.

[0067] In FIG. 9, a central processing unit (CPU) 901 executes various processes based on a program stored in a read-only memory (ROM) 902 or a program loaded from a storage unit 908 to a random access memory (RAM) 903. The RAM 903 also stores data required when the CPU 901 executes various processes as necessary. The central processing unit is merely exemplary, and may be other types of processors, such as the various processors described above. The ROM 902, the RAM 903, and the storage unit 908 may be various forms of computer-readable storage media, such as those described below. It should be noted that although the ROM 902, the RAM 903, and the storage unit 908 are shown in FIG. 9, one or more of them may be integrated or located in the same or different memory or storage modules.

[0068] The CPU 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output interface 905 is also connected to the bus 904.

[0069] The following components are connected to the input / output interface 905: an input unit 906, such as a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyro, an output unit 907, such as a display, such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, a storage unit 908, such as a hard disk, a magnetic tape, and a communication unit 909, such as a network interface card, such as a LAN card, a modem, and the like. The communication unit 909 is permitted to execute communication processing via a network, such as the Internet. For ease of understanding, FIG. 9 shows each device or module in the electronic device 900 communicating via a bus 904, but they may communicate via a network or other manner, where the network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network.

[0070] If necessary, the driver 910 is also connected to the input / output interface 905. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is attached to the driver 910 if necessary, and a computer program read therefrom is installed in the storage unit 908 if necessary.

[0071] When the above series of processes is realized by software, the programs constituting the software may be installed from a network called the Internet or a storage medium called removable media 911 .

[0072] According to an embodiment of the present disclosure, the process described with reference to the above flowchart may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, the computer program including a program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via a communication device 909, or may be installed from a storage unit 908, or may be installed from a ROM 902. When the computer program is executed by the CPU 901, it performs the above functions limited to the method of the embodiment of the present disclosure.

[0073] It should be explained that in the context of this disclosure, a computer-readable medium may be a tangible medium that may contain or store a program used by or in combination with an instruction execution system, device or apparatus. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium or any combination of both. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in combination with an instruction execution system, apparatus or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier, on which computer-readable program code is loaded. Such a propagated data signal may take various forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which may transmit, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted on any suitable medium, including, but not limited to, an electrical wire, an optical cable, RF (radio frequency), or the like, or any suitable combination of the above.

[0074] The computer readable medium may be included in the electronic device or may be a separate entity not assembled into the electronic device.

[0075] In some embodiments, a computer program product is further provided, comprising instructions, which when executed by a processor, cause the processor to perform the method of any one of the above embodiments. For example, the instructions may be embodied as computer program code.

[0076] In embodiments of the present disclosure, computer program code for carrying out the operations of the present disclosure can be written in one or a variety of programming languages ​​or combinations thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and also including general procedural programming languages ​​such as "C" or similar. The program code may be executed entirely on the user computer, partially on the user computer, as an independent software package, partially on the user computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., connected via the Internet using an Internet Service Provider).

[0077] The flowcharts and block diagrams in the drawings illustrate possible system architectures, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment or part of code, which includes one or more executable instructions for implementing the specified logic function. It should also be noted that in some implementations, as a replacement, the functions illustrated in the blocks may occur in a different order than those illustrated in the drawings. For example, two consecutive blocks may actually be essentially executed in parallel, or may be executed in a reverse order depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be realized by a dedicated hardware-based system that performs the specified functions or operations, or by a combination of dedicated hardware and computer instructions.

[0078] The modules, components, or units described in relation to the embodiments of the present disclosure may be realized in a software form or a hardware form, and the names of the modules, components, or units in some cases do not limit the modules, components, or units themselves.

[0079] The functionality described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0080] The above description is merely a description of some embodiments of the present disclosure and the technical principles applied therein. It should be understood by those skilled in the art that the disclosure scope of the present disclosure is not limited to the technical solution consisting of a specific combination of the above technical features, but should also cover other technical solutions consisting of any combination of the above technical features or their equivalent features without departing from the concept of the above disclosure. For example, a technical solution formed by replacing the above features with technical features having similar functions (including but not limited to those) disclosed in the present disclosure.

[0081] In the description provided herein, numerous specific details are set forth. However, it should be understood that embodiments of the present invention may be practiced without these specific details. In other instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.

[0082] It should be noted that although operations are described employing a particular sequence, this should not be understood as requiring that these operations be performed in the particular sequence shown, or sequentially. In certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes certain specific implementation details, these should not be understood as limiting the scope of the present disclosure. Some features that are described in the context of a single embodiment may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may be implemented in multiple embodiments alone or in any suitable subcombination.

[0083] Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art should understand that the above examples are merely illustrative and are not intended to limit the scope of the present disclosure. Those skilled in the art should understand that the above examples can be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is limited by the appended claims.

Claims

1. 1. A video processing method comprising the steps of: receiving original subtitles added to the video waiting to be translated by the creator of the video; Selecting a translator based on the original subtitle text and the language used by the user on the social network; providing a selected translator with a video to be translated and providing an interaction interface in the video for the translator to translate original subtitles in the video; receiving a subtitle translation returned by a translator from an interaction interface; and displaying the successfully checked subtitle translation over the video.

2. The video processing method of claim 1 , wherein the language used by the user includes at least one of a system language used by the user, a video language viewed by the user, and a language input by the user.

3. 3. The video processing method according to claim 1 or 2, wherein the translators include already registered community translators.

4. Choosing a translator is The method of claim 1 , further comprising selecting a translator depending on the video type waiting for translation and the video type in which the user is interested.

5. Selecting translators according to the types of videos waiting to be translated and the types of videos users are interested in is determining a user's predicted interest value for different types of videos based on the user's historical behavior data; determining video types in which the user is interested based on the user's predicted interest values ​​for different types of videos; 5. The method of claim 4, further comprising: selecting as translators those users whose video types of interest match those of videos waiting to be translated.

6. Providing an interaction interface for a translator to translate original subtitles in a video, providing a translator with a translation of an original subtitle text of a video waiting to be translated in the form of an information stream in the video; 6. A method according to claim 1, further comprising the step of: entering a proofreading page in response to a request from the translator to edit the translation.

7. Providing an interaction interface for a translator to translate original subtitles in a video, 7. The method of claim 1, further comprising providing the translator with instructions to register as a community translator.

8. Displaying subtitle translations that pass the check on a video is A method according to any preceding claim, comprising displaying in the video a translator's signature corresponding to the subtitle translation.

9. Sending a notification to the translator once their subtitle translation has passed the check; and / or 9. The video processing method of claim 1, further comprising providing an interaction interface for a translator and a viewer to interact in the video.

10. 10. The video processing method according to claim 1, further comprising receiving original subtitles added to a video waiting for translation by a video creator by providing the video creator with a subtitle management interaction interface.

11. The video processing method of claim 10, wherein after a video creator adds a subtitle original, the creator enters a subtitle management page, and the subtitle management page displays a subtitle status of the video, the subtitle status of the video including: waiting for subtitle generation; and completing adding subtitle.

12. For videos that are waiting for subtitle generation, the Subtitle Management page will additionally display the video playback amount, The video processing method of claim 11, wherein for a video to which subtitles have been added, the subtitle management page further displays a type of subtitle translation.

13. 1. A video processing device comprising: receiving original subtitles added to the video waiting to be translated by the creator of the video; Selecting a translator based on the original subtitle text and the language used by the user on the social network; providing a selected translator with a video to be translated and providing an interaction interface in the video for the translator to translate original subtitles in the video; receiving a subtitle translation returned by a translator from the interaction page; a processor configured as a display configured to display the successfully verified subtitle translation over the video; 23. A video processing device comprising:

14. 1. A video processing device comprising: Memory, A video processing apparatus comprising: a processor coupled to the memory, the processor configured to perform one or more steps of the video processing method according to any one of claims 1 to 12 based on instructions stored in the memory.

15. A computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a video processing method according to any one of claims 1 to 12.

16. A computer program which, when executed by a processor, implements a video processing method according to any one of claims 1 to 12.

Citation Information

Patent Citations

  • Caption creation system and program

    JP2010157961A

  • Systems and methods for captioning media

    JP2016509408A

  • Crowd-matching translators

    US20170371869A1

  • Multilingual subtitle service system and method for controlling server thereof

    US20220383228A1