Text input method, device, electronic device, and storage medium
Patent Information
- Application Number
- JP2023579179
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-08-13
- Filing Date
- 2022-08-04
- Publication Date
- 2025-02-26
- Estimated Expiration
- 2042-08-04
AI Technical Summary
【0011】 本開示の本出願実施例は、ユーザの歌詞ビデオ提示操作に基づき、提示対象であるマルチメディアデータと音楽データを再生し、ここで、マルチメディアデータは、画像データを含み、音楽データは、オーディオデータと歌詞を含み、それとともに、画像データにおけるターゲットオブジェクトと歌詞におけるターゲット歌詞を決定し、ターゲットオブジェクトの近くでターゲット歌詞を提示し、ターゲットオブジェクトの奥行き情報に基づき歌詞表示の特殊効果を調節し、歌詞を画像データの実空間にはめこみ、ユーザに仮想表示な感覚体験をもたらし、ユーザ体験がより高い。
Smart Images

Figure 0007635926000001 
Figure 0007635926000002 
Figure 0007635926000003
Abstract
Description
[Technical field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This disclosure claims priority to Chinese patent application number "202110932864.7", filed on August 13, 2021, entitled "Text input method, device, electronic device and storage medium", the entire contents of which are incorporated herein by reference.
[0002] The present disclosure relates to the field of information technology, and in particular to a text input method, device, electronic device, and storage medium. [Background technology]
[0003] With the rapid development of terminal technology and network technology, currently, video-based applications generally have functions such as uploading videos, etc. Users can create and upload wonderful videos through video-based applications, or record their daily lives and upload videos that they casually take in their daily lives.
[0004] Before posting a video, users often edit the video.
[0005] However, the conventional technology has a problem that it is difficult to edit videos, which is disadvantageous for users to quickly post their works. Summary of the Invention [Problem to be solved by the invention]
[0006] In order to solve or at least partially solve the above technical problems, the embodiments of the present disclosure provide a text input method, device, electronic device, and storage medium that can reduce the difficulty of adding text to videos, achieve the goal of improving user experience, and help improve users' work submission efficiency. [Means for solving the problem]
[0007] According to a first aspect, an embodiment of the present disclosure provides a text input method, the method comprising: determining at least two recommended text items based on the edited video; Displaying the at least two recommendation text items in a first target area of an editing page of the edited video; In response to a first trigger operation acting on a first recommended text item, displaying a first text contained in the first recommended text item in a text input area of the editing page, the first trigger operation being used to determine the first recommended text item to be selected from the at least two recommended text items.
[0008] According to a second aspect, an embodiment of the present disclosure further provides a text input device, the device comprising: a recommendation text determination module for determining at least two recommendation text items based on the edited video; a first display module for displaying the at least two recommendation text items in a first target area of an editing page of the edited video; and a second display module for displaying a first text contained in a first recommended text item in a text input area of the editing page in response to a first trigger operation acting on the first recommended text item, the first trigger operation being used to determine the first recommended text item to be selected from the at least two recommended text items.
[0009] According to a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising: one or more processors; a storage device for storing one or more programs; The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the text input method described above.
[0010] According to a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, the program realizing the text input method described above when executed by a processor. Effect of the Invention
[0011] The application embodiment of the present disclosure plays multimedia data and music data to be presented based on a user's lyric video presentation operation, where the multimedia data includes image data, and the music data includes audio data and lyrics, and also determines a target object in the image data and a target lyric in the lyrics, presents the target lyric near the target object, adjusts the special effect of the lyric display based on the depth information of the target object, and fits the lyrics into the real space of the image data, bringing the user a virtual display sensory experience, and improving the user experience. [Brief description of the drawings]
[0012] The above and other features, advantages and aspects of each embodiment of the present disclosure will become more apparent with reference to the following specific embodiments in conjunction with the drawings. Throughout the drawings, the same or similar symbols represent the same or similar elements. It should be understood that the drawings are schematic and that the devices and elements are not necessarily drawn to scale.
[0013] [Figure 1] 1 is a flowchart of a text input method according to an embodiment of the present disclosure. [Diagram 2] FIG. 2 is a schematic diagram of a video editing page in an embodiment of the present disclosure. [Diagram 3] FIG. 2 is a schematic diagram of a video editing page in an embodiment of the present disclosure. [Figure 4]FIG. 2 is a schematic diagram of a video editing page in an embodiment of the present disclosure. [Diagram 5] FIG. 2 is a schematic diagram of a video editing page in an embodiment of the present disclosure. [Figure 6] 1 is a flowchart of a text input method according to an embodiment of the present disclosure. [Figure 7] 1 is a flowchart of a text input method according to an embodiment of the present disclosure. [Figure 8] FIG. 2 is a schematic diagram of a video editing page in an embodiment of the present disclosure. [Figure 9] FIG. 2 is a schematic diagram of a video editing page in an embodiment of the present disclosure. [Figure 10] FIG. 2 is a schematic diagram of a video editing page in an embodiment of the present disclosure. [Figure 11] FIG. 2 is a schematic diagram of a video editing page in an embodiment of the present disclosure. [Figure 12] FIG. 2 is a structural schematic diagram of a text input device in an embodiment of the present disclosure; [Figure 13] FIG. 2 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Hereinafter, the embodiments of the present disclosure will be described in more detail with reference to the drawings. Although several embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be realized in various forms and should not be construed as being limited to the embodiments described herein, but rather, these embodiments are provided for a clearer and more complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are merely illustrative and are not intended to limit the scope of protection of the present disclosure.
[0015] It should be understood that the steps described in the method embodiments of the present disclosure may be performed in different orders or in parallel, and that method embodiments may include additional steps and / or omit the performance of steps that are shown, and the scope of the present disclosure is not limited in this respect.
[0016] As used herein, the terms "comprises" and variations thereof are open-ended, i.e., including, but not limited to. The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one other embodiment," and the term "some embodiments" means "at least some embodiments." Relevant definitions of other terms are provided below in the description.
[0017] It should be noted that concepts such as "first" and "second" referred to in the present disclosure are merely intended to distinguish different devices, modules or units, and are not intended to limit the order of functions performed by these devices, modules or units or their mutual dependencies.
[0018] It should be noted that the modifications "a" and "a plurality" referred to in this disclosure are intended to be exemplary rather than limiting, and should be understood as "one or more" unless the context clearly indicates otherwise, as would be understood by one of ordinary skill in the art.
[0019] The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of these messages or information.
[0020] FIG. 1 is a flow chart of a text input method in an embodiment of the present disclosure. The method may be applied to an application scenario in adding text to a video to be edited. The method may be performed by a text input device, and the device may be realized by adopting the form of software and / or hardware. The device may be disposed in an electronic device, such as a display terminal, specifically including but not limited to electronic devices having a display screen, such as a smartphone, a palmtop computer, a tablet computer, a portable wearable device, a smart home device (e.g., a desk lamp), etc.
[0021] As shown in FIG. 1, the method may specifically include the following steps:
[0022] Step 110: Determine at least two recommended text items based on the edited video.
[0023] Here, the video to be edited may be a video shot by the user in real time, or may be a historical video selected from an album.
[0024] In one embodiment, determining at least two recommended text items based on a video to be edited includes performing frame extraction on the video to be edited, determining thematic information of the video to be edited based on the extracted video frames, and determining the at least two recommended text items based on the thematic information and / or attention information of each candidate text item in a text library. For example, when the thematic information of the video to be edited is determined to be "scenery" by performing image recognition on the extracted video frames, text items related to scenery may be determined as recommended text items. Furthermore, from the text items related to scenery, text items whose attention reaches a threshold may be determined as recommended text items. Here, the attention of the text items may be determined based on the number of times the text items are used within a certain period of time. When the thematic information of the video to be edited is determined to be "people", text items related to people may be determined as recommended text items, and further, from the text items related to people, text items whose attention reaches a threshold may be determined as recommended text items.
[0025] Step 120: Display the at least two recommendation text items in a first target area of an editing page of the edited video.
[0026] Referring to the schematic diagram of the video editing page shown in FIG. 2, it includes a first target area 210 and a text input area 220, and three recommended text items, a first recommended text item 211, a second recommended text item 212, and a third recommended text item 213, are displayed in the first target area 210. When the number of texts contained in the recommended text item is small, the recommended text item is the text contained in the recommended text item, and when the number of texts contained in the recommended text item is large, the recommended text item is a part of the text contained therein. For example, when the text contained in the recommended text item has 15 characters, specifically "The weather is nice, let's take a walk", the recommended text item may be five characters of the recommended text item, "The weather is nice...", and the remaining characters may be replaced with ellipses. The reason for setting in this way is mainly because too much text cannot be displayed directly due to the size of the terminal display screen. The number of texts contained in the text item and the number of texts that need to be displayed can both be configured by parameters.
[0027] Here, the video editing page may be a text editing page for adding text to a specific video to be edited, and the video to be edited may be a video that has already been shot, and may be one that the user has shot instantly, or one that the user has selected from an album. It can be understood that if the editing page is a text adding editing page that the user has entered through a "text" sticker on a video shooting screen, if the video to be edited has not yet been shot or a specific video to be edited has not yet been selected from an album at this time, the text input method according to the present embodiment will not be executed, because the video to be edited does not exist and the recommended text items cannot be determined based on the video to be edited.
[0028] In one embodiment, the recommendation text items may be rearranged and displayed in the first target area based on the relevance to the video to be edited and / or the attention of each of the recommendation text items. For example, a recommendation text item having a relatively high relevance to the video to be edited is displayed at a left position in the first target area, and a recommendation text item having a relatively low relevance to the video to be edited is displayed at a right position in the first target area. Alternatively, a recommendation text item having a relatively high attention level is displayed at a left position in the first target area, and a recommendation text item having a relatively low attention level is displayed at a right position in the first target area. The recommendation text items may be rearranged and displayed by comprehensively considering the relevance of each recommendation text item to the video to be edited and the attention level of each recommendation text item.
[0029] Step 130: In response to a first trigger operation acting on a first recommended text item, display a first text contained in the first recommended text item in a text input area of the editing page, where the first trigger operation is used to determine the first recommended text item to be selected from the at least two recommended text items.
[0030] Referring to the schematic diagram of the video editing page shown in FIG. 3, based on FIG. 2, when a user clicks on the first recommended text item 211 (the first recommended text item 211 is the first recommended text item), the text included in the first recommended text item 211 (i.e., the first text), i.e., "The weather is nice, let's take a walk" is displayed in the text input area 220. In this way, the user can complete the text addition by simply selecting the recommended text item that he likes, and does not need to form the text by constructing words by himself, which reduces the user's thinking cost and improves the user's satisfaction with the added text, and can encourage more users to add text information when posting videos, which greatly meets the needs of some users who are willing to express themselves in text but are limited by their own verbal expressiveness. Furthermore, adding more text information to a video helps improve the efficiency of video consumption.
[0031] Furthermore, in response to a first trigger operation acting on the first recommendation text item, other recommendation text items than the first recommendation text item are used to replace the first recommendation text item and display it in the first target area, so that the user can easily view more recommendation text items. As shown in Fig. 3, the first recommendation text item 211 is removed from the first target area 210, the second recommendation text item 212 occupies the position of the first recommendation text item 211, the third recommendation text item 213 occupies the position of the second recommendation text item 212, and the fourth recommendation text item 214 newly appeared in the first target area 210 occupies the position of the third recommendation text item 213. In short, the triggered recommendation text item is removed from the first target area, the other recommendation text items already displayed in the first target area are moved to the left as a whole, and the vacant position is used to display a recommendation text item that has never been displayed in the first target area.
[0032] In one embodiment, the method of inputting text comprises: and further comprising: in response to a second trigger operation acting on a second recommendation text item, using a second text included in the second recommendation text item to replace the first text, where the second trigger operation is used to determine the second recommendation text item to be selected from the at least two recommendation text items. Referring to the schematic diagram of the video editing page shown in Fig. 4, based on Fig. 3, when a user further clicks a second recommendation text item 212 (i.e., the second recommendation text item), the second text (i.e., "hoho") included in the second recommendation text item 212 is used to replace the first text (i.e., "The weather is nice, let's take a walk") and displayed in the text input area 220, that is, the first text is not displayed in the text input area 220, and only the second text is displayed. Similarly, the triggered second recommendation text item 212 is removed from the first target area 210, and the other recommendation text items already displayed in the first target area 210 (third recommendation text item 213 and fourth recommendation text item 214) are moved generally to the left, and the vacant position is used to display the fifth recommendation text item 215, which has not been displayed in the first target area.
[0033] In another embodiment, in response to a second trigger operation acting on a second recommended text item, the second text is displayed at a position relative to the first text, as shown in Fig. 5, the second text is displayed after the first text, and the first text and the second text are separated by a space, i.e., the first text and the second text are displayed in the text input area 220 at the same time.
[0034] The text input method according to the present embodiment determines at least two recommended text items based on the video to be edited, displays the at least two recommended text items in a first target area of the video editing page, and displays the first text included in the triggered recommended text item in the text input area of the editing page when the user triggers one of the recommended text items, thereby realizing the input of the first text. That is, when the user adds text to the video to be edited, the recommended text items are provided for the user, and the user only needs to select his / her preferred one from the provided recommended text items, and does not need to construct words to form text by himself / herself, which reduces the user's thinking cost and improves the user's satisfaction with the added text, and can encourage more users to add text information when posting videos, which greatly meets the needs of some users who are willing to express themselves in text but are limited by their own verbal expressiveness. Furthermore, adding more text information to the video helps improve the efficiency of video consumption.
[0035] Based on the above embodiment, if the execution of the above step 110 fails, that is, the operation of determining at least two recommended text items based on the video to be edited as described above fails, in other words, the recommended text items cannot be obtained, then, in order to provide basic services to the user, a pre-set text item is displayed in the first target area, and the pre-set text item may be any text item with relatively high attention.
[0036] 6 is a flow chart of a text input method in one embodiment. Based on the above embodiment, the text input method is further optimized in this embodiment, and the advantage of the optimization is that personalized text recommendations can be made for the user based on the user's interaction operations, thereby further improving the efficiency and satisfaction of the user's text addition.
[0037] As shown in FIG. 6, the text input method includes the following steps.
[0038] Step 610: Determine at least two recommended text items based on the edited video.
[0039] Step 620: Display the at least two recommendation text items in a first target area of an editing page of the edited video.
[0040] Step 630: In response to a first trigger operation acting on a first recommended text item, display a first text contained in the first recommended text item in a text input area of the editing page, where the first trigger operation is used to determine the first recommended text item to be selected from the at least two recommended text items.
[0041] Step 640: In response to an editing operation on the first text, determine at least two first related text items based on the first text.
[0042] Here, the editing operation on the first text includes deleting one or several texts in the first text, and then making related recommendations based on the texts remaining after the deletion. The editing operation on the first text may further include activating an input method based on the first text, and then making related recommendations based on the first text, or when a user inputs one or several texts through the input method, making related recommendations based on the first text and / or the texts input by the user. For example, when a user inputs "weather", a related recommendation may be made based on "weather", and the first related text item determined may be "Like".
[0043] Step 650: The at least two first related text items are used to replace the recommended text item for display in the first target area.
[0044] Here, the related text items may be rearranged and displayed in the first target area based on the relevance of each related text item to the video to be edited and / or the attention of each related text item. For example, a related text item having a relatively high relevance to the video to be edited is displayed in a position closer to the left of the first target area, and a related text item having a relatively low relevance to the video to be edited is displayed in a position closer to the right of the first target area. Alternatively, a related text item having a relatively high attention level is displayed in a position closer to the left of the first target area, and a related text item having a relatively low attention level is displayed in a position closer to the right of the first target area. The related text items may be rearranged and displayed by comprehensively considering the relevance of each related text item to the video to be edited and the attention level of each related text item.
[0045] Similar to the interaction process with the recommended text items, when the user specifically clicks on a related text item, the text contained in the clicked related text item is displayed in the text input area of the editing page, thereby realizing convenient addition of text; and then, as the logic of related recommendation, a related search is performed based on the text in the text input area to obtain new related text items, and the new related text items are recommended to the user, thus achieving the purpose of improving the accuracy of recommendation.
[0046] Specifically, in response to a third trigger operation acting on the target-related text item, a third text included in the target-related text item is displayed in a text input area of the editing page, wherein the third trigger operation is used to determine the target-related text item to be selected from the at least two first related text items, at least two second related text items are determined based on the third text, and the at least two second related text items are used to replace the at least two first related text items for display in the first target area.
[0047] The text input method according to this embodiment is further optimized based on the above embodiment, specifically, when a user performs an editing operation on a first text input in a text input area, related recommendations are made based on the first text, and related text items related to the first text are displayed in a first target area of the editing page for the user to select, and when the user selects one of the related text items, the next recommendation is made based on the related text included in the related text item selected by the user. The advantage of such optimization is that personalized text recommendations can be made for the user based on the user's operating behavior, which further improves the efficiency and satisfaction of the user in adding text.
[0048] 7 is a flow chart of a text input method in an embodiment. Based on the above embodiment, the present embodiment further optimizes the text input method, specifically, displays a text library control at the target position of the editing page, and displays pre-defined texts in the text library when the user clicks the text library control, allowing the user to select the preferred text to add to the video to be edited. The advantage of the optimization is to provide more text options for the user, and further improve the efficiency and satisfaction of the user in adding text.
[0049] As shown in FIG. 7, the text input method includes the following steps.
[0050] Step 710: Determine at least two recommendation text items based on the to-be-edited video, and display the at least two recommendation text items in a first target area of an editing page of the to-be-edited video.
[0051] Step 720: In response to a first trigger operation acting on a first recommended text item, display a first text contained in the first recommended text item in a text input area of the editing page, where the first trigger operation is used to determine the first recommended text item to be selected from the at least two recommended text items.
[0052] Step 730: In response to an editing operation on the first text, determine at least two first related text items based on the first text, and use the at least two first related text items to replace the recommended text item for display in the first target area.
[0053] Step 740: In response to a third trigger operation acting on the target related text item, a third text contained in the target related text item is displayed in a text input area of the editing page, wherein the third trigger operation is used to determine the target related text item to be selected from the at least two first related text items.
[0054] Step 750: Determine at least two second related text items based on the third text, and use the at least two second related text items to replace the at least two first related text items for display in the first target area.
[0055] Step 760: Displaying a text library control at a target location on the edit page, displaying a preset text in a second target area of the edit page in response to a trigger operation acting on the text library control, and displaying the target preset text in a text input area of the edit page in response to a fourth trigger operation on the target preset text, the fourth trigger operation being used to determine the target preset text to be selected from the preset texts.
[0056] In one embodiment, referring to the schematic diagram of an edit page shown in FIG. 8, a recommended text item 801 and a recommended text item 802 are displayed in a first target area 800, and a copy-editing library control 811 is displayed at a target position 810. When a user triggers the copy-editing library control 811, the schematic diagram of an edit page shown in FIG. 9 is displayed, and pre-defined copy-editings are displayed in a second target area 820 of the edit page. When a user specifically selects a pre-defined copy-editing, the selected pre-defined copy-editing is displayed in the text input area 830, as shown in FIG. 10.
[0057] Further, in order to improve the efficiency of the user browsing the preset sentences and to allow the user to quickly find the desired preset sentences, referring to Fig. 8, at least two sentence classification labels 821 are displayed in a third target area of an editing page, and preset sentences under the target sentence classification labels are displayed in a second target area 820 in response to a fifth trigger operation acting on the target sentence classification labels, where the fifth trigger operation is used to determine the target sentence classification label to be selected from the at least two sentence classification labels. For example, when a user clicks on a label "gourmet", preset sentences related to gourmet are displayed in the second target area 820, and when a user clicks on a label "sports", preset sentences related to sports are displayed in the second target area 820.
[0058] In another embodiment, when a user has not yet selected or shot a video to be edited but would like to pre-edit the text to be added to the video, referring to the schematic diagram of an editing page shown in FIG. 11, a copy library control 1111 is displayed at target location 1110, and target location 1110 can be located at the top right of the editing page to provide as large a text entry area as possible for the user.
[0059] The text input method according to this embodiment is based on the above embodiment, and the text input method is further optimized in this embodiment, specifically, a text library control is displayed at the target position of the editing page, and when the user clicks the text library control, pre-defined texts in the text library are displayed, and the user is allowed to select the preferred text to add to the video to be edited. The advantage of the optimization is to provide more text options for the user, and further improve the efficiency and satisfaction of the user in adding text.
[0060] 12 is a structural schematic diagram of a text input device in an embodiment of the present disclosure. As shown in FIG. 12, the text input device specifically includes: a recommendation text determination module 1210, a first display module 1220 and a second display module 1230.
[0061] Here, the recommendation text determination module 1210 is used to determine at least two recommendation text items based on the video to be edited, a first display module 1220 is used to display the at least two recommendation text items in a first target area of an editing page of the video to be edited, and a second display module 1230 is used to display a first text contained in the first recommendation text item in a text input area of the editing page in response to a first trigger operation acting on the first recommendation text item, where the first trigger operation is used to determine the first recommendation text item to be selected from the at least two recommendation text items.
[0062] Optionally, the second display module 1230 is further used to replace the first text with a second text included in the second recommended text item or display the second text at a relative position of the first text in response to a second trigger operation acting on the second recommended text item, where the second trigger operation is used to determine the second recommended text item to be selected from the at least two recommended text items.
[0063] Optionally, the first display module 1220 is further used to, in response to a first trigger operation acting on the first recommended text item, use another recommended text item other than the first recommended text item to replace the first recommended text item and display it in the first target area.
[0064] Optionally, the device further includes a first related text determination module for determining at least two first related text items based on the first text in response to an editing operation on the first text, and the first display module 1220 is further used to use the at least two first related text items to replace the recommended text item for display in the first target area.
[0065] Optionally, the second display module 1230 is further used to display a third text contained in the target-related text item in the text input area of the editing page in response to a third trigger operation acting on the target-related text item, wherein the third trigger operation is used to determine the target-related text item to be selected from the at least two first related text items.
[0066] Optionally, the device further includes a second related text determination module for determining at least two second related text items based on the third text, and accordingly, the first display module 1220 is further used to use the at least two second related text items to replace the at least two first related text items for display in the first target area.
[0067] Optionally, the recommendation text items are sorted and displayed in the first target area based on the relevance to the edited video and / or the attention of each of the recommendation text items.
[0068] And / or, each of the related text items is sorted and displayed in the first target area based on the relevance to the video to be edited and / or the prominence of each of the related text items.
[0069] Optionally, the recommended text determination module 1210 includes a frame extraction unit for performing frame extraction on the edited video, a first determination unit for determining subject information of the edited video based on the extracted video frames, and a second determination unit for determining the at least two recommended text items based on the subject information and / or attention information of each candidate text item in a text library.
[0070] Optionally, the apparatus further includes a third display module for displaying a text library control at a target location of the editing page, and a fourth display module for displaying a preset text in a second target area of the editing page in response to a trigger operation acting on the text library control, and accordingly, the second display module 1230 is further used for displaying the target preset text in a text input area of the editing page in response to a fourth trigger operation on the target preset text, and the fourth trigger operation is used to determine the target preset text to be selected from the preset texts.
[0071] Optionally, the device further includes a fifth display module for displaying at least two draft classification labels in a third target area of the editing page, and accordingly, the fourth display module is further used for displaying a pre-set draft under the target draft classification label in the second target area in response to a fifth trigger operation acting on the target draft classification label, wherein the fifth trigger operation is used to determine the target draft classification label to be selected from the at least two draft classification labels.
[0072] Optionally, the first display module 1220 is further used for displaying a pre-defined text item in the first target area when the operation of determining at least two recommended text items based on the edited video fails.
[0073] The text input device according to the embodiment of the present disclosure determines at least two recommended text items based on the video to be edited, displays the at least two recommended text items in a first target area of the video editing page, and displays a first text included in the triggered recommended text item in the text input area of the editing page when the user triggers one of the recommended text items, thereby realizing the input of the first text. That is, when the user adds text to the video to be edited, the recommended text items are provided for the user, and the user only needs to select his / her preferred one from the provided recommended text items, and does not need to construct words and form text by himself / herself, which reduces the user's thinking cost and improves the user's satisfaction with the added text, and can encourage more users to add text information when posting videos, which greatly meets the needs of users who are willing to express themselves in text but are limited by their own verbal expressiveness. Furthermore, adding more text information to the video helps to improve the efficiency of video consumption.
[0074] The text input device according to the embodiments of the present disclosure can perform the steps in the text input method according to the method embodiments of the present disclosure, and the specific steps performed and beneficial effects are not detailed here.
[0075] FIG. 13 is a structural schematic diagram of an electronic device in an embodiment of the present disclosure. The following specifically refers to FIG. 13. It shows a structural schematic diagram for realizing an electronic device 500 in an embodiment of the present disclosure. The electronic device 500 in an embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet personal computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), wearable electronic devices, and fixed terminals such as digital TVs, desktop personal computers, smart home devices, and the like. The electronic device shown in FIG. 13 is merely an example and does not pose any limitation to the functions and scope of use of the embodiment of the present disclosure.
[0076] As shown in Fig. 13, the electronic device 500 may include a processing unit (e.g., a central processor, a graphics processor, etc.) 501, which can perform various appropriate operations and processes to realize the method of the embodiments described in the present disclosure based on a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for operating the electronic device 500 are further stored. The processing unit 501, the ROM 502 and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.
[0077] Typically, the following devices may be connected to the I / O interface 505: input devices 506 including, for example, a touch screen, touch panel, keyboard, mouse, camera, microphone, accelerometer, gyro, etc.; output devices 507 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 508 including, for example, a tape, hard disk, etc.; and communication devices 509. The communication devices 509 may enable the electronic device 500 to communicate wirelessly or wired with other devices to exchange data. Although FIG. 13 shows the electronic device 500 having various devices, it should be understood that it does not have to implement or include all of the devices shown. More or fewer devices may alternatively be implemented or included.
[0078] In particular, according to the embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, the embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, the computer program including a program code for executing the method shown in the flowchart, thereby implementing the method described above. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 509, or may be installed from the storage device 508, or may be installed from the ROM 502. When the computer program is executed by the processing device 501, it performs the above-mentioned functions defined in the method of the embodiment of the present disclosure.
[0079] It should be explained that the computer readable medium of the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the above. The computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer readable storage medium may include, but are not limited to, an electrical connection having one or more conductors, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact magnetic disk read-only memory (CD-ROM), an optical memory device, a magnetic memory device, or any suitable combination of the above. In the present disclosure, the computer readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with computer-readable program code carried thereon. Such propagated data signals may take many different forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which may transmit, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted over any suitable medium, including, but not limited to, electrical wires, optical cables, RF (radio frequency), or the like, or any suitable combination of the above.
[0080] In some embodiments, the clients and servers may communicate using any network protocol now known or later developed, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include a local area network ("LAN"), a wide area network ("WAN"), an internet network (e.g., the Internet), and an end-to-end network (e.g., an ad hoc end-to-end network), as well as any network now known or later developed.
[0081] The computer readable medium may be included in the electronic device or may be separate from and not integrated into the electronic device.
[0082] One or more programs are loaded on the computer-readable medium, and when the one or more programs are executed by the electronic device, the electronic device: Based on the video to be edited, at least two recommended text items are determined, and the at least two recommended text items are displayed in a first target area of an editing page of the video to be edited, and in response to a first trigger operation acting on a first recommended text item, a first text contained in the first recommended text item is displayed in a text input area of the editing page, wherein the first trigger operation is used to determine the first recommended text item to be selected from the at least two recommended text items.
[0083] Optionally, when the one or more programs are executed by the electronic device, the electronic device may perform other steps described in the above embodiments.
[0084] Computer program code for carrying out the operations of the present disclosure may be organized using one or more programming languages or combinations thereof, including but not limited to object-oriented programming languages such as Java, Smalltalk, C++, and also including conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computer, partially on the user computer, as a single separate software pack, partially on the user computer and partially on a remote computer, or entirely on a remote computer or server. In the context of a remote computer, the remote computer may be connected to the user computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., connected via the Internet using an Internet Service Provider).
[0085] In the flowcharts and block diagrams in the drawings, possible system architectures, functions and operations of the system, method and computer program product according to the embodiments of the present disclosure are illustrated. In this regard, each block in the flowcharts or block diagrams represents a module, program segment or part of code, which includes one or more executable instructions for implementing the specified logical function. It should be noted that in some alternative implementations, the functions shown in the blocks may occur in a different order than the order shown in the drawings. For example, two blocks shown in succession may actually be executed substantially in parallel, or in some cases may be executed in the reverse order, as determined by the relevant functionality. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware system that executes the specified function or operation, or may be implemented using a combination of dedicated hardware and computer instructions.
[0086] The units described in the embodiments of the present disclosure may be implemented in a software manner or a hardware manner, and the names of the units, in some cases, do not limit the units themselves.
[0087] The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.
[0088] In the context of this disclosure, a machine-readable medium may be a tangible medium, which may include or store a program for use in or in connection with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the above. More specific examples of machine-readable storage media include an electrical connection by one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0089] According to one or more embodiments of the present disclosure, the present disclosure provides a text input method, the method including: determining at least two recommended text items based on a video to be edited; displaying the at least two recommended text items in a first target area of an editing page of the video to be edited; and displaying a first text contained in the first recommended text item in a text input area of the editing page in response to a first trigger operation acting on the first recommended text item, wherein the first trigger operation is used to determine the first recommended text item to be selected from the at least two recommended text items.
[0090] According to one or more embodiments of the present disclosure, the text input method of the present disclosure optionally further includes, in response to a second trigger operation acting on a second recommended text item, replacing the first text with a second text included in the second recommended text item or displaying the second text at a relative position of the first text, wherein the second trigger operation is used to determine the second recommended text item to be selected from the at least two recommended text items.
[0091] According to one or more embodiments of the present disclosure, the text input method of the present disclosure optionally further includes, in response to a first trigger operation acting on a first recommended text item, using another recommended text item other than the first recommended text item to replace the first recommended text item and display it in the first target area.
[0092] According to one or more embodiments of the present disclosure, the text input method of the present disclosure optionally further includes determining at least two first related text items based on the first text in response to an editing operation on the first text, and using the at least two first related text items to replace the recommended text item for display in the first target area.
[0093] According to one or more embodiments of the present disclosure, the text input method of the present disclosure further includes, selectively, displaying a third text included in the target related text item in a text input area of the editing page in response to a third trigger operation acting on the target related text item, wherein the third trigger operation is used to determine the target related text item to be selected from the at least two first related text items, and determining at least two second related text items based on the third text, and using the at least two second related text items to replace the at least two first related text items for display in the first target area.
[0094] According to one or more embodiments of the present disclosure, in the text input method of the present disclosure, optionally, each of the recommended text items is sorted and displayed in the first target area based on relevance to the video to be edited and / or attention of each of the recommended text items, and / or each of the related text items is sorted and displayed in the first target area based on relevance to the video to be edited and / or attention of each of the related text items.
[0095] According to one or more embodiments of the present disclosure, in the text input method of the present disclosure, optionally, determining at least two recommended text items based on the video to be edited as described above includes performing frame extraction on the video to be edited, determining thematic information of the video to be edited based on the extracted video frames, and determining the at least two recommended text items based on the thematic information and / or attention information of each candidate text item in a text library.
[0096] According to one or more embodiments of the present disclosure, a text input method according to the present disclosure further includes selectively displaying a text library control at a target location on the editing page; displaying a preset text in a second target area of the editing page in response to a trigger operation acting on the text library control; and displaying the target preset text in a text input area of the editing page in response to a fourth trigger operation on the target preset text, wherein the fourth trigger operation is used to determine the target preset text to be selected from the preset texts.
[0097] According to one or more embodiments of the present disclosure, the text input method of the present disclosure further includes selectively displaying at least two draft classification labels in a third target area of the editing page, and displaying pre-defined drafts under the target draft classification labels in the second target area in response to a fifth trigger operation acting on the target draft classification labels, wherein the fifth trigger operation is used to determine the target draft classification label to be selected from the at least two draft classification labels.
[0098] According to one or more embodiments of the present disclosure, the text input method of the present disclosure optionally further includes displaying a pre-defined text item in the first target area if the operation of determining at least two recommended text items based on the video to be edited fails.
[0099] According to one or more embodiments of the present disclosure, the present disclosure provides a text input device, the device including: a recommendation text determination module for determining at least two recommendation text items based on a video to be edited; a first display module for displaying the at least two recommendation text items in a first target area of an editing page of the video to be edited; and a second display module for displaying a first text contained in the first recommendation text item in a text input area of the editing page in response to a first trigger operation acting on the first recommendation text item, wherein the first trigger operation is used to determine the first recommendation text item to be selected from the at least two recommendation text items.
[0100] According to one or more embodiments of the present disclosure, in the text input device according to the present disclosure, optionally, the second display module is further used to replace the first text using a second text included in the second recommended text item or display the second text at a relevant position of the first text in response to a second trigger operation acting on the second recommended text item, wherein the second trigger operation is used to determine the second recommended text item to be selected from the at least two recommended text items.
[0101] According to one or more embodiments of the present disclosure, in the text input device according to the present disclosure, optionally, the first display module is further used to replace the first recommended text item with another recommended text item other than the first recommended text item and display it in the first target area in response to a first trigger operation acting on the first recommended text item.
[0102] According to one or more embodiments of the present disclosure, in the text input device of the present disclosure, optionally, the device further includes a first related text determination module for determining at least two first related text items based on the first text in response to an editing operation on the first text, and the first display module is further used to replace the recommended text item using the at least two first related text items for display in the first target area.
[0103] According to one or more embodiments of the present disclosure, in a text input device according to the present disclosure, optionally, the second display module is further used to display a third text contained in the target-related text item in the text input area of the editing page in response to a third trigger operation acting on the target-related text item, wherein the third trigger operation is used to determine the target-related text item to be selected from the at least two first related text items.
[0104] According to one or more embodiments of the present disclosure, in the text input device according to the present disclosure, optionally, the device further includes a second related text determination module for determining at least two second related text items based on the third text, and accordingly, the first display module is further used to use the at least two second related text items to replace the at least two first related text items for display in the first target area.
[0105] According to one or more embodiments of the present disclosure, in the text input device according to the present disclosure, selectively, each of the recommended text items is sorted and displayed in the first target area based on the relevance to the video to be edited and / or the attention of each of the recommended text items, and / or each of the related text items is sorted and displayed in the first target area based on the relevance to the video to be edited and / or the attention of each of the related text items.
[0106] According to one or more embodiments of the present disclosure, in the text input device according to the present disclosure, optionally, the recommended text determination module includes a frame extraction unit for performing frame extraction on the video to be edited, a first determination unit for determining subject information of the video to be edited based on the extracted video frames, and a second determination unit for determining the at least two recommended text items based on the subject information and / or attention information of each candidate text item in a text library.
[0107] According to one or more embodiments of the present disclosure, in the text input device according to the present disclosure, optionally, the device further includes a third display module for displaying a text library control at a target position of the editing page, and a fourth display module for displaying a preset text in a second target area of the editing page in response to a trigger operation acting on the text library control, and accordingly, the second display module is further used for displaying the target preset text in the text input area of the editing page in response to a fourth trigger operation on the target preset text, and the fourth trigger operation is used to determine the target preset text to be selected from the preset texts.
[0108] According to one or more embodiments of the present disclosure, in the text input device according to the present disclosure, optionally, the device further includes a fifth display module for displaying at least two draft classification labels in a third target area of the editing page, and accordingly, the fourth display module is further used for displaying a pre-set draft under the target draft classification label in the second target area in response to a fifth trigger operation acting on the target draft classification label, wherein the fifth trigger operation is used to determine the target draft classification label to be selected from the at least two draft classification labels.
[0109] According to one or more embodiments of the present disclosure, in the text input device of the present disclosure, optionally, the first display module is further used to display a pre-defined text item in the first target area when the operation of determining at least two recommended text items based on the video to be edited fails.
[0110] According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device, the electronic device comprising: one or more processors; a memory for storing one or more programs; The one or more programs, when executed by the one or more processors, cause the one or more processors to implement any one of the text input methods according to the present disclosure.
[0111] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, realizes any one of the text input methods according to the present disclosure.
[0112] An embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions, which, when executed by a processor, implements the text input method described above.
[0113] The above description is merely a description of the preferred embodiments and the technical principles of the present disclosure. It should be understood by those skilled in the art that the scope of the present disclosure is not limited to the technical solution made by the specific combination of the above technical features, but should also include other technical solutions made by any combination of the above technical features or their equivalent features without departing from the concept disclosed above. For example, a technical solution made by mutually replacing the above features with technical features having similar functions disclosed in the present disclosure (but not limited to them).
[0114] It should be noted that although operations are described in a particular order, it should not be understood that these operations must be performed in the particular order shown or in sequential execution. In certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the above description includes some specific implementation details, these should not be construed as limiting the scope of the disclosure. Some features described in the context of a single embodiment may be combined and implemented in a single embodiment. Conversely, each feature described in the context of a single embodiment may be implemented in multiple embodiments alone or in any suitable subcombination manner.
[0115] Although the present subject matter has been described in terms specific to structural features and / or methodological operations, it should be understood that the subject matter defined by the claims is not necessarily limited to the specific features or operations described above. Rather, the specific features and operations described above are merely example forms of implementing the claims.
Claims
1. A method of text entry executed by at least a processor, the method comprising: determining at least two recommended text items based on the edited video; Displaying the at least two recommendation text items in a first target area of an editing page of the edited video; displaying a first text included in a first recommended text item in a text input area of the editing page in response to a first trigger operation acting on the first recommended text item, the first trigger operation being used to determine the first recommended text item to be selected from the at least two recommended text items; The method of the text input method further includes, in response to a first trigger operation acting on a first recommended text item, using another recommended text item other than the first recommended text item to replace the first recommended text item and display it in the first target area.
2. The method comprises: and further comprising: in response to a second trigger operation acting on a second recommendation text item, replacing the first text with a second text included in the second recommendation text item, or displaying the second text at a position relative to the first text; The method of claim 1 , wherein the second trigger operation is used to determine the second recommended text item to be selected from the at least two recommended text items.
3. determining at least two first related text items based on the first text in response to an editing operation on the first text; The method of claim 1 , further comprising: utilizing the at least two first related text items to replace the recommended text item for display in the first target area.
4. displaying, in a text entry area of the edit page, a third text included in the target-related text item in response to a third trigger operation acting on the target-related text item, the third trigger operation being used to determine the target-related text item to be selected from the at least two first related text items; 4. The method of claim 3, further comprising: determining at least two second related text items based on the third text; and utilizing the at least two second related text items to replace the at least two first related text items for display in the first target area.
5. The recommended text items are sorted and displayed in the first target area based on the relevance to the video to be edited and / or the attention of each of the recommended text items; The method of claim 3 , further comprising: sorting and displaying the related text items in the first target area based on their relevance to the video to be edited and / or their prominence.
6. Determining at least two recommended text items based on the edited video includes: performing frame extraction on the video to be edited; determining thematic information of the to-be-edited video based on the extracted video frames; Determining the at least two recommended text items based on the topic information and / or popularity information of each candidate text item in a text library.
7. displaying a copybook library control at a target location on the edit page; displaying pre-defined copy prompts in a second target area of the edit page in response to a trigger operation acting on the copy prompt library control; The method of any one of claims 1 to 5, further comprising: displaying a pre-defined text in the second target area in a text input area of the editing page in response to a fourth trigger operation on a pre-defined text in the second target area, the fourth trigger operation being used to determine a pre-defined text in the second target area to be selected from the pre-defined texts.
8. displaying at least two copybook classification labels in a third target area of the edit page; 8. The method of claim 7, further comprising: in response to a fifth trigger operation acting on a target sentence classification label, displaying a preset sentence under the target sentence classification label in the second target area, the fifth trigger operation being used to determine the target sentence classification label to be selected from the at least two sentence classification labels.
9. The method according to any one of claims 1 to 5, further comprising: displaying a pre-defined text item in the first target area if the operation of determining at least two recommended text items based on the edited video fails.
10. 1. A text input device, comprising: a recommendation text determination module for determining at least two recommendation text items based on the edited video; a first display module for displaying the at least two recommendation text items in a first target area of an editing page of the edited video; a second display module for displaying a first text included in the first recommended text item in a text input area of the editing page in response to a trigger operation acting on the first recommended text item, the second display module being used to determine the first recommended text item to be selected from the at least two recommended text items; The text input device, wherein the first display module is further used for, in response to a first trigger operation acting on the first recommended text item, replacing the first recommended text item with another recommended text item other than the first recommended text item and displaying it in the first target area.
11. An electronic device, one or more processors; a storage device for storing one or more programs; An electronic device, wherein said one or more programs, when executed by said one or more processors, cause said one or more processors to implement the method of any one of claims 1-5.
12. A computer readable storage medium having a computer program stored thereon, the program implementing the method according to any one of claims 1 to 5 when executed by a processor.
Citation Information
Patent Citations
Communication terminal, communication information providing server, communication system, mobile phone terminal, communication information generation method, communication information generation program, communication auxiliary method, and communication auxiliary program
JP2011076140A
Electronic apparatus, method, and program
JP2015022654A
Electronic apparatus, method, and program
JP2015022656A
Messenger search method using interaction, and server and application realizing the same
JP2018109991A
Text description generating method and device, mobile terminal and storage medium
US20200242296A1