Clipboard content pasting method and related apparatus
By recognizing the scenarios and user intent of copying and pasting pages, electronic devices extract and process the content to be pasted from the clipboard, solving the problem of tedious copying and pasting between different apps or pages and improving the accuracy and efficiency of pasting.
Patent Information
- Application Number
- PCT/CN2024/101727
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-07-04
- Filing Date
- 2024-06-26
- Publication Date
- 2025-01-09
AI Technical Summary
When copying and pasting content between different apps or pages on electronic devices, users often struggle to accurately select the content they need, and the cumbersome process leads to a poor user experience, especially when there is redundant information or multiple pieces of information spaced apart in the copied content.
Electronic devices can extract and process content to be pasted from the clipboard by recognizing the scenarios and user intent of copying and pasting pages, and provide matching paste options, including error correction, completion, sorting and filtering, thereby improving pasting efficiency and accuracy.
It simplifies the copy-paste operation for users, reduces the processing of redundant information and switching between apps, and improves user experience and efficiency.
Smart Images

Figure CN2024101727_09012025_PF_FP_ABST
Abstract
Description
Method for pasting clipboard contents and related device
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on July 4, 2023, with application number 202310810949.7, and priority to the Chinese patent application entitled “Method for pasting clipboard contents and related devices”, all contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminal technology, and in particular to a method for pasting clipboard contents and related devices. Background Art
[0003] When using electronic devices such as mobile phones and computers, users often need to copy and paste between different apps or pages. This demand is common in social, office, entertainment, shopping and other scenarios. However, in current practical applications, it is rather troublesome for users to accurately copy the required content from a piece of content. For example, because the cursor displayed on the mobile phone screen is small, users need to repeatedly adjust the cursor position to select the content to be copied. For another example, some applications only support copying the entire content. Users need to copy and paste the entire content, and then delete the unnecessary parts of the entire content one by one. In addition, users may need to copy multiple pieces of information in a piece of content, and these multiple pieces of information may be distributed at intervals. If the user needs to paste the copied multiple pieces of information into other apps, the user has to repeatedly switch between apps and perform multiple copy and paste operations. It can be seen that the above copy and paste operations are rather cumbersome and the user experience is poor.
[0004] Summary of the Invention
[0005] This application provides a method and related apparatus for pasting clipboard content. An electronic device can extract content to be pasted from the clipboard content that satisfies the user's intent and matches the pasting scenario based on the copy page and the paste page. The electronic device can provide the content to be pasted on the paste page for the user to select and enter into an input box on the paste page. The electronic device can provide the content to be pasted on the paste page for the user to select and enter into an input box on the paste page.
[0006] In a first aspect, the present application provides a method for pasting clipboard content. The electronic device receives a first operation on first content on a first page and stores the first content in the clipboard; the electronic device receives a second operation to enter a second page and displays the second page; the electronic device provides a first paste option on the second page, the first paste option being used to paste second content, the second content being obtained after processing the first content and being related to the second page; the electronic device receives a third operation to enter a third page and displays the third page; the electronic device provides a second paste option on the third page, the second paste option being used to paste third content, the third content being obtained after processing the first content and being related to the third page.
[0007] Among them, the above-mentioned first operation can be an operation of copying the first content, or an operation of cutting the first content. The first content can be copied content or cut content (i.e., clipboard content). The first page can be the copy page in this application, and the second page and the third page can both be the paste page in this application. The second page and the third page can be different pages in the same application, or they can also be pages in different applications. The second content and the third content can be the content to be pasted obtained after the electronic device processes the first content. The second content and the third content can be different, or they can be the same.
[0008] In some embodiments, the second content being associated with the second page may specifically mean that the second content matches the type of content to be input in the input box on the second page. The third content being associated with the third page may specifically mean that the third content matches the type of content to be input in the input box on the third page.
[0009] It can be seen from the above method that for the same copied content, the electronic device can provide paste options corresponding to the content to be pasted related to each paste page from the copied content according to different paste pages. The content to be pasted related to a paste page can be the content that the electronic device analyzes that the user wants to paste from the copied content to the paste page. In this way, when the copied content contains a lot of redundant information, the user does not need to move the cursor when copying and perform tedious copy content selection operations, and does not need to delete the redundant information one by one after pasting the copied content. In addition, when there are multiple pieces of information in the copied content that the user wants to copy and paste, but these multiple pieces of information are distributed at intervals, the user can copy all the information as a whole without having to switch between APPs to perform multiple copy and paste operations. The above method can effectively improve the efficiency of user copy and paste and improve the user's copy and paste experience.
[0010] In combination with the first aspect, in some embodiments, before the electronic device provides the first paste option on the second page, the electronic device can extract the fourth content from the first content based on the first page and the second page, wherein the second content is the fourth content, or is the content obtained after processing the fourth content.
[0011] Similarly, before providing the second paste option on the third page, the electronic device may extract the first content based on the first page and the third page to obtain the third content, or process the content extracted from the first content to obtain the third content.
[0012] It can be seen that the content to be pasted provided by the electronic device on the paste page for the user to paste can be directly extracted from the copied content, or can be obtained by extracting relevant content from the copied content and then processing it. For example, when the first content contains a lot of redundant information, the electronic device can eliminate the redundant information in the first content based on the first page and the second page, and extract the information in the first content that the user is most likely to want to paste. In this way, the user does not need to move the cursor when copying and perform tedious operations to select the copied content, and does not need to delete the redundant information one by one after pasting the copied content. For another example, when there are multiple pieces of information in the first content that the user wants to copy and paste, but these multiple pieces of information are distributed at intervals, the electronic device can extract all the multiple pieces of information that the user wants to copy and paste based on the first page and the second page as content to be pasted and display them on the paste page. In this way, the user can perform multiple copy and paste operations without repeatedly switching between APPs.
[0013] In conjunction with the first aspect, in some embodiments, the electronic device uses a public knowledge base to determine that the fourth content contains one or more errors and then performs error correction processing on the fourth content. The public knowledge base contains public knowledge in one or more fields (e.g., music, film, technology, agriculture, etc.). The data in the public knowledge base can be obtained by crawling data from databases such as websites and applications using a data crawler. In some embodiments, the second content can be the content after the error correction processing of the fourth content has been performed.
[0014] As can be seen, the electronic device can correct errors in the pasted content. In this way, even if there are errors in the information in the copied content, the electronic device can provide the correct content to the user for pasting after correction, avoiding the incorrect copied content affecting the user's use effect and experience.
[0015] In combination with the first aspect, in some embodiments, the electronic device uses the user's personal knowledge base and / or the public knowledge base to supplement the sixth content in the fifth content to obtain the second content, and the fifth content is the content obtained by error correction processing of the fourth content; the user's personal knowledge base includes one or more of the following user information: the user's age group, the user's home and company address, the user's preferences, and the user's habits.
[0016] For example, the fifth content mentioned above is the titles of one or more TV series played on playback platform 1. The electronic device discovers from the public knowledge base that the first content also stores the titles of TV series played on playback platform 1 in addition to the fifth content. The titles of the TV series that belong to playback platform 1 but have not yet been extracted into the fifth content can be the sixth content. The electronic device can then add the titles of the TV series that belong to playback platform 1 from the first content but have not yet been extracted into the fifth content to the fifth content.
[0017] It can be seen that after correcting the content to be pasted, the electronic device can further complete the corrected content to be pasted based on the user's personal knowledge base and / or public knowledge base, so as to provide the user with content to be pasted that conforms to the user's expression or search habits, and the above method can improve the content to be pasted and reduce the situation where information that the user may need is omitted in the copied content.
[0018] Optionally, the electronic device may first complete the content to be pasted, and then perform error correction on the completed content to be pasted.
[0019] In combination with the first aspect, in some embodiments, the electronic device uses the user's personal knowledge base and / or the public knowledge base to supplement the seventh content in the fourth content to obtain the second content. The user's personal knowledge base contains one or more of the following user information: the user's age group, the user's home and company address, the user's preferences, and the user's habits. The public knowledge base contains public knowledge in one or more fields.
[0020] For example, the fourth content may include a movie theater frequently visited by the user. The electronic device determines, based on the user's personal knowledge base, that the movie theater frequently visited by the user is an AA movie theater. The name of the AA movie theater may be the seventh content. The electronic device may add the AA movie theater to the fourth content.
[0021] It can be seen that the electronic device can complete the content to be pasted based on the user's personal knowledge base and / or the public knowledge base, so as to provide the user with content to be pasted that conforms to the user's expression or search habits, and the above method can improve the content to be pasted and reduce the situation where information that the user may need is omitted in the copied content.
[0022] In combination with the first aspect, in some embodiments, the electronic device determines that the user's preference for the eighth content is higher than the preference for the second content based on the user's personal knowledge base, and the user's personal knowledge base includes one or more of the following user information: the user's age group, the user's home and company address, the user's preferences, and the user's habits. The eighth content is obtained after processing the first content, and the eighth content is related to the second page; the electronic device provides a first paste option and a third paste option on the second page, and the third paste option is used to paste the eighth content; wherein, the display position of the third paste option is better than the display position of the first paste option.
[0023] For example, the second content is the title of TV series 1. The eighth content is the title of TV series 2. The electronic device can determine that TV series 2 is a TV series that the user prefers to watch based on the user's personal knowledge base.
[0024] The display position of the third paste option being superior to the display position of the first paste option can mean that the third paste option is displayed at a front position relative to the first paste option. For example, if the paste options are displayed in a top-down order, the third paste option can be displayed above the first paste option. For another example, if the paste options are displayed in a left-to-right order, the third paste option can be displayed to the left of the first paste option. It is understood that displaying the paste option corresponding to the to-be-pasted content with a higher user preference in a more preferred position can facilitate users to prioritize pasting the information they are interested in on the paste page.
[0025] In conjunction with the first aspect, in some embodiments, the electronic device provides a first paste option and a fourth paste option on the second page. The fourth paste option is used to paste ninth content, which is obtained by processing the first content and is related to the second page; the ninth content is different from the second content. The electronic device receives an operation for the first paste option and pastes the second content into an input box on the second page. After exiting the second page, the electronic device receives an operation to enter the second page again and displays the second page. The electronic device provides the fourth paste option on the second page, wherein the paste options on the second page do not include the first paste option.
[0026] For example, the second content may be gift package redemption code 1. The ninth content may be gift package redemption code 2. The second page may be a page for entering a gift package redemption code for gift package redemption. When gift package redemption code 1 (i.e., the second content) has been pasted and used, the electronic device enters the second page again. The electronic device may filter out gift package redemption code 1 and only provide a paste option corresponding to gift package redemption code 2. This can prevent the user from forgetting that gift package redemption code 1 has been used and pasting gift package redemption code 1 again, resulting in invalid redemption.
[0027] As can be seen, the electronic device can filter the content to be pasted and remove the information that has been pasted in the content to be pasted. This can reduce the interference of the expired information on the user when the information becomes invalid after being pasted, and prevent the user from repeatedly pasting the expired information.
[0028] In combination with the first aspect, in some embodiments, the electronic device provides a first paste option and a fifth paste option on the second page, the fifth paste option is used to paste the tenth content, the tenth content is obtained after processing the first content, and the tenth content is related to the second page; the electronic device receives an operation on the first paste option, pastes the second content in the input box on the second page, and jumps to the fourth page; the electronic device provides a fifth paste option on the fourth page, wherein the paste options on the fourth page do not include the first paste option.
[0029] For example, the second content may be a store name. The tenth content may be a product name. The second page may be the homepage of a shopping application. It is understandable that when the homepage of a shopping application is displayed, the user may want to search for a store or a product. Therefore, the electronic device may provide paste options corresponding to the second content and the tenth content. When pasting the store name in the search box on the homepage of a shopping application, searching for and entering the product display page of the store, the user usually wants to search for products within the store, rather than searching for other stores within the store. The fourth page may be the product display page of the store. When switching to the fourth page, the electronic device may filter out the second content and retain the tenth content.
[0030] It can be seen that the electronic device can filter out the information that the user needs to paste according to the changes in the pasting page, thereby reducing the interference of other information on the user.
[0031] In combination with the first aspect, in some embodiments, the specific method for an electronic device to extract fourth content from a first content based on a first page and a second page may include: the electronic device determines first page information based on the first page, and determines second page information based on the second page; the electronic device identifies a first pasting scenario and a first user intention based on the first page information and the second page information; the electronic device determines first extraction prompt information based on the first pasting scenario and the first user intention; and the electronic device uses a language model to extract the fourth content from the first content through the first extraction prompt information.
[0032] Similarly, the electronic device can determine the third page information based on the third page, and identify the corresponding pasting scenario and user intention based on the first page information and the third page information, and then extract content related to the third page from the first content based on the pasting scenario and user intention.
[0033] As can be seen, the electronic device can identify the paste scenario and user intent by combining the copy and paste pages, and extract the content to be pasted that satisfies the user intent and matches the paste scenario from the copied content. This can effectively improve the user's copy and paste efficiency and enhance the user's copy and paste experience.
[0034] In conjunction with the first aspect, in some embodiments, the first page information includes the first content and / or contextual information of the first content, and the second page information includes one or more of the following: the app category to which the second page belongs, the type of content to be entered in the input box of the second page, and operation information related to the second page. The third page information may include one or more of the following: the app category to which the third page belongs, the type of content to be entered in the input box of the third page, and operation information related to the third page.
[0035] In combination with the first aspect, in some embodiments, before the electronic device provides the first paste option on the second page, the electronic device receives an operation on the first input box on the second page; after the electronic device provides the first paste option on the second page, the electronic device receives an operation on the first paste option and pastes the second content in the first input box.
[0036] The second page also includes a second input box. The electronic device receives an operation on the second input box and provides a sixth paste option on the second page. The sixth paste option is used to paste an eleventh content, the eleventh content being obtained by processing the first content, and the eleventh content being related to the second page. The electronic device receives an operation on the sixth paste option and pastes the eleventh content into the second input box.
[0037] As can be seen, when the pasting page contains multiple input boxes, the electronic device can provide the content to be pasted that matches the type of the content to be input in the input box selected by the user. In this way, the user can paste the corresponding content in the multiple input boxes one by one.
[0038] In combination with the first aspect, in some embodiments, the second page includes n1 input boxes, n1 is a positive integer greater than 1, and the second content includes n1 pieces of information; after the electronic device provides a first paste option on the second page, the electronic device receives an operation on the first paste option and pastes the n1 pieces of information in the n1 input boxes respectively.
[0039] As can be seen, when the paste page contains multiple input boxes, the electronic device can provide the user with the content to be pasted that matches each of the multiple input boxes as a paste option. In this way, the user can fill in multiple pieces of information in the content to be pasted into the multiple input boxes on the paste page with one click, which can improve the user's copy and paste efficiency.
[0040] In combination with the first aspect, in some embodiments, the first content belongs to the most recent m1 copied or cut content before the electronic device displays the second page, where m1 is a positive integer, or the second page is a page displayed by the electronic device within a first time period after receiving the first operation.
[0041] In combination with the first aspect, in some embodiments, the electronic device receives an operation on the twelfth content on the fifth page, stores the twelfth content in the clipboard, the fifth page is the same as or different from the first page, and the twelfth content is different from the first content; the electronic device receives an operation to enter the sixth page and displays the sixth page; the electronic device provides a seventh paste option and an eighth paste option on the sixth page, the seventh paste option is used to paste the thirteenth content, and the eighth paste option is used to paste the fourteenth content, the thirteenth content is obtained after processing the first content, and the thirteenth content is related to the sixth page, and the fourteenth content is obtained after processing the twelfth content, and the fourteenth content is related to the sixth page.
[0042] The electronic device may determine the fifth page information based on the fifth page and determine the sixth page information based on the sixth page. The electronic device may process the first content based on the first and sixth page information to obtain the thirteenth content. The electronic device may process the twelfth content based on the fifth and sixth page information to obtain the fourteenth content.
[0043] It can be seen that the electronic device can use the multiple copied contents in the clipboard to extract the content to be pasted. In this way, when a user interface contains multiple pieces of information that need to be copied, the user can perform multiple copy operations and then open the paste page where the paste needs to be pasted, so as to quickly paste the multiple copied contents into one or more input boxes in the paste page. The user does not need to switch repeatedly between the copy page (such as the chat page of the instant messaging application) and the paste page (such as the page of the information entry application). The above method can effectively improve the efficiency of the user's copy and paste and improve the user's copy and paste experience.
[0044] In a second aspect, the present application provides an electronic device, which may include a display screen, a memory, and a processor. The display screen may be used to display application pages. The memory may be used to store a computer program. The processor may be used to invoke the computer program, causing the electronic device to execute any possible implementation method described in the first aspect.
[0045] In a third aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, enables the electronic device to execute any possible implementation method in the first aspect.
[0046] In a fourth aspect, the present application provides a computer program product, which may include computer instructions. When the computer instructions are run on an electronic device, the electronic device executes any possible implementation method as in the first aspect.
[0047] In a fifth aspect, the present application provides a chip, which is applied to an electronic device. The chip includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute any possible implementation method as in the first aspect.
[0048] It is understandable that the electronic device provided in the second aspect, the computer-readable storage medium provided in the third aspect, the computer program product provided in the fourth aspect, and the chip provided in the fifth aspect are all used to execute the methods provided in the embodiments of the present application. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] FIG1 is a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;
[0050] FIG2 is a software structure block diagram of an electronic device 100 provided in an embodiment of the present application;
[0051] 3A to 3E are schematic diagrams of some methods for processing clipboard content provided in embodiments of the present application;
[0052] 4A to 4L are schematic diagrams of some movie ticket purchase scenarios and navigation scenarios provided in embodiments of the present application;
[0053] 5A to 5G are schematic diagrams of some shopping scenarios provided in embodiments of the present application;
[0054] 6A to 6F are schematic diagrams of some film and television drama search scenarios provided by embodiments of the present application;
[0055] 7A to 7H are schematic diagrams of some redemption code redemption scenarios provided by embodiments of the present application;
[0056] 8A to 8I are schematic diagrams of some contact adding scenarios provided in embodiments of the present application;
[0057] 9A to 9H are schematic diagrams of some information entry scenarios provided in embodiments of the present application. DETAILED DESCRIPTION
[0058] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and claims of the present application, the singular expressions "a", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in a kind of "or" relationship.
[0059] References to "one embodiment" or "some embodiments" etc. described in this specification mean that the specific features, structures or characteristics described in conjunction with the embodiment are included in one or more embodiments of the present application. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in another way. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in another way. The term "connected" includes direct and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.
[0060] In the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.
[0061] The term "user interface (UI)" in the following embodiments of this application refers to a medium interface for interaction and information exchange between an application (APP) or an operating system (OS) and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.
[0062] In some embodiments, upon detecting a user's copy operation, the electronic device may select the content selected by the user's copy operation based on the contextual information of the copied content and the user's historical copy and paste operations, and provide the selected content to the user as a paste option. While the above method can help users select content they may need to paste from the copied content, it may be difficult to accurately determine which content in the copied content is the user's desired content when the copied content contains a large amount of related information. Furthermore, the above method cannot meet the user's needs to copy multiple pieces of information within a piece of content.
[0063] In other embodiments, the electronic device can segment the copied content based on the context of the copied content and the user pasting it, extract one or more pieces of related information from the copied content, and list the one or more pieces of related information for the user to select. Although the above method can help users copy multiple pieces of information within a piece of content, it does not take into account the user's usage habits and the pasted content. The segmented related information may not be what the user needs, making it difficult to meet the user's actual copy and paste needs.
[0064] The present application provides a method for pasting clipboard content. When a copy operation is detected, the electronic device may parse the copy page to obtain copy page information. The copy page information may include the copied content and / or contextual information of the copied content. The copied content may represent the content selected by the copy operation. When entering the paste page, the electronic device may parse the paste page to obtain paste page information. The paste page may include a page capable of pasting the copied content. The paste page information may include one or more of the following: the APP category to which the paste page belongs, the type of content to be entered in the paste page input box, operation information related to the paste page, and the like. The electronic device may identify the paste scenario and user intent based on the copy page information and the paste page information. The user intent may indicate the user's need to perform a copy and paste operation. Furthermore, the electronic device may determine the content to be pasted based on the paste scenario, user intent, and copied content. The content to be pasted may include information extracted by the electronic device from the copied content that satisfies the user's intent and matches the input box on the paste page. The electronic device may provide the content to be pasted on the paste page for the user to select and enter into the input box on the paste page.
[0065] As can be seen from the above method, the electronic device can extract the content to be pasted from the copied content that meets the user's intention and matches the input box on the paste page by identifying the paste scenario and user intent. The user can directly select the content to be pasted and enter it into the input box on the paste page. The content to be pasted can meet the user's copy and paste needs. The above method can accurately extract the content that the user wants to copy and paste from the copied content when the user's copied content contains a lot of redundant information. In this way, the user does not need to move the cursor when copying and perform tedious operations to select the copied content, and does not need to delete the redundant information one by one after pasting the copied content. In addition, when there are multiple pieces of information in the copied content that the user wants to copy and paste, but these multiple pieces of information are distributed at intervals, the electronic device can extract these multiple pieces of information based on the paste scenario and user intent and display them as the content to be pasted on the paste page. In this way, the user does not need to repeatedly switch between apps to perform multiple copy and paste operations. The pasting method of the present application can effectively improve the efficiency of the user's copy and paste and enhance the user's copy and paste experience.
[0066] In some embodiments, when the above-mentioned content to be pasted is extracted, the electronic device can use the public knowledge base to correct the content to be pasted to obtain the corrected content to be pasted. The above-mentioned public knowledge base may store public knowledge in one or more fields such as music, film and television, technology, agriculture, etc. For example, if the above-mentioned content to be pasted contains the name of a TV series, the electronic device can use the public knowledge base to determine whether the name of the TV series is correct. In the case where it is determined that the name of the TV series is wrong, the electronic device can modify the name of the TV series to the correct name. In this way, if the content copied by the user is wrong, the electronic device can correct the error and provide the correct content to the user for pasting.
[0067] In other embodiments, the electronic device may also use the user's personal knowledge base and / or public knowledge base to complete the content to be pasted to obtain the completed content to be pasted. Among them, the electronic device may also complete the content to be pasted after the above error correction. The above user's personal knowledge base may include user information such as user portraits that represent user identity, user preferences, user habits and other characteristics. For example, when the pasting scene is a shopping scene and the user intends to search for clothes or stores recommended by others, the electronic device can determine the type of clothes the user likes to wear in combination with the user's personal knowledge base. The electronic device can supplement the type of clothes the user likes to wear in the content to be pasted, so that the completed content to be pasted is more in line with the user's expression or search habits, helping the user to search for the clothes or stores the user wants more accurately. The above completion of the content to be pasted can provide the user with content to be pasted that is in line with the user's expression or search habits, and can improve the content to be pasted, reducing the situation where information that the user may need is omitted in the copied content.
[0068] In other embodiments, the electronic device may further use a personal knowledge base to sort the content to be pasted to obtain sorted content to be pasted. The electronic device may also sort the content to be pasted after error correction and / or completion. The content to be pasted may include multiple pieces of information extracted from the copied content. The electronic device may prioritize the information to be pasted that better meets the user's preferences based on the personal knowledge base. This sorting of the content to be pasted allows the user to prioritize pasting the information they are interested in on the pasting page.
[0069] In other embodiments, the electronic device may further filter the content to be pasted to obtain filtered content to be pasted. The electronic device may also filter the content to be pasted after the correction, completion, and / or sorting described above. Specifically, the electronic device may filter the content to be pasted based on historical pasting operation information and / or user intent. For example, if the content to be pasted contains multiple pieces of information of the same type, and if the electronic device has already pasted a piece of information from the content to be pasted on the pasting page, the electronic device may filter the previously pasted piece of information when re-entering the pasting page, and provide the information from the content to be pasted that has not yet been pasted on the pasting page. For another example, if the content to be pasted contains multiple pieces of information of different types, the electronic device may determine the type of content to be pasted on the currently displayed pasting page based on the user's intent, thereby filtering out one or more types of information from the content to be pasted and providing only the information that needs to be pasted on the current pasting page. It can be seen that the aforementioned filtering of the content to be pasted can reduce the situation where users repeatedly paste expired information when the information becomes invalid after being pasted, or it can filter out the information that the user needs to paste based on the user's intent, thereby reducing the interference of other information on the user.
[0070] It should be noted that when a user is detected to have selected content and to copy or cut it, the electronic device may store the copied or cut content in the clipboard. The copied or cut content may be text, symbols, images, and the like. The embodiments of this application do not limit the types of copied or cut content. For ease of description, the subsequent embodiments of this application will specifically use the copy scenario as an example. For the paste method in the cut scenario, reference may be made to the paste method in the copy scenario.
[0071] The clipboard can be a storage area on the memory of an electronic device, which can be used to store data copied or cut by the user. The data stored in the clipboard can be called clipboard content. In some embodiments, the clipboard can store the copied content of one or more copy operations, and be marked with the storage time of these copied contents. When the copied content stored in the clipboard exceeds the limit of the storage area, the electronic device can delete part of the copied content in the clipboard according to rules such as the order of storage time. For example, the electronic device can delete the copied content with the earliest storage time in the clipboard so that the copied content corresponding to the new copy operation can be stored in the clipboard. In some embodiments, the electronic device may include a clipboard application. The user can view the data stored in the clipboard through the clipboard application and edit the data in the clipboard.
[0072] The pasting method provided in this application can be used to obtain copied content from the clipboard and perform corresponding processing on the copied content (for example, extraction, error correction, completion, sorting, filtering, etc.) to obtain the content to be pasted, thereby providing the content to be pasted to the user for pasting, thereby improving the user's copy and paste experience.
[0073] Introduction to electronic equipment
[0074] Here, the software and hardware structure of the electronic device 100 involved in this application is introduced.
[0075] FIG1 exemplarily shows a schematic diagram of the hardware structure of an electronic device 100 .
[0076] As shown in Figure 1, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0077] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0078] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0079] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0080] Processor 110 may also include a memory for storing instructions and data. In some examples, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces processor 110 latency, and thus improves system efficiency.
[0081] In the present application, a computer program may be stored in the memory, for enabling the controller or processor to implement the pasting method of the present application through an interface or protocol.
[0082] Exemplarily, the computer program stored in the memory can be used to: perform page parsing on the copied page to obtain copy page information, perform page parsing on the pasted page to obtain paste page information, identify the pasting scenario and user intention based on the copy page information and the pasted page information, and intelligently extract the copied content based on the pasting scenario and user intention to obtain content to be pasted, where the content to be pasted may include information extracted from the copied content that meets the user intention and matches the input box in the paste page, and perform one or more of the following processing on the pasted content: error correction, completion, sorting, filtering, etc.
[0083] USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. USB interface 130 can be used to connect a charger to charge electronic device 100, transfer data between electronic device 100 and peripheral devices, or connect headphones to play audio.
[0084] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While charging the battery 142, the charging management module 140 can also power the electronic device through the power management module 141.
[0085] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to provide power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160.
[0086] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0087] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0088] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low-noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor and convert them into electromagnetic waves for radiation via the antenna 1.
[0089] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0090] The electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.
[0091] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
[0092] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0093] The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then transmitted to the ISP for processing and converted into an image visible to the naked eye.
[0094] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0095] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0096] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, text comprehension, and text generation.
[0097] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0098] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0099] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0100] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some examples, the audio module 170 can be set in the processor 110, or some functional modules of the audio module 170 can be set in the processor 110. The speaker 170A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 170C, also known as the "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 170D is used to connect wired headphones.
[0101] The sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a gravity sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
[0102] The gyroscope sensor can be used to determine the motion posture of the electronic device 100. In some embodiments, the gyroscope sensor can be used to determine the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes). The electronic device 100 can also use the gyroscope sensor to determine the offset angle of the electronic device 100.
[0103] The accelerometer can detect the magnitude of acceleration in all directions (generally three axes) of the electronic device 100. In some embodiments, the accelerometer can be used to identify the posture of the electronic device 100 and can be applied to applications such as landscape and portrait screen switching and pedometers.
[0104] The gravity sensor can be used to determine the tilt angle of the electronic device 100 relative to the horizontal plane. In some embodiments, the gravity sensor can be used to determine the screen state of the electronic device 100, so as to adjust the screen to keep it horizontal.
[0105] In some embodiments, the electronic device 100 may determine the movement distance of the electronic device 100 within a period of time through an acceleration sensor and a gravity sensor.
[0106] Buttons 190 include a power button, a volume button, etc. Motor 191 can generate vibration prompts. Indicator 192 can be an indicator light that can be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
[0107] The SIM card interface 195 is used to connect a SIM card. A SIM card can be connected to and disconnected from the electronic device 100 by inserting or removing it from the SIM card interface 195. The electronic device 100 may support one or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some examples, the electronic device 100 uses an eSIM, or embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0108] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. Taking the system as an example, the software structure of the electronic device 100 is exemplarily described.
[0109] FIG. 2 exemplarily shows a software structure block diagram of the electronic device 100 .
[0110] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, The system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime (Android Runtime) and system library, and kernel layer.
[0111] The application layer can include a series of application packages.
[0112] As shown in Figure 2, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, clipboard application, input method application, and short message. Among them, the clipboard application can be used to obtain clipboard contents and provide users with the functions of viewing and editing clipboard contents. The input method application can be used to provide functions for inputting text, symbols, and other contents. Optionally, the input method application can also obtain clipboard contents and provide the clipboard contents when the user needs to input, so that the user can quickly paste the clipboard contents into the input box.
[0113] In one possible implementation, both the clipboard application and the input method application can provide users with a smart paste function. The above-mentioned smart paste function can mean: extracting the content to be pasted that meets the user's intention and matches the input box in the paste page from the clipboard content, and providing the above-mentioned content to be pasted on the paste page for the user to input into the input box. Among them, the above-mentioned content to be pasted provided on the paste page can also be the content to be pasted after one or more of the following processing: error correction, completion, sorting, and filtering. In other words, the above-mentioned smart paste function can be used to accurately extract the content that the user wants to paste on the current paste page from the clipboard content, thereby improving the efficiency of the user's copy and paste.
[0114] The embodiments of the present application do not limit the applications in the electronic device 100 that perform one or more processes such as extraction, error correction, completion, sorting, and filtering on the clipboard content. In addition to the above-mentioned clipboard application and input method application, the above-mentioned application that extracts the content to be pasted based on the clipboard content and performs one or more processes such as error correction, completion, sorting, and filtering on the pasted content can also be other applications in the electronic device 100. Optionally, the above-mentioned one or more processes such as extraction, error correction, completion, sorting, and filtering on the clipboard content can also be implemented by multiple applications. For example, the clipboard application can extract the clipboard content to obtain the content to be pasted. Then, the input method application can obtain the above-mentioned content to be pasted and perform one or more processes such as error correction, completion, sorting, and filtering on the pasted content.
[0115] The application framework layer provides APIs and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions.
[0116] As shown in FIG2 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, an activity manager, and the like.
[0117] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.
[0118] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0119] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.
[0120] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).
[0121] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0122] The Notification Manager allows applications to display notification information in the status bar (such as the pull-down notification bar). It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the Notification Manager is used to notify the completion of downloads, message reminders, etc. The Notification Manager can also be used to display notifications in the form of icons or scrolling text in the status bar at the top of the system, such as notifications from applications running in the background, or notifications that appear on the screen in the form of dialog windows. For example, text messages can be displayed in the status bar, prompts can be sounded, electronic devices can vibrate, indicator lights can flash, etc.
[0123] The Activity Manager is responsible for managing activities, starting, switching, and scheduling components in the system, as well as managing and scheduling applications. The Activity Manager can be called by upper-level applications to open corresponding activities.
[0124] Android Runtime includes core libraries and a virtual machine. Android Runtime is responsible for scheduling and management of the Android system.
[0125] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.
[0126] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0127] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0128] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0129] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0130] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0131] A 2D graphics engine is a drawing engine for 2D drawings.
[0132] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.
[0133] How to process the clipboard content
[0134] In some embodiments, the electronic device 100 can extract content to be pasted that meets the user's intent and matches the input box in the paste page based on the clipboard content. In addition, the electronic device 100 can also perform one or more of error correction, completion, sorting, and / or filtering on the content to be pasted, so that the content to be pasted better meets the user's copy and paste needs.
[0135] 1. Extraction
[0136] FIG3A exemplarily shows a schematic diagram of a method for extracting content to be pasted provided in an embodiment of the present application.
[0137] As shown in FIG3A , the electronic device 100 may include a page parsing module, a scene recognition module, a user intention recognition module, an extraction prompt generator, and a language model.
[0138] Page parsing module: can be used to perform page parsing on a copied page to obtain copied page information, and can be used to perform page parsing on a pasted page to obtain pasted page information.
[0139] Specifically, when an operation of selecting and copying content is detected, the electronic device 100 can store the copied content in the clipboard. The copied content is the content selected by the copy operation. The page on which the copy operation acts is the copy page. The electronic device 100 can perform page parsing on the copied page through a page parsing module to obtain copy page information. The copy page information may include one or more of the following: the copied content, the context information of the copied content. Among them, the context information of the copied content may include one or more pieces of information on the copy page that are located before and / or after the copied content. The context information of the copied content may include text, symbols, pictures and other content.
[0140] In one possible implementation, the electronic device 100 can extract a preset number of pieces of information before and after the copied content on the copied page through a page parsing module, and use this information as context information for the copied content. The present embodiment does not limit the value of the preset number of pieces of information. For example, in a chat page of an instant messaging application, the copied content is a chat record in the chat page. Then, the electronic device 100 can extract the five chat records before and after this chat record, and use them as context information for the copied content.
[0141] In another possible implementation, the electronic device 100 may also take a screenshot of the copied page and perform image recognition on the screenshot to obtain context information of the copied content. The embodiment of the present application does not limit the method by which the electronic device 100 obtains context information of the copied content.
[0142] The electronic device 100 may determine the pasted page and perform page parsing on the pasted page through a page parsing module to obtain pasted page information. The pasted page information may include one or more of the following: the APP category to which the pasted page belongs, the type of content to be entered in the pasted page input box, and operation information related to the pasted page.
[0143] Here are some examples of methods for the electronic device 100 to determine the pasted page.
[0144] In one possible implementation, when an operation is detected for inputting into an input box (such as clicking on the input box, long pressing the input box, etc.), the electronic device 100 may determine the page containing the above-mentioned input box as a paste page. The above-mentioned input box may refer to an area for the user to input. The electronic device 100 can input text, symbols, pictures, and the like into the input box. The embodiment of the present application does not limit the content that can be entered into the input box. That is to say, when the user needs to input information on a page, this page can be a paste page. The electronic device 100 can identify the paste scenario and user intention based on the paste page to provide content to be pasted that meets the user's needs.
[0145] In another possible implementation, when a copy operation is detected, the electronic device 100 can determine the page containing the input box displayed within a preset time period after the copy operation starts as a paste page. That is to say, within the preset time period after the user performs the copy operation, any page containing an input box displayed by the electronic device 100 can be a paste page. The embodiment of the present application does not limit the value of the above-mentioned preset time period. It can be understood that after the user performs the copy operation, the page will usually jump to the page where the copied content needs to be pasted. Then, the page containing the input box displayed by the electronic device 100 within the preset time period after the user performs the copy operation may be the page where the user needs to paste.
[0146] The embodiment of the present application does not limit the method by which the electronic device 100 determines the pasted page.
[0147] In the above-mentioned paste page information, the category of the APP to which the paste page belongs may include but is not limited to: social APP, game APP, payment APP, shopping APP, office APP, reading APP, film and television APP, music APP, etc. The embodiment of this application does not limit the category of APP. The type of content to be entered in the paste page input box may include but is not limited to: name, film and television drama name, place name, store name, product name, redemption code, ID number, mobile phone number, email address, etc. One or more types of information can be entered in an input box. The embodiment of this application does not limit the type of content to be entered in the above-mentioned input box. The operation information related to the paste page may include but is not limited to information about the user's operations on the paste page and operation information for opening the paste page. In one implementation method, the operation information related to the paste page includes information about the user's operations on the paste page. For example, a paste page may contain multiple input boxes (such as an input box for entering a name, an input box for entering a mobile phone number, etc.). The information about the user's operations on the paste page may include information about the input box clicked or long pressed on the paste page (such as the type of content to be entered in the input box). The electronic device 100 can determine what the user currently wants to input based on which input box the user clicks on the paste page. In another implementation, the operation information related to the paste page includes information for opening the paste page. For example, both the homepage of a shopping application and the product display page of a store in the shopping application contain an input box. Among them, the user can enter the store name in the input box on the homepage of the shopping application to search for the store and enter the store's product display page. The above operation for entering the store's product display page helps the electronic device 100 determine that the user intends to search for products in the store. The embodiment of the present application does not limit the content of the operation information related to the paste page. Optionally, the paste page information can also include more content (such as context information of the input box, etc.).
[0148] Scene recognition module: can be used to identify the paste scene based on the copy page information and the paste page information. In one possible implementation, the scene recognition module can identify the paste scene based on a neural network model. The embodiment of the present application does not limit the above-mentioned method for identifying the paste scene. In one possible implementation, the scene recognition module can first use the copy page information to pre-identify the paste scene, and then further identify the pre-identified paste scene in combination with the paste page information to determine the final recognition result of the paste scene.
[0149] For example, the copied page information includes information such as the movie name, the time to watch the movie, and the address of the theater. The paste scenes pre-identified by the scene recognition module based on the copied page information may include: movie ticket purchase scene, navigation scene, movie information search scene, etc. Further, when the APP category to which the pasted page belongs in the pasted page information is an APP for movie ticket purchase, the scene recognition module can determine that the paste scene is a movie ticket purchase scene in combination with the above-mentioned pre-identified paste scene and the pasted page information. Alternatively, when the APP category to which the pasted page belongs in the pasted page information is a navigation APP, the scene recognition module can determine that the paste scene is a navigation scene in combination with the above-mentioned pre-identified paste scene and the pasted page information.
[0150] User intention recognition module: can be used to identify user intention based on copy page information and paste page information. The user intention may refer to the user's intention to copy and paste. In one possible implementation, the user intention recognition module may identify user intention based on a neural network model. The embodiment of the present application does not limit the above-mentioned method for identifying user intention. In one possible implementation, the user intention recognition module may first use the copy page information to pre-identify the user intention, and then further identify the pre-identified user intention in combination with the paste page information to determine the final recognition result of the user intention.
[0151] For example, the copied page information includes information such as the movie name, the time to watch the movie, and the address of the theater. The user intentions pre-identified by the user intention recognition module based on the copied page information may include: the intention to buy movies in the theater, the intention to navigate to the theater, and the intention to search for movie information. Furthermore, when the APP category of the pasted page in the pasted page information is an APP for purchasing movie tickets, the scene recognition module can determine that the user intention is to buy movies in the theater based on the above pre-identified user intention and the pasted page information. Alternatively, when the APP category to which the pasted page belongs in the pasted page information is a navigation APP, the scene recognition module can determine that the user intention is to navigate to the theater based on the above pre-identified user intention and the pasted page information.
[0152] Extraction Prompt Generator: This tool generates extraction prompts based on the pasting scenario and user intent. These prompts can include text or sentences, guiding the language model to extract the content to be pasted from the copied content that satisfies the user's intent and matches the input box on the pasting page.
[0153] Among them, the extraction prompt generator can be a type of prompt generator. The prompt generator can be used to generate prompt information (prompt). The prompt can be natural language that can be understood by humans (i.e., hard prompt / discrete prompt). For example, the prompt can be a text or sentence composed of natural language. Alternatively, the prompt can be machine-readable content that belongs to non-natural language (i.e., soft prompt / continuous prompt). For example, a soft prompt can be an embedding, which converts a word into a meaning vector representation processed by a computer. Hard prompts are more interpretable. Soft prompts can more flexibly eliminate the parameter restrictions of the language model. Prompts can be used to start and guide the language model to generate output of a specified type, topic, or format. For example, in the field of natural language processing, a prompt can include a set of questions and answers or task descriptions. For example, the prompt is: "Give your pet three names", "Translate this English sentence into French", etc. For another example, the prompt can also include question and answer examples. The prompt for the task "Give your pet three names" might include question-and-answer examples: "Pet type: cat, pet names: Name 1, Name 2, Name 3," and "Pet type: dog, pet names: Name 4, Name 5, Name 6." These question-and-answer examples can be used to guide the language model in answering the user's question using the same format as the question-and-answer examples. The language model can then generate text that meets the requirements based on the prompt and ensure that the output is relevant to the prompt.
[0154] The above extraction prompt information can be called extraction prompt.
[0155] For example, if the pasting scenario is a movie ticket purchase scenario, and the user's intention is to purchase a movie at a theater, the extraction prompt information generated by the extraction prompt generator may include: extracting the movie title and theater information from the given content. The above-mentioned given content is the copied content input into the language model. For another example, if the pasting scenario is a navigation scenario, and the user's intention is to navigate to a theater, the extraction prompt information generated by the extraction prompt generator may include: extracting the theater address from the given content. The above-mentioned extraction prompt information is only an exemplary description of this application and should not constitute a limitation on this application.
[0156] Language model: may refer to an artificial intelligence (AI) model used to process language (or symbol system), which can be used to generate text that meets the requirements based on the prompt and ensure that the output result is relevant to the prompt. Language models may include language models based on probability theory and statistics (i.e., statistical language models), language models based on deep learning and neural networks (i.e., neural network language models), etc. The embodiments of the present application do not limit the implementation method of the language model. For example, the electronic device 100 can implement the pasting method of the present application using a large language model (LLM). The LLM can be a neural network model that can learn the grammar and semantics of natural language to generate human-readable text. The LLM can be trained using a large corpus. The above corpus can include a large amount of text data. The LLM can handle various natural language processing tasks, such as natural language generation, text error correction, text completion, text classification, text summarization, machine translation, speech recognition, etc.
[0157] In some embodiments, the electronic device 100 may use the copied content and the extraction prompt information as input to the language model. The language model may extract the content to be pasted from the copied content according to the instructions of the extraction prompt information. The content to be pasted may include information extracted from the copied content that meets the user's intent and matches the input box on the paste page.
[0158] Exemplarily, the copied content includes information such as the name of the movie, the time to watch the movie, and the address of the cinema. It can be seen from the above embodiment that if the pasting scene is a navigation scene and the user's intention is to navigate to the cinema, the extraction prompt information generated by the extraction prompt generator may include: extracting the cinema address from the given content. When the above-mentioned copied content and extraction prompt information are input into the language model, the content to be pasted output by the language model may include: the address of the cinema. The electronic device can provide the above-mentioned content to be pasted on the paste page (that is, the page where the address is to be entered in the map application). In this way, the user can directly choose to enter the above-mentioned content to be pasted (that is, the cinema address) into the input box of the paste page to search and navigate to the cinema address, thereby eliminating the need to move the cursor in the entire content to accurately select the content to be copied (such as only selecting and copying the cinema address), and eliminating the need to delete redundant information one by one after copying the entire content and pasting it (such as deleting the movie name, the time to watch the movie, and other information after pasting the copied content, and only retaining the cinema address).
[0159] In some embodiments, the content to be pasted may be structured information. Structured information may refer to data recorded in a pre-set format and having a clear structure. For example, structured information may be organized into a row-column structure, where rows and columns may define the specific content of the structured information.
[0160] For example, when the content to be pasted includes a movie title or a theater name, the electronic device 100 may generate the content to be pasted according to the format shown in Table 1 below:
[0161] Table 1
[0162] For another example, when the content to be pasted includes the titles of multiple movies and TV series played on multiple playback platforms, the electronic device 100 may generate the content to be pasted according to the format shown in Table 2 below:
[0163] Table 2
[0164] The structures of the content to be pasted shown in Table 1 and Table 2 above are merely exemplary descriptions of the embodiments of the present application and should not constitute a limitation to the present application.
[0165] In one possible implementation, when an operation of selecting and copying content is detected, the electronic device 100 can parse the copied page through a page parsing module to obtain copied page information. Then, the electronic device 100 can use the copied page information to pre-identify the paste scene through a scene recognition module, and use the copied page information to pre-identify the user intention through a user intention recognition module. Based on the above-mentioned pre-identified paste scene and user intention, the electronic device 100 can generate extraction prompt information through an extraction prompt generator, and use a language model to pre-extract the content to be pasted from the copied content based on the extraction prompt information. The electronic device 100 can save the above-mentioned pre-extracted content to be pasted. Among them, the pre-extracted content to be pasted can be associated with the copied content stored in the clipboard.
[0166] It is understandable that, since there may be multiple pre-identified pasting scenarios based on the copied page information and multiple pre-identified user intentions, the pre-extracted content to be pasted may also include multiple pieces of information. These multiple pieces of information can satisfy different user intentions and match different pasting scenarios.
[0167] Exemplarily, the electronic device 100 may store the pre-extracted content to be pasted according to Table 3 below.
[0168] Table 3
[0169] In Table 3 above, copied content 1 and copied content 2 may be the content selected and copied in the two copy operations, respectively. It can be seen that the content to be pasted pre-extracted by electronic device 100 based on copied content 1 may include information 1, information 2, and information 3. Information 1 may be generated by the extraction prompt generator and language model based on paste scenario 1 and user intent 1. That is, information 1 may be content to be pasted that satisfies user intent 1 and matches paste scenario 1. Information 2 may be generated by the extraction prompt generator and language model based on paste scenario 2 and user intent 2. That is, information 2 may be content to be pasted that satisfies user intent 2 and matches paste scenario 2. Information 3 may be generated by the extraction prompt generator and language model based on paste scenario 3 and user intent 3. That is, information 3 may be content to be pasted that satisfies user intent 3 and matches paste scenario 3. The content to be pasted pre-extracted by electronic device 100 based on copied content 2 may include information 4, information 5, and information 6. Information 4, information 5, and information 6 can all refer to the description of information 1, information 2, and information 3. These descriptions will not be repeated here.
[0170] In some embodiments, a paste scenario may correspond to multiple user intentions. Among them, when the type of content to be entered in an input box on the paste page includes multiple types, the electronic device can recognize multiple user intentions. When the paste page contains multiple input boxes, the electronic device can also recognize multiple user intentions. For example, when the paste page is the homepage of a shopping application, the user may need to enter the store name or the product name in the input box on the homepage of the shopping application. Based on the homepage of the shopping application, the electronic device can determine that the paste scenario is a shopping scenario, and the user intention includes the intention to search for the store name and the intention to search for the product name. For another example, the new contact page contains input boxes for entering information such as name, phone number, and work unit. When the paste page is a new contact page, the electronic device can determine that the paste scenario is a new contact scenario, and the user intention includes the intention to fill in the name, the intention to fill in the phone number, and the intention to fill in the work unit.
[0171] In other embodiments, different pasting scenarios may correspond to the same user intent. When the pasting page is a new contact page, the electronic device may determine that the pasting scenario is a new contact scenario. When the pasting page is a registration information entry interface, the electronic device may determine that the pasting scenario is an information entry scenario. For both the new contact and information entry scenarios, the user intent may include the intention to enter a name, the intention to enter a phone number, and so on.
[0172] The above Table 3 is only an exemplary description of the storage of pre-extracted content to be pasted in an embodiment of the present application and should not constitute a limitation to the present application.
[0173] Furthermore, once the pasting page is determined, the electronic device 100 can parse the pasting page using the page parsing module to obtain pasting page information. The electronic device 100 can then use the pasting page information to identify the pasting scenario using the scene recognition module, and use the pasting page information to identify the user's intent using the user intent recognition module. The electronic device 100 can then obtain pre-extracted content to be pasted associated with the most recently copied content before the pasting page is determined.
[0174] The electronic device 100 may determine whether, among the pre-identified pasting scenarios and user intentions based on the most recently copied content, there are pasting scenarios and user intentions that respectively match the pasting scenarios and user intentions identified based on the pasted page information.
[0175] If it exists, the electronic device 100 can filter out information that meets the user's intention and matches the paste scene from the pre-extracted content to be pasted (the user intention and paste scene may refer to the user intention and paste scene identified based on the paste page information). The electronic device 100 can provide the above-mentioned filtered information on the paste page for the user to choose to enter into the input box in the paste page. Exemplarily, the copied content 1 in the above Table 3 is the most recent copied content before the electronic device 100 determines the paste page. The electronic device 100 identifies the paste scene 2 and the user intention 2 based on the paste page information. It can be seen from the above Table 3 that the electronic device 100 can filter out information 2 that meets the user's intention 2 and matches the paste scene 2 from the pre-extracted information to be pasted. The electronic device 100 can provide information 2 on the paste page for the user to choose to enter into the input box of the paste page.
[0176] If not, the electronic device 100 can generate extraction prompt information using an extraction prompt generator based on the paste scenario and user intent identified by the paste page information. The electronic device 100 can then input the extraction prompt information and the most recently copied content into a language model, which extracts content to be pasted that satisfies the user intent and matches the paste scenario from the copied content (the user intent and paste scenario can refer to the user intent and paste scenario identified based on the paste page information).
[0177] Optionally, rather than being limited to the most recent copied content before determining the paste page, the electronic device 100 may also obtain the k most recent copied content before determining the paste page, and analyze whether any of the k most recent copied content contains information that the user intends to paste to the current paste page. The above k may be an integer greater than 1. The specific value of k is not limited in this embodiment of the present application.
[0178] It can be seen from the above embodiment that after the electronic device 100 detects the user's copy operation, it can pre-identify the paste scenario and user intention and pre-extract the content to be pasted. Afterwards, when entering the paste page, the electronic device 100 can parse the paste page and identify the paste scenario and user intention based on the paste page. In the case where the paste scenario and user intention identified based on the paste page match the paste scenario and user intention pre-identified based on the copy page, the electronic device 100 can filter out relevant information from the pre-extracted content to be pasted for the user to paste. In this way, when entering the paste page, the electronic device 100 can quickly provide the user with paste options based on the pre-extracted content to be pasted, without the need to generate extraction prompt information through the extraction prompt generator and extract the content to be pasted using a language model. The above method can reduce the interaction delay, and the user can obtain paste options that meet personal pasting needs more quickly after opening the paste page.
[0179] In another possible implementation, upon detecting an operation of selecting and copying content, the electronic device 100 may parse the copied page using a page parsing module to obtain copied page information. The electronic device 100 may store the copied page information. In other words, in a copy scenario, in addition to storing the copied content in the clipboard, the electronic device 100 may also store the copied page information, such as contextual information of the copied content, in a memory of the electronic device 100.
[0180] Optionally, the electronic device 100 may store the copy page information of the most recent k1 copies. The above k1 may be a positive integer. The embodiment of the present application does not limit the specific value of k1.
[0181] When the paste page is determined, the electronic device 100 can perform page parsing on the paste page through the page parsing module to obtain the paste page information. The electronic device 100 can obtain the copy page information of the most recent copy before the paste page is determined. The electronic device 100 can identify the paste scenario and user intention based on the copy page information of the most recent copy and the paste page information. Then, the electronic device 100 can use the paste scenario and user intention as input to the extraction prompt generator, and generate extraction prompt information through the extraction prompt generator. The electronic device 100 can use the language model to extract the content to be pasted that meets the user intention and matches the paste scenario from the copied content based on the extraction prompt information. The above-mentioned match with the pasted content can represent information that matches the input box in the paste page.
[0182] Optionally, rather than being limited to the copy page information of the most recent copy before determining the pasted page, the electronic device 100 may also obtain the copy page information of the most recent k2 copies before determining the pasted page, thereby combining the copy page information of the most recent k2 copies with the pasted page information to identify the pasting scenario and user intent. k2 may be a positive integer less than or equal to k1. The specific value of k2 is not limited in this embodiment of the present application.
[0183] That is to say, in the present application, the electronic device 100 extracts the target content from the copied content in combination with the copy page information and the paste page information, which may include: first pre-extracting according to the copy page information, and then extracting the target content from the copied content according to the paste page information; and, using the copy page information and the paste page information at the same time to determine the paste scenario and user intention, and then extracting the target content from the copied content.
[0184] As can be seen from the method shown in Figure 3A above, the electronic device 100 can analyze the pasting scenario and user intent in combination with the copy page information and the paste page information, and then extract the content to be pasted that meets the user's intent and matches the pasting scenario from the copied content. The above method can accurately extract the content that the user wants to copy and paste from the copied content when the user's copied content contains a lot of redundant information. In this way, the user does not need to move the cursor when copying and perform tedious operations to select the copied content, and does not need to delete the redundant information one by one after pasting the copied content. In addition, when there are multiple pieces of information in the copied content that the user wants to copy and paste, but these multiple pieces of information are distributed at intervals, the electronic device 100 can extract these multiple pieces of information based on the pasting scenario and user intent and display them as content to be pasted on the paste page. In this way, the user does not need to switch between apps repeatedly to perform multiple copy and paste operations. The above method can effectively improve the efficiency of user copy and paste and improve the user's copy and paste experience.
[0185] 2. Error Correction
[0186] FIG3B exemplarily shows a schematic diagram of a method for correcting errors in content to be pasted provided in an embodiment of the present application.
[0187] As shown in FIG3B , the electronic device 100 may include an error correction prompt generator and a language model. The language model may be described in detail in FIG3A , and will not be described in detail here.
[0188] Error Correction Generator: This tool can be used to generate error correction information based on the pasting scenario and user intent. This error correction information can include text or sentences and can be used to guide the language model to correct the pasted content, resulting in the corrected content to be pasted.
[0189] The error correction prompt generator may be a type of prompt generator. Different from the extraction prompt generator, the error correction prompt information generated by the error correction prompt generator may be called an error correction prompt.
[0190] For example, if the pasting scene is a movie ticket purchase scene, and the user's intention is to purchase a movie at a theater, the error correction prompt information generated by the error correction prompt generator may include: determining whether the movie name and theater address in the given content are correct and correcting them if they are incorrect. For another example, if the pasting scene is a navigation scene, and the user's intention is to navigate to the theater, the error correction prompt information generated by the error correction prompt generator may include: determining whether the theater address in the given content is correct and correcting it if it is incorrect. The above error correction prompt information is only an exemplary description of this application and should not constitute a limitation on this application.
[0191] In some embodiments, the electronic device 100 may use the content to be pasted and the error correction prompt information as input to the language model. The content to be pasted may be the content to be pasted extracted based on the method shown in FIG. 3A . The language model may use the public knowledge base to determine whether there are errors in the content to be pasted based on the indication of the error correction prompt information, and correct the content to be pasted if there are errors, and output the corrected content to be pasted.
[0192] The public knowledge base may store public knowledge in one or more fields such as music, film, technology, and agriculture. The data in the public knowledge base may be obtained by crawling data from various websites, applications, and other databases using a data crawler. The present embodiment of the application does not limit the method for establishing the public knowledge base.
[0193] Exemplarily, the content to be pasted includes the movie name "XY Movie" and the theater address "AA Cinema". As can be seen from the above description, if the pasting scene is a movie ticket purchase scene, and the user's intention is to purchase a movie at the theater, the error correction prompt information generated by the error correction prompt generator may include: judging whether the movie name and theater address in the given content are correct and correcting them if they are incorrect. When the above content to be pasted and the error correction prompt information are input into the language model, the language model can use the public knowledge base to determine whether there are errors in the above movie name and theater address. For example, there is an error in the above movie name, and the movie name should originally be "xx Movie". The above theater address is correct. The language model can then correct the movie name, and the output corrected content to be pasted may include: movie name "xx Movie" and theater address "AA Cinema".
[0194] As shown in the method shown in FIG3B , after extracting the content to be pasted by combining the copied and pasted page information, the electronic device 100 can also correct errors in the pasted content. Thus, even if there are errors in the copied content, the electronic device 100 can provide the correct content to the user for pasting after correction, preventing the incorrect copied content from affecting the user's experience.
[0195] 3. Completion
[0196] FIG3C exemplarily shows a schematic diagram of a method for completing content to be pasted provided in an embodiment of the present application.
[0197] As shown in Figure 3C, the electronic device 100 may include a user tag generation module, a completion prompt generator, a language model, and a completion generation model. The language model can be referred to in the introduction of Figure 3A above and will not be described in detail here.
[0198] User tag generation module: can be used to generate user completion tags based on the user's personal knowledge base, the posting scenario, and the user's intention. The user completion tags can be tags that conform to the user's personal characteristics and are relevant to the posting scenario and user intention.
[0199] The above-mentioned user personal knowledge base may include user information such as user portraits that represent characteristics such as user identity, user preferences, and user habits. In some embodiments, the data contained in the user personal knowledge base may be collected and analyzed and inferred during the user's use of the electronic device 100. For example, the electronic device 100 may collect one or more of the following data: places that users frequently search for and visit in map applications, goods that users frequently browse and purchase in shopping applications, videos that users frequently watch in video playback applications, how long users use the APP, and other data. Based on the above-mentioned collected data, one or more of the following user personal characteristics can also be analyzed: the user's age group, the user's home and company address, the type of videos the user likes to watch, the type of clothing the user likes to wear, the food the user likes to eat, the user's interests and hobbies, etc. The embodiments of the present application do not limit the data content contained in the personal knowledge base, nor the method of establishing the above-mentioned user personal knowledge base.
[0200] In one possible implementation, the user tag generation module can generate user completion tags based on a trained neural network model. The embodiment of the present application does not limit the implementation method of generating user completion tags based on the user's personal knowledge base, the pasting scenario, and the user's intention.
[0201] For example, if the posting scene is a movie ticket purchase scene, and the user's intention is to buy movies at the theater, the user tag generation module can determine the theater information (such as the theater name, theater address, etc.) that the user frequently visits based on the user's personal knowledge base, thereby generating a user completion tag. The user completion tag may include the theater information that the user frequently visits. For another example, if the posting scene is a shopping scene, and the user's intention is to search for the store name or product name of a skirt, the user tag generation module can determine the type of clothing the user likes to wear based on the user's personal knowledge base. For example, the information in the user's personal knowledge base may indicate that the user is a fan of long skirts. The user completion tag generated by the user tag generation module may include: long skirt.
[0202] Completion prompt generator: This can be used to generate completion prompt information based on the pasting scenario and user intent. This completion prompt information can include text or sentences and can be used to guide the language model to generate public knowledge base completion information based on the content to be pasted and / or copied. This public knowledge base completion information can be information that needs to be supplemented in the content to be pasted, as determined by the public knowledge base.
[0203] The completion prompt generator may be a type of prompt generator. Different from the aforementioned extraction prompt generator and error correction prompt generator, the completion prompt information generated by the completion prompt generator may be called a completion prompt.
[0204] For example, if the pasting scenario is a film or TV series search scenario, and the user intends to search for the film or TV series on a specific broadcasting platform, the completion prompt information generated by the completion prompt generator may include: the broadcasting platform information of the film or TV series in the given content. Optionally, the completion prompt information generated by the completion prompt generator may also include: the title of the film or TV series in the given content. The above completion prompt information is merely illustrative of this application and should not constitute a limitation on this application.
[0205] In some embodiments, the electronic device 100 can use the completion prompt information as the input of the language model, and use the content to be pasted and / or the copied content as the input of the language model. The above-mentioned content to be pasted can be the content to be pasted extracted based on the method shown in Figure 3A, or it can also be the content to be pasted after error correction based on the method shown in Figure 3B. The language model can use the public knowledge base to determine the information that needs to be supplemented in the content to be pasted according to the indication of the completion prompt information, thereby outputting the public knowledge base completion information. The above-mentioned information that needs to be supplemented can be information related to the completion prompt information.
[0206] Exemplarily, the copied content includes the names of multiple film and television dramas played on multiple playback platforms (such as playback platform 1, playback platform 2, etc.). The content to be pasted includes the names of multiple film and television dramas extracted from the copied content, and these multiple film and television dramas can be played on playback platform 1. It can be seen from the above embodiment that if the pasting scene is a film and television drama search scene, and the user's intention is to search for film and television dramas on playback platform 1, the completion prompt information generated by the completion prompt generator may include: completing the playback platform information of the film and television drama in the given content. The language model can use the public knowledge base to determine the playback platform to which each film and television drama in the copied content (or the copied content that has not yet been extracted to the content to be pasted) belongs. For example, the copied content includes the name of film and television drama 1. The playback platform to which film and television drama 1 belongs is playback platform 1. The public knowledge base completion information generated by the language model may include: the playback platform to which film and television drama 1 belongs is playback platform 1.
[0207] It should be noted that, when completing based on the public knowledge base, the electronic device 100 can input only the content to be pasted or only the copied content into the language model according to the completion prompt information, or input both the content to be pasted and the copied content into the language model.
[0208] For example, if the completion prompt information is the information of the playback platform to which the film and television drama in the given content belongs, the electronic device 100 can input only the copied content into the language model, or input both the content to be pasted and the copied content into the language model. It can be understood that if the pasting scenario is a film and television drama search scenario, and the user's intention is to search for film and television dramas on playback platform 1, the content to be pasted extracted by the electronic device 100 based on the method shown in Figure 3A may contain the name of the film and television drama played on playback platform 1. That is, the playback platform to which the film and television drama contained in the content to be pasted belongs is already known, and no language model is required for further identification.
[0209] For another example, if the completion prompt information is to complete the title of a TV series in the given content, the electronic device 100 may only input the content to be pasted into the language model. It is understandable that when the content to be pasted needs to be completed, if the title of the TV series in the content to be pasted is incomplete (for example, the content to be pasted contains the abbreviation of the title of the TV series), the language model may only need to complete the title of the TV series in the content to be pasted.
[0210] Completion generation model: can be used to complete the content to be pasted based on the user's personal knowledge base and / or the public knowledge base, and generate the completed content to be pasted. The content to be pasted input into the completion generation model can be the content to be pasted extracted based on the method shown in Figure 3A above, or it can also be the content to be pasted after error correction based on the method shown in Figure 3B above. The completion generation model can be a model based on a neural network. The embodiment of the present application does not limit the implementation method of the completion generation model.
[0211] In some embodiments, the electronic device 100 can complete the content to be pasted based on the user's personal knowledge base. Specifically, the electronic device 100 can use the user completion tag and the content to be pasted as input to the completion generation model, and obtain the completed content to be pasted through the completion generation model.
[0212] For example, the content to be pasted may include the name of a movie. When the user completes the tag to include information about a theater that the user frequently visits, such as the theater name "AA Theater", the completed content to be pasted generated by the completion generation model may include not only the movie name but also the theater name "AA Theater". The electronic device 100 may provide the completed content to be pasted on the pasting page (such as a page for purchasing movie tickets). The completed content to be pasted can facilitate users to quickly search for movie tickets of a specified power source in theaters they frequently visit.
[0213] For another example, the content to be pasted may include the name of a store that sells skirts. When the user completes the tag to include long skirts, the completed content to be pasted generated by the completion generation model may include not only the store name but also the text "long skirt". The electronic device 100 may provide the above-mentioned completed content to be pasted on the pasting page (such as the search page of the shopping application), that is, the store name + the text corresponding to the long skirt. It is understandable that there may be multiple stores in the shopping application with the same store name but different products. The above-mentioned completed content to be pasted can facilitate users to quickly search for the store they are looking for.
[0214] In other embodiments, the electronic device 100 can complete the content to be pasted based on the public knowledge base. Specifically, the electronic device 100 can use the public knowledge base completion information and the content to be pasted as input to the completion generation model, and obtain the completed content to be pasted through the completion generation model.
[0215] For example, the content to be pasted includes the names of multiple films and TV series. Multiple films and TV series in the content to be pasted can all be played on playback platform 1. The content to be pasted does not include the name of film and TV series 1. When the public knowledge base completion information includes: the playback platform to which film and TV series 1 belongs is playback platform 1, the completion generation model can add the name of film and TV series 1 to the content to be pasted. That is, the completed content to be pasted includes the name of film and TV series 1. The electronic device 100 can paste a page (such as the search page of playback platform 1) to provide the above-mentioned completed content to be pasted. It is understandable that when extracting films and TV series played on playback platform 1 from the copied content to generate the content to be pasted, there may be incomplete extraction, and the names of one or more films and TV series played on playback platform 1 in the copied content may be omitted. The above-mentioned completion of the content to be pasted based on the public knowledge base can add the names of films and TV series in the copied content that belong to playback platform 1 but have not yet been extracted to the content to be pasted to the content to be pasted. In this way, the integrity of the content to be pasted extracted from the copied content can be ensured, making it convenient for users to search for any film and TV series in the copied content that belongs to playback platform 1 on the search page of playback platform 1.
[0216] In other embodiments, the electronic device 100 can also complete the content to be pasted based on the user's personal knowledge base and the public knowledge base at the same time. The electronic device 100 can use the content to be pasted, the user's completion tag, and the content to be pasted as input to the completion generation model, and obtain the completed content to be pasted through the completion generation model. For example, when the pasting scene is a movie ticket purchase scene, and the user's intention is to purchase a movie at the theater, the electronic device 100 can complete the theater address in the content to be pasted based on the user's personal knowledge base, and complete the movie name in the content to be pasted based on the public knowledge base.
[0217] It can be seen from the method shown in Figure 3C above that the electronic device 100 can complete the content to be pasted based on the user's personal knowledge base and / or the public knowledge base, so as to provide the user with content to be pasted that conforms to the user's expression or search habits, and the above method can improve the content to be pasted and reduce the situation where information that the user may need is omitted in the copied content.
[0218] 4. Sorting
[0219] FIG3D exemplarily shows a schematic diagram of a method for sorting content to be pasted provided in an embodiment of the present application.
[0220] As shown in FIG3D , the electronic device 100 may include a sorting model.
[0221] Sorting model: This can be used to sort the information in the content to be pasted based on the user's personal knowledge base, generating sorted content to be pasted. The electronic device 100 can use the sorting model to prioritize information in the content to be pasted that better matches the user's preferences. In one possible implementation, the sorting model can be based on a neural network. The present application does not limit the implementation method of the sorting model.
[0222] The content to be pasted input into the sorting model may be the content to be pasted extracted based on the method shown in FIG. 3A , or may be the content to be pasted after error correction based on the method shown in FIG. 3B , or may be the content to be pasted completed based on the method shown in FIG. 3C .
[0223] For example, the content to be pasted contains the titles of multiple films and TV series. The ranking model can rank these films and TV series based on the user's personal knowledge base. The ranking model can calculate the user's level of interest in these films and TV series. The higher the user's level of interest, the higher the ranking position of the film and TV series. This makes it easier for users to prioritize the films and TV series they are interested in.
[0224] 3D , the electronic device 100 can sort the multiple pieces of information in the content to be pasted. The sorted content to be pasted can help the user to preferentially paste the information he or she is interested in on the pasting page.
[0225] 5. Filter
[0226] FIG3E exemplarily shows a schematic diagram of a method for filtering content to be pasted provided in an embodiment of the present application.
[0227] As shown in FIG. 3E , the electronic device 100 may include a filtering model.
[0228] Filtering model: This model can be used to filter the content to be pasted based on historical pasting operation information and / or user intent, generating filtered content to be pasted. The historical pasting operation information can indicate relevant information about the content to be pasted. For example, the historical pasting operation information can include, but is not limited to, whether the content to be pasted has been pasted before, the number of times it was pasted, the time of pasting, the app in which it was pasted, etc.
[0229] The electronic device 100 can use the filtering model to filter out information in the content to be pasted that has already been pasted and is no longer valid. It can also use the filtering model to filter out information in the content to be pasted that does not meet the current user's intent when the user's intent changes. In one possible implementation, the filtering model can be a neural network-based model. The embodiments of this application do not limit the implementation method of the filtering model.
[0230] The content to be pasted input into the filtering model may be the content to be pasted extracted based on the method shown in FIG. 3A , or may be the content to be pasted after error correction based on the method shown in FIG. 3B , or may be the content to be pasted completed based on the method shown in FIG. 3C , or may be the content to be pasted filtered based on the method shown in FIG. 3D .
[0231] Exemplarily, the content to be pasted contains multiple redemption codes, such as redemption code 1. A redemption code can only be redeemed once. When the redemption code 1 in the content to be pasted has been pasted, the electronic device 100 can generate historical pasting operation information related to the redemption code 1. The historical pasting operation information can be used to indicate that the redemption code 1 has been pasted. When entering the redemption code input page, the electronic device 100 can filter out the redemption code 1 in the content to be pasted through the filtering model, and display other redemption codes in the content to be pasted except redemption code 1 on the redemption code input page. This can prevent the user from repeatedly pasting an expired redemption code when they forget which redemption code in the content to be pasted was pasted and used before.
[0232] For another example, the content to be pasted contains a clothing store name and clothing item name. When accessing the homepage of a shopping application (which can be a paste page), the electronic device 100 can provide the content to be pasted, allowing the user to paste the store name or clothing item name in the content to be pasted into the search box on the homepage. It is understood that based on the homepage of the shopping application, the user intent that the electronic device 100 can identify may include the intent to search for stores and the intent to search for products. When accessing the product search page for a clothing store in the shopping application, the electronic device 100 can filter out the store name in the content to be pasted using a filtering model and display the clothing item name in the content to be pasted on the product search page. In this way, after the user opens the product search page for a store in the shopping application, they can quickly search for the corresponding product using the information filtered from the content to be pasted. It is understood that users on the product search page for a clothing store typically search for products within that store and not for other stores. That is, based on the product search page for the clothing store, the electronic device 100 can identify that the user intent is to search for products. Therefore, the electronic device 100 can filter out the store name in the content to be pasted.
[0233] As can be seen from the method shown in Figure 3E above, the above filtering of the content to be pasted can reduce the situation where users repeatedly paste expired information when the information becomes invalid after being pasted, or it can filter out the information that the user needs to paste according to the user's intention, thereby reducing the interference of other information on the user.
[0234] In some embodiments, after the electronic device 100 extracts the content to be pasted based on the method shown in Figure 3A, it can perform error correction, completion, sorting and filtering on the content to be pasted according to the method shown in Figures 3B to 3E, and then provide the processed content to be pasted to the user (such as displaying it on the page to be pasted). Among them, the embodiment of the present application does not limit the order of the four processes of error correction, completion, sorting and filtering. For example, the electronic device 100 can first correct the content to be pasted, then complete the content to be pasted after error correction, then sort the completed content to be pasted, and finally filter the sorted content to be pasted. Alternatively, after the electronic device 100 performs error correction and completion on the content to be pasted in turn, it can first filter the completed content, and then sort the filtered content to be pasted.
[0235] In other embodiments, the electronic device 100 may perform one or more of error correction, completion, sorting, and filtering on the content to be pasted. For example, the electronic device 100 may only perform error correction on the content to be pasted and then provide the corrected content to be pasted to the user. Alternatively, the electronic device 100 may only perform completion on the content to be pasted and then provide the completed content to be pasted to the user. Alternatively, the electronic device 100 may only perform sorting on the content to be pasted and then provide the sorted content to be pasted to the user. Alternatively, the electronic device 100 may only perform filtering on the content to be pasted and then provide the filtered content to be pasted to the user. Alternatively, the electronic device 100 may perform error correction and completion on the content to be pasted and then provide the corrected and completed content to be pasted to the user. Alternatively, the electronic device 100 may perform error correction and sorting on the content to be pasted and then provide the corrected and sorted content to be pasted to the user. Alternatively, the electronic device 100 may perform error correction and filtering on the content to be pasted and then provide the corrected and filtered content to be pasted to the user. Alternatively, the electronic device 100 may perform completion and sorting on the content to be pasted and then provide the completed and sorted content to be pasted to the user. Alternatively, the electronic device 100 may complete and filter the content to be pasted, and then provide the completed and filtered content to be pasted to the user. Alternatively, the electronic device 100 may sort and filter the content to be pasted, and then provide the sorted and filtered content to be pasted to the user. Alternatively, the electronic device 100 may correct errors, complete and sort the content to be pasted, and then provide the corrected, completed and sorted content to be pasted to the user. Alternatively, the electronic device 100 may correct errors, complete and filter the content to be pasted, and then provide the corrected, completed and filtered content to be pasted to the user. Alternatively, the electronic device 100 may correct errors, complete and filter the content to be pasted, and then provide the corrected, sorted and filtered content to be pasted to the user. Alternatively, the electronic device 100 may complete, sort and filter the content to be pasted, and then provide the corrected, sorted and filtered content to be pasted to the user. Alternatively, the electronic device 100 may complete, sort and filter the content to be pasted, and then provide the corrected, sorted and filtered content to be pasted to the user.
[0236] The following introduces some pasting scenarios provided by this application based on the above-mentioned method for processing clipboard content.
[0237] Paste scene 1: movie ticket purchase scene and navigation scene
[0238] 4A to 4I are schematic diagrams illustrating some movie ticket purchasing scenarios.
[0239] As shown in FIG4A , electronic device 100 may display user interface 410. User interface 410 may be a chat page of an instant messaging application. User interface 410 may include chat records 411 to 414. In response to an operation on chat record 411 shown in FIG4A , such as a long press operation, electronic device 100 may display the content in chat record 411 in a selected state as shown in FIG4B , and may display a function option box 415 as shown in FIG4B . The function option box may include function options such as a copy option 415A, a forward option, a favorite option, and a quote option for operating chat record 411.
[0240] As shown in Figure 4B, all text in chat record 411 is displayed in a selected state. The selected state can be, for example, a state in which the background color of the selected text is displayed in a darker color. The embodiment of the present application does not limit the display style of the selected state. In some embodiments, the electronic device 100 can adjust the text in the selected state in response to an operation of moving the cursor in the chat record 411. That is, the user can manually adjust the selected text, for example, only select part of the text in the chat record 411. When all the text in the chat record 411 is selected, in response to the operation of the copy option 415A shown in Figure 4B, such as a click operation, the electronic device 100 can store all the text in the chat record 411 to the clipboard. That is, all the text in the chat record 411 can be copied content. The user interface 410 can be a copy page.
[0241] As can be seen from the method shown in Figure 3A above, electronic device 100 can perform page parsing on user interface 410 to obtain copied page information. The copied page information may include contextual information of the copied content. For example, the contextual information of the copied content shown in Figure 4B may include chat records 412, chat records 413, and chat records 414 shown in Figure 4A.
[0242] Here, an example is taken in which a user copies the chat record 411 shown in FIG4B and then opens a ticket purchasing application for purchasing movie tickets in the electronic device 100.
[0243] As shown in FIG4C , in response to opening the ticket purchase application, electronic device 100 may display user interface 420. User interface 420 may include input box 421. Input box 421 can be used to enter and search for information such as movies and theaters. In response to an operation on input box 421 shown in FIG4C , such as a click operation, electronic device 100 may display user interface 430 shown in FIG4D .
[0244] As shown in FIG4D , user interface 430 may include an input box 421 and an input keyboard 432. Input box 421 may be the same as input box 421 shown in FIG4C , and may be used to input and search for information such as movies and theaters. Input keyboard 432 may be used by a user to input information in input box 431. Input keyboard 432 may be provided by an input method application.
[0245] It should be noted that when an operation on the input box 421 shown in Figure 4C is detected, the electronic device 100 can determine the user interface 420 as a paste page and perform page parsing to obtain paste page information. The paste page information may include the APP category to which the user interface 420 belongs (i.e., ticket purchasing APP), the input box clicked in the user interface 420 (i.e., input box 421), and the type of content to be entered in the input box 421 (i.e., movie name and / or theater name). In addition, the user interface 430 shown in Figure 4D is displayed by the electronic device 100 in response to the operation on the input box 421 shown in Figure 4C. The user interface 430 can also be a paste page. Among them, the user interface 430 and the user interface 420 belong to the same APP, and the input box 431 is also the same as the input box 421. Therefore, the paste page information obtained based on the analysis of the user interface 430 can be the same as the paste page information obtained based on the analysis of the user interface 420.
[0246] The electronic device 100 can identify the pasting scenario as a movie ticket purchase scenario and the user's intention to purchase movie tickets based on the copy page information determined by the user interface 410 shown in FIG4A and the paste page information determined by the user interface 420 shown in FIG4C . Based on the above-mentioned pasting scenario and user intention, the electronic device 100 can generate extraction prompt information: extract the movie name and theater information from the given content. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: "xx movie" and "frequently visited theater."
[0247] Furthermore, the electronic device 100 can use the method shown in Figure 3C above to complete the above-extracted content to be pasted. In one possible implementation, the electronic device 100 can use the user's personal knowledge base to complete the content to be pasted. For example, the information in the user's personal knowledge base can indicate that the movie theater the user often goes to is AA Cinema (Central Park Store). The electronic device 100 can generate a user completion tag through the user tag generation module: The movie theater the user often goes to is AA Cinema (Central Park Store). Based on the above user completion tag, the electronic device 100 can complete the above-mentioned content to be pasted as: xx movie, AA Cinema (Central Park Store).
[0248] When jumping to the user interface 430 shown in Figure 4D, the electronic device 100 can provide a paste option 433 in the user interface 430. The paste option 433 can include the above-mentioned completed content to be pasted. In response to an operation on the paste option 433 shown in Figure 4D, such as a click operation, the electronic device 100 can display the user interface 430 shown in Figure 4E.
[0249] As shown in FIG4E , electronic device 100 can enter the content in paste option 433 in input box 431. Upon detecting that "xx movie, AA Cinema (Central Park)" has been entered in input box 431, the ticket purchasing application in electronic device 100 can display search result 434 shown in FIG4E . Search result 434 can be a search result for purchasing movie tickets for xx movie at AA Cinema (Central Park). Thus, the user can quickly purchase movie tickets for xx movie at AA Cinema (Central Park) using search result 434.
[0250] In other embodiments, in response to the operation on the input box 421 shown in FIG. 4C , the electronic device 100 may display the user interface 440 shown in FIG. 4F .
[0251] As shown in Figure 4F, user interface 440 may include an input box 441 and a prompt box 442. Input box 441 may be the same input box as input box 421 shown in Figure 4C. Prompt box 442 may include the above-mentioned completed content to be pasted, so as to prompt the user to enter the completed content into input box 441. Prompt box 442 may include a confirmation fill-in control 442A and a close control 442B. Confirm fill-in control 442A can be used to trigger electronic device 100 to enter the completed content into input box 441. Close control 442B can be used to trigger electronic device 100 to close prompt box 442.
[0252] Alternatively, in response to an operation on input box 421 shown in FIG4C , electronic device 100 may display user interface 450 shown in FIG4G . User interface 450 may include input box 451. Input box 451 may be the same input box as input box 421 shown in FIG4C . In response to an operation on input box 451 shown in FIG4G , such as a long press operation, electronic device 100 may display prompt box 452 shown in FIG4H .
[0253] As shown in FIG4H , prompt box 452 may include smart paste option 452A and paste option 452B. Among them, smart paste option 452A can be used to trigger electronic device 100 to provide content to be pasted determined according to the paste method of the present application. Paste option 452B can be used to trigger electronic device 100 to input the most recently copied content into input box 451. The most recently copied content can be the entire text in chat record 411 shown in FIG4B above, "Do you want to go to the cinema you often go to this weekend to watch the recently released movie "xx movie"?"
[0254] In response to an operation on smart paste option 452A shown in FIG4H , such as a click operation, electronic device 100 may display paste option 453 shown in FIG4I . Paste option 453 may include the completed content to be pasted, "xx movie, AA Cinema (Central Park Branch)". In response to the operation on paste option 453, electronic device 100 may input the content in paste option 453 into input box 451.
[0255] In some embodiments, in response to an operation on the input box 421 shown in FIG. 4C , the electronic device 100 may also directly input the extracted and completed content to be pasted into the input box 421 (ie, into the input box 431 shown in FIG. 4D ).
[0256] As can be seen from the scenarios shown in Figures 4A to 4I above, the user can directly copy all the text in the chat record 411 shown in Figure 4B without having to adjust the selected and copied text by moving the cursor. After the user copies all the content in the chat record 411, they can use the paste option 433 in the user interface 430 shown in Figure 4D to directly enter the movie name and theater name they want to search for in the input box 431, without having to paste all the content in the chat record 411 into the input box 431 and then delete the redundant information one by one. This can effectively improve the efficiency of the user's copy and paste and enhance the user's copy and paste experience.
[0257] That is to say, a section of content (chat record 411 as shown in FIG4B ) may contain one or more pieces of information that the user wants to copy, as well as redundant information that the user does not need to copy. Based on the pasting method of the present application, the user can directly copy this section of content without the trouble of adjusting the cursor position to select part of this section of content for copying. The electronic device 100 can accurately extract the content that the user wants to paste on the paste page from this section of content. Moreover, when there is an indirect expression of the content required by the user in this section of content (such as the address of a cinema is expressed as "a frequently visited cinema" in the chat record 411), the electronic device 100 can complete the extracted content to be pasted, and complete the above-mentioned indirect expression into a direct expression of the content required by the user, so that the content to be pasted better meets the user's copy and paste needs.
[0258] 4J to 4L are schematic diagrams illustrating some navigation scenarios.
[0259] Here, an example is taken where a user copies the chat record 411 shown in FIG. 4B and then opens the map application in the electronic device 100 .
[0260] As shown in FIG4J , in response to the operation of opening the map application, the electronic device 100 may display a user interface 460. The user interface 460 may include an input box 461. The input box 461 can be used to enter and search for information such as an address. In response to an operation on the input box 461 shown in FIG4J , such as a click operation, the electronic device 100 may display the user interface 430 shown in FIG4K .
[0261] 4K , user interface 430 may include an input box 471. Input box 471 may be the same input box as input box 461 shown in FIG 4J .
[0262] Among them, when the operation of the input box 461 shown in Figure 4J is detected, the electronic device 100 can determine the user interface 460 as a paste page, and perform page parsing to obtain the paste page information. The paste page information may include the APP category shown in the user interface 460 (i.e., navigation APP), the input box clicked in the user interface 460 (i.e., input box 461), and the type of content to be entered in the input box 461 (i.e., address). In addition, the user interface 470 shown in Figure 4K is displayed by the electronic device 100 in response to the operation of the input box 461 shown in Figure 4J. The user interface 470 can also be a paste page. Among them, the user interface 470 is the same as the APP to which the user interface 460 belongs, and the input box 471 is also the same as the input box 461. Therefore, the paste page information obtained based on the analysis of the user interface 470 can be the same as the paste page information obtained based on the analysis of the user interface 460.
[0263] The electronic device 100 can identify the pasting scenario as a navigation scenario and the user's intention as navigating to a theater based on the copy page information determined by the user interface 410 shown in FIG4A and the paste page information determined by the user interface 460 shown in FIG4J . Based on the above-mentioned pasting scenario and user intention, the electronic device 100 can generate extraction prompt information: extract theater information from the given content. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: "frequently visited theaters."
[0264] Furthermore, the electronic device 100 can use the method shown in Figure 3C above to complete the above-mentioned extracted content to be pasted. In one possible implementation, the electronic device 100 can use the user's personal knowledge base to complete the content to be pasted. For example, the information in the user's personal knowledge base can indicate that the movie theater the user often goes to is AA Cinema (Central Park Store). The electronic device 100 can generate a user completion tag through the user tag generation module: The movie theater the user often goes to is AA Cinema (Central Park Store). Based on the above-mentioned user completion tag, the electronic device 100 can complete the above-mentioned content to be pasted as: AA Cinema (Central Park Store).
[0265] When jumping to user interface 470, electronic device 100 may display paste option 472 shown in FIG4K on user interface 470. Paste option 472 may include the above-mentioned completed content to be pasted. In response to an operation on paste option 472 shown in FIG4K, such as a click operation, electronic device 100 may display user interface 470 shown in FIG4L.
[0266] As shown in FIG4L , electronic device 100 can enter the content in paste option 472 in input box 471. After detecting that "AA Cinema (Central Park Branch)" has been entered in input box 471, the map application in electronic device 100 can display search result 473 shown in FIG4L . Search result 473 can be a search result for navigating to AA Cinema (Central Park Branch). In this way, the user can quickly navigate to AA Cinema (Central Park Branch) through search result 473.
[0267] Optionally, after receiving a long press operation on the input box 471 shown in FIG4K , the electronic device 100 may also provide a paste option corresponding to the content to be pasted "AA Cinema (Central Park Store)" for the user to paste the content to be pasted "AA Cinema (Central Park Store)" into the input box 471. For specific interaction methods, please refer to the scenarios shown in the aforementioned FIG4F to FIG4I . The embodiment of the present application does not limit the method by which the electronic device 100 provides the paste option corresponding to the content to be pasted.
[0268] As can be seen from the scenarios shown in Figures 4J to 4L above, the user can directly copy all the text in the chat record 411 shown in Figure 4B without having to adjust the selected and copied text by moving the cursor. After the user copies all the content in the chat record 411, they can use the paste option 472 in the user interface 470 shown in Figure 4K to directly enter the name of the theater they want to search for in the input box 471, without having to paste all the content in the chat record 411 into the input box 431 and then delete the redundant information one by one. This can effectively improve the efficiency of the user's copy and paste, and enhance the user's copy and paste experience.
[0269] In addition, combining the above-mentioned movie ticket purchase scenario and navigation scenario, it can be seen that for the same copied content, the electronic device 100 can extract different content to be pasted according to different pasting scenarios and user intentions, thereby meeting the user's pasting needs in different pasting scenarios.
[0270] In some embodiments, the copied content shown in Figure 4B may belong to the most recent m1 copied content before the electronic device 100 displays the user interface 420 shown in Figure 4C, and may belong to the most recent m1 copied content before the electronic device 100 displays the user interface 460 shown in Figure 4J. The above m1 can be a positive integer. Optionally, the user interface 420 shown in Figure 4C and the user interface 460 shown in Figure 4J can both be interfaces displayed by the electronic device 100 within a preset time period after detecting the copy operation shown in Figure 4B. For example, the above preset time period can be 1 minute, 2 minutes, 5 minutes, etc. The embodiment of the present application does not limit the value of the preset time period.
[0271] Paste scene 2: shopping scene
[0272] 5A to 5G are schematic diagrams showing some shopping scenarios.
[0273] As shown in Figure 5A, the electronic device 100 can display a user interface 510. The user interface 510 can be a page of a social application. The user interface 510 can include a shared content display area 511 and a comment display area 512. The shared content of the user on the social application can be displayed in the shared content display area 511. For example, the shared content can include pictures, texts, and other information used to describe the dress as shown in Figure 5A. The comment display area 512 can include one or more comments. These comments can be comments on the above-mentioned shared content and comment replies, etc. The comment display area 512 can include comments 512A. In response to the operation on the comment 512A shown in Figure 5A, such as a long press operation, the electronic device 100 can display the function option box 513 shown in Figure 5B.
[0274] As shown in FIG5B , function option box 513 may include options for performing operations on comment 512A, such as a copy option 513A, a reply option, and a share option. In response to an operation on copy option 513A shown in FIG5B , such as a click operation, electronic device 100 may store the entire text of comment 512A to the clipboard. In other words, the entire text of comment 512A may be copied. User interface 510 may be a copy page.
[0275] As can be seen from the method shown in Figure 3A above, the electronic device 100 can perform page parsing on the user interface 510 to obtain the copied page information. The copied page information may include contextual information of the copied content. For example, the contextual information of the copied content (i.e., comment 512A) shown in Figure 5A may include the shared content in the shared content display area 511 shown in Figure 5A and the comments before and after the comment 512A in the comment display area 512.
[0276] Here, an example is taken where a user copies the comment 512A shown in FIG. 5A and then opens a shopping application in the electronic device 100 .
[0277] As shown in FIG5C , in response to the operation of opening the shopping application, the electronic device 100 may display a user interface 520. The user interface 520 may include an input box 521. The input box 521 can be used to input and search for information such as stores and products. In response to an operation on the input box 521 shown in FIG5C , such as a click operation, the electronic device 100 may display a user interface 530 shown in FIG5D .
[0278] As shown in Figure 5D, user interface 530 may include an input box 531. Input box 531 may be the same input box as input box 521 shown in Figure 5C, and may be used to input and search for information such as stores and products.
[0279] It should be noted that when an operation on the input box 521 shown in Figure 5C is detected, the electronic device 100 can determine the user interface 520 as a paste page and perform page parsing to obtain paste page information. The paste page information may include the APP category to which the user interface 520 belongs (i.e., shopping APP), the input box clicked in the user interface 520 (i.e., input box 521), and the type of content to be entered in the input box 521 (e.g., store name and / or product name). In addition, the user interface 530 shown in Figure 5D is displayed by the electronic device 100 in response to the operation on the input box 521 shown in Figure 5C. The user interface 530 can also be a paste page. Among them, the user interface 530 and the user interface 520 belong to the same APP, and the input box 531 is also the same as the input box 521. Therefore, the paste page information obtained based on the analysis of the user interface 530 can be the same as the paste page information obtained based on the analysis of the user interface 520.
[0280] Based on the copy page information determined by user interface 510 shown in FIG5A and the paste page information determined by user interface 520 shown in FIG5C , electronic device 100 can identify the pasting scenario as a shopping scenario and recognize the user's intention to search for the store name or product name of a skirt. Based on the above pasting scenario and user intention, electronic device 100 can generate extraction prompt information: extract the store name and product name from the given content. Electronic device 100 inputs the copied content and the extraction prompt information into the language model, and the language model can be used to extract the content to be pasted from the copied content: BB store, CC store, floral long skirt.
[0281] Furthermore, the electronic device 100 can use the method shown in the aforementioned FIG3C to complete the above-mentioned extracted content to be pasted. In one possible implementation, the electronic device 100 can use the user's personal knowledge base to complete the content to be pasted. For example, the information in the user's personal knowledge base can indicate that the user is a long skirt lover. The electronic device 100 can generate a user completion tag through the user tag generation module: long skirt lover. Based on the above-mentioned user completion tag, the electronic device 100 can complete the above-mentioned content to be pasted as: BB store + long skirt, CC store + long skirt, floral long skirt. It can be understood that the store name combined with the clothing type can help users search for the store they want to find more accurately.
[0282] When jumping to the user interface 530 shown in Figure 5D, the electronic device 100 can display a prompt box 532. The prompt box 532 can display the above-mentioned completed content to be pasted. Exemplarily, the electronic device 100 can provide the user with multiple pieces of information in the content to be pasted as multiple paste options. The prompt box 532 may include paste option 532A, paste option 532B, and paste option 532C. Paste option 532A can be used to input "BB shop long skirt" in the content to be pasted into the input box 531. Paste option 532B can be used to input "CC shop long skirt" in the content to be pasted into the input box 531. Paste option 532C can be used to input "floral long skirt" in the content to be pasted into the input box 531. In response to the operation of paste option 532B shown in Figure 5D, the electronic device 100 can display the user interface 530 shown in Figure 5E.
[0283] As shown in Figure 5E , electronic device 100 can enter the content in paste option 532B in input box 531. Upon detecting that "CC shop long skirt" has been entered in input box 531, the shopping app on electronic device 100 can display search result 533 as shown in Figure 5E . This search result can be a search result for accessing the product display page of the CC shop in the shopping app. This allows the user to quickly open the CC shop's product display page through search result 533 to find the desired product.
[0284] As shown in Figure 5E, search result 533 may include an enter-store option 533A. In response to an operation on enter-store option 533A, electronic device 100 may display user interface 540 shown in Figure 5F. User interface 540 may be a product display page of a CC store.
[0285] As shown in FIG5F , user interface 540 may include an input box 541. Input box 541 may be used to input and search for information such as products in the CC store. In response to an operation on input box 541 shown in FIG5F , such as a click operation, electronic device 100 may display user interface 550 shown in FIG5G .
[0286] As shown in Figure 5G, user interface 550 may include an input box 551. Input box 551 may be the same input box as input box 541 shown in Figure 5F, and may be used to input and search for information such as products in the CC store.
[0287] It should be noted that when an operation on the input box 541 shown in Figure 5F is detected, the electronic device 100 can determine the user interface as a paste page and perform page parsing to obtain paste page information. The paste page information may include the APP category to which the user interface 540 belongs (i.e., shopping APP), the type of content to be entered in the input box 541 (i.e., product name), and the operation information for entering the paste page (i.e., the operation information for the store entry option 533A shown in Figure 5E). In addition, the user interface 550 shown in Figure 5G is displayed by the electronic device 100 in response to the operation on the input box 541 shown in Figure 5F. The user interface 550 can also be a paste page. Among them, the user interface 550 is the same as the APP to which the user interface 540 belongs, and the input box 551 is also the same as the input box 541. Therefore, the paste page information obtained based on the analysis of the user interface 550 can be the same as the paste page information obtained based on the analysis of the user interface 540.
[0288] The electronic device 100 can identify the pasting scene as a shopping scene based on the copy page information determined by the user interface 510 shown in Figure 5A and the pasting page information determined by the user interface 540 shown in Figure 5F, and identify the user's intention to search for goods in the store. In one possible implementation, since the electronic device 100 has already extracted the content to be pasted based on a page in the APP to which the user interface 540 belongs (i.e., the user interface 520 shown in Figure 5C above), the electronic device 100 can filter the corresponding information from the content to be pasted based on the user's intention identified when displaying the user interface 540, for the user to enter into the input box 541 in the user interface 540. The electronic device 100 identifies the user's intention as the intention to search for goods in the store based on the user's intention. Based on this user intention, the electronic device 100 can filter the content to be pasted displayed in the prompt box 532 shown in Figure 5D above. Among them, the electronic device 100 can filter out the store name in the content to be pasted and retain the product name in the content to be pasted. That is, the electronic device 100 can filter out the paste option 532A and the paste option 532B shown in Figure 5D.
[0289] As shown in FIG5G , when the user interface 550 is redirected, the electronic device 100 may display a paste option 552. The content in paste option 552 may be information retained after filtering the content to be pasted. It can be seen that paste option 552 is the same as paste option 532C shown in FIG5D . Thus, the user can use paste option 552 to quickly paste the product name in the copied content into input box 551, thereby searching for the corresponding product in the selected store.
[0290] In some embodiments, the copied content shown in FIG5A may belong to the most recent m1 copies of content before the electronic device 100 displays the user interface 520 shown in FIG5C , and may belong to the most recent m1 copies of content before the electronic device 100 displays the user interface 540 shown in FIG5F . The above m1 may be a positive integer. Optionally, the user interface 520 shown in FIG5C and the user interface 540 shown in FIG5F may both be interfaces displayed by the electronic device 100 within a preset time period after detecting the copy operation shown in FIG5A and FIG5B .
[0291] As can be seen from the scenarios shown in Figures 5A to 5G above, the user can directly copy the entire text in comment 512A shown in Figure 5A. Comment 512A may contain multiple pieces of information that the user needs to copy under relevant pasting scenarios and user intentions. The electronic device 100 can provide these multiple pieces of information to the user as different paste options, or combine one or more of these multiple pieces of information and provide them to the user as paste options. This can provide the user with more paste options, better meet the user's copy and paste needs, and facilitate the user to select one or more pieces of information in the copied content and paste them into the input box of the paste page.
[0292] Furthermore, if the electronic device 100 has already extracted content to be pasted from copied content based on a paste page in an app, when the electronic device 100 jumps to another paste page in the same app, the already extracted content to be pasted can be filtered based on the user intent corresponding to the other paste page, without having to re-extract the content to be pasted. This not only allows the content to be pasted provided on different paste pages to better meet the different user intents, but also reduces interaction latency, providing the user with content to be pasted more quickly after the paste page is displayed.
[0293] Paste scene 3: Movie and TV drama search scene
[0294] 6A to 6F are schematic diagrams illustrating some film and television drama search scenes.
[0295] As shown in Figure 6A, the electronic device 100 can display a user interface 610. The user interface 610 can be a page of a social application. The user interface 610 can include a shared content display area 611 and a comment display area 612. The shared content displayed by the user on the social application can be displayed in the shared content display area 611. For example, the shared content can include information about a film or TV series as shown in Figure 6A. The comment display area 612 can include one or more comments. These comments can be comments on the above-mentioned shared content and comment replies, etc. The comment display area 612 can include comments 612A. In response to an operation on the comment 612A shown in Figure 6A, such as a long press operation, the electronic device 100 can display the function option box 613 shown in Figure 6B.
[0296] As shown in FIG6B , function option box 613 may include a copy option 613A. In response to an operation on copy option 613A shown in FIG6B , such as a click operation, electronic device 100 may store the entire text in comment 612A to the clipboard. That is, the entire text in comment 612A may be copied. User interface 610 may be a copy page.
[0297] As can be seen from the method shown in Figure 3A above, the electronic device 100 can perform page parsing on the user interface 610 to obtain the copied page information. The copied page information may include contextual information of the copied content. For example, the contextual information of the copied content (i.e., comment 612A) shown in Figure 6A may include the shared content in the shared content display area 611 shown in Figure 6A and the comments before and after the comment 612A in the comment display area 612.
[0298] Here, an example is given in which a user copies the comment 612A shown in FIG6A and then opens one or more video applications in the electronic device 100. One of the video applications may be a playback platform for a film or TV series.
[0299] As shown in FIG6C , in response to the operation of opening the video application 1, the electronic device 100 may display a user interface 620. The user interface 620 may include an input box 621. The input box 621 may be used to input and search for information such as movies, TV series, and actors. In response to an operation on the input box 621 shown in FIG6C , such as a click operation, the electronic device 100 may display a user interface 630 shown in FIG6D .
[0300] As shown in Figure 6D, the user interface 630 may include an input box 631. The input box 631 may be the same input box as the input box 621 shown in Figure 6C, and may be used to input and search for information such as movies, TV series, and actors.
[0301] It should be noted that when an operation on the input box 621 shown in Figure 6C is detected, the electronic device 100 can determine the user interface 620 as a paste page and perform page parsing to obtain paste page information. The paste page information may include the APP category described in the user interface 620 (i.e., video playback APP), the input box clicked in the user interface 620 (i.e., input box 621), and the type of content to be entered in the input box 621 (e.g., the name of the film and television drama and / or the name of the actor). In addition, the user interface 630 shown in Figure 6D can also be a paste page. Among them, the user interface 630 is the same as the APP to which the user interface 620 belongs, and the input box 631 is also the same as the input box 621. Therefore, the paste page information obtained based on the analysis of the user interface 630 can be the same as the paste page information obtained based on the analysis of the user interface 620.
[0302] The electronic device 100 can identify that the pasting scenario is a film and television drama search scenario and recognize that the user's intention is to search for film and television dramas in the video application 1 based on the copy page information determined by the user interface 610 shown in FIG6A and the paste page information determined by the user interface 620 shown in FIG6C. Based on the above-mentioned pasting scenario and user intention, the electronic device 100 can generate extraction prompt information: extract the film and television dramas belonging to the video application 1 from the given content. It can be understood that there are currently multiple applications for users to watch videos. A film and television drama may only be played in some video applications. The above-mentioned film and television drama belonging to the video application 1 may refer to the film and television drama played in the video application 1. The electronic device 100 inputs the copy content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: life and death, honey, and glittering.
[0303] It is understandable that comment 612A contains the names of TV series and movies, as well as the video applications to which some of the TV series and movies belong. From comment 612A, it can be seen that the TV series and movies belonging to video application 1 include: Life and Death, Honey, and Sparkling, the TV series and movies belonging to video application 2 include: The First Half, Sleeping, and the TV series and movies belonging to video application 3 include: Unforgettable Love. Among them, the TV series and movie named "Like You" is not specified in the video application mentioned in comment 612A. Therefore, when video application 1 is opened, the content to be pasted extracted by the electronic device 100 can be the name of the TV series and movie belonging to video application 1 in the copied content.
[0304] The above-mentioned film and television drama titles are merely exemplary illustrations of this application.
[0305] Furthermore, the electronic device 100 can use the method shown in FIG3B to correct the above-mentioned extracted content to be pasted. Specifically, the electronic device 100 can use the above-mentioned pasting scene and user intention as input to the error correction prompt generator, and obtain error correction prompt information through the error correction prompt generator: determine whether the name of the film and television drama in the given content is correct and correct the incorrect film and television drama name. The electronic device 100 can input the above-mentioned extracted content to be pasted and the error correction prompt information into the language model, and correct the pasted content through the language model. The above-mentioned error correction can be implemented based on a public knowledge base. For example, the information in the public knowledge base indicates that the name of the above-mentioned film and television drama "Bright Stars" is wrong, and the correct name should be "Bright Stars". Then, the electronic device 100 can modify "Bright Stars" in the content to be pasted to "Bright Stars". The content to be pasted after error correction may include: Life and Death, Honey, and Bright Stars.
[0306] Afterwards, the electronic device 100 can use the method shown in Figure 3C above to complete the above-mentioned content to be pasted after error correction. In a possible implementation method, the electronic device 100 can use a public knowledge base to complete the content to be pasted after error correction. Among them, the electronic device 100 can use the above-mentioned pasting scene and user intention as input to the completion prompt generator, and obtain the completion prompt information through the completion prompt generator: complete the playback platform information of the film and television drama in the given content. For example, the above-mentioned given content may be the content in the copied content that has not yet been extracted to the content to be pasted. The electronic device 100 can input the above-mentioned copied content, the content to be pasted after error correction, and the completion prompt information into the language model, and obtain the public knowledge base completion information through the language model. The public knowledge base completion information may include the playback platform information of the film and television drama in the above-mentioned copied content that has not yet been extracted to the content to be pasted. For example, the public knowledge base completion information may include: the playback platform to which the TV series "Like You" belongs includes video application 1 and video application 2. The electronic device 100 can input the corrected content to be pasted and the above-mentioned public knowledge base completion information into the completion generation model, and obtain the completed content to be pasted through the completion generation model: Life and Death, Honey, Bright Stars, Like You. It can be seen that even if the comment 612A shown in Figure 6A does not explicitly indicate the video application to which the film and television drama "Like You" belongs, the electronic device 100 can determine through the above-mentioned completion method that the video application to which the film and television drama "Like You" belongs includes Video Application 1, thereby supplementing "Like You" in the extracted content to be pasted. This can reduce the situation where the extracted content to be pasted omits the film and television drama belonging to Video Application 1 in the copied content.
[0307] Finally, the electronic device 100 can also use the method shown in Figure 3D above to sort the completed content to be pasted. Specifically, the electronic device 100 can use the user's personal knowledge base to sort the completed content to be pasted. For example, the information in the user's personal knowledge base can indicate that the user's interest in movies and TV series from high to low is: Honey, Life and Death, Like You, and Bright Star. The electronic device 100 can sort the pasted content according to the user's interest in the movie and TV series, and obtain the sorted content to be pasted: Honey, Life and Death, Like You, and Bright Star. Among them, the electronic device 100 can provide each movie and TV series name to the user as a separate paste option.
[0308] In one possible implementation, the electronic device 100 can detect whether the content to be pasted contains multiple pieces of information of the same type. The above-mentioned multiple pieces of information of the same type may be, for example: the names of multiple film and television dramas, multiple names of people, multiple store names, multiple product names, multiple place names, and the like. In the case where the pasted content contains multiple pieces of information of the same type, the electronic device 100 may provide these multiple pieces of information of the same type to the user as different paste options. It is understandable that the user usually only needs to enter one of the multiple pieces of information of the same type in the input box at a time. The above-mentioned providing multiple pieces of information of the same type as different paste options to the user can facilitate the user to select the required information and paste it into the input box. Optionally, the electronic device 100 can also use the method shown in FIG3D above to sort the above-mentioned multiple pieces of information of the same type, thereby providing the user with sorted content to be pasted.
[0309] As shown in Figure 6D, when jumping to user interface 630, electronic device 100 can display prompt box 632. Prompt box 632 can display the content to be pasted in the above-mentioned sorting. Among them, prompt box 632 can include paste option 632A, paste option 632B, paste option 632C, and paste option 632D. Paste option 632A can be used to enter the title of the film and television series "Honey" into input box 631. Paste option 632B can be used to enter the title of the film and television series "Life and Death" into input box 631. Paste option 632C can be used to enter the title of the film and television series "Like You" into input box 631. Paste option 632D can be used to enter the title of the film and television series "Bright Star" into input box 631. It can be seen that the content to be pasted in prompt box 632 is displayed according to the above-mentioned sorting of user interest. The film and television series that the user is most interested in (such as "Honey") can be displayed at the front. It is understandable that the above interest ranking is merely an illustrative description of the present application and should not constitute a limitation to the present application.
[0310] In this way, after copying the comment 612A shown in Figure 6A, the user opens the video application 1 and can quickly enter the name of the film or TV series belonging to the video application 1 in the comment 612A in the input box 631 of the video application 1 through the paste option in the prompt box 632.
[0311] In addition, if the user opens the video application 2 in the electronic device 100 after copying the comment 612A shown in FIG6A , the electronic device 100 may display the user interface 640 shown in FIG6E . The user interface 640 may be the user interface of the video application 2.
[0312] As shown in FIG6E , user interface 640 may include an input box 641. Input box 641 may be used to input and search information such as movies, TV series, and actors. In response to an operation on input box 641 shown in FIG6E , such as a click operation, electronic device 100 may display user interface 650 shown in FIG6F .
[0313] As shown in Figure 6F, the user interface 650 may include an input box 651. The input box 651 may be the same input box as the input box 641 shown in Figure 6E, and may be used to input and search for information such as movies, TV series, and actors.
[0314] It should be noted that when an operation on the input box 621 shown in FIG6E is detected, the electronic device 100 can determine the user interface 640 as a paste page and perform page parsing to obtain paste page information. The paste page information may include the APP category described in the user interface 640 (i.e., a video playback APP), the input box clicked in the user interface 640 (i.e., input box 641), and the type of content to be entered in the input box 641 (e.g., the title of a film or TV series and / or the name of an actor).
[0315] The electronic device 100 can extract the content to be pasted according to the method of the aforementioned embodiment and perform error correction, completion, and sorting on the content to be pasted. For details, please refer to the aforementioned FIG. 6C and FIG. 6D for the process of determining the content to be pasted using the user interface 620 of the video application 1 as the pasting page.
[0316] The content to be pasted extracted by the electronic device 100 using the user interface 640 shown in FIG6E as the paste page can be the name of the film or TV series belonging to the video application 2 in the copied content (i.e., the comment 612A shown in FIG6A ). For example, the electronic device 100 uses the user interface 640 as the paste page to extract the content to be pasted, and after correcting, completing, and sorting the content to be pasted, the content to be pasted can be: Like You, First Half, Sleeping. Among them, the film or TV series "Like You" can be the film or TV series that the user is most interested in among the above content to be pasted. The film or TV series "Sleeping" can be the film or TV series that the user is least interested in among the above content to be pasted.
[0317] As shown in Figure 6F, when jumping to the user interface 650, the electronic device 100 can display a prompt box 652. The prompt box 652 can display the content to be pasted after the above-mentioned error correction, completion and sorting. Among them, the prompt box 652 may include paste options 652A, paste options 652B, and paste options 652C. Paste option 652A can be used to input the name of the film and television drama "Like You" into the input box 651. Paste option 652B can be used to input the name of the film and television drama "First Half" into the input box 651. Paste option 652C can be used to input the name of the film and television drama "Sleeping" into the input box 651. In this way, after the user copies the comment 612A shown in Figure 6A and opens the video application 2, the paste option in the prompt box 652 can be used to quickly input the name of the film and television drama belonging to the video application 2 in the comment 612A into the input box 651 of the video application 2.
[0318] In some embodiments, the copied content shown in FIG6A may belong to the most recent m1 copies of content before the electronic device 100 displays the user interface 620 shown in FIG6C , and may belong to the most recent m1 copies of content before the electronic device 100 displays the user interface 640 shown in FIG6E . The above m1 may be a positive integer. Optionally, the user interface 620 shown in FIG6C and the user interface 640 shown in FIG6E may both be interfaces displayed by the electronic device 100 within a preset time period after detecting the copy operation shown in FIG6A and FIG6B .
[0319] As can be seen from the scenarios shown in Figures 6A to 6F above, the user can directly copy all the text in the comment 612A shown in Figure 6A. Among them, the electronic device 100 can correct the content to be pasted extracted from the comment 612A. In this way, even if there are errors in the information in the copied content, the electronic device 100 can provide the correct content to the user for pasting after error correction, so as to avoid the erroneous copied content affecting the user's use effect and experience. In addition, the electronic device 100 can also complete the content to be pasted and provide the user with more complete content to be pasted. The above-mentioned completed content to be pasted can reduce the situation where information that the user may need is omitted in the copied content. The electronic device 100 can also sort the content to be pasted, so as to facilitate the user to prioritize the information that the user is interested in for pasting.
[0320] In addition, it can be seen from the prompt box 632 provided in the video application 1 shown in Figure 6D above and the prompt box 652 provided in the video application 2 shown in Figure 6F above that, for the same copied content, the electronic device 100 can extract different content to be pasted according to different pasting scenarios and user intentions, thereby meeting the user's pasting needs in different pasting scenarios.
[0321] Paste Scenario 4: Redemption Code Redemption Scenario
[0322] 7A to 7H are schematic diagrams illustrating some redemption code redemption scenarios.
[0323] As shown in FIG7A , electronic device 100 may display user interface 710. User interface 710 may be a chat page of an instant messaging application. User interface 710 may include chat history 711. In response to an operation on chat history 711 shown in FIG7A , such as a long press operation, electronic device 100 may display the content in chat history 711 in a selected state as shown in FIG7B , and may also display function option box 712 as shown in FIG7B . Function option box 712 may include a copy option 712A.
[0324] As shown in FIG7B , when all text in chat log 711 is selected, in response to an operation on copy option 712A, such as a click operation, electronic device 100 can store all text in chat log 711 to the clipboard. That is, all text in chat log 711 can be copied content. User interface 710 can be a copy page.
[0325] As can be seen from the method shown in Figure 3A above, the electronic device 100 can perform page parsing on the user interface 710 to obtain the copied page information. The copied page information may include contextual information of the copied content. For example, the contextual information of the copied content shown in Figure 7B may include one or more chat records before and after the chat record 711 shown in Figure 4A: "Game 1 has a gift pack to redeem", "How to redeem?", "Use this redemption code, each redemption code can be redeemed for a gift pack".
[0326] Here, an example is taken in which a user copies the chat record 711 shown in FIG. 7B and then opens the game 1 application in the electronic device 100 .
[0327] As shown in Figure 7C, the electronic device 100 can display a user interface 720. The user interface 720 can be an interface in the game 1 application for entering a redemption code to redeem a gift package. The user interface 720 may include a prompt box 721. The prompt box 721 may include an input box 722 and a confirmation control 723. Among them, the input box 722 can be used to enter a redemption code. The confirmation control 723 can be used to trigger the electronic device 100 to detect whether the redemption code entered in the input box 722 meets the requirements, and to implement the gift package redemption when the redemption code meets the requirements. It can be understood that a redemption code becomes an invalid redemption code after being used once and cannot be used again.
[0328] In response to the operation on the input box 722 shown in Figure 7C, the electronic device 100 can determine the user interface 720 as a paste page and perform page parsing to obtain paste page information. The paste page information may include the APP category to which the user interface 720 belongs (i.e., game APP), the input box clicked in the user interface 720 (i.e., input box 722), and the type of content to be entered in the input box 722 (i.e., redemption code).
[0329] The electronic device 100 can identify the pasting scenario as a redemption code redemption scenario based on the copy page information determined by the user interface 710 shown in Figure 7A and the paste page information determined by the user interface 720 shown in Figure 7C, and recognize that the user's intention is to use the redemption code to redeem the gift package. Based on the above-mentioned pasting scenario and user intention, the electronic device 100 can generate extraction prompt information: extract the redemption code from the given content. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: 2023gfhaigonsh, 2023asongalghd, 2023ishghalngai. It can be seen that the above-mentioned content to be pasted may contain 3 redemption codes. The above-mentioned redemption code is only an exemplary description of this application.
[0330] In some embodiments, the electronic device 100 can identify that multiple redemption codes in the content to be pasted are multiple pieces of information of the same type. The electronic device 100 can provide the multiple redemption codes in the content to be pasted as different paste options to the user. Optionally, the electronic device 100 can also determine whether the multiple redemption codes in the content to be pasted have been pasted based on historical paste operation information. If none of the multiple redemption codes have been pasted, the electronic device 100 can provide a prompt box 724 as shown in Figure 7D.
[0331] That is, in response to the operation on the input box 722 shown in FIG. 7C , the electronic device 100 may determine the content to be pasted and provide the content to be pasted shown in FIG. 7D on the user interface 720 .
[0332] As shown in FIG7D , user interface 720 may include a prompt box 724 . Prompt box 724 may display the content to be pasted. Prompt box 724 may include paste options 724A, paste option 724B, and paste option 724C. These paste options may correspond to multiple redemption codes in the content to be pasted. Thus, the user can select a redemption code from these paste options and enter it into input box 722 to redeem the gift package.
[0333] As shown in FIG. 7D , in response to an operation of selecting the paste option 724A, the electronic device 100 may display the user interface 720 shown in FIG. 7E .
[0334] 7E , the electronic device 100 may input the redemption code “2023gfhaigonsh” corresponding to the paste option 724A into the input box 722. In response to the operation of the confirmation control 723, the electronic device 100 may use the redemption code “2023gfhaigonsh” to redeem the gift package.
[0335] In one possible implementation, in response to selecting paste option 724A as shown in FIG7D to paste the redemption code "2023gfhaigonsh" corresponding to paste option 724A into input box 722, electronic device 100 may mark the redemption code "2023gfhaigonsh." For example, electronic device 100 may add information indicating that the redemption code "2023gfhaigonsh" has been pasted to the historical paste operation information.
[0336] As shown in FIG7F , the electronic device 100 may again display the interface (i.e., user interface 720) for inputting a redemption code to redeem a gift package in the Game 1 application. Since the electronic device 100 has already extracted the content to be pasted using user interface 720 as the paste page, the electronic device 100 may filter the extracted content to be pasted based on the method shown in FIG3E when an operation is detected on the input box 722 again.
[0337] The electronic device 100 can filter the content to be pasted based on the historical pasting operation information. As can be seen from the above description, the historical pasting operation information contains information that the redemption code "2023gfhaigonsh" has been pasted. Therefore, the electronic device 100 can filter out the redemption code "2023gfhaigonsh" in the content to be pasted and provide the remaining redemption codes to the user as paste options.
[0338] That is, in response to the operation on the input box 722 shown in FIG. 7F , the electronic device 100 may filter out the content to be pasted, and display the filtered content to be pasted on the user interface 720 as shown in FIG. 7G .
[0339] As shown in Figure 7G , user interface 720 may include a prompt box 725. Prompt box 725 may display the filtered content to be pasted. Prompt box 725 may include a paste option 725A and a paste option 725B. As can be seen, paste option 725A is based on paste option 724B shown in Figure 7D . Paste option 725B is the same as paste option 724C shown in Figure 7D . Thus, the user can enter an unused redemption code into input box 722 using the paste option shown in Figure 7G .
[0340] As shown in FIG. 7G , in response to an operation of selecting the paste option 725A, the electronic device 100 may display the user interface 720 shown in FIG. 7H .
[0341] As shown in Figure 7H, the electronic device 100 can paste the redemption code "2023asongalghd" corresponding to the above-mentioned paste option 725A into the input box 722. Similarly, in response to the operation of selecting the paste option 725A as shown in Figure 7G to paste the redemption code "2023asongalghd" corresponding to the paste option 725A into the input box 722, the electronic device 100 can mark the redemption code "2023asongalghd". For example, the electronic device 100 can add information that the redemption code "2023asongalghd" has been pasted in the historical pasting operation information. In this way, when the electronic device 100 displays the user interface 720 again, the electronic device 100 can filter out the redemption code "2023asongalghd" from the content to be pasted provided to the user. The above method can reduce the interference of the redemption code that has been pasted and used on the user's selection of the redemption code for redemption, and avoid the situation where the user repeatedly selects the redemption code that has been pasted and used for redemption again.
[0342] In some embodiments, the copied content shown in FIG7B may be the content copied m1 times most recently before the electronic device 100 displays the user interface 720 shown in FIG7C . The above m1 may be a positive integer. Optionally, the user interface 720 shown in FIG7C may be the interface displayed by the electronic device 100 within a preset time period after detecting the copy operation shown in FIG7A and FIG7B .
[0343] As can be seen from the scenarios shown in Figures 7A to 7H above, the electronic device 100 can analyze the paste scenario and user intention in combination with the copy page information and the paste page information, and then extract the content to be pasted that meets the user's intention and matches the paste scenario from the copied content. The electronic device 100 can also provide the user with multiple pieces of information of the same type in the content to be pasted as different paste options. This can provide the user with more paste options, better meet the user's copy and paste needs, and facilitate the user to select one or more pieces of information in the copied content to paste into the input box of the paste page. In addition, the electronic device 100 can also filter the content to be pasted. This can reduce the situation where users repeatedly paste expired information when part of the information in the content to be pasted becomes invalid after being pasted, and reduce the interference of other information on the user.
[0344] Paste Scenario 5: Contact Adding Scenario
[0345] 8A to 8I are schematic diagrams illustrating some contact adding scenarios.
[0346] As shown in FIG8A , electronic device 100 may display user interface 810. User interface 810 may be the interface of a text messaging application. User interface 810 may include text message 811. For example, text message 811 may include the identity of a user named "Xiao Zhang": Account Manager of DD Company, mobile phone number: 188********, and contact ID: xiaozhang on application E. Application E may be an instant messaging application.
[0347] In some embodiments, in response to an operation on text message 811, such as a long press operation, electronic device 100 may display function option box 812 shown in FIG8A . Function option box 812 may include a copy option 812A. When all text in text message 811 is selected, in response to an operation on copy option 812A shown in FIG8A , such as a click operation, electronic device 100 may store all text in text message 811 to the clipboard, i.e., all text in text message 811 may be copied content. User interface 810 may be a copy page.
[0348] As can be seen from the method shown in Figure 3A above, the electronic device 100 can perform page parsing on the user interface 810 to obtain the copy page information. The copy page information may include contextual information of the copied content. For example, the contextual information of the copied content shown in Figure 8A may include information displayed before and after the text message 811. In some embodiments, the contextual information of the copied content may also be empty. That is, no other information is displayed before or after the copied content on the copy page.
[0349] Here, an example is taken in which a user copies the text message 811 shown in FIG. 8A and then opens the application E in the electronic device 100 .
[0350] As shown in FIG8B , electronic device 100 may display user interface 820. User interface 820 may be the interface for adding contacts in application E. User interface 820 may include input box 821. Input box 821 may be used to enter and search for information such as an account number or mobile phone number. In response to an operation on input box 821 shown in FIG8B , such as a click operation, electronic device 100 may display user interface 830 shown in FIG8C .
[0351] As shown in Figure 8C, the user interface 830 may include an input box 831. The input box 831 may be the same input box as the input box 821 shown in Figure 8B, and may be used to input and search for information such as an account number or a mobile phone number.
[0352] It should be noted that when an operation on the input box 821 shown in Figure 8B is detected, the electronic device 100 can determine the user interface 820 as a paste page and perform page parsing to obtain paste page information. The paste page information may include the APP category to which the user interface 820 belongs (i.e., a communication APP), the input box clicked in the user interface 820 (i.e., input box 821), and the type of content to be entered in the input box 821 (such as an account number or a mobile phone number). In addition, the user interface 830 shown in Figure 8C is displayed by the electronic device 100 in response to the operation on the input box 821 shown in Figure 8B. The user interface 830 can also be a paste page. Among them, the user interface 830 is the same as the APP to which the user interface 820 belongs, and the input box 831 is also the same as the input box 821. Therefore, the paste page information obtained based on the analysis of the user interface 830 can be the same as the paste page information obtained based on the analysis of the user interface 820.
[0353] The electronic device 100 can identify that the paste scenario is a contact adding scenario and recognize that the user intention is to search for contacts to be added in application E based on the copy page information determined by the user interface 810 shown in Figure 8A and the paste page information determined by the user interface 820 shown in Figure 8B. Based on the above-mentioned paste scenario and user intention, the electronic device 100 can generate extraction prompt information: extract the mobile phone number and the account in application E from the given content. Among them, the above-mentioned mobile phone number and the account in application E can be used to uniquely identify the user who has created an account in application E in application E. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted: xiaozhang, 188******** from the copied content through the language model.
[0354] The electronic device 100 can provide the above-mentioned content to be pasted on the paste page. For example, as shown in Figure 8C, when jumping to the user interface 830, the electronic device 100 can display a prompt box 832. The above-mentioned content to be pasted can be displayed in the prompt box 832. The prompt box 832 may include a paste option 832A and a paste option 832B. Paste option 832A can be used to input the account "xiaozhang" in application E into the input box 831. Paste option 832B can be used to input the mobile phone number "188********" into the input box 831. It can be seen that the electronic device 100 can provide the mobile phone number and the account in application E as different paste options to the user. That is, the electronic device 100 can provide multiple pieces of information in the content to be pasted to the user as multiple different paste options. This can make it convenient for the user to choose to use one of the two pieces of information, the mobile phone number and the account in application E, to search for related contacts.
[0355] As shown in FIG. 8C , in response to the operation of selecting the paste option 832A, the electronic device 100 may display the user interface 830 shown in FIG. 8D .
[0356] As shown in Figure 8D, the electronic device 100 can enter the content "xiaozhang" in the paste option 832A in the input box 831. After detecting that "xiaozhang" is entered in the input box 831, the application E in the electronic device 100 can display the search result 833 shown in Figure 8D. The search result 833 can be the search result of searching for contacts with the account number "xiaozhang" in application E. The search result 833 may include an add control 833A. The add control 833A can be used to add the contact with the above-mentioned account number "xiaozhang". In response to the operation of the add control 833A shown in Figure 8D, the electronic device 100 can display the user interface 840 shown in Figure 8E.
[0357] As shown in Figure 8E, user interface 840 may be the application interface for adding a contact in application E. User interface 840 may include an application information input box 841, a note input box 842, a tag input box 843, a description input box 844, and a send control 845. Application information input box 841 is used to enter information that is sent to the other party (i.e., the contact to be added) when requesting to add a contact. For example, a user can enter their name, identity, purpose of adding a contact, and other information in application information input box 841 so that the contact to be added knows who they are and can quickly approve the addition request. Notes input box 842 is used to enter notes about the contact so that the contact's identity is known after the contact is added. For example, a user can enter information such as the contact's name and identity in note input box 842. Tag input box 843 is used to enter tags for the contact to categorize the contact. Description input box 844 is used to enter additional notes for the contact. Send control 845 can be used to trigger electronic device 100 to send the contents of application information input box 841 to the contact to be added. The user interface 840 may include more or fewer input boxes, which is not limited in this embodiment of the present application.
[0358] In some embodiments, when the user interface 840 shown in Figure 8E is displayed, the electronic device 100 can determine the user interface 840 as a paste page and perform page parsing to obtain paste page information. The paste page information may include the APP category to which the user interface 840 belongs (i.e., a communication APP) and the type of content to be entered in the input box contained in the user interface 840. Since the user interface 840 includes multiple input boxes, the type of content to be entered in the input box contained in the user interface 840 may include: the type of content to be entered in the application information input box 841 (such as the name and identity of the user requesting to add a contact), and the type of content to be entered in the remarks input box 842 (such as the name and identity of the user to whom the contact is to be added).
[0359] The electronic device 100 can identify that the pasting scenario is a contact adding scenario and recognize that the user's intention is to apply to add a contact based on the copy page information determined by the user interface 810 shown in FIG8A and the paste page information determined by the user interface 840 shown in FIG8E. Based on the above-mentioned pasting scenario and user intention, the electronic device 100 can generate extraction prompt information: extract the user's identity information and the identity information of the contact to be added from the given content. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: Ms. Xu, Xiao Zhang, the account manager of DD Company. It can be seen that "Ms. Xu" is the identity information of the user. "Xiao Zhang, the account manager of DD Company" is the identity information of the contact to be added.
[0360] The electronic device 100 can provide the above-mentioned content to be pasted on the paste page (i.e., user interface 840). In one possible implementation, when jumping to the user interface 840 shown in Figure 8E, the electronic device 100 can directly fill the content to be pasted into the corresponding input boxes according to the type of content to be entered in the input boxes contained in the user interface 840. For example, the electronic device 100 can fill in the user's identity information "Ms. Xu" in the application information input box 841 and fill in the identity information of the contact to be added "DD Company Account Manager Xiao Zhang" in the remarks input box 842. In this way, the user does not need to manually enter information in the above-mentioned application interface for adding contacts. This can improve the efficiency and experience of users adding contacts. In another possible implementation, the information in the application information input box 841 and the remarks input box 842 shown in Figure 8E can be filled in by the electronic device 100 based on the user selecting the paste option provided by the electronic device 100. The electronic device 100 can provide multiple pieces of information in the content to be pasted as different paste options to the user. For example, the electronic device 100 may display the paste option corresponding to the information "Ms. Xu" and the paste option corresponding to the information "DD Company Account Manager Xiao Zhang" in the user interface 840 (not shown in FIG8E ). The scenario in which the electronic device 100 displays the paste option may refer to the embodiments shown in the aforementioned FIG5D , FIG6D , FIG6F , and FIG7D . When the input focus is on the application information input box 841 , the electronic device 100 may input "Ms. Xu" in the application information input box 841 in response to the user selecting the paste option corresponding to the information "Ms. Xu". When the input focus is on the note input box 842 , the electronic device 100 may input "DD Company Account Manager Xiao Zhang" in the note input box 842 in response to the user selecting the paste option corresponding to the information "DD Company Account Manager Xiao Zhang".
[0361] In some embodiments, when the paste page contains multiple input boxes, the electronic device 100 can provide a paste option corresponding to the content to be pasted that matches the type of content to be entered in the input box where the input focus is located. For example, in Figure 8E, the user interface 840 includes an application information input box 841 and a note input box 842. In response to an operation on the application information input box 841 (such as a click operation), the electronic device 100 can determine that the input focus is on the application information input box 841. The electronic device 100 can select the identity information "Ms. Xu" from the above-extracted content to be pasted and provide a paste option corresponding to the identity information "Ms. Xu" in the user interface 840. In response to the operation on the paste option corresponding to the identity information "Ms. Xu", the electronic device 100 can fill in the user's identity information "Ms. Xu" in the application information input box 841. In response to an operation on the note input box 842 (such as a click operation), the electronic device 100 can determine that the input focus is on the note input box 842. Electronic device 100 may select the identity information of the contact to be added, "DD Company Account Manager Xiao Zhang," from the extracted content to be pasted, and provide a paste option corresponding to the identity information of the contact to be added, "DD Company Account Manager Xiao Zhang," on user interface 840. In response to the operation of the paste option corresponding to the identity information of the contact to be added, "DD Company Account Manager Xiao Zhang," electronic device 100 may enter the identity information of the contact to be added, "DD Company Account Manager Xiao Zhang," into remark input box 842.
[0362] Optionally, when jumping to the application interface for adding contacts (such as user interface 840 shown in Figure 8E), the electronic device 100 can determine whether the contact to be added is a contact in the copied content (such as text message 811 shown in Figure 8A). That is, the electronic device 100 can determine whether the contact searched for by the electronic device 100 in user interface 830 shown in Figure 8D is a contact in the copied content. If the electronic device 100 detects that the information entered in the input box 831 in user interface 830 is entered according to the paste option provided by the electronic device 100 (such as paste option 832A or paste option 832B shown in Figure 8C), the electronic device 100 can determine that the contact to be added is a contact in the copied content. Then, after jumping to user interface 840, the electronic device 100 can provide the content to be pasted shown in Figure 8E in user interface 840. It can be understood that the copied content shown in Figure 8A contains, in addition to the account number and mobile phone number used to search for contacts, the user's identity information and the identity information of the contact to be added. If a user searches for a contact using an account or phone number copied from the content, they typically fill in the user's identity information from the copied content and the identity information of the contact to be added on the contact add request screen. This method can more accurately provide the user with relevant content to be pasted on the contact add request screen, improving the user experience when adding contacts after copying the contact's information.
[0363] The embodiment of the present application does not limit the method by which the electronic device 100 provides the content to be pasted on the paste page shown in Figures 8C and 8E above. In some embodiments, when the electronic device 100 uses the user interface 830 shown in Figure 8C as the paste page to extract the content to be pasted from the copied content shown in Figure 8A, in addition to extracting the mobile phone number of the contact to be added and the account number in application E, the user's identity information and the identity information of the contact to be added can also be extracted. Then, the electronic device 100 can provide the content to be pasted on the paste page shown in Figures 8C and 8E. Optionally, when jumping to the paste page shown in Figure 8E, the electronic device 100 can filter the content to be pasted based on the user intention determined on the paste page shown in Figure 8E. Among them, the electronic device 100 can filter out the mobile phone number of the contact to be added and the account number in application E in the content to be pasted, thereby providing the identity information of the user and the identity information of the contact to be added in the user interface shown in Figure 8E.
[0364] Here, the pasting process in the contact adding scenario is described by taking an example where a user copies the text message 811 shown in FIG. 8A and then opens the contact application in the electronic device 100 .
[0365] As shown in FIG8F , electronic device 100 may display user interface 850. User interface 850 may be the user interface of a contacts application. The contacts application may be an app for storing contact information. User interface 850 may include an add control 851. In response to an operation on add control 851 shown in FIG8F , such as a click operation, electronic device 100 may display user interface 860 shown in FIG8G .
[0366] As shown in Figure 8G, the user interface 860 may include a name input box 861, a unit input box 862, a mobile phone number input box 863, a cursor 864, and a completion control 865. Among them, the name input box 861 can be used to enter the name of the contact. The unit input box 862 can be used to enter the work unit of the contact. The mobile phone number input box 863 can be used to enter the mobile phone number of the contact. The cursor 864 can be used to indicate the location of the input focus. For example, the cursor 864 is located in the name input box 861 shown in Figure 8G, which can indicate that the input focus is currently located in the name input box 861. The electronic device 100 can input the information entered by the user into the input box where the input focus is. The completion control 865 can be used to trigger the electronic device 100 to save the contact information entered in the user interface 860.
[0367] When jumping to the user interface 860, the electronic device 100 can determine the user interface 860 as a paste page and perform page parsing to obtain paste page information. The paste page information may include the APP category to which the user interface 860 belongs (i.e., a communication APP), the type of content to be entered in the name input box 861 (such as a person's name), the type of content to be entered in the unit input box 862 (such as a company name), and the type of content to be entered in the mobile phone number input box 863 (such as a mobile phone number).
[0368] The electronic device 100 can identify the paste scenario as a contact adding scenario and recognize the user's intention to save the contact information based on the copy page information determined by the user interface 810 shown in Figure 8A and the paste page information determined by the user interface 860 shown in Figure 8G. Based on the above paste scenario and user intention, the electronic device 100 can generate extraction prompt information: extract the name, unit and mobile phone number of the contact to be added from the given content. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: Xiao Zhang, DD Company, 188********.
[0369] The electronic device 100 may provide the content to be pasted on the pasting page.
[0370] In one possible implementation, the electronic device 100 may provide part of the information in the content to be pasted as a paste option to the user. If the user selects the paste option, the electronic device 100 may fill in multiple pieces of information in the content to be pasted into multiple input boxes of the user interface shown in FIG8G .
[0371] For example, as shown in FIG8G , when jumping to the user interface 860, the electronic device 100 may provide a paste option 866 in the user interface 860. The content in the paste option 866 may include the contact name "Xiao Zhang" in the content to be pasted. The paste option 866 can be used to prompt the user to fill in the content to be pasted into multiple input boxes in the user interface 860. In response to the operation of selecting the paste option 866 shown in FIG8G , the electronic device 100 may display the user interface 860 shown in FIG8H . As can be seen from FIG8H , the electronic device 100 fills each piece of information in the content to be pasted into the corresponding input box in the user interface 860. Among them, the electronic device 100 fills in the contact name "Xiao Zhang" in the content to be pasted in the name input box 861, fills in the contact's work unit "DD Company" in the content to be pasted in the unit input box 862, and fills in the contact's mobile phone number "188********" in the content to be pasted in the mobile phone number input box 863.
[0372] Optionally, the electronic device 100 may also provide the user with multiple pieces of information in the content to be pasted as different paste options. The user may move the cursor 864 to the input box where information needs to be input, and then select the corresponding paste option to input the corresponding contact information in the input box.
[0373] In the case where the paste page contains multiple input boxes, the electronic device 100 may provide a paste option corresponding to the content to be pasted that matches the type of content to be entered in the input box with input focus. For example, in Figure 8G, user interface 860 includes a name input box 861, an organization input box 862, and a mobile phone number input box 863. In response to a click on name input box 861, the electronic device 100 may determine that the input focus is on name input box 861. The electronic device 100 may determine that the contact name "Xiao Zhang" in the content to be pasted matches name input box 861 (i.e., matches the type of content to be entered in name input box 861). The electronic device 100 may provide a paste option corresponding to the contact name "Xiao Zhang" in user interface 860 (see paste option 866 shown in Figure 8G). In response to the click on the paste option corresponding to the contact name "Xiao Zhang", the electronic device 100 may fill in the contact name "Xiao Zhang" in name input box 861. Furthermore, in response to a click on organization input box 862, the electronic device 100 may determine that the input focus is on organization input box 862. Alternatively, when the corresponding content is entered into the name input box 861, the electronic device 100 may automatically move the input focus from the name input box 861 to the work unit input box 862. This embodiment of the present application does not limit the method by which the electronic device 100 determines the input box where the input focus is located. The electronic device 100 may determine that the contact's work unit "DD Company" in the content to be pasted matches the work unit input box 862. The electronic device 100 may provide a paste option corresponding to the contact's work unit "DD Company" in the user interface 860. In response to clicking on the paste option corresponding to the contact's work unit "DD Company", the electronic device 100 may fill in the contact's work unit "DD Company" in the work unit input box 862. Similarly, when the input focus moves to the mobile phone number input box 863, the electronic device 100 may provide a paste option corresponding to the contact's mobile phone number "188********" in the content to be pasted, allowing the user to paste the contact's mobile phone number "188********" into the mobile phone number input box 863. As can be seen, the user can paste the corresponding content into the multiple input boxes on the paste page one by one according to the paste options provided by the electronic device 100 corresponding to the content to be pasted that match the input box.
[0374] In another possible implementation, the electronic device 100 may provide the user with the entire content to be pasted so that the user can confirm whether the content to be pasted is the content the user wants to paste. The user can then fill in multiple pieces of information in the content to be pasted into multiple input boxes of the user interface shown in FIG8G with one click.
[0375] For example, as shown in FIG8I , in response to the operation of adding control 851 shown in FIG8F , electronic device 100 may display user interface 870 shown in FIG8I . User interface 870 may include a name input box 871 , a work unit input box 872 , a mobile phone number input box 873 , and a prompt box 874 . Name input box 871 , work unit input box 872 , and mobile phone number input box 873 may refer to name input box 861 , work unit input box 862 , and mobile phone number input box 863 shown in FIG8G , respectively. Prompt box 874 may include a display area 874A for content to be pasted, a confirmation control 874B, and a close control 874C. Content to be pasted (such as a contact name, work unit, and mobile phone number) extracted by electronic device 100 may be displayed in display area 874A for content to be pasted. Confirmation control 874B may be used to input each piece of information in the content to be pasted into name input box 871 , work unit input box 872 , and mobile phone number input box 873 , respectively. The close control 874C can be used to trigger the electronic device 100 to close the prompt box 874. In response to an operation on the confirmation control 874B, such as a click operation, the electronic device 100 can fill in the above-mentioned content to be pasted in the input box in the user interface 870 (refer to the user interface 860 shown in Figure 8H).
[0376] It can be seen that the above embodiment can improve the efficiency of users in creating and saving contact information. After the user copies the text containing contact information, the user can quickly enter the multiple pieces of information to be pasted in the copied content into the corresponding input boxes.
[0377] In some embodiments, the copied content shown in FIG8A may belong to the most recent m1 copied content before the electronic device 100 displays the user interface 820 shown in FIG8B , and may belong to the most recent m1 copied content before the electronic device 100 displays the user interface 840 shown in FIG8E , and may also belong to the most recent m1 copied content before the electronic device 100 displays the user interface 860 shown in FIG8G . The above m1 can be a positive integer. Optionally, the user interface 820 shown in FIG8B , the user interface 840 shown in FIG8E , and the user interface 860 shown in FIG8G can all be interfaces displayed by the electronic device 100 within a preset time period after detecting the copy operation shown in FIG8A .
[0378] As can be seen from the scenarios shown in Figures 8A to 8I above, the user can directly copy all the text in the text message 811 shown in Figure 8A without having to adjust the selected and copied text by moving the cursor. After the user copies all the contents in the text message 811, the user can quickly enter the relevant contact information in the multiple input boxes on the paste page through the content to be pasted provided by the electronic device 100. In this way, when the text message 811 contains multiple pieces of information that the user needs to copy and paste, the user only needs to perform a copy operation once, that is, the multiple pieces of information that need to be pasted in the copied content can be pasted separately in the multiple input boxes on the paste page. The user does not need to repeatedly switch between the text message application and the application that needs to paste the information (such as the above-mentioned application E, the contact application, etc.) to perform multiple copy and paste operations. The above method can effectively improve the efficiency of the user's copy and paste and improve the user's copy and paste experience.
[0379] Paste Scenario 6: Information Entry Scenario
[0380] 9A to 9H are schematic diagrams illustrating some information entry scenarios.
[0381] As shown in Figure 9A, electronic device 100 may display user interface 910. User interface 910 may be a chat interface with user "Zhang San" in an instant messaging application. User interface 910 may include chat logs 911 to 913. As can be seen, chat logs 911 to 913 may be personal identification information sent by user "Zhang San". Chat log 911 includes the name of user "Zhang San". Chat log 912 includes the mobile phone number of user "Zhang San". Chat log 913 includes the ID number of user "Zhang San".
[0382] As shown in Figure 9B, electronic device 100 may also display user interface 920. User interface 920 may be a chat interface with user "Li Si" in an instant messaging application. User interface 920 may include chat logs 921 to 923. As can be seen, chat logs 921 to 923 may be personal identification information sent by user "Li Si". Chat log 921 includes user "Li Si's" name. Chat log 922 includes user "Li Si's" mobile phone number. Chat log 923 includes user "Li Si's" ID number.
[0383] As shown in Figure 9C, the user can copy the personal identity information of the user "Zhang San" and the personal identity information of the user "Li Si" in multiple times. For example, when the electronic device 100 displays the user interface 910 shown in Figure 9A, the electronic device 100 can store the entire text of chat record 911 to the clipboard in response to the user's operation of copying chat record 911. Similarly, the electronic device 100 can store the entire text of chat record 912 and chat record 913 to the clipboard in response to the user's operation of copying chat record 912 and chat record 913 respectively. When the electronic device 100 displays the user interface 920 shown in Figure 9B, the electronic device 100 can store the entire text of chat record 921 to chat record 921 to the clipboard in response to the user's operation of copying chat record 921 to chat record 921 respectively.
[0384] Chat record 911 may be the copied content of the first copy. Chat record 912 may be the copied content of the second copy. Chat record 913 may be the copied content of the third copy. Chat record 921 may be the copied content of the fourth copy. Chat record 922 may be the copied content of the fifth copy. Chat record 923 may be the copied content of the sixth copy. User interface 910 and user interface 920 are both copy pages.
[0385] 3A , the electronic device 100 can parse the user interface 910 to obtain the copy page information of the user interface 910. The electronic device 100 can also parse the user interface 920 to obtain the copy page information of the user interface 920.
[0386] Here, an example is taken for explanation in which a user copies chat records 911 to 913 shown in FIG. 9A and chat records 921 to 923 shown in FIG. 9B and then opens the information entry application in electronic device 100 .
[0387] As shown in Figure 9D, electronic device 100 may display user interface 930. User interface 930 may be the user interface used for information entry in the above-mentioned information entry application. User interface 930 may include a name input box 931, an ID type input box 932, an ID number input box 933, a gender input box 934, a birthday input box 935, a region input box 936, a mobile phone number input box 937, and a cursor 931A. Name input box 931 may be used to enter the user's name. ID type input box 932 may be used to enter the user's ID type (e.g., ID card). ID number input box 933 may be used to enter the user's ID number. Gender input box 934 may be used to enter the user's gender. Birthday input box 935 may be used to enter the user's birthday. Region input box 936 may be used to enter the user's region. Mobile phone number input box 937 may be used to enter the user's mobile phone number. Cursor 931A may be used to indicate the input box with input focus.
[0388] The electronic device 100 can perform page parsing with the user interface 930 as the pasting page to obtain pasting page information. The pasting page information may include the APP category described in the user interface 930 (i.e., an information entry APP) and the type of content to be entered in the input box included in the user interface 930.
[0389] The electronic device 100 can identify that the pasting scenario is an information entry scenario and recognize that the user intention is to enter user information based on the copy page information determined by the user interface 910 shown in Figure 9A, the copy page information determined by the user interface 920 shown in Figure 9B, and the paste page information determined by the user interface 930 shown in Figure 9D. Based on the above-mentioned pasting scenario and user intention, the electronic device 100 can generate extraction prompt information: extract user information from given content. The electronic device 100 inputs the copied content (i.e., chat records 911 to 913 shown in Figure 9A and chat records 921 to 923 shown in Figure 9B) and the extraction prompt information into the language model, and the content to be pasted can be extracted from the copied content through the language model. The content to be pasted may include the personal identity information of the user "Zhang San" and the personal identity information of the user "Li Si".
[0390] The electronic device 100 may provide the content to be pasted on the pasting page.
[0391] In one possible implementation, the electronic device 100 may provide the user with a paste option for indicating information about user "Zhang San" and a paste option for indicating information about user "Li Si." Thus, the user can use the paste options to input multiple pieces of information about a user in the content to be pasted in multiple input boxes of the user interface 930.
[0392] For example, as shown in FIG9D , the electronic device 100 may display a paste option 938 and a paste option 939 on the user interface 930. The paste option 938 may be used to indicate the information of the user "Zhang San". The paste option 939 may be used to indicate the information of the user "Li Si". In response to an operation on the paste option 938 shown in FIG9D , such as a click operation, the electronic device 100 may display the user interface 930 shown in FIG9E . As can be seen from FIG9E , the electronic device 100 fills the information of the user "Zhang San" (such as name, ID number, mobile phone number) in the content to be pasted into the corresponding input box in the user interface 930.
[0393] In another possible implementation, the electronic device 100 may also provide the user with multiple pieces of information in the above-mentioned content to be pasted as different paste options. The user can move the cursor 931A to the input box where information needs to be entered, and then select the corresponding paste option to enter the corresponding contact information in the input box. Among them, the electronic device 100 can provide a paste option corresponding to the information in the content to be pasted that matches the type of content to be entered in the input box where the cursor 931A is located. The above-mentioned matching with the type of content to be entered in the input box can be referred to as matching with the input box.
[0394] For example, as shown in FIG9D , when cursor 931A is located in name input box 931, electronic device 100 may filter information matching name input box 931 (i.e., the user's name) from the content to be pasted, thereby providing paste options 938 and 939. Paste option 938 may be a paste option corresponding to the name of user "Zhang San." Paste option 939 may be a paste option corresponding to the name of user "Li Si." In response to the operation of paste option 938 shown in FIG9D , electronic device 100 may display user interface 930 shown in FIG9F . As shown in FIG9F , electronic device 100 enters the name of user "Zhang San" in name input box 931 according to paste option 938. Furthermore, electronic device 100 may move cursor 931A from the position shown in FIG9D to ID number input box 933 shown in FIG9F . Electronic device 100 may filter information matching ID number input box 933 (i.e., the user's ID number) from the content to be pasted, thereby providing paste option 941. Paste option 941 may be the paste option corresponding to the ID number of user "Zhang San". It is understandable that since electronic device 100 entered the name of user "Zhang San" in name input box 931, the information entered by electronic device 100 in other input boxes in user interface 930 should all be information of user "Zhang San". Therefore, when the electronic device filters the content to be pasted for information that matches the ID number input box 933, it may only filter out the ID number of user "Zhang San".
[0395] As shown in Figure 9F , in response to the operation of the paste option 941, the electronic device 100 may display the user interface 930 shown in Figure 9G . As shown in Figure 9G , the electronic device 100 can enter the ID number of the user "Zhang San" in the ID number input box 933 based on the position of the cursor 931A. The contents of the gender input box 934 and the birthday input box 935 can both be determined based on the ID number entered in the ID number input box 933. Therefore, the electronic device 100 can enter the ID number of the user "Zhang San" in the ID number input box 933, the gender of the user "Zhang San" (e.g., "male") in the gender input box 934, and the birthday of the user "Zhang San" in the birthday input box 935. Furthermore, the electronic device 100 can move the cursor 931A from the position shown in Figure 9F to the mobile phone number input box 937 shown in Figure 9G . The electronic device 100 can filter the content to be pasted to select the information that matches the mobile phone number input box 937 (i.e., the user's mobile phone number) and provide the paste option 942. Paste option 942 may be a paste option corresponding to the mobile phone number of user “Zhang San.” In response to the operation on paste option 942 shown in FIG9G , electronic device 100 may input the mobile phone number of user “Zhang San” in mobile phone number input box 937 .
[0396] Optionally, the electronic device 100 may also provide the user with the entire content to be pasted so that the user can confirm whether the content to be pasted is the content the user desires. The user can then enter multiple pieces of information from the content to be pasted into the multiple input boxes of the user interface 930 shown in FIG9D with one click. This method may refer to the description of the embodiment of FIG8I above.
[0397] In some embodiments, when the user enters the information of the user "Zhang San" in the information entry application according to the scenarios shown in Figures 9D to 9H above, the electronic device 100 can filter the content to be pasted as prompted above when it opens the user interface for entering information in the information entry application again. Among them, the electronic device 100 can filter out the information that has been pasted in the content to be pasted, thereby providing a paste option corresponding to the information that has not been pasted (that is, the information that has not been entered) in the user interface for entering information, so that the user can continue to enter the information of the user that has not been entered. The above filtering method can refer to the method described in Figure 3E above.
[0398] For example, as shown in FIG9H , electronic device 100 displays user interface 930 again. Electronic device 100 may provide paste option 943 based on the filtered content to be pasted. Paste option 943 may be a paste option corresponding to the information of user "Li Si". In response to a manipulation of paste option 943, electronic device 100 may input the information of user "Li Si" into the input box in user interface 930.
[0399] As can be seen from the scenarios shown in Figures 9A to 9H above, the electronic device 100 can use the multiple copied contents in the clipboard to extract the content to be pasted. In this way, when a user interface contains multiple pieces of information that need to be copied, the user can perform multiple copy operations and then open the paste page where the pasting is required, so as to quickly paste the multiple copied contents into one or more input boxes in the paste page. The user does not need to switch repeatedly between the copy page (such as the chat page of the instant messaging application) and the paste page (such as the page of the information entry application). The above method can effectively improve the efficiency of user copy and paste and improve the user's copy and paste experience.
[0400] It is understandable that the pasting method provided in the embodiment of the present application is not limited to the above-mentioned pasting scenarios 1 to 6, and can also be applied to other scenarios. The embodiment of the present application does not limit this.
[0401] It is understood that the various user interfaces described in the embodiments of this application are merely exemplary interfaces and do not limit the scope of this application. In other embodiments, the user interface may adopt a different interface layout, include more or fewer controls, and add or remove other functional options. As long as they are based on the same inventive concept provided by this application, they are all within the scope of protection of this application.
[0402] It should be noted that, without causing any contradiction or conflict, any feature in any embodiment of the present application, or any part of any feature, can be combined, and the combined technical solution is also within the scope of the embodiments of the present application.
[0403] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for pasting clipboard contents, characterized in that: The method comprises: The electronic device receives a first operation on a first content on a first page, and stores the first content in a clipboard; The electronic device receives a second operation of entering a second page, and displays the second page; The electronic device provides a first paste option on the second page, the first paste option is used to paste second content, the second content is obtained after the first content is processed, and the second content is related to the second page; The electronic device receives a third operation of entering a third page, and displays the third page; The electronic device provides a second paste option on the third page, where the second paste option is used to paste third content, where the third content is obtained after processing the first content, and the third content is related to the third page.
2. The method according to claim 1, characterized in that: Before the electronic device provides the first paste option on the second page, the method further includes: The electronic device extracts fourth content from the first content according to the first page and the second page, The second content is the fourth content, or is content obtained after processing the fourth content.
3. The method according to claim 2, characterized in that The method further comprises: The electronic device determines that the fourth content has one or more errors by using a public knowledge base, and performs error correction on the fourth content, wherein the public knowledge base includes public knowledge in one or more fields.
4. The method according to claim 3, characterized in that The method further comprises: The electronic device uses the user's personal knowledge base and / or the public knowledge base to supplement the sixth content in the fifth content to obtain the second content, and the fifth content is the content obtained by performing the error correction processing on the fourth content; the user's personal knowledge base includes one or more of the following user information: user's age group, user's home and company address, user preferences, and user habits.
5. The method according to claim 2, characterized in that: The method further comprises: The electronic device uses the user's personal knowledge base and / or the public knowledge base to supplement the seventh content in the fourth content to obtain the second content, and the user's personal knowledge base contains one or more of the following user information: user's age group, user's home and company address, user preferences, user habits, and the public knowledge base contains public knowledge in one or more fields.
6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: The electronic device determines, based on a user personal knowledge base, that the user's preference for the eighth content is higher than the preference for the second content, the user personal knowledge base comprising one or more of the following user information: the user's age group, the user's home and company address, the user's preferences, and the user's habits, the eighth content is obtained after processing the first content, and the eighth content is related to the second page; The electronic device provides a first paste option on the second page, specifically including: The electronic device provides the first paste option and a third paste option on the second page, and the third paste option is used to paste the eighth content; wherein a display position of the third paste option is higher than a display position of the first paste option.
7. The method according to any one of claims 1 to 6, characterized in that The electronic device provides a first paste option on the second page, specifically including: The electronic device provides the first paste option and a fourth paste option on the second page, the fourth paste option is used to paste a ninth content, the ninth content is obtained after processing the first content, and the ninth content is related to the second page; After the electronic device provides the first paste option on the second page, the method further includes: The electronic device receives an operation on the first paste option, and pastes the second content in an input box on the second page; After the electronic device exits the second page, it receives an operation of entering the second page again, and displays the second page; The electronic device provides the fourth paste option on the second page, wherein the paste options on the second page do not include the first paste option.
8. The method according to any one of claims 1 to 7, characterized in that The method further comprises: The electronic device provides a first paste option on the second page, specifically including: The electronic device provides the first paste option and a fifth paste option on the second page, the fifth paste option is used to paste a tenth content, the tenth content is obtained after processing the first content, and the tenth content is related to the second page; After the electronic device provides the first paste option on the second page, the method further includes: The electronic device receives the operation on the first paste option, pastes the second content in the input box of the second page, and jumps to the fourth page; The electronic device provides the fifth paste option on the fourth page, wherein the paste options on the fourth page do not include the first paste option.
9. The method according to any one of claims 2 to 8, characterized in that: The electronic device extracts fourth content from the first content according to the first page and the second page, specifically including: The electronic device determines first page information according to the first page, and determines second page information according to the second page; The electronic device identifies a first pasting scenario and a first user intention according to the first page information and the second page information; The electronic device determines first extraction prompt information according to the first pasting scenario and the first user intention; The electronic device extracts the fourth content from the first content using a language model according to the first extraction prompt information.
10. The method according to any one of claims 9, characterized in that The first page information includes the first content and / or context information of the first content, and the second page information includes one or more of the following: the APP category to which the second page belongs, the type of content to be entered in the input box of the second page, and operation information related to the second page.
11. The method according to any one of claims 1 to 10, characterized in that Before the electronic device provides the first paste option on the second page, the method further includes: The electronic device receives an operation on the first input box on the second page; After the electronic device provides the first paste option on the second page, the method further includes: The electronic device receives an operation on the first paste option and pastes the second content in the first input box.
12. The method according to claim 11, characterized in that The second page also includes a second input box, and the method further includes: The electronic device receives an operation on the second input box, and provides a sixth paste option on the second page, where the sixth paste option is used to paste an eleventh content, where the eleventh content is obtained after processing the first content, and the eleventh content is related to the second page; The electronic device receives an operation on the sixth paste option, and pastes the eleventh content in the second input box.
13. The method according to any one of claims 1 to 10, characterized in that The second page includes n1 input boxes, where n1 is a positive integer greater than 1, and the second content includes n1 pieces of information; after the electronic device provides the first paste option on the second page, the method further includes: The electronic device receives an operation on the first paste option, and pastes the n1 pieces of information in the n1 input boxes respectively.
14. The method according to any one of claims 1 to 13, characterized in that The first content belongs to the most recent m1 copied or cut content before the electronic device displays the second page, where m1 is a positive integer, or the second page is a page displayed by the electronic device within a first time period after receiving the first operation.
15. The method according to any one of claims 1 to 14, characterized in that The method further comprises: The electronic device receives an operation on a twelfth content on a fifth page, and stores the twelfth content in a clipboard, wherein the fifth page is the same as or different from the first page, and the twelfth content is different from the first content; The electronic device receives an operation of entering a sixth page and displays the sixth page; The electronic device provides a seventh paste option and an eighth paste option on the sixth page, the seventh paste option is used to paste a thirteenth content, the eighth paste option is used to paste a fourteenth content, the thirteenth content is obtained after processing the first content, the thirteenth content is related to the sixth page, and the fourteenth content is obtained after processing the twelfth content, and the fourteenth content is related to the sixth page.
16. An electronic device, characterized in that: The electronic device includes a display screen, a memory and a processor, wherein the display screen is used to display application pages; the memory is used to store computer programs; and the processor is used to call the computer program so that the electronic device executes the method described in any one of claims 1-15.
17. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 15.
18. A computer program product, characterized in that The computer program product comprises computer instructions, and when the computer instructions are run on an electronic device, the electronic device executes the method according to any one of claims 1 to 15.
Citation Information
Patent Citations
Clipboard content pasting method and related device
CN119271424A
Copy and paste processing method and device as well as terminal device
CN105843510A
Copying / pasting method and mobile terminal
CN106055202A
Character input processing method and device and electronic equipment
CN109684022A
Copying and pasting method, terminal and computer readable storage medium
CN109947523A