Clipboard content pasting method and related device
By recognizing the scenarios and user intent of copying and pasting pages, electronic devices extract and process the content to be pasted from the clipboard, solving the problem of cumbersome copy and paste operations between different apps or pages, and improving efficiency and user experience.
Patent Information
- Application Number
- CN202310810949.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-04
- Publication Date
- 2025-01-07
AI Technical Summary
When users copy and paste content between different apps or pages, it is difficult to accurately select the content they need, resulting in cumbersome and inefficient operations. This is especially true when the copied content contains redundant information or multiple pieces of information that are spaced out, where existing technologies cannot effectively improve the user experience.
Electronic devices can identify the scenarios and user intentions of copying and pasting pages, extract and process the content to be pasted from the clipboard to meet the user's needs, and provide relevant options on the paste page, supporting operations such as error correction, completion, sorting and filtering, so as to improve the accuracy and efficiency of pasting.
It improves the efficiency and experience of copying and pasting between different apps or pages, reduces the processing of redundant information and multiple operations, and ensures the accuracy of pasted content and its alignment with user preferences.
Smart Images

Figure CN119271424A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a method for pasting clipboard contents and related devices. Background Art
[0002] When users use electronic devices such as mobile phones and computers, they often need to copy and paste between different APPs or pages. The above requirements are spread across social, office, entertainment, shopping and other scenarios. However, in current practical applications, it is troublesome for users to accurately copy the required content from a piece of content. For example, because the cursor displayed on the mobile phone screen is small, the user needs to repeatedly adjust the position of the cursor to select the content to be copied. For another example, some applications only support the copying of the entire content. After the user needs to copy and paste the entire content, the unnecessary parts of the entire content are deleted one by one. In addition, the user may need to copy multiple pieces of information in a piece of content, and these multiple pieces of information may be distributed at intervals. If the user needs to paste the above-mentioned copied multiple pieces of information in other APPs, the user has to switch between APPs repeatedly to perform multiple copy and paste operations. It can be seen that the above copy and paste operations are cumbersome and the user experience is poor. Summary of the invention
[0003] The present application provides a method and a related device for pasting clipboard content. The electronic device can extract the content to be pasted that meets the user's intention and matches the pasting scenario from the clipboard content based on the copy page and the paste page. The electronic device can provide the above content to be pasted on the paste page for the user to select and enter into an input box in the paste page. The electronic device can provide the above content to be pasted on the paste page for the user to select and enter into an input box in the paste page.
[0004] In a first aspect, the present application provides a method for pasting clipboard content. In which, the electronic device receives a first operation on a first content on a first page and stores the first content in the clipboard; the electronic device receives a second operation to enter a second page and displays the second page; the electronic device provides a first paste option on the second page, the first paste option is used to paste the second content, the second content is obtained after the first content is processed, and the second content is related to the second page; the electronic device receives a third operation to enter a third page and displays the third page; the electronic device provides a second paste option on the third page, the second paste option is used to paste the third content, the third content is obtained after the first content is processed, and the third content is related to the third page.
[0005] Among them, the above-mentioned first operation can be an operation of copying the first content, or an operation of cutting the first content. The first content can be copied content or cut content (i.e., clipboard content). The first page can be a copy page in this application, and the second page and the third page can both be paste pages in this application. The second page and the third page can be different pages in the same application, or pages in different applications. The second content and the third content can be the content to be pasted obtained after the electronic device processes the first content. The second content and the third content can be different, or they can be the same.
[0006] In some embodiments, the second content being related to the second page may specifically mean that the second content matches the type of content to be input in the input box of the second page. The third content being related to the third page may specifically mean that the third content matches the type of content to be input in the input box of the third page.
[0007] It can be seen from the above method that for the same copied content, the electronic device can provide a paste option corresponding to the content to be pasted related to each paste page from the copied content according to different paste pages. The content to be pasted related to a paste page can be the content that the electronic device analyzes that the user wants to paste from the copied content to the paste page. In this way, when the copied content contains a lot of redundant information, the user does not need to move the cursor when copying, perform cumbersome copy content selection operations, and does not need to delete the redundant information one by one after pasting the copied content. In addition, when there are multiple pieces of information that the user wants to copy and paste in the copied content, but these multiple pieces of information are distributed at intervals, the user can copy all the information as a whole without having to switch between APPs repeatedly to perform multiple copy and paste operations. The above method can effectively improve the efficiency of user copy and paste and improve the user's copy and paste experience.
[0008] In combination with the first aspect, in some embodiments, before the electronic device provides the first paste option on the second page, the electronic device may extract fourth content from the first content based on the first page and the second page, wherein the second content is the fourth content, or is content obtained after processing the fourth content.
[0009] Similarly, before providing the second paste option on the third page, the electronic device may extract the first content according to the first page and the third page to obtain the third content, or process the content extracted from the first content to obtain the third content.
[0010] It can be seen that the content to be pasted provided by the electronic device on the paste page for the user to paste can be directly extracted from the copied content, or it can be obtained by extracting relevant content from the copied content and then processing it. For example, when the first content contains a lot of redundant information, the electronic device can remove the redundant information in the first content according to the first page and the second page, and extract the information in the first content that the user is most likely to want to paste. In this way, the user does not need to move the cursor when copying, perform cumbersome operations to select the copied content, and does not need to delete the redundant information one by one after pasting the copied content. For another example, when there are multiple pieces of information that the user wants to copy and paste in the first content, but these multiple pieces of information are distributed at intervals, the electronic device can extract all the multiple pieces of information that the user wants to copy and paste according to the first page and the second page as the content to be pasted and display them on the paste page. In this way, the user can perform multiple copy and paste operations without repeatedly switching between APPs.
[0011] In combination with the first aspect, in some embodiments, the electronic device uses a public knowledge base to determine that the fourth content has one or more errors and performs error correction processing on the fourth content. The public knowledge base contains public knowledge in one or more fields (such as music, film, technology, agriculture, etc.). The data in the public knowledge base can be crawled from databases such as websites and applications by a data crawling device. In some embodiments, the second content can be the content after the error correction processing of the fourth content.
[0012] It can be seen that the electronic device can correct the pasted content. In this way, even if there are errors in the information in the copied content, the electronic device can provide the correct content to the user for pasting after error correction, avoiding the incorrect copied content from affecting the user's use effect and experience.
[0013] In combination with the first aspect, in some embodiments, the electronic device uses the user's personal knowledge base and / or the public knowledge base to supplement the sixth content in the fifth content to obtain the second content, and the fifth content is the content obtained by error correction processing of the fourth content; the user's personal knowledge base includes one or more of the following user information: the user's age group, the user's home and company address, the user's preferences, and the user's habits.
[0014] For example, the fifth content is the name of one or more TV series played on the playback platform 1. The electronic device finds out from the public knowledge base that the first content also stores the names of TV series played on the playback platform 1 in addition to the fifth content. The name of the TV series belonging to the playback platform 1 but not yet extracted into the fifth content may be the sixth content. The electronic device may add the name of the TV series belonging to the playback platform 1 in the first content that has not yet been extracted into the fifth content to the fifth content.
[0015] It can be seen that after correcting the content to be pasted, the electronic device can further complete the corrected content to be pasted based on the user's personal knowledge base and / or the public knowledge base, so as to provide the user with content to be pasted that conforms to the user's expression or search habits, and the above method can improve the content to be pasted and reduce the situation of missing information that the user may need in the copied content.
[0016] Optionally, the electronic device may first complete the content to be pasted, and then correct errors in the completed content to be pasted.
[0017] In combination with the first aspect, in some embodiments, the electronic device uses the user's personal knowledge base and / or the public knowledge base to supplement the seventh content in the fourth content to obtain the second content, and the user's personal knowledge base contains one or more of the following user information: the user's age group, the user's home and company address, the user's preferences, and the user's habits; the public knowledge base contains public knowledge in one or more fields.
[0018] For example, the fourth content may include a movie theater that the user often goes to. The electronic device determines that the movie theater that the user often goes to is an AA movie theater based on the user's personal knowledge base. The name of the AA movie theater may be the seventh content. The electronic device may supplement the AA movie theater to the fourth content.
[0019] It can be seen that the electronic device can complete the content to be pasted based on the user's personal knowledge base and / or the public knowledge base, so as to provide the user with content to be pasted that conforms to the user's expression or search habits, and the above method can improve the content to be pasted and reduce the situation of missing information that the user may need in the copied content.
[0020] In combination with the first aspect, in some embodiments, the electronic device determines that the user's preference for the eighth content is higher than the preference for the second content based on the user's personal knowledge base, the user's personal knowledge base includes one or more of the following user information: the user's age group, the user's home and company address, the user's preferences, and the user's habits; the eighth content is obtained after processing the first content, and the eighth content is related to the second page; the electronic device provides a first paste option and a third paste option on the second page, and the third paste option is used to paste the eighth content; wherein, the display position of the third paste option is better than the display position of the first paste option.
[0021] For example, the second content is the name of TV series 1. The eighth content is the name of TV series 2. The electronic device can determine that TV series 2 is a TV series that the user prefers to watch based on the user's personal knowledge base.
[0022] The display position of the third paste option being superior to the display position of the first paste option can indicate that the third paste option is displayed at a front position than the first paste option. For example, if the paste options are displayed in order from top to bottom, the third paste option can be displayed above the first paste option. For another example, if the paste options are displayed in order from left to right, the third paste option can be displayed to the left of the first paste option. It can be understood that displaying the paste option corresponding to the content to be pasted with a higher user preference at a more preferred position can facilitate users to preferentially paste the information they are interested in on the paste page.
[0023] In combination with the first aspect, in some embodiments, the electronic device provides a first paste option and a fourth paste option on the second page, the fourth paste option is used to paste the ninth content, the ninth content is obtained after the first content is processed, the ninth content is related to the second page; the ninth content is different from the second content. The electronic device receives an operation on the first paste option and pastes the second content in the input box on the second page; after the electronic device exits the second page, it receives an operation to enter the second page again and displays the second page; the electronic device provides the fourth paste option on the second page, wherein the paste options on the second page do not include the first paste option.
[0024] For example, the second content may be gift package redemption code 1. The ninth content may be gift package redemption code 2. The second page may be a page for inputting a gift package redemption code for gift package redemption. When gift package redemption code 1 (i.e., the second content) has been pasted and used, the electronic device enters the second page again, and the electronic device may filter out gift package redemption code 1 and only provide a paste option corresponding to gift package redemption code 2. This can avoid the situation where the user forgets that gift package redemption code 1 has been used and pastes gift package redemption code 1 again, resulting in invalid redemption.
[0025] It can be seen that the electronic device can filter the content to be pasted and filter out the information that has been pasted in the content to be pasted. In this way, when the information becomes invalid after being pasted, the interference of the invalid information to the user can be reduced, and the user can be prevented from repeatedly pasting the invalid information.
[0026] In combination with the first aspect, in some embodiments, the electronic device provides a first paste option and a fifth paste option on the second page, the fifth paste option is used to paste a tenth content, the tenth content is obtained after processing the first content, and the tenth content is related to the second page; the electronic device receives an operation on the first paste option, pastes the second content in the input box on the second page, and jumps to the fourth page; the electronic device provides a fifth paste option on the fourth page, wherein the paste options on the fourth page do not include the first paste option.
[0027] For example, the second content may be a store name. The tenth content may be a product name. The second page may be the homepage of a shopping application. It is understandable that when the homepage of a shopping application is displayed, the user may want to search for stores or may want to search for products. Therefore, the electronic device may provide paste options corresponding to the second content and the tenth content. When pasting the store name in the search box on the homepage of a shopping application, searching and entering the product display page of the store, the user usually wants to search for products in the store, and will not search for other stores in the store. The fourth page may be the product display page of the store. When switching to the fourth page, the electronic device may filter out the second content and retain the tenth content.
[0028] It can be seen that the electronic device can filter out the information that the user needs to paste according to the changes in the pasting page, thereby reducing the interference of other information on the user.
[0029] In combination with the first aspect, in some embodiments, a specific method for an electronic device to extract fourth content from a first content based on a first page and a second page may include: the electronic device determines first page information based on the first page, and determines second page information based on the second page; the electronic device identifies a first pasting scenario and a first user intent based on the first page information and the second page information; the electronic device determines first extraction prompt information based on the first pasting scenario and the first user intent; and the electronic device extracts fourth content from the first content using a language model through the first extraction prompt information.
[0030] Similarly, the electronic device can determine the third page information based on the third page, and identify the corresponding pasting scenario and user intention based on the first page information and the third page information, and then extract content related to the third page from the first content based on the pasting scenario and user intention.
[0031] It can be seen that the electronic device can identify the pasting scenario and user intention by combining the copy page and the paste page, and extract the content to be pasted that meets the user intention and matches the pasting scenario from the copied content. This can effectively improve the efficiency of user copy and paste and improve the user's copy and paste experience.
[0032] In combination with the first aspect, in some embodiments, the first page information includes the first content and / or context information of the first content, and the second page information includes one or more of the following: the APP category to which the second page belongs, the type of content to be entered in the input box of the second page, and operation information related to the second page. The third page information may include one or more of the following: the APP category to which the third page belongs, the type of content to be entered in the input box of the third page, and operation information related to the third page.
[0033] In combination with the first aspect, in some embodiments, before the electronic device provides the first paste option on the second page, the electronic device receives an operation on the first input box on the second page; after the electronic device provides the first paste option on the second page, the electronic device receives an operation on the first paste option and pastes the second content in the first input box.
[0034] The second page also includes a second input box. The electronic device receives an operation on the second input box and provides a sixth paste option on the second page. The sixth paste option is used to paste the eleventh content, which is obtained after the first content is processed, and the eleventh content is related to the second page; the electronic device receives an operation on the sixth paste option and pastes the eleventh content in the second input box.
[0035] It can be seen that when the pasting page includes multiple input boxes, the electronic device can provide the content to be pasted that matches the type of the content to be input in the input box selected by the user. In this way, the user can paste the corresponding content one by one in the multiple input boxes to be pasted.
[0036] In combination with the first aspect, in some embodiments, the second page includes n1 input boxes, n1 is a positive integer greater than 1, and the second content includes n1 pieces of information; after the electronic device provides a first paste option on the second page, the electronic device receives an operation on the first paste option and pastes the n1 pieces of information in the n1 input boxes respectively.
[0037] It can be seen that when the paste page contains multiple input boxes, the electronic device can provide the content to be pasted that matches the multiple input boxes as a paste option to the user. In this way, the user can fill multiple pieces of information in the content to be pasted into multiple input boxes on the paste page with one click, which can improve the efficiency of the user's copy and paste.
[0038] In combination with the first aspect, in some embodiments, the first content belongs to the most recent m1 copied or cut content before the electronic device displays the second page, where m1 is a positive integer, or the second page is a page displayed by the electronic device within a first time period after receiving the first operation.
[0039] In combination with the first aspect, in some embodiments, the electronic device receives an operation on the twelfth content on the fifth page, stores the twelfth content in the clipboard, the fifth page is the same as or different from the first page, and the twelfth content is different from the first content; the electronic device receives an operation to enter the sixth page, and displays the sixth page; the electronic device provides a seventh paste option and an eighth paste option on the sixth page, the seventh paste option is used to paste the thirteenth content, the eighth paste option is used to paste the fourteenth content, the thirteenth content is obtained after processing the first content, the thirteenth content is related to the sixth page, and the fourteenth content is obtained after processing the twelfth content, and the fourteenth content is related to the sixth page.
[0040] The electronic device may determine the fifth page information according to the fifth page, and determine the sixth page information according to the sixth page. The electronic device may process the first content according to the first page information and the sixth page information to obtain the thirteenth content. The electronic device may process the twelfth content according to the fifth page information and the sixth page information to obtain the fourteenth content.
[0041] It can be seen that the electronic device can use the multiple copied contents in the clipboard to extract the content to be pasted. In this way, when a user interface contains multiple pieces of information that need to be copied, the user can perform multiple copy operations and then open the paste page that needs to be pasted, so as to quickly paste the multiple copied contents into one or more input boxes in the paste page. The user does not need to repeatedly switch between the copy page (such as the chat page of the instant messaging application) and the paste page (such as the page of the information entry application). The above method can effectively improve the efficiency of user copy and paste and improve the user's copy and paste experience.
[0042] In a second aspect, the present application provides an electronic device, which may include a display screen, a memory, and a processor. The display screen may be used to display application pages. The memory may be used to store computer programs. The processor may be used to call the computer program so that the electronic device executes any possible implementation method as in the first aspect.
[0043] In a third aspect, the present application provides a computer-readable storage medium, comprising instructions, which, when executed on an electronic device, enable the electronic device to execute any possible implementation method in the first aspect.
[0044] In a fourth aspect, the present application provides a computer program product, which may include computer instructions. When the computer instructions are run on an electronic device, the electronic device executes any possible implementation method in the first aspect.
[0045] In a fifth aspect, the present application provides a chip, which is applied to an electronic device, and the chip includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute any possible implementation method as in the first aspect.
[0046] It can be understood that the electronic device provided in the second aspect, the computer-readable storage medium provided in the third aspect, the computer program product provided in the fourth aspect, and the chip provided in the fifth aspect are all used to execute the method provided in the embodiment of the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Figure 1 is a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;
[0048] Figure 2 is a software structure block diagram of an electronic device 100 provided in an embodiment of the present application;
[0049] Figure 3A to Figure 3E It is a schematic diagram of some methods for processing clipboard content provided in the embodiments of the present application;
[0050] Figure 4A to Figure 4L It is a schematic diagram of some movie ticket purchase scenarios and navigation scenarios provided in the embodiments of the present application;
[0051] Figure 5A to Figure 5G is a schematic diagram of some shopping scenarios provided in the embodiments of the present application;
[0052] Figure 6A to Figure 6F It is a schematic diagram of some film and television drama search scenarios provided in the embodiments of the present application;
[0053] Figure 7A to Figure 7H It is a schematic diagram of some redemption code redemption scenarios provided in the embodiments of the present application;
[0054] FIG. 8A to FIG. 8I is a schematic diagram of some contact adding scenarios provided in the embodiments of the present application;
[0055] Figures 9A to 9H It is a schematic diagram of some information entry scenarios provided in the embodiments of the present application. DETAILED DESCRIPTION
[0056] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "a", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear indication to the contrary in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in a "or" relationship.
[0057] References to "one embodiment" or "some embodiments" etc. described in this specification mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Thus, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways. The term "connection" includes direct connection and indirect connection, unless otherwise specified. "First" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.
[0058] In the embodiments of the present application, the words "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.
[0059] The term "user interface (UI)" in the following embodiments of the present application refers to the medium interface for interaction and information exchange between an application (APP) or an operating system (OS) and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that can be recognized by the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.
[0060] In some embodiments, when a user's copy operation is detected, the electronic device can select the copied content selected by the user's copy operation based on the context information of the copied content and the user's historical copy and paste operation behavior, and provide the selected content to the user as a paste option. Although the above method can help the user select the content that the user may need to paste from the copied content, when there is a large amount of relevant information in the copied content, the above method may be difficult to accurately determine which content in the copied content is needed by the user. In addition, the above method cannot meet the user's needs to copy multiple pieces of information in a piece of content.
[0061] In other embodiments, the electronic device can segment the copied content based on the copied content and the user's pasting scenario, extract one or more related information from the copied content, and list the one or more related information for the user to select. Although the above method can help the user copy multiple pieces of information in a piece of content, the above method does not take into account the user's usage habits and the pasted content. The segmented related information may not be what the user needs, and it is difficult to meet the user's actual copy and paste needs.
[0062] The present application provides a method for pasting clipboard content. Among them, when a copy operation is detected, the electronic device can parse the copy page to obtain copy page information. The copy page information may include the copy content and / or the context information of the copy content. The above-mentioned copy content may represent the content selected by the copy operation. When entering the paste page, the electronic device can parse the paste page to obtain the paste page information. The above-mentioned paste page may include a page that can paste the above-mentioned copy content. The above-mentioned paste page information may include one or more of the following: the APP category to which the paste page belongs, the type of content to be entered in the paste page input box, operation information related to the paste page, etc. The electronic device can identify the paste scene and the user intention based on the above-mentioned copy page information and the above-mentioned paste page information. The above-mentioned user intention may indicate the user's need to perform a copy and paste operation. Further, the electronic device can determine the content to be pasted based on the above-mentioned paste scene, user intention, and copy content. The above-mentioned content to be pasted may include information extracted by the electronic device from the copy content that meets the user's intention and matches the input box in the paste page. The electronic device can provide the above-mentioned content to be pasted on the paste page for the user to select to enter into the input box in the paste page.
[0063] It can be seen from the above method that the electronic device can extract the content to be pasted that meets the user's intention and matches the input box in the paste page from the copied content by identifying the paste scene and the user's intention. The user can directly select the above content to be pasted and enter it into the input box of the paste page. The above content to be pasted can meet the user's copy and paste needs. The above method can accurately extract the content that the user wants to copy and paste from the copied content when the user's copied content contains a lot of redundant information. In this way, the user does not need to move the cursor when copying, perform cumbersome copy content selection operations, and does not need to delete the redundant information one by one after pasting the copied content. In addition, when there are multiple pieces of information that the user wants to copy and paste in the copied content, but these multiple pieces of information are distributed at intervals, the electronic device can extract all these multiple pieces of information based on the paste scene and the user's intention as the content to be pasted and display them on the paste page. In this way, the user does not need to switch repeatedly between APPs to perform multiple copy and paste operations. The pasting method of the present application can effectively improve the efficiency of user copy and paste, and improve the user's copy and paste experience.
[0064] In some embodiments, when the above-mentioned content to be pasted is extracted, the electronic device can use the public knowledge base to correct the content to be pasted to obtain the corrected content to be pasted. The above-mentioned public knowledge base may store public knowledge in one or more fields such as music, film and television, technology, agriculture, etc. For example, if the above-mentioned content to be pasted contains the name of a TV series, the electronic device can use the public knowledge base to determine whether the name of the TV series is correct. In the case where it is determined that the name of the TV series is wrong, the electronic device can modify the name of the TV series to the correct name. In this way, if there is an error in the content copied by the user, the electronic device can correct the error and provide the correct content to the user for pasting.
[0065] In other embodiments, the electronic device may also use the user's personal knowledge base and / or the public knowledge base to complete the content to be pasted to obtain the completed content to be pasted. Among them, the electronic device may also complete the content to be pasted after the above error correction. The above user's personal knowledge base may include user information such as user portraits that represent user identity, user preferences, user habits and other characteristics. For example, when the pasting scene is a shopping scene and the user intends to search for clothing or stores recommended by others, the electronic device can determine the type of clothing that the user likes to wear in combination with the user's personal knowledge base. The electronic device can supplement the type of clothing that the user likes to wear in the content to be pasted, so that the completed content to be pasted is more in line with the user's expression or search habits, helping the user to more accurately search for the clothing or store that the user wants. The above completion of the content to be pasted can provide the user with content to be pasted that conforms to the user's expression or search habits, and can improve the content to be pasted, reducing the situation where information that the user may need is omitted in the copied content.
[0066] In other embodiments, the electronic device may also use a personal knowledge base to sort the content to be pasted to obtain sorted content to be pasted. Among them, the electronic device may also sort the content to be pasted after the above error correction and / or completion. The above content to be pasted may include multiple pieces of information extracted from the copied content. The electronic device may sort the information to be pasted that is more in line with the user's preferences in the content to be pasted according to the personal knowledge base. The above sorting of the content to be pasted can facilitate users to preferentially paste the information they are interested in on the pasting page.
[0067] In other embodiments, the electronic device may also filter the content to be pasted to obtain the filtered content to be pasted. Among them, the electronic device may also filter the content to be pasted after the above correction, completion and / or sorting. Specifically, the electronic device may filter the content to be pasted according to the operation information of the historical pasting and / or the user's intention. For example, in the case where the content to be pasted contains multiple pieces of information of the same type, if the electronic device has pasted a piece of information in the content to be pasted on the pasting page, the electronic device may filter the pasted piece of information when entering the pasting page again, and provide the information that has not been pasted in the content to be pasted on the pasting page. For another example, in the case where the content to be pasted contains multiple pieces of information of different types, the electronic device may determine the type of the content to be pasted on the currently displayed pasting page according to the user's intention, thereby filtering out one or more types of information in the content to be pasted, and only providing the information that needs to be pasted on the current pasting page. It can be seen that the above filtering of the content to be pasted can reduce the situation where the user repeatedly pastes the expired information when the information is invalid after being pasted, or filter out the information that the user needs to paste according to the user's intention, and reduce the interference of other information on the user.
[0068] It should be noted that when it is detected that the user has selected content and performs a copy or cut operation, the electronic device can store the copied content or the cut content to the clipboard. The above-mentioned copied content and cut content can be text, symbols, pictures, etc. The embodiments of the present application do not limit the types of copied content and cut content. For ease of description, the subsequent embodiments of the present application specifically use the copy scenario as an example for explanation. The pasting method in the cut scenario can refer to the pasting method in the copy scenario.
[0069] The clipboard may be a storage area on the memory of an electronic device, which may be used to store data copied or cut by a user. The data stored in the clipboard may be referred to as clipboard content. In some embodiments, the clipboard may store the copied content of one or more copy operations, and be marked with the storage time of these copied contents. When the copied content stored in the clipboard exceeds the limit of the storage area, the electronic device may delete part of the copied content in the clipboard according to rules such as the order of storage time. For example, the electronic device may delete the copied content with the earliest storage time in the clipboard so that the copied content corresponding to the new copy operation can be stored in the clipboard. In some embodiments, the electronic device may include a clipboard application. The user may view the data stored in the clipboard through the clipboard application and edit the data in the clipboard.
[0070] The pasting method provided in the present application can be used to obtain copied content from a clipboard, and perform corresponding processing (for example, extraction, error correction, completion, sorting, filtering, etc.) on the copied content to obtain the content to be pasted, thereby providing the content to be pasted to the user for pasting, thereby improving the user's copy and paste experience.
[0071] Electronic equipment introduction
[0072] Here, the software and hardware structure of the electronic device 100 involved in this application is introduced.
[0073] Figure 1 The schematic diagram of the hardware structure of the electronic device 100 is exemplarily shown.
[0074] like Figure 1 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0075] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0076] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0077] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0078] The processor 110 may also be provided with a memory for storing instructions and data. In some examples, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0079] In the present application, a computer program may be stored in the memory, which is used to enable the controller or processor to implement the pasting method of the present application through an interface or protocol.
[0080] Exemplarily, the computer program stored in the memory can be used to: perform page analysis on the copied page to obtain copy page information, perform page analysis on the pasted page to obtain paste page information, identify the pasting scenario and user intent based on the copy page information and the pasted page information, intelligently extract the copied content based on the paste scenario and user intent to obtain content to be pasted, wherein the content to be pasted may include information extracted from the copied content that meets the user intent and matches the input box in the paste page, and perform one or more of the following processing on the content to be pasted: error correction, completion, sorting, filtering, etc.
[0081] The USB interface 130 is an interface that complies with USB standard specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 may be used to connect a charger to charge the electronic device 100, or may be used to transmit data between the electronic device 100 and a peripheral device. It may also be used to connect headphones to play audio through the headphones.
[0082] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While the charging management module 140 charges the battery 142, it can also power the electronic device through the power management module 141.
[0083] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
[0084] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0085] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0086] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1.
[0087] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0088] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.
[0089] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
[0090] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.
[0091] The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, and the light signal is converted into an electrical signal. The camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.
[0092] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0093] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0094] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. NPU can realize applications such as intelligent cognition of electronic device 100, such as image recognition, face recognition, voice recognition, text understanding, text generation, etc.
[0095] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0096] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0097] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0098] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some examples, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110. The speaker 170A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 170C, also known as the "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 170D is used to connect wired headphones.
[0099] The sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a gravity sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
[0100] Among them, the gyroscope sensor can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor. The electronic device 100 can determine the offset angle of the electronic device 100 through the gyroscope sensor.
[0101] The acceleration sensor can detect the magnitude of acceleration in all directions (generally three axes) of the electronic device 100. In some embodiments, the acceleration sensor can be used to identify the posture of the electronic device 100, and can be applied to applications such as horizontal and vertical screen switching and pedometers.
[0102] The gravity sensor can be used to determine the tilt angle of the electronic device 100 relative to the horizontal plane. In some embodiments, the screen state of the electronic device 100 can be determined by the gravity sensor, so that the screen is adjusted to keep it horizontal.
[0103] In some embodiments, the electronic device 100 may determine the moving distance of the electronic device 100 within a period of time by using an acceleration sensor and a gravity sensor.
[0104] The buttons 190 include a power button, a volume button, etc. The motor 191 can generate a vibration prompt. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, messages, missed calls, notifications, etc.
[0105] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some examples, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0106] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. Taking the system as an example, the software structure of the electronic device 100 is exemplified.
[0107] Figure 2The software structure block diagram of the electronic device 100 is exemplarily shown.
[0108] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. The system is divided into four layers, from top to bottom: application layer, application framework layer, Android Runtime and system library, and kernel layer.
[0109] The application layer can include a series of application packages.
[0110] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, clipboard application, input method application, short message, etc. Among them, the clipboard application can be used to obtain the clipboard content and provide the user with the function of viewing the clipboard content and the function of editing the clipboard content. The input method application can be used to provide the function of inputting text, symbols and other content. Optionally, the input method application can also obtain the clipboard content and provide the clipboard content when the user has input requirements, so that the user can quickly paste the clipboard content into the input box.
[0111] In one possible implementation, both the clipboard application and the input method application can provide users with a smart paste function. The above-mentioned smart paste function can mean: extracting the content to be pasted that meets the user's intention and matches the input box in the paste page from the clipboard content, and providing the above-mentioned content to be pasted on the paste page for the user to input into the input box. Among them, the above-mentioned content to be pasted provided on the paste page can also be the content to be pasted after one or more of the following processing: error correction, completion, sorting, and filtering. In other words, the above-mentioned smart paste function can be used to accurately extract the content that the user wants to paste on the current paste page from the clipboard content, thereby improving the efficiency of the user's copy and paste.
[0112] The embodiment of the present application does not limit the application in the electronic device 100 that performs one or more processes such as extraction, error correction, completion, sorting and filtering on the clipboard content. In addition to the above-mentioned clipboard application and input method application, the above-mentioned application that extracts the content to be pasted based on the clipboard content and performs one or more processes such as error correction, completion, sorting, filtering, etc. on the pasted content can also be other applications in the electronic device 100. Optionally, the above-mentioned one or more processes such as extraction, error correction, completion, sorting and filtering on the clipboard content can also be implemented by multiple applications. For example, the clipboard application can extract the clipboard content to obtain the content to be pasted. Then, the input method application can obtain the above-mentioned content to be pasted, and perform one or more processes such as error correction, completion, sorting and filtering on the pasted content.
[0113] The application framework layer provides API and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0114] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, an activity manager, and the like.
[0115] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0116] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0117] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0118] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).
[0119] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0120] The notification manager enables applications to display notification information in the status bar (such as the pull-down notification bar). It can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0121] The activity manager is responsible for managing activities, starting, switching, and scheduling components in the system, as well as managing and scheduling applications. The activity manager can be called by upper-level applications to open corresponding activities.
[0122] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.
[0123] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.
[0124] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0125] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0126] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0127] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0128] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0129] A 2D graphics engine is a drawing engine for 2D drawings.
[0130] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[0131] How to process the clipboard content
[0132] In some embodiments, the electronic device 100 can extract the content to be pasted that meets the user's intention and matches the input box in the pasting page based on the clipboard content. In addition, the electronic device 100 can also perform one or more of error correction, completion, sorting and / or filtering on the content to be pasted, so that the content to be pasted better meets the user's copy and paste needs.
[0133] 1. Extraction
[0134] Figure 3A The following is a schematic diagram of a method for extracting content to be pasted provided in an embodiment of the present application.
[0135] like Figure 3AAs shown, the electronic device 100 may include a page parsing module, a scene recognition module, a user intent recognition module, an extraction prompt generator and a language model.
[0136] Page parsing module: can be used to parse the copied page to obtain the copied page information, and can be used to parse the pasted page to obtain the pasted page information.
[0137] Specifically, when an operation of selecting and copying content is detected, the electronic device 100 can store the copied content in the clipboard. The above-mentioned copied content is the content selected by the copy operation. The page on which the copy operation acts is the copy page. The electronic device 100 can perform page parsing on the copied page through a page parsing module to obtain copy page information. The copy page information may include one or more of the following: the copied content, the context information of the copied content. Among them, the context information of the copied content may include one or more pieces of information on the copy page that are located before and / or after the copied content. The context information of the copied content may include text, symbols, pictures and other content.
[0138] In a possible implementation, the electronic device 100 can extract a preset number of pieces of information before and after the copied content on the copied page through a page parsing module, and use the information as context information of the copied content. The embodiment of the present application does not limit the value of the preset number of pieces. For example, in a chat page of an instant messaging application, the copied content is a chat record in the chat page. Then, the electronic device 100 can extract the 5 chat records before this chat record and the 5 chat records after this chat record, and use them as context information of the copied content.
[0139] In another possible implementation, the electronic device 100 may also take a screenshot of the copied page and perform image recognition on the screenshot of the copied page to obtain context information of the copied content. The embodiment of the present application does not limit the method by which the electronic device 100 obtains context information of the copied content.
[0140] The electronic device 100 can determine the pasted page, and perform page parsing on the pasted page through the page parsing module to obtain the pasted page information, wherein the pasted page information may include one or more of the following: the APP category to which the pasted page belongs, the type of content to be input in the pasted page input box, and operation information related to the pasted page.
[0141] Here, some exemplary methods for the electronic device 100 to determine the pasted page are introduced.
[0142] In one possible implementation, when an operation is detected for inputting into an input box (such as clicking on the input box, long pressing the input box, etc.), the electronic device 100 may determine the page containing the above input box as a paste page. The above input box may refer to an area for the user to input. The electronic device 100 may input text, symbols, pictures, and the like into the input box. The embodiment of the present application does not limit the content that can be input into the input box. In other words, when a user needs to input information on a page, this page may be a paste page. The electronic device 100 may identify the paste scenario and the user's intention based on the paste page to provide content to be pasted that meets the user's needs.
[0143] In another possible implementation, when a copy operation is detected, the electronic device 100 may determine the page containing the input box displayed within a preset time period after the copy operation starts as a paste page. That is to say, within the preset time period after the user performs the copy operation, any page containing the input box displayed by the electronic device 100 may be a paste page. The embodiment of the present application does not limit the value of the above-mentioned preset time period. It is understandable that after the user performs the copy operation, the page will usually jump to the page where the copied content needs to be pasted. Then, the page containing the input box displayed by the electronic device 100 within the preset time period after the user performs the copy operation may be the page where the user needs to paste.
[0144] The embodiment of the present application does not limit the method by which the electronic device 100 determines the pasted page.
[0145] In the above-mentioned paste page information, the category of the APP to which the paste page belongs may include but is not limited to: social APP, game APP, payment APP, shopping APP, office APP, reading APP, film and television APP, music APP, etc., and the embodiment of the present application does not limit the category of APP. The type of content to be entered in the paste page input box may include but is not limited to: name, film and television drama name, place name, store name, product name, redemption code, certificate number, mobile phone number, email address, etc. One or more types of information can be entered in an input box. The embodiment of the present application does not limit the type of content to be entered in the above-mentioned input box. The operation information related to the paste page may include but is not limited to information about the user's operation on the paste page and operation information for opening the paste page. In one implementation, the operation information related to the paste page includes information about the user's operation on the paste page. Exemplarily, a paste page may contain multiple input boxes (such as an input box for entering a name, an input box for entering a mobile phone number, etc.). The information that the user operates on the paste page may include information about the input box clicked or long pressed on the paste page (such as the type of content to be entered in the input box). The electronic device 100 can determine what the user currently wants to input based on which input box the user clicks on the pasted page. In another implementation, the operation information related to the pasted page includes information for opening the pasted page. For example, both the homepage of a shopping application and the product display page of a store in the shopping application include an input box. Among them, the user can enter the store name in the input box on the homepage of the shopping application to search for the store and enter the store's product display page. The above operation for entering the store's product display page helps the electronic device 100 determine that the user intends to search for products in the store. The embodiment of the present application does not limit the content of the operation information related to the pasted page. Optionally, the pasted page information can also include more content (such as context information of the input box, etc.).
[0146] Scene recognition module: can be used to identify the paste scene based on the copy page information and the paste page information. In one possible implementation, the scene recognition module can identify the paste scene based on a neural network model. The embodiment of the present application does not limit the above method for identifying the paste scene. In one possible implementation, the scene recognition module can first use the copy page information to pre-identify the paste scene, and then further identify the pre-identified paste scene in combination with the paste page information to determine the final recognition result of the paste scene.
[0147] Exemplarily, the copied page information includes information such as the movie name, the time to watch the movie, and the address of the theater. The paste scenes pre-identified by the scene recognition module based on the copied page information may include: movie ticket purchase scene, navigation scene, movie information search scene, etc. Further, when the APP category to which the pasted page belongs in the pasted page information is an APP for movie ticket purchase, the scene recognition module can determine that the paste scene is a movie ticket purchase scene in combination with the above pre-identified paste scene and the pasted page information. Alternatively, when the APP category to which the pasted page belongs in the pasted page information is a navigation APP, the scene recognition module can determine that the paste scene is a navigation scene in combination with the above pre-identified paste scene and the pasted page information.
[0148] User intention recognition module: can be used to recognize user intention based on copy page information and paste page information. The user intention may refer to the user's intention to copy and paste. In one possible implementation, the user intention recognition module may recognize user intention based on a neural network model. The embodiment of the present application does not limit the above method for recognizing user intention. In one possible implementation, the user intention recognition module may first use the copy page information to pre-recognize the user intention, and then further recognize the pre-recognized user intention in combination with the paste page information to determine the final recognition result of the user intention.
[0149] Exemplarily, the copied page information includes information such as the movie name, the time to watch the movie, and the address of the theater. The user intention pre-identified by the user intention recognition module based on the copied page information may include: the intention to buy movies in the theater, the intention to navigate to the theater, and the intention to search for movie information. Furthermore, when the APP category of the pasted page in the pasted page information is an APP for purchasing movie tickets, the scene recognition module can determine that the user intention is to buy movies in the theater based on the above pre-identified user intention and the pasted page information. Alternatively, when the APP category of the pasted page in the pasted page information is a navigation APP, the scene recognition module can determine that the user intention is to navigate to the theater based on the above pre-identified user intention and the pasted page information.
[0150] Extraction prompt generator: can be used to generate extraction prompt information based on the pasting scenario and user intent. The extraction prompt information can include text or sentences, which can be used to guide the language model to extract the content to be pasted from the copied content that meets the user's intent and matches the input box in the pasting page.
[0151] Among them, the extraction prompt generator can be a kind of prompt generator. The prompt generator can be used to generate prompt information (prompt). Prompt can be a natural language that humans can understand (i.e., hard prompt word (hardprompt / discreteprompt)). For example, prompt can be a text or sentence composed of natural language. Alternatively, prompt can be machine-readable content, which belongs to non-natural language (i.e., soft prompt word (softprompt / continuousprompt)). For example, soft prompt word can be an embedding, which is a word converted into a meaning vector representation processed by a computer. Hard prompt words are more interpretable. Soft prompt words can more flexibly eliminate the parameter restrictions of the language model. Prompt can be used to start and guide the language model to generate output of a specified type, theme or format. Exemplarily, in the field of natural language processing, prompt can include a set of questions and answers or task descriptions. For example, prompt is: "Give your pet three names", "Translate this English sentence into French", etc. For another example, prompt can also include question and answer examples. The prompt for the task description "Give your pet three names" may include question-and-answer examples: "Pet type: cat, pet name: name 1, name 2, name 3", "Pet type: dog, pet name: name 4, name 5, name 6". It can be understood that the question-and-answer examples included in the above prompt can be used to guide the language model to answer the user's questions in the manner of the question-and-answer examples. The language model can generate text that meets the requirements based on the prompt and ensure that the output result is related to the prompt.
[0152] The above extraction prompt information can be called extraction prompt.
[0153] Exemplarily, if the pasting scene is a movie ticket purchase scene, and the user's intention is to purchase a movie at a theater, the extraction prompt information generated by the extraction prompt generator may include: extracting the movie name and theater information from the given content. The above given content is the copied content input into the language model. For another example, if the pasting scene is a navigation scene, and the user's intention is to navigate to the theater, the extraction prompt information generated by the extraction prompt generator may include: extracting the theater address from the given content. The above extraction prompt information is only an exemplary description of the present application and should not be construed as a limitation on the present application.
[0154] Language model: may refer to an artificial intelligence (AI) model for processing language (or symbol system), which can be used to generate text that meets the requirements according to prompt, and ensure that the output result is related to prompt. Language models may include language models based on probability theory and statistics (i.e., statistical language models), language models based on deep learning and neural network implementation (i.e., neural network language models), and the like. The implementation method of the language model is not limited in the embodiment of the present application. Exemplarily, the electronic device 100 may implement the pasting method of the present application through a large language model (LLM). Among them, LLM may be a neural network model that can learn the grammar and semantics of natural language to generate human-readable text. Among them, LLM may be obtained by training using a large-scale corpus. The above-mentioned corpus may include a large amount of text data. LLM can handle various natural language processing tasks, such as natural language generation, text error correction, text completion, text classification, text summarization, machine translation, speech recognition, and the like.
[0155] In some embodiments, the electronic device 100 may use the copied content and the extraction prompt information as inputs to the language model. The language model may extract the content to be pasted from the copied content according to the instructions of the extraction prompt information. The content to be pasted may include information extracted from the copied content that meets the user's intention and matches the input box in the paste page.
[0156] Exemplarily, the copied content includes information such as the name of the movie, the time to watch the movie, and the address of the theater. It can be seen from the above embodiment that if the pasting scene is a navigation scene and the user's intention is to navigate to the theater, the extraction prompt information generated by the extraction prompt generator may include: extracting the theater address from the given content. When the above-mentioned copied content and extraction prompt information are input into the language model, the content to be pasted output by the language model may include: the address of the theater. The electronic device can provide the above-mentioned content to be pasted on the paste page (i.e., the page where the address is to be entered in the map application). In this way, the user can directly choose to enter the above-mentioned content to be pasted (i.e., the theater address) into the input box of the paste page to search and navigate to the theater address, thereby eliminating the need to move the cursor in the entire content to accurately select the content to be copied (such as only selecting and copying the theater address), and there is no need to delete redundant information one by one after copying the entire content and pasting it (such as deleting the movie name, the time to watch the movie, etc. after pasting the copied content, and only retaining the theater address).
[0157] In some embodiments, the content to be pasted may be structured information. The structured information may refer to data recorded in a preset format and has a clear structure. For example, the structured information may be organized into a row and column structure, where the rows and columns may define the specific content of the structured information.
[0158] Exemplarily, when the content to be pasted includes a movie name or a theater name, the electronic device 100 may generate the content to be pasted according to the format shown in Table 1 below:
[0159] Movie Title Cinema Name
[0160] Table 1
[0161] For another example, when the content to be pasted includes the names of multiple movies and TV series played on multiple playback platforms, the electronic device 100 may generate the content to be pasted according to the format shown in Table 2 below:
[0162]
[0163] Table 2
[0164] The structures of the content to be pasted shown in Table 1 and Table 2 above are merely exemplary descriptions of the embodiments of the present application and should not constitute a limitation to the present application.
[0165] In one possible implementation, when an operation of selecting and copying content is detected, the electronic device 100 can parse the copied page through a page parsing module to obtain copy page information. Then, the electronic device 100 can use the copy page information to pre-identify the paste scene through a scene recognition module, and use the copy page information to pre-identify the user intention through a user intention recognition module. Based on the above-mentioned pre-identified paste scene and user intention, the electronic device 100 can generate extraction prompt information through an extraction prompt generator, and pre-extract the content to be pasted from the copied content using a language model based on the extraction prompt information. The electronic device 100 can save the above-mentioned pre-extracted content to be pasted. Among them, the pre-extracted content to be pasted can be associated with the copied content stored in the clipboard.
[0166] It is understandable that, since there may be multiple pre-identified pasting scenarios based on the copied page information, there may also be multiple pre-identified user intentions, so the pre-extracted content to be pasted may also include multiple pieces of information. These multiple pieces of information can respectively meet different user intentions and match different pasting scenarios.
[0167] Exemplarily, the electronic device 100 may store the pre-extracted content to be pasted according to Table 3 below.
[0168]
[0169] Table 3
[0170] In the above Table 3, the copied content 1 and the copied content 2 may be the contents selected and copied in the two copy operations respectively. It can be seen that the content to be pasted pre-extracted by the electronic device 100 based on the copied content 1 may include information 1, information 2, and information 3. Among them, information 1 may be the information extracted by the prompt generator and the language model based on the paste scenario 1, the user intention Figure 1 That is, information 1 can be Figure 1 and matches the content to be pasted in pasting scene 1. Information 2 can be extracted by the prompt generator and the language model based on pasting scene 2 and user intention. Figure 2 That is, information 2 can be Figure 2 And the content to be pasted matching the pasting scene 2. Information 3 may be generated by the extraction prompt generator and the language model based on the pasting scene 3 and the user intention 3. That is, information 3 may be the content to be pasted that satisfies the user intention 3 and matches the pasting scene 3. The content to be pasted pre-extracted by the electronic device 100 based on the copied content 2 may include information 4, information 5, and information 6. The above-mentioned information 4, information 5, and information 6 may all refer to the introduction of information 1, information 2, and information 3. No further details are given here.
[0171] In some embodiments, a paste scenario may correspond to multiple user intentions. Among them, when the type of content to be input in an input box of the paste page includes multiple types, the electronic device can recognize multiple user intentions. When the paste page contains multiple input boxes, the electronic device can also recognize multiple user intentions. For example, when the paste page is the homepage of a shopping application, the user may need to enter the store name or the product name in the input box of the homepage of the shopping application. According to the homepage of the shopping application, the electronic device can determine that the paste scenario is a shopping scenario, and the user intention includes the intention to search for the store name and the intention to search for the product name. For another example, the new contact page contains an input box for entering information such as name, phone number, and work unit. When the paste page is a new contact page, the electronic device can determine that the paste scenario is a new contact scenario, and the user intention includes the intention to fill in the name, the intention to fill in the phone number, and the intention to fill in the work unit.
[0172] In other embodiments, different pasting scenarios may correspond to the same user intent. When the pasting page is a new contact page, the electronic device may determine that the pasting scenario is a new contact scenario. When the pasting page is a registration information entry interface, the electronic device may determine that the pasting scenario is an information entry scenario. For the above-mentioned new contact scenario and information entry scenario, the user intent may include the intention to fill in the name, the intention to fill in the phone number, etc.
[0173] The above Table 3 is only an exemplary description of storing pre-extracted content to be pasted in an embodiment of the present application, and should not constitute a limitation to the present application.
[0174] Further, when the paste page is determined, the electronic device 100 can parse the paste page through the page parsing module to obtain the paste page information. Then, the electronic device 100 can use the paste page information to identify the paste scene through the scene recognition module, and use the paste page information to identify the user intention through the user intention recognition module. The electronic device 100 can obtain the pre-extracted content to be pasted associated with the most recent copied content before determining the paste page.
[0175] The electronic device 100 may determine whether, among the pre-identified pasting scenarios and user intentions based on the most recently copied content, there are pasting scenarios and user intentions that respectively match the pasting scenarios and user intentions identified based on the pasted page information.
[0176] If so, the electronic device 100 can filter out information that satisfies the user's intention and matches the paste scenario from the pre-extracted content to be pasted (the user's intention and paste scenario can refer to the user's intention and paste scenario identified based on the paste page information). The electronic device 100 can provide the above-screened information on the paste page for the user to select and enter into the input box in the paste page. Exemplarily, the copied content 1 in the above Table 3 is the most recent copied content before the electronic device 100 determines the paste page. The electronic device 100 identifies the paste scenario 2 and the user's intention based on the paste page information. Figure 2 As can be seen from Table 3, the electronic device 100 can filter out the information to be pasted that meets the user's requirements from the pre-extracted information to be pasted. Figure 2 And information 2 matching the pasting scene 2. The electronic device 100 can provide information 2 on the pasting page for the user to select and input into an input box on the pasting page.
[0177] If it does not exist, the electronic device 100 can generate extraction prompt information using an extraction prompt generator based on the paste scene and user intention identified by the paste page information. Then, the electronic device 100 can input the extraction prompt information and the most recent copied content into a language model, and extract the content to be pasted that meets the user intention and matches the paste scene from the copied content through the language model (the user intention and paste scene can refer to the user intention and paste scene identified based on the paste page information).
[0178] Optionally, not limited to the most recent copy content before determining the pasting page, the electronic device 100 may also obtain the most recent k copy content before determining the pasting page, and analyze whether the most recent k copy content contains information that the user wants to paste to the current pasting page. The above k may be an integer greater than 1. The specific value of k is not limited in the present embodiment of the application.
[0179] It can be seen from the above embodiment that after the electronic device 100 detects the user's copy operation, it can pre-identify the paste scenario and user intention and pre-extract the content to be pasted. Afterwards, when entering the paste page, the electronic device 100 can parse the paste page and identify the paste scenario and user intention based on the paste page. In the case where the paste scenario and user intention identified based on the paste page match the paste scenario and user intention pre-identified based on the copy page, respectively, the electronic device 100 can filter out relevant information from the pre-extracted content to be pasted for the user to paste. In this way, when entering the paste page, the electronic device 100 can quickly provide the user with a paste option based on the pre-extracted content to be pasted, without having to generate extraction prompt information through an extraction prompt generator and extract the content to be pasted using a language model. The above method can reduce the interaction delay, and the user can obtain paste options that meet personal pasting needs more quickly after opening the paste page.
[0180] In another possible implementation, when an operation of selecting and copying content is detected, the electronic device 100 can parse the copy page through a page parsing module to obtain copy page information. The electronic device 100 can store the copy page information. That is, in the copy scenario, the electronic device 100 can store the copy page information such as context information of the copy content in the memory of the electronic device 100 in addition to storing the copy content in the clipboard.
[0181] Optionally, the electronic device 100 may store the copy page information of the most recent k1 copies. The above k1 may be a positive integer. The specific value of k1 is not limited in the embodiment of the present application.
[0182] When the paste page is determined, the electronic device 100 can perform page parsing on the paste page through the page parsing module to obtain the paste page information. The electronic device 100 can obtain the copy page information of the most recent copy before the paste page is determined. The electronic device 100 can identify the paste scenario and the user's intention based on the copy page information of the most recent copy and the paste page information. Then, the electronic device 100 can use the paste scenario and the user's intention as inputs to the extraction prompt generator, and generate extraction prompt information through the extraction prompt generator. The electronic device 100 can use the language model to extract the content to be pasted that meets the user's intention and matches the paste scenario from the copied content based on the extraction prompt information. The above-mentioned match with the pasted content can represent information that matches the input box in the paste page.
[0183] Optionally, the electronic device 100 is not limited to the copy page information of the most recent copy before determining the pasted page. The electronic device 100 can also obtain the copy page information of the most recent k2 copies before determining the pasted page, thereby combining the copy page information of the most recent k2 copies with the pasted page information to identify the pasting scenario and the user's intention. k2 can be a positive integer less than or equal to the above k1. The specific value of k2 is not limited in the embodiment of the present application.
[0184] That is to say, in the present application, the electronic device 100 extracts the target content from the copied content in combination with the copy page information and the paste page information, which may include: first pre-extracting according to the copy page information, and then extracting the target content from the copied content according to the paste page information; and, after simultaneously using the copy page information and the paste page information to determine the paste scenario and user intention, extracting the target content from the copied content.
[0185] By the above Figure 3A It can be seen from the method shown that the electronic device 100 can analyze the pasting scene and user intention in combination with the copy page information and the paste page information, and then extract the content to be pasted that meets the user's intention and matches the pasting scene from the copied content. The above method can accurately extract the content that the user wants to copy and paste from the copied content when there is a lot of redundant information in the content copied by the user. In this way, the user does not need to move the cursor when copying, perform cumbersome copy content selection operations, and does not need to delete the redundant information one by one after pasting the copied content. In addition, when there are multiple pieces of information that the user wants to copy and paste in the copied content, but these multiple pieces of information are distributed at intervals, the electronic device 100 can extract all these multiple pieces of information based on the paste scene and user intention as the content to be pasted and display them on the paste page. In this way, the user does not need to switch repeatedly between APPs to perform multiple copy and paste operations. The above method can effectively improve the efficiency of user copy and paste and improve the user's copy and paste experience.
[0186] 2. Error correction
[0187] Figure 3B A schematic diagram of a method for correcting errors in content to be pasted provided in an embodiment of the present application is exemplified.
[0188] like Figure 3B As shown, the electronic device 100 may include an error correction prompt generator and a language model. The language model may refer to the aforementioned Figure 3A The introduction in , will not be repeated here.
[0189] Error correction prompt generator: can be used to generate error correction prompt information according to the pasting scenario and user intention. The error correction prompt information may include text or sentences, which can be used to guide the language model to correct the content to be pasted and obtain the corrected content to be pasted.
[0190] The error correction prompt generator may be a type of prompt generator. Different from the extraction prompt generator, the error correction prompt information generated by the error correction prompt generator may be called an error correction prompt.
[0191] Exemplarily, if the pasting scene is a movie ticket purchase scene, and the user intends to purchase a movie at a theater, the error correction prompt information generated by the error correction prompt generator may include: determining whether the movie name and theater address in the given content are correct and correcting them if they are incorrect. For another example, if the pasting scene is a navigation scene, and the user intends to navigate to the theater, the error correction prompt information generated by the error correction prompt generator may include: determining whether the theater address in the given content is correct and correcting it if it is incorrect. The above error correction prompt information is only an exemplary description of the present application and should not be construed as a limitation on the present application.
[0192] In some embodiments, the electronic device 100 may use the content to be pasted and the error correction prompt information as inputs to the language model. Figure 3A The language model can use the public knowledge base to determine whether there is an error in the content to be pasted according to the instruction of the error correction prompt information, and correct the error in the content to be pasted, and output the corrected content to be pasted.
[0193] The public knowledge base may store public knowledge in one or more fields such as music, film, technology, and agriculture. The data in the public knowledge base may be crawled from databases such as websites and applications by a data crawling device. The present application embodiment does not limit the method for establishing the public knowledge base.
[0194] Exemplarily, the content to be pasted includes the movie name "XY Movie" and the theater address "AA Cinema". It can be seen from the above description that if the pasting scene is a movie ticket purchase scene, and the user's intention is to purchase a movie in the theater, the error correction prompt information generated by the error correction prompt generator may include: judging whether the movie name and theater address in the given content are correct and correcting them if they are incorrect. When the above content to be pasted and the error correction prompt information are input into the language model, the language model can use the public knowledge base to determine whether there are errors in the above movie name and theater address. For example, there is an error in the above movie name, and the movie name should originally be "xx Movie". The above theater address is correct. Then the language model can correct the movie name, and the output corrected content to be pasted may include: movie name "xx Movie" and theater address "AA Cinema".
[0195] By the above Figure 3B As can be seen from the method shown, after extracting the content to be pasted by combining the copy page information and the paste page information, the electronic device 100 can also correct the content to be pasted. In this way, even if there are errors in the information in the copied content, the electronic device 100 can provide the correct content to the user for pasting after error correction, so as to avoid the incorrect copied content affecting the user's use effect and experience.
[0196] 3. Completion
[0197] Figure 3C A schematic diagram of a method for completing content to be pasted provided in an embodiment of the present application is exemplified.
[0198] like Figure 3C As shown, the electronic device 100 may include a user tag generation module, a completion prompt generator, a language model and a completion generation model. The language model may refer to the aforementioned Figure 3A The introduction in , will not be repeated here.
[0199] User tag generation module: can be used to generate user completion tags according to the user's personal knowledge base, pasting scenario, and user intention. The user completion tag can be a tag that conforms to the user's personal characteristics and is related to the pasting scenario and user intention.
[0200] The above-mentioned user personal knowledge base may include user information such as user portraits that represent user identity, user preferences, user habits and other characteristics. In some embodiments, the data contained in the user personal knowledge base may be collected and analyzed and inferred during the user's use of the electronic device 100. For example, the electronic device 100 may collect one or more of the following data: places that users often search and go to in map applications, goods that users often browse and purchase in shopping applications, videos that users often watch in video playback applications, and the length of time users use APPs. Based on the above-mentioned collected data, one or more of the following user personal characteristics can also be analyzed: the user's age group, the user's home and company address, the type of videos the user likes to watch, the type of clothing the user likes to wear, the food the user likes to eat, the user's interests and hobbies, etc. The embodiments of this application do not limit the data content contained in the personal knowledge base, nor the method for establishing the above-mentioned user personal knowledge base.
[0201] In a possible implementation, the user tag generation module can generate user completion tags based on a trained neural network model. The embodiment of the present application does not limit the implementation method of generating user completion tags based on the user's personal knowledge base, pasting scenario, and user intention.
[0202] Exemplarily, if the pasting scene is a movie ticket purchase scene, and the user's intention is to purchase movies in the theater, the user tag generation module can determine the theater information (such as the theater name, theater address, etc.) that the user often goes to based on the user's personal knowledge base, thereby generating a user completion tag. The user completion tag may include the theater information that the user often goes to. For another example, if the pasting scene is a shopping scene, and the user's intention is to search for the store name or product name of a skirt, the user tag generation module can determine the type of clothing that the user likes to wear based on the user's personal knowledge base. For example, the information in the user's personal knowledge base may indicate that the user is a long skirt lover. Then the user completion tag generated by the user tag generation module may include: long skirt.
[0203] Completion prompt generator: can be used to generate completion prompt information according to the pasting scenario and user intention. The completion prompt information may include text or sentences, which can be used to guide the language model to generate public knowledge base completion information based on the content to be pasted and / or copied content. The public knowledge base completion information can be the information that needs to be supplemented in the content to be pasted determined according to the public knowledge base.
[0204] The completion prompt generator may be a type of prompt generator. Different from the aforementioned extraction prompt generator and error correction prompt generator, the completion prompt information generated by the completion prompt generator may be called a completion prompt.
[0205] Exemplarily, if the pasting scene is a film and TV drama search scene, and the user intends to search for the film and TV drama on a film and TV drama playback platform, the completion prompt information generated by the completion prompt generator may include: completing the playback platform information of the film and TV drama in the given content. Optionally, the completion prompt information generated by the completion prompt generator may also include: completing the name of the film and TV drama in the given content. The above completion prompt information is only an exemplary description of the present application and should not constitute a limitation on the present application.
[0206] In some embodiments, the electronic device 100 may use the completion prompt information as the input of the language model, and use the content to be pasted and / or the copied content as the input of the language model. Figure 3A The content to be pasted can be extracted by the method shown in the figure, or it can also be based on the above Figure 3B The content to be pasted after error correction by the method shown. The language model can use the public knowledge base to determine the information to be supplemented in the content to be pasted according to the indication of the completion prompt information, thereby outputting the public knowledge base completion information. The above information to be supplemented can be information related to the completion prompt information.
[0207] Exemplarily, the copied content includes the names of multiple film and television dramas played on multiple playback platforms (such as playback platform 1, playback platform 2, etc.). The content to be pasted includes the names of multiple film and television dramas extracted from the copied content, and these multiple film and television dramas can be played on playback platform 1. It can be seen from the above embodiment that if the pasting scene is a film and television drama search scene, and the user's intention is to search for film and television dramas on playback platform 1, the completion prompt information generated by the completion prompt generator may include: completing the playback platform information of the film and television drama in the given content. The language model can use the public knowledge base to determine the playback platform to which each film and television drama in the copied content (or the copied content that has not been extracted to the content to be pasted) belongs. For example, the copied content includes the name of film and television drama 1. The playback platform to which film and television drama 1 belongs is playback platform 1. Then the public knowledge base completion information generated by the language model may include: the playback platform to which film and television drama 1 belongs is playback platform 1.
[0208] It should be noted that, when completing based on the public knowledge base, the electronic device 100 can input only the content to be pasted or only the copied content into the language model according to the completion prompt information, or input both the content to be pasted and the copied content into the language model.
[0209] For example, if the completion prompt information is the above-mentioned completion of the broadcast platform information of the film and television drama in the given content, the electronic device 100 can only input the copied content into the language model, or input both the content to be pasted and the copied content into the language model. It can be understood that if the pasting scene is a film and television drama search scene, and the user's intention is to search for film and television dramas on the broadcast platform 1, the electronic device 100 can input the copied content into the language model based on the content to be pasted. Figure 3A The content to be pasted extracted by the method shown may include the name of a TV series played on the playback platform 1. That is, the playback platform to which the TV series included in the content to be pasted belongs is already known, and no language model is required for further identification.
[0210] For another example, if the completion prompt information is to complete the name of the film and television drama in the given content, the electronic device 100 can only input the content to be pasted into the language model. It can be understood that when the content to be pasted needs to be completed, if the name of the film and television drama in the content to be pasted is incomplete (for example, the content to be pasted contains the abbreviation of the name of the film and television drama), the language model can only complete the name of the film and television drama in the content to be pasted.
[0211] Completion generation model: can be used to complete the content to be pasted based on the user's personal knowledge base and / or the public knowledge base to generate the completed content to be pasted. The content to be pasted input to the completion generation model can be based on the aforementioned Figure 3A The content to be pasted can be extracted by the method shown in the figure, or it can also be based on the above Figure 3B The content to be pasted after error correction by the method shown. The completion generation model can be a model based on a neural network. The embodiment of the present application does not limit the implementation method of the completion generation model.
[0212] In some embodiments, the electronic device 100 can complete the content to be pasted based on the user's personal knowledge base. Specifically, the electronic device 100 can use the user completion tag and the content to be pasted as inputs of the completion generation model, and obtain the completed content to be pasted through the completion generation model.
[0213] Exemplarily, the content to be pasted may include the name of a movie. When the user completes the tag to include information about a theater that the user often goes to, such as the theater name "AA Theater", the completed content to be pasted generated by the completion generation model may include not only the movie name, but also the theater name "AA Theater". The electronic device 100 may provide the above-mentioned completed content to be pasted on the pasting page (such as a page for purchasing movie tickets). The above-mentioned completed content to be pasted can facilitate users to quickly search for movie tickets of a specified power source in theaters that they often go to.
[0214] For another example, the content to be pasted may include the name of a store that sells skirts. When the user completes the tag to include long skirts, the completed content to be pasted generated by the completion generation model may include the text "long skirt" in addition to the store name. The electronic device 100 may provide the above-mentioned completed content to be pasted on the pasting page (such as the search page of the shopping application), that is, the store name + the text corresponding to the long skirt. It is understandable that there may be multiple stores in the shopping application with the same store name but different products. The above-mentioned completed content to be pasted can facilitate users to quickly search for the store they want to find.
[0215] In other embodiments, the electronic device 100 can complete the content to be pasted based on the public knowledge base. Specifically, the electronic device 100 can use the public knowledge base completion information and the content to be pasted as inputs of the completion generation model, and obtain the completed content to be pasted through the completion generation model.
[0216] Exemplarily, the content to be pasted includes the names of multiple film and television dramas. Multiple film and television dramas in the content to be pasted can be played on playback platform 1. The content to be pasted does not include the name of film and television drama 1. When the public knowledge base completion information includes: the playback platform to which film and television drama 1 belongs is playback platform 1, the completion generation model can add the name of film and television drama 1 to the content to be pasted. That is, the completed content to be pasted contains the name of film and television drama 1. The electronic device 100 can paste a page (such as a search page of playback platform 1) to provide the above-mentioned completed content to be pasted. It can be understood that when extracting the film and television drama played on playback platform 1 from the copied content to generate the content to be pasted, there may be an incomplete extraction, and the names of one or more film and television dramas played on playback platform 1 in the copied content are omitted. The above-mentioned completion of the content to be pasted based on the public knowledge base can add the names of the film and television dramas in the copied content that belong to playback platform 1 but have not been extracted to the content to be pasted to the content to be pasted. In this way, the integrity of the content to be pasted extracted from the copied content can be ensured, which is convenient for users to search for any film and television drama belonging to playback platform 1 in the copied content on the search page of playback platform 1.
[0217] In other embodiments, the electronic device 100 can also complete the content to be pasted based on the user's personal knowledge base and the public knowledge base at the same time. The electronic device 100 can use the content to be pasted, the user's completion tag, and the content to be pasted as inputs to the completion generation model, and obtain the completed content to be pasted through the completion generation model. For example, when the pasting scene is a movie ticket purchase scene, and the user's intention is to purchase a movie at the theater, the electronic device 100 can complete the theater address in the content to be pasted based on the user's personal knowledge base, and complete the name of the movie in the content to be pasted based on the public knowledge base.
[0218] By the above Figure 3CIt can be seen from the method shown that the electronic device 100 can complete the content to be pasted based on the user's personal knowledge base and / or the public knowledge base, so as to provide the user with content to be pasted that conforms to the user's expression or search habits, and the above method can improve the content to be pasted and reduce the situation of missing information that the user may need in the copied content.
[0219] 4. Sorting
[0220] Figure 3D The following is a schematic diagram of a method for sorting content to be pasted provided in an embodiment of the present application.
[0221] like Figure 3D As shown, the electronic device 100 may include a sorting model.
[0222] Sorting model: can be used to sort the information in the content to be pasted according to the user's personal knowledge base, and generate sorted content to be pasted. Among them, the electronic device 100 can sort the information in the content to be pasted that is more in line with the user's preference first through the sorting model. In one possible implementation, the above-mentioned sorting model can be a model based on a neural network. The embodiment of the present application does not limit the implementation method of the above-mentioned sorting model.
[0223] The content to be pasted that is input into the sorting model may be based on the aforementioned Figure 3A The content to be pasted can be extracted by the method shown in the figure, or it can also be based on the above Figure 3B The content to be pasted after error correction by the method shown, or it can also be based on the above Figure 3C The content to be pasted after completion by the method shown.
[0224] For example, the content to be pasted includes the names of multiple movies and TV series. The sorting model can sort the multiple movies and TV series according to the user's personal knowledge base. The sorting model can calculate the user's interest in the multiple movies and TV series. The names of movies and TV series that the user is more interested in can be sorted in a higher position. This can facilitate users to prioritize the movies and TV series they are interested in.
[0225] By the above Figure 3D As can be seen from the method shown, the electronic device 100 can sort the multiple pieces of information in the content to be pasted. The sorted content to be pasted can facilitate the user to preferentially paste the information that he is interested in on the pasting page.
[0226] 5. Filter
[0227] Figure 3E The following is a schematic diagram of a method for filtering content to be pasted provided in an embodiment of the present application.
[0228] like Figure 3E As shown, the electronic device 100 may include a filtering model.
[0229] Filtering model: can be used to filter the content to be pasted according to the historical pasting operation information and / or user intention, and generate filtered content to be pasted. The above historical pasting operation information can indicate the relevant information of the pasted content. For example, the above historical pasting operation information can include but is not limited to: whether the content to be pasted has been pasted, the number of times it has been pasted, the time, and the APP in which it has been pasted, etc.
[0230] Among them, the electronic device 100 can filter out the information that has been pasted and invalid in the content to be pasted through the filtering model, and can also filter out the information that does not meet the current user's intention in the content to be pasted through the filtering model when the user's intention changes. In a possible implementation, the above-mentioned filtering model can be a model based on a neural network. The embodiment of the present application does not limit the implementation method of the above-mentioned filtering model.
[0231] The content to be pasted input into the filtering model may be based on the aforementioned Figure 3A The content to be pasted can be extracted by the method shown in the figure, or it can also be based on the above Figure 3B The content to be pasted after error correction by the method shown, or it can also be based on the above Figure 3C The content to be pasted after the method shown is completed, or it can also be based on the aforementioned Figure 3D The content to be pasted is filtered by the method shown.
[0232] Exemplarily, the content to be pasted includes multiple redemption codes, such as redemption code 1. A redemption code can only be redeemed once. When redemption code 1 in the content to be pasted has been pasted, the electronic device 100 can generate historical pasting operation information related to the redemption code 1. The historical pasting operation information can be used to indicate that redemption code 1 has been pasted. When entering the redemption code input page, the electronic device 100 can filter out redemption code 1 in the content to be pasted through a filtering model, and display other redemption codes in the content to be pasted except redemption code 1 on the redemption code input page. This can prevent the user from repeatedly pasting an expired redemption code when the user forgets which redemption code in the content to be pasted has been pasted and used.
[0233] For another example, the content to be pasted includes the store name and clothing name of clothing. When entering the homepage of the shopping application (the homepage can be a paste page), the electronic device 100 can provide the above content to be pasted so that the user can paste the store name or clothing name in the above content to be pasted in the search box of the homepage. It can be understood that based on the homepage of the above shopping application, the user intention that the electronic device 100 can identify may include the intention of searching for stores and the intention of searching for goods. When entering the product search page of a clothing store in the shopping application, the electronic device 100 can filter out the store name in the content to be pasted through the filtering model, and display the clothing name in the content to be pasted on the product search page. In this way, after the user opens the product search page of a store in the shopping application, the information filtered from the content to be pasted can be used to quickly search for the corresponding product. It can be understood that the user usually searches for the products in this clothing store on the product search page of a clothing store, and does not search for other store names. That is, based on the product search page of the above shopping clothing store, the electronic device 100 can identify that the user's intention is to search for goods. Therefore, the electronic device 100 can filter out the store name in the content to be pasted.
[0234] By the above Figure 3E As can be seen from the method shown, the above filtering of the content to be pasted can reduce the situation where users repeatedly paste expired information when the information becomes invalid after being pasted, or can filter out the information that the user needs to paste according to the user's intention, reducing the interference of other information on the user.
[0235] In some embodiments, the electronic device 100 is based on Figure 3A After extracting the content to be pasted using the method shown, you can follow Figure 3B to Figure 3E The method shown performs error correction, completion, sorting and filtering on the content to be pasted, and then provides the processed content to be pasted to the user (such as displaying it on the page to be pasted). Among them, the embodiment of the present application does not limit the order of the four processes of error correction, completion, sorting and filtering. For example, the electronic device 100 can first perform error correction on the content to be pasted, and then complete the content to be pasted after error correction, and then sort the completed content to be pasted, and finally filter the sorted content to be pasted. Alternatively, after the electronic device 100 performs error correction and completion on the content to be pasted in turn, it can first filter the completed content, and then sort the filtered content to be pasted.
[0236] In other embodiments, the electronic device 100 may perform one or more of error correction, completion, sorting and filtering on the content to be pasted. For example, the electronic device 100 may only perform error correction on the content to be pasted, and then provide the corrected content to be pasted to the user. Alternatively, the electronic device 100 may only complete the content to be pasted, and then provide the completed content to be pasted to the user. Alternatively, the electronic device 100 may only sort the content to be pasted, and then provide the sorted content to be pasted to the user. Alternatively, the electronic device 100 may only filter the content to be pasted, and then provide the filtered content to be pasted to the user. Alternatively, the electronic device 100 may perform error correction and completion on the content to be pasted, and then provide the corrected and completed content to be pasted to the user. Alternatively, the electronic device 100 may perform error correction and sorting on the content to be pasted, and then provide the corrected and sorted content to be pasted to the user. Alternatively, the electronic device 100 may perform error correction and filtering on the content to be pasted, and then provide the corrected and filtered content to be pasted to the user. Alternatively, the electronic device 100 may complete and sort the content to be pasted, and then provide the completed and sorted content to be pasted to the user. Alternatively, the electronic device 100 may complete and filter the content to be pasted, and then provide the completed and filtered content to be pasted to the user. Alternatively, the electronic device 100 may sort and filter the content to be pasted, and then provide the sorted and filtered content to be pasted to the user. Alternatively, the electronic device 100 may correct, complete, and sort the content to be pasted, and then provide the error-corrected, completed and sorted content to be pasted to the user. Alternatively, the electronic device 100 may correct, complete, and filter the content to be pasted, and then provide the error-corrected, completed and filtered content to be pasted to the user. Alternatively, the electronic device 100 may correct, complete, and filter the content to be pasted, and then provide the error-corrected, completed and filtered content to be pasted to the user. Alternatively, the electronic device 100 may correct, complete, and filter the content to be pasted, and then provide the error-corrected, sorted and filtered content to be pasted to the user. Alternatively, the electronic device 100 may complete, sort, and filter the content to be pasted, and then provide the completed, sorted and filtered content to be pasted to the user.
[0237] The following introduces some pasting scenarios provided by this application based on the above-mentioned method for processing clipboard content.
[0238] Paste scene 1: movie ticket purchase scene and navigation scene
[0239] Figure 4A to Figure 4I Schematic diagrams showing some movie ticket purchasing scenarios.
[0240] like Figure 4A As shown, the electronic device 100 may display a user interface 410. The user interface 410 may be a chat page of an instant messaging application. The user interface 410 may include chat records 411 to 414. Figure 4AAs shown in FIG. 1 , by operating the chat record 411, such as a long press operation, the electronic device 100 can display the content in the chat record 411 as Figure 4B The selected state shown and can be displayed Figure 4B The function option box 415 shown. The function option box may include a copy option 415A, a forwarding option, a favorite option, a quote option, and the like for operating the chat record 411.
[0241] like Figure 4B As shown, all text in chat record 411 is displayed as selected. The selected state may be, for example, a state in which the background color of the selected text is darkened. The embodiment of the present application does not limit the display style of the selected state. In some embodiments, the electronic device 100 can adjust the text in the selected state in response to the operation of moving the cursor in the chat record 411. That is, the user can manually adjust the selected text, for example, only select part of the text in the chat record 411. In the case where all the text in the chat record 411 is selected, in response to Figure 4B The operation of the copy option 415A, such as a click operation, can cause the electronic device 100 to store all the text in the chat record 411 to the clipboard. That is, all the text in the chat record 411 can be the copy content. The user interface 410 can be a copy page.
[0242] By the aforementioned Figure 3A As can be seen from the method shown, the electronic device 100 can perform page parsing on the user interface 410 to obtain the copy page information. The copy page information can include context information of the copy content. For example, Figure 4B The contextual information of the copied content may include Figure 4A Chat records 412, chat records 413, and chat records 414 are shown.
[0243] Here is the user copy Figure 4B The chat record 411 shown is followed by opening a ticket purchasing application in the electronic device 100 for purchasing movie tickets as an example for explanation.
[0244] like Figure 4C As shown, in response to the operation of opening the ticket purchase application, the electronic device 100 can display a user interface 420. The user interface 420 can include an input box 421. The input box 421 can be used to input and search for information such as movies and theaters. Figure 4C As shown, when the input box 421 is operated, such as a click operation, the electronic device 100 may display Figure 4D User interface 430 is shown.
[0245] like Figure 4DAs shown, the user interface 430 may include an input box 421 and an input keyboard 432. The input box 421 may be Figure 4C The same input box as the input box 421 shown can be used to input and search for information about movies, theaters, etc. The input keyboard 432 can be used by the user to input in the input box 431. The input keyboard 432 can be provided by an input method application.
[0246] It should be noted that when Figure 4C As shown in the operation of input box 421, electronic device 100 can determine user interface 420 as a paste page, and perform page parsing to obtain paste page information. The paste page information may include the APP category to which user interface 420 belongs (i.e., ticket purchase APP), the input box clicked in user interface 420 (i.e., input box 421), and the type of content to be entered in input box 421 (i.e., movie name and / or theater name). In addition, Figure 4D The user interface 430 shown is a display of the electronic device 100 in response to the Figure 4C The user interface 430 may also be a paste page. The user interface 430 and the user interface 420 belong to the same APP, and the input box 431 and the input box 421 are also the same. Therefore, the paste page information obtained by parsing the user interface 430 may be the same as the paste page information obtained by parsing the user interface 420.
[0247] The electronic device 100 may be configured according to Figure 4A The copied page information determined by the user interface 410 is consistent with the Figure 4C The user interface 420 shown determines the pasted page information, identifies the pasting scene as a movie ticket purchase scene, and identifies the user's intention to purchase movie tickets. Based on the above pasting scene and user intention, the electronic device 100 can generate extraction prompt information: extract the movie name and theater information from the given content. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: "xx movie" and "frequently visited theater".
[0248] Furthermore, the electronic device 100 may use the aforementioned Figure 3CThe method shown completes the above-extracted content to be pasted. In one possible implementation, the electronic device 100 can use the user's personal knowledge base to complete the content to be pasted. For example, the information in the user's personal knowledge base can indicate that the movie theater frequented by the user is AA Cinema (Central Park Store). The electronic device 100 can generate a user completion tag through a user tag generation module: The movie theater frequented by the user is AA Cinema (Central Park Store). Based on the above user completion tag, the electronic device 100 can complete the above content to be pasted as: xx movie, AA Cinema (Central Park Store).
[0249] When jumping to Figure 4D In the user interface 430 shown, the electronic device 100 may provide a paste option 433 in the user interface 430. The paste option 433 may include the above-mentioned completed content to be pasted. Figure 4D As shown in the operation of the paste option 433, such as a click operation, the electronic device 100 can display Figure 4E User interface 430 is shown.
[0250] like Figure 4E As shown, the electronic device 100 can enter the content in the paste option 433 in the input box 431. After the ticket purchase application in the electronic device 100 detects that "xx movie, AA Cinema (Central Park Store)" is entered in the input box 431, it can display Figure 4E The search result 434 shown. The search result 434 may be a search result for purchasing movie tickets for xx movie at AA Cinema (Central Park Store). In this way, the user can quickly purchase movie tickets for xx movie at AA Cinema (Central Park Store) through the search result 434.
[0251] In other embodiments, in response to Figure 4C For the operation of the input box 421, the electronic device 100 may display Figure 4F User interface 440 is shown.
[0252] like Figure 4F As shown, the user interface 440 may include an input box 441 and a prompt box 442. The input box 441 may be Figure 4C The prompt box 442 may include the completed content to be pasted to prompt the user to input the completed content into the input box 441. The prompt box 442 may include a confirmation fill-in control 442A and a close control 442B. The confirmation fill-in control 442A may be used to trigger the electronic device 100 to input the completed content into the input box 441. The close control 442B may be used to trigger the electronic device 100 to close the prompt box 442.
[0253] Or, in response to Figure 4CFor the operation of the input box 421, the electronic device 100 may display Figure 4G The user interface 450 shown in FIG. 4 may include an input box 451. The input box 451 may be the same as the aforementioned Figure 4C The same input box as the input box 421 shown. Figure 4G As shown, by operating the input box 451, such as long pressing, the electronic device 100 may display Figure 4H Prompt box 452 is shown.
[0254] like Figure 4H As shown, prompt box 452 may include smart paste option 452A and paste option 452B. Among them, smart paste option 452A can be used to trigger electronic device 100 to provide content to be pasted determined according to the paste method of the present application. Paste option 452B can be used to trigger electronic device 100 to input the most recently copied content into input box 451. The most recently copied content can be the aforementioned Figure 4B The entire text in chat record 411 is shown as “Do you want to go to your regular movie theater this weekend to watch the recently released movie “xx movie”?”
[0255] In response to Figure 4H The electronic device 100 may display the operation of the smart paste option 452A, such as a click operation. Fig. 4I Paste option 453 is shown. Paste option 453 may include the completed content to be pasted “xx movie, AA Cinema (Central Park Store)”. In response to the operation on paste option 453, electronic device 100 may input the content in paste option 453 into input box 451.
[0256] In some embodiments, in response to Figure 4C The electronic device 100 can also directly input the extracted and completed content to be pasted into the input box 421 (that is, input into the Figure 4D 431 as shown).
[0257] By the above Figure 4A to Figure 4I As shown in the scenario, users can directly copy Figure 4B The entire text in the chat record 411 shown in the figure does not need to be adjusted by moving the cursor to adjust the selected and copied text. After the user copies the entire content in the chat record 411, Figure 4D In the user interface 430 shown, the paste option 433 is used to directly input the movie name and theater name that the user wants to search for in the input box 431, without having to paste all the content in the chat record 411 into the input box 431 and then delete the redundant information one by one. This can effectively improve the efficiency of copying and pasting for users and improve the copying and pasting experience for users.
[0258] That is to say, a piece of content (such as Figure 4B The chat record 411 shown may contain one or more pieces of information that the user wants to copy, as well as redundant information that the user does not need to copy. Based on the pasting method of the present application, the user can directly copy this section of content without the trouble of adjusting the cursor position to select part of this section of content for copying. The electronic device 100 can accurately extract the content that the user wants to paste on the paste page from this section of content. Moreover, when there is an indirect expression of the content required by the user in this section of content (such as the address of the cinema is expressed as "frequently visited cinema" in the chat record 411), the electronic device 100 can complete the extracted content to be pasted, and complete the above indirect expression into a direct expression of the content required by the user, so that the content to be pasted better meets the user's copy and paste needs.
[0259] Figure 4J to Figure 4L Schematic diagrams showing some navigation scenarios are shown as examples.
[0260] Here is the user copy Figure 4B The chat record 411 shown is then followed by opening the map application in the electronic device 100 as an example for explanation.
[0261] like Figure 4J As shown, in response to the operation of opening the map application, the electronic device 100 can display a user interface 460. The user interface 460 can include an input box 461. The input box 461 can be used to input and search for information such as an address. Figure 4J As shown, when the input box 461 is operated, such as a click operation, the electronic device 100 may display Figure 4K User interface 430 is shown.
[0262] like Figure 4K As shown, the user interface 430 may include an input box 471. The input box 471 may be Figure 4J The input box 461 shown is the same input box.
[0263] Among them, when it is detected Figure 4J For the operation of input box 461, electronic device 100 can determine user interface 460 as a paste page, and perform page parsing to obtain paste page information. The paste page information may include the APP category (i.e., navigation APP) shown in user interface 460, the input box (i.e., input box 461) clicked in user interface 460, and the type of content to be entered in input box 461 (i.e., address). In addition, Figure 4K The user interface 470 shown is a display of the electronic device 100 in response to the Figure 4JThe user interface 470 may also be a paste page. The user interface 470 and the user interface 460 belong to the same APP, and the input box 471 is also the same as the input box 461. Therefore, the paste page information obtained by parsing the user interface 470 may be the same as the paste page information obtained by parsing the user interface 460.
[0264] The electronic device 100 may be configured according to Figure 4A The copied page information determined by the user interface 410 is consistent with the Figure 4J The user interface 460 shown determines the pasted page information, identifies the pasting scene as a navigation scene, and identifies the user's intention to navigate to a theater. Based on the above pasting scene and user intention, the electronic device 100 can generate extraction prompt information: extract theater information from given content. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: "frequently visited theaters".
[0265] Furthermore, the electronic device 100 may use the aforementioned Figure 3C The method shown completes the above-extracted content to be pasted. In one possible implementation, the electronic device 100 can use the user's personal knowledge base to complete the content to be pasted. For example, the information in the user's personal knowledge base can indicate that the movie theater frequently visited by the user is AA Cinema (Central Park Store). The electronic device 100 can generate a user completion tag through a user tag generation module: The movie theater frequently visited by the user is AA Cinema (Central Park Store). Based on the above user completion tag, the electronic device 100 can complete the above content to be pasted as: AA Cinema (Central Park Store).
[0266] When jumping to the user interface 470, the electronic device 100 can display in the user interface 470 Figure 4K Paste option 472 is shown. Paste option 472 may include the above-mentioned completed content to be pasted. Figure 4K As shown in the operation of the paste option 472, such as a click operation, the electronic device 100 can display Figure 4L User interface 470 is shown.
[0267] like Figure 4L As shown, the electronic device 100 can enter the content in the paste option 472 in the input box 471. After the map application in the electronic device 100 detects that "AA Cinema (Central Park Store)" is entered in the input box 471, it can display Figure 4LThe search result 473 shown. The search result 473 may be a search result for navigating to the AA Cinema (Central Park Store). In this way, the user can quickly navigate to the AA Cinema (Central Park Store) through the search result 473.
[0268] Optionally, the electronic device 100 may also receive Figure 4K After the long press operation of the input box 471 is shown, a paste option corresponding to the content to be pasted "AA Cinema (Central Park Store)" is provided, so that the user can paste the content to be pasted "AA Cinema (Central Park Store)" into the input box 471. For specific interaction methods, please refer to the aforementioned Figure 4F to Figure 4I The embodiment of the present application does not limit the method in which the electronic device 100 provides the above-mentioned paste options corresponding to the content to be pasted.
[0269] By the above Figure 4J to Figure 4L As shown in the scenario, users can directly copy Figure 4B The entire text in the chat record 411 shown in the figure does not need to be adjusted by moving the cursor to adjust the selected and copied text. After the user copies the entire content in the chat record 411, Figure 4K In the user interface 470 shown, the name of the theater that the user wants to search for is directly input into the input box 471 through the paste option 472, without having to delete the redundant information one by one after pasting all the contents in the chat record 411 into the input box 431. This can effectively improve the efficiency of copying and pasting of the user and improve the copying and pasting experience of the user.
[0270] In addition, in combination with the above-mentioned movie ticket purchase scenario and navigation scenario, it can be seen that for the same copied content, the electronic device 100 can extract different content to be pasted according to different pasting scenarios and user intentions, thereby meeting the user's pasting needs in different pasting scenarios.
[0271] In some embodiments, Figure 4B The copied content shown may belong to the electronic device 100 display Figure 4C The user interface 420 shown in the figure shows the most recent m1 copies of the content, and may belong to the electronic device 100 display Figure 4J The most recent m1 copies of the content before the user interface 460 shown. The m1 above may be a positive integer. Optionally, Figure 4C The user interface 420 and Figure 4J The user interfaces 460 shown can all be the electronic device 100 detecting Figure 4B The interface shown is displayed within a preset time period after the copy operation. For example, the preset time period may be 1 minute, 2 minutes, 5 minutes, etc. The embodiment of the present application does not limit the value of the preset time period.
[0272] Paste scene 2: shopping scene
[0273] Figure 5A to Figure 5G Schematic diagrams showing some shopping scenarios.
[0274] like Figure 5A As shown, the electronic device 100 may display a user interface 510. The user interface 510 may be a page of a social application. The user interface 510 may include a shared content display area 511 and a comment display area 512. The shared content displayed in the shared content display area 511 may display the shared content of the user on the social application. For example, the shared content may include Figure 5A The picture, text, and other information used to describe the dress are shown. The comment display area 512 may include one or more comments. These comments may be comments on the above-mentioned shared content and comment replies. The comment display area 512 may include comment 512A. In response to Figure 5A As shown, by operating the comment 512A, such as long pressing, the electronic device 100 may display Figure 5B Function option box 513 is shown.
[0275] like Figure 5B As shown, the function option box 513 may include options such as a copy option 513A, a reply option, and a share option for operating the comment 512A. Figure 5B The operation of the copy option 513A, such as a click operation, can cause the electronic device 100 to store all the text in the comment 512A to the clipboard. That is, all the text in the comment 512A can be the copy content. The user interface 510 can be a copy page.
[0276] By the aforementioned Figure 3A As can be seen from the method shown, the electronic device 100 can perform page parsing on the user interface 510 to obtain the copy page information. The copy page information can include context information of the copy content. For example, Figure 5A The contextual information of the copied content (i.e., comment 512A) may include Figure 5A The shared content in the shared content display area 511 and the comments before and after the comment 512A in the comment display area 512 are shown.
[0277] Here is the user copy Figure 5A The example of opening a shopping application in the electronic device 100 after comment 512A is shown is used for explanation.
[0278] like Figure 5C As shown, in response to the operation of opening the shopping application, the electronic device 100 can display a user interface 520. The user interface 520 can include an input box 521. The input box 521 can be used to input and search for information such as stores and products. Figure 5CAs shown, when the input box 521 is operated, such as a click operation, the electronic device 100 may display Figure 5D User interface 530 is shown.
[0279] like Figure 5D As shown, the user interface 530 may include an input box 531. The input box 531 may be Figure 5C The input box 521 shown is the same as the one shown in the figure, and can be used to input and search for information such as stores and products.
[0280] It should be noted that when Figure 5C As shown in the operation of the input box 521, the electronic device 100 can determine the user interface 520 as a paste page, and perform page parsing to obtain the paste page information. The paste page information may include the APP category to which the user interface 520 belongs (i.e., shopping APP), the input box clicked in the user interface 520 (i.e., input box 521), and the type of content to be entered in the input box 521 (e.g., store name and / or product name). In addition, Figure 5D The user interface 530 shown is a display of the electronic device 100 in response to Figure 5C The user interface 530 may also be a paste page. The user interface 530 and the user interface 520 belong to the same APP, and the input box 531 and the input box 521 are also the same. Therefore, the paste page information obtained by parsing the user interface 530 may be the same as the paste page information obtained by parsing the user interface 520.
[0281] The electronic device 100 may be configured according to Figure 5A The copied page information determined by the user interface 510 is consistent with the Figure 5C The user interface 520 shown determines the pasted page information, identifies the pasting scene as a shopping scene, and identifies the user's intention to search for the store name or product name of the skirt. Based on the above pasting scene and user intention, the electronic device 100 can generate extraction prompt information: extract the store name and product name from the given content. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: BB store, CC store, floral long skirt.
[0282] Furthermore, the electronic device 100 may use the aforementioned Figure 3CThe method shown completes the above-extracted content to be pasted. In a possible implementation, the electronic device 100 can use the user's personal knowledge base to complete the content to be pasted. For example, the information in the user's personal knowledge base can indicate that the user is a long skirt lover. The electronic device 100 can generate a user completion tag through a user tag generation module: long skirt lover. Based on the above user completion tag, the electronic device 100 can complete the above content to be pasted as: BB store + long skirt, CC store + long skirt, floral long skirt. It can be understood that the store name combined with the clothing type can help users search for the store they want to find more accurately.
[0283] When jumping to Figure 5D In the user interface 530 shown, the electronic device 100 may display a prompt box 532. The above-mentioned completed content to be pasted may be displayed in the prompt box 532. Exemplarily, the electronic device 100 may provide the user with multiple pieces of information in the content to be pasted as multiple paste options. Prompt box 532 may include paste option 532A, paste option 532B, and paste option 532C. Paste option 532A can be used to input "BB shop long skirt" in the content to be pasted into input box 531. Paste option 532B can be used to input "CC shop long skirt" in the content to be pasted into input box 531. Paste option 532C can be used to input "floral long skirt" in the content to be pasted into input box 531. In response to Figure 5D For the operation of the paste option 532B, the electronic device 100 may display Figure 5E User interface 530 is shown.
[0284] like Figure 5E As shown, the electronic device 100 can input the content in the paste option 532B in the input box 531. After the shopping application in the electronic device 100 detects that "CC shop long skirt" is input in the input box 531, it can display Figure 5E The search result 533 shown. The search result may be a search result for entering the product display page of the CC store in the shopping application. In this way, the user can quickly open the product display page of the CC store through the search result 533 to find the desired product.
[0285] like Figure 5E As shown, search result 533 may include store entry option 533A. In response to the operation of store entry option 533A, electronic device 100 may display Fig. 5F User interface 540 is shown. User interface 540 may be a product display page of a CC store.
[0286] like Fig. 5FAs shown, the user interface 540 may include an input box 541. The input box 541 may be used to input and search for information such as products in the CC store. Fig. 5F As shown, when the input box 541 is operated, such as a click operation, the electronic device 100 may display Figure 5G User interface 550 is shown.
[0287] like Figure 5G As shown, the user interface 550 may include an input box 551. The input box 551 may be Fig. 5F The same input box as the input box 541 shown can be used to input and search for information such as products in the CC store.
[0288] It should be noted that when Fig. 5F For the operation of the input box 541, the electronic device 100 can determine the user interface as a paste page, and perform page parsing to obtain paste page information. The paste page information may include the APP category to which the user interface 540 belongs (i.e., shopping APP), the type of content to be input in the input box 541 (i.e., product name), and the operation information for entering the paste page (i.e., Figure 5E In addition, Figure 5G The user interface 550 shown is a display of the electronic device 100 in response to Fig. 5F The user interface 550 may also be a paste page. The user interface 550 and the user interface 540 belong to the same APP, and the input box 551 and the input box 541 are also the same. Therefore, the paste page information obtained by parsing the user interface 550 may be the same as the paste page information obtained by parsing the user interface 540.
[0289] The electronic device 100 may be configured according to Figure 5A The copied page information determined by the user interface 510 is consistent with the Fig. 5F The user interface 540 shown in the figure determines the pasted page information, identifies the pasting scene as a shopping scene, and identifies the user's intention to search for goods in the store. In a possible implementation, since the electronic device 100 has already been based on a page in the APP to which the user interface 540 belongs (i.e., the aforementioned Figure 5C The electronic device 100 can filter out corresponding information from the above content to be pasted according to the user intention identified when displaying the user interface 540, so that the user can input it into the input box 541 in the user interface 540. The electronic device 100 recognizes that the user intention of the user is to search for goods in the store according to the user intention. Based on the user intention, the electronic device 100 can filter out corresponding information from the above content to be pasted according to the user intention identified when displaying the user interface 540, so as to provide the user with input information into the input box 541 in the user interface 540. Figure 5DThe content to be pasted displayed in the prompt box 532 is filtered. The electronic device 100 can filter out the store name in the content to be pasted and retain the product name in the content to be pasted. Figure 5D Paste option 532A and paste option 532B are shown.
[0290] like Figure 5G As shown, when jumping to the user interface 550, the electronic device 100 may display a paste option 552. The content in the paste option 552 may be the information retained after filtering the above-mentioned content to be pasted. Figure 5D The paste option 532C shown is the same. In this way, the user can quickly paste the commodity name in the copied content in the input box 551 through the paste option 552, thereby searching for the corresponding commodity in the selected store.
[0291] In some embodiments, Figure 5A The copied content shown may belong to the electronic device 100 display Figure 5C The user interface 520 shown in the figure shows the most recent m1 copies of the content, and may belong to the electronic device 100 display Fig. 5F The most recent m1 copies of the content before the user interface 540 shown. The m1 above may be a positive integer. Optionally, Figure 5C The user interface 520 and Fig. 5F The user interfaces 540 shown in the figure can all be the electronic device 100 detecting Figure 5A and Figure 5B The interface shown is displayed within a preset time period after the copy operation.
[0292] By the above Figure 5A to Figure 5G As shown in the scenario, users can directly copy Figure 5A The entire text in the comment 512A is shown. The comment 512A may contain multiple pieces of information that the user needs to copy under relevant pasting scenarios and user intentions. The electronic device 100 can provide the multiple pieces of information to the user as different paste options, or combine one or more of the multiple pieces of information and provide them to the user as paste options. In this way, more paste options can be provided to the user, better meeting the user's copy and paste needs, and facilitating the user to select one or more pieces of information in the copied content and paste them into the input box of the paste page.
[0293] In addition, when the electronic device 100 has extracted the content to be pasted from the copied content based on a paste page in an APP, when the electronic device 100 jumps to other paste pages in the APP, the extracted content to be pasted can be filtered according to the user intention corresponding to the other paste pages, without re-extracting the content to be pasted. This can not only achieve that the content to be pasted provided on different paste pages better meets the different intentions of users, but also reduce the interaction delay, and provide the content to be pasted to the user more quickly after the paste page is displayed.
[0294] Paste scene 3: Movie and TV drama search scene
[0295] Figure 6A to Figure 6F A schematic diagram showing some exemplary search scenarios for movies and TV series.
[0296] like Fig. 6A As shown, the electronic device 100 may display a user interface 610. The user interface 610 may be a page of a social application. The user interface 610 may include a shared content display area 611 and a comment display area 612. The shared content displayed in the shared content display area 611 may display the shared content of the user on the social application. For example, the shared content may include Fig. 6A The information about the film and TV series is shown. The comment display area 612 may include one or more comments. These comments may be comments on the above-mentioned shared content and comment replies, etc. The comment display area 612 may include comment 612A. In response to Fig. 6A As shown, by operating the comment 612A, such as long pressing, the electronic device 100 may display Figure 6B Function option box 613 is shown.
[0297] like Figure 6B As shown, the function option box 613 may include a copy option 613A. Figure 6B The operation of the copy option 613A, such as a click operation, can cause the electronic device 100 to store all the text in the comment 612A to the clipboard. That is, all the text in the comment 612A can be the copy content. The user interface 610 can be a copy page.
[0298] By the aforementioned Figure 3A As can be seen from the method shown, the electronic device 100 can perform page parsing on the user interface 610 to obtain the copy page information. The copy page information may include context information of the copy content. For example, Fig. 6A The contextual information of the copied content (i.e., comment 612A) may include Fig. 6A The shared content in the shared content display area 611 and the comments before and after the comment 612A in the comment display area 612 are shown.
[0299] Here is the user copy Fig. 6A The example of opening one or more video applications in the electronic device 100 after the comment 612A is shown is used for explanation. One of the video applications may be a playback platform for a film or TV series.
[0300] like Figure 6C As shown, in response to the operation of opening the video application 1, the electronic device 100 can display a user interface 620. The user interface 620 can include an input box 621. The input box 621 can be used to input and search for information such as movies, TV series, and actors. Figure 6C As shown, when the input box 621 is operated, such as a click operation, the electronic device 100 may display Fig.6D User interface 630 is shown.
[0301] like Fig.6D As shown, the user interface 630 may include an input box 631. The input box 631 may be Figure 6C The same input box as the input box 621 shown can be used to input and search for information such as movies, TV series, and actors.
[0302] It should be noted that when Figure 6C As shown in the operation of the input box 621, the electronic device 100 can determine the user interface 620 as a paste page, and perform page parsing to obtain paste page information. The paste page information may include the APP category described in the user interface 620 (i.e., video playback APP), the input box clicked in the user interface 620 (i.e., input box 621), and the type of content to be entered in the input box 621 (e.g., the name of the film and TV series and / or the name of the actor). In addition, Fig.6D The user interface 630 shown may also be a paste page. The user interface 630 and the user interface 620 belong to the same APP, and the input box 631 is also the same as the input box 621. Therefore, the paste page information obtained by parsing the user interface 630 may be the same as the paste page information obtained by parsing the user interface 620.
[0303] The electronic device 100 may be configured according to Fig. 6A The copied page information determined by the user interface 610 is consistent with the Figure 6CThe pasted page information determined by the user interface 620 shown recognizes that the pasting scenario is a film and television drama search scenario, and recognizes that the user's intention is to search for film and television dramas in video application 1. Based on the above-mentioned pasting scenario and user intention, the electronic device 100 can generate extraction prompt information: extract the film and television dramas belonging to video application 1 from the given content. It can be understood that there are currently multiple applications for users to watch videos. A film and television drama may only be played in some video applications. The above-mentioned film and television dramas belonging to video application 1 may refer to the film and television dramas played in the video application 1. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: life after life, honey, and glittering.
[0304] It is understandable that comment 612A includes the names of TV series and movies, as well as the video applications to which some of the TV series and movies belong. From comment 612A, it can be seen that the TV series and movies belonging to video application 1 include: Life and Death, Honey, and Starry Sky; the TV series and movies belonging to video application 2 include: The First Half and Sleeping; and the TV series and movies belonging to video application 3 include: Never Forget. Among them, the TV series and movie named "I Like You" is not specified in the comment 612A as the video application it describes. Therefore, when video application 1 is opened, the content to be pasted extracted by the electronic device 100 can be the name of the TV series and movie belonging to video application 1 in the copied content.
[0305] The above-mentioned film and television drama titles are only exemplary illustrations of this application.
[0306] Furthermore, the electronic device 100 may use the aforementioned Figure 3B The method shown corrects the above-extracted content to be pasted. Specifically, the electronic device 100 can use the above-mentioned pasting scene and user intention as the input of the error correction prompt generator, and obtain the error correction prompt information through the error correction prompt generator: determine whether the name of the film and television drama in the given content is correct and correct the incorrect film and television drama name. The electronic device 100 can input the above-extracted content to be pasted and the error correction prompt information into the language model, and correct the pasted content through the language model. The above-mentioned error correction can be implemented based on a public knowledge base. For example, the information in the public knowledge base indicates that the name of the above-mentioned film and television drama "Bright Stars" is wrong, and the correct name should be "Bright Stars". Then, the electronic device 100 can modify "Bright Stars" in the content to be pasted to "Bright Stars". The content to be pasted after error correction may include: Life and Death, Honey, and Bright Stars.
[0307] Afterwards, the electronic device 100 can use the aforementioned Figure 3CThe method shown completes the content to be pasted after the above error correction. In a possible implementation, the electronic device 100 can use a public knowledge base to complete the content to be pasted after the error correction. Among them, the electronic device 100 can use the above-mentioned pasting scene and user intention as the input of the completion prompt generator, and obtain the completion prompt information through the completion prompt generator: complete the playback platform information of the film and television drama in the given content. For example, the above-mentioned given content may be the content that has not been extracted to the content to be pasted in the copied content. The electronic device 100 can input the above-mentioned copied content, the content to be pasted after error correction, and the completion prompt information into the language model, and obtain the public knowledge base completion information through the language model. The public knowledge base completion information may include the playback platform information of the film and television drama that has not been extracted to the content to be pasted in the above-mentioned copied content. For example, the public knowledge base completion information may include: the playback platform to which the TV series "Like You" belongs includes video application 1 and video application 2. The electronic device 100 can input the corrected content to be pasted and the above-mentioned public knowledge base completion information into the completion generation model, and obtain the completed content to be pasted through the completion generation model: life, life, honey, bright stars, like you. It can be seen that even if Fig. 6A The comment 612A shown does not clearly indicate the video application to which the film and television drama "Like You" belongs. The electronic device 100 can determine that the video application to which the film and television drama "Like You" belongs includes video application 1 through the above-mentioned completion method, and thus add "Like You" to the extracted content to be pasted. This can reduce the situation where the extracted content to be pasted omits the film and television drama belonging to video application 1 in the copied content.
[0308] Finally, the electronic device 100 can also use the aforementioned Figure 3D The method shown is used to sort the completed content to be pasted. Specifically, the electronic device 100 can use the user's personal knowledge base to sort the completed content to be pasted. For example, the information in the user's personal knowledge base can indicate that the user's interest in the following movies and TV series from high to low is: Honey, Life after Life, Like You, Bright Star. The electronic device 100 can sort the pasted content according to the user's interest in the movies and TV series, and obtain the sorted content to be pasted: Honey, Life after Life, Like You, Bright Star. Among them, the electronic device 100 can provide each movie and TV series name to the user as a separate paste option.
[0309] In one possible implementation, the electronic device 100 can detect whether the content to be pasted contains multiple pieces of information of the same type. The multiple pieces of information of the same type may be, for example: multiple names of film and television dramas, multiple names of people, multiple store names, multiple product names, multiple place names, etc. In the case where the pasted content contains multiple pieces of information of the same type, the electronic device 100 may provide these multiple pieces of information of the same type to the user as different paste options. It is understandable that the user usually only needs to enter one of the multiple pieces of information of the same type in the input box at a time. The above-mentioned providing multiple pieces of information of the same type to the user as different paste options can facilitate the user to select the required information and paste it into the input box. Optionally, the electronic device 100 may also use the aforementioned Figure 3D The method shown sorts the above-mentioned multiple pieces of information of the same type, thereby providing the user with sorted content to be pasted.
[0310] like Fig.6D As shown, when jumping to the user interface 630, the electronic device 100 can display a prompt box 632. The prompt box 632 can display the content to be pasted after the above sorting. Among them, the prompt box 632 may include a paste option 632A, a paste option 632B, a paste option 632C, and a paste option 632D. Paste option 632A can be used to input the name of the film and television drama "Honey" into the input box 631. Paste option 632B can be used to input the name of the film and television drama "Life and Death" into the input box 631. Paste option 632C can be used to input the name of the film and television drama "Like You" into the input box 631. Paste option 632D can be used to input the name of the film and television drama "Bright Stars" into the input box 631. It can be seen that the content to be pasted in the prompt box 632 is displayed according to the above-mentioned ranking of the user's interest. The film and television drama with the highest user interest (such as "Honey") can be displayed in the front position. It can be understood that the above interest ranking is only an exemplary description of the present application and should not constitute a limitation to the present application.
[0311] In this way, the user copies Fig. 6A After opening the video application 1 after viewing the comment 612A shown, the name of the TV series or movies in the comment 612A belonging to the video application 1 can be quickly input into the input box 631 of the video application 1 through the paste option in the prompt box 632 .
[0312] In addition, if the user is copying Fig. 6A After the comment 612A is shown, the video application 2 in the electronic device 100 is opened, and the electronic device 100 can display Fig. 6E User interface 640 is shown. User interface 640 may be a user interface of video application 2.
[0313] like Fig. 6EAs shown, the user interface 640 may include an input box 641. The input box 641 may be used to input and search for information such as movies, TV series, and actors. Fig. 6E As shown, when the input box 641 is operated, such as a click operation, the electronic device 100 may display Fig. 6F User interface 650 is shown.
[0314] like Fig. 6F As shown, the user interface 650 may include an input box 651. The input box 651 may be Fig. 6E The same input box as the input box 641 shown can be used to input and search for information such as movies, TV series, and actors.
[0315] It should be noted that when Fig. 6E As shown in the operation of the input box 621, the electronic device 100 can determine the user interface 640 as a paste page, and perform page parsing to obtain paste page information. The paste page information may include the APP category described in the user interface 640 (i.e., video playback APP), the input box clicked in the user interface 640 (i.e., input box 641), and the type of content to be input in the input box 641 (e.g., the name of a film or TV series and / or an actor's name).
[0316] The electronic device 100 can extract the content to be pasted according to the method of the above embodiment, and perform error correction, completion and sorting on the content to be pasted. Figure 6C and Fig.6D The processing procedure of determining the content to be pasted is performed by taking the user interface 620 of the video application 1 as the pasting page.
[0317] The electronic device 100 is Fig. 6E The user interface 640 shown is a paste page. The content to be pasted can be the copied content (i.e. Fig. 6A The names of movies and TV series belonging to the video application 2 in the comments 612A shown. For example, the electronic device 100 uses the user interface 640 as the paste page to extract the content to be pasted, and after error correction, completion and sorting of the content to be pasted, the content to be pasted can be: Like You, First Half, Sleeping. Among them, the movie and TV series "Like You" can be the movie and TV series that the user is most interested in among the above content to be pasted. The movie and TV series "Sleeping" can be the movie and TV series that the user is least interested in among the above content to be pasted.
[0318] like Fig. 6FAs shown, when jumping to user interface 650, electronic device 100 can display prompt box 652. Prompt box 652 can display the content to be pasted after the above-mentioned error correction, completion and sorting. Among them, prompt box 652 can include paste option 652A, paste option 652B, and paste option 652C. Paste option 652A can be used to input the name of the film and television drama "Like You" into input box 651. Paste option 652B can be used to input the name of the film and television drama "First Half" into input box 651. Paste option 652C can be used to input the name of the film and television drama "Sleeping" into input box 651. In this way, the user can copy Fig. 6A After opening the video application 2 after viewing the comment 612A shown, the name of the TV series or movies in the comment 612A belonging to the video application 2 can be quickly input into the input box 651 of the video application 2 through the paste option in the prompt box 652 .
[0319] In some embodiments, Fig. 6A The copied content shown may belong to the electronic device 100 display Figure 6C The user interface 620 shown in the figure shows the most recent m1 copies of the content, and may belong to the electronic device 100 display Fig. 6E The most recent m1 copies of the content before the user interface 640 shown. The m1 above may be a positive integer. Optionally, Figure 6C The user interface 620 and Fig. 6E The user interfaces 640 shown can all be the electronic device 100 detecting Fig. 6A and Figure 6B The interface shown is displayed within a preset time period after the copy operation.
[0320] By the above Figure 6A to Figure 6F As shown in the scenario, users can directly copy Fig. 6A The entire text in the comment 612A shown. Among them, the electronic device 100 can correct the content to be pasted extracted from the comment 612A. In this way, even if there are errors in the information in the copied content, the electronic device 100 can provide the correct content to the user for pasting after error correction, so as to avoid the erroneous copied content affecting the user's use effect and experience. In addition, the electronic device 100 can also complete the content to be pasted to provide the user with more complete content to be pasted. The above-mentioned completed content to be pasted can reduce the situation where information that the user may need in the copied content is omitted. The electronic device 100 can also sort the content to be pasted, so as to facilitate the user to prioritize the information that the user is interested in for pasting.
[0321] In addition, the above Fig.6D The prompt box 632 provided in the video application 1 is similar to the above Fig. 6FAs shown in the prompt box 652 provided in the video application 2, for the same copied content, the electronic device 100 can extract different content to be pasted according to different pasting scenarios and user intentions, thereby meeting the user's pasting needs in different pasting scenarios.
[0322] Paste scenario 4: Redemption code redemption scenario
[0323] Figure 7A to Figure 7H A schematic diagram showing some exemplary redemption code redemption scenarios.
[0324] like Fig. 7A As shown, the electronic device 100 may display a user interface 710. The user interface 710 may be a chat page of an instant messaging application. The user interface 710 may include a chat record 711. Fig. 7A As shown in FIG. 1 , by operating the chat record 711, such as a long press operation, the electronic device 100 can display the content in the chat record 711 as Figure 7B The selected state shown and can be displayed Figure 7B Function option box 712 is shown. Function option box 712 may include copy option 712A.
[0325] like Figure 7B As shown, when all the text in the chat record 711 is selected, in response to an operation on the copy option 712A, such as a click operation, the electronic device 100 can store all the text in the chat record 711 to the clipboard. That is, all the text in the chat record 711 can be the copy content. The user interface 710 can be a copy page.
[0326] By the aforementioned Figure 3A As can be seen from the method shown, the electronic device 100 can perform page parsing on the user interface 710 to obtain the copy page information. The copy page information may include context information of the copy content. For example, Figure 7B The contextual information of the copied content may include Figure 4A One or more chat records before and after chat record 711 are shown: "Game 1 has gift packs that can be redeemed", "How to redeem?", "Use this redemption code, each redemption code can be redeemed for a gift pack".
[0327] Here is the user copy Figure 7B The chat record 711 shown is then followed by opening the game 1 application in the electronic device 100 as an example for explanation.
[0328] like Figure 7CAs shown, the electronic device 100 can display a user interface 720. The user interface 720 can be an interface in the game 1 application for inputting a redemption code to redeem a gift package. The user interface 720 may include a prompt box 721. The prompt box 721 may include an input box 722 and a determination control 723. Among them, the input box 722 can be used to input a redemption code. The determination control 723 can be used to trigger the electronic device 100 to detect whether the redemption code entered in the input box 722 meets the requirements, and to implement the gift package redemption when the redemption code meets the requirements. It can be understood that a redemption code becomes an invalid redemption code after being used once and cannot be used again.
[0329] In response to Figure 7C As shown in the operation of the input box 722, the electronic device 100 can determine the user interface 720 as a paste page, and perform page parsing to obtain paste page information. The paste page information may include the APP category to which the user interface 720 belongs (i.e., game APP), the input box clicked in the user interface 720 (i.e., input box 722), and the type of content to be entered in the input box 722 (i.e., redemption code).
[0330] The electronic device 100 may be configured according to Fig. 7A The user interface 710 shown determines the copy page information and the Figure 7C The pasting page information determined by the user interface 720 shown recognizes the pasting scenario as a redemption code redemption scenario, and recognizes that the user's intention is to use the redemption code to redeem a gift package. Based on the above-mentioned pasting scenario and user intention, the electronic device 100 can generate extraction prompt information: extract the redemption code from the given content. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: 2023gfhaigonsh, 2023asongalghd, 2023ishghalngai. It can be seen that the above-mentioned content to be pasted may contain 3 redemption codes. The above-mentioned redemption code is only an exemplary description of the present application.
[0331] In some embodiments, the electronic device 100 can identify that the multiple redemption codes in the content to be pasted are multiple pieces of information of the same type. The electronic device 100 can provide the multiple redemption codes in the content to be pasted as different paste options to the user. Optionally, the electronic device 100 can also determine whether the multiple redemption codes in the content to be pasted have been pasted based on the historical pasting operation information. If none of the multiple redemption codes have been pasted, the electronic device 100 can provide Fig.7D Prompt box 724 is shown.
[0332] That is to say, in response to Figure 7C As shown in the operation of the input box 722, the electronic device 100 can determine the content to be pasted and provide it on the user interface 720. Fig.7D The content to be pasted is shown.
[0333] like Fig.7D As shown, the user interface 720 may include a prompt box 724. The prompt box 724 may display the content to be pasted. Among them, the prompt box 724 may include a paste option 724A, a paste option 724B, and a paste option 724C. These paste options may be paste options corresponding to multiple redemption codes in the content to be pasted. In this way, the user can select the redemption code through these paste options and input it into the input box 722 to realize the redemption gift package.
[0334] like Fig.7D As shown, in response to selecting the operation of the paste option 724A, the electronic device 100 may display Fig. 7E User interface 720 is shown.
[0335] like Fig. 7E As shown, the electronic device 100 can input the redemption code "2023gfhaigonsh" corresponding to the above-mentioned paste option 724A into the input box 722. In response to the operation of the confirmation control 723, the electronic device 100 can use the redemption code "2023gfhaigonsh" to redeem the gift package.
[0336] In one possible implementation, in response to Fig.7D As shown, the electronic device 100 selects the paste option 724A to paste the redemption code "2023gfhaigonsh" corresponding to the paste option 724A into the input box 722. The redemption code "2023gfhaigonsh" can be marked by the electronic device 100. For example, the electronic device 100 can add the information that the redemption code "2023gfhaigonsh" has been pasted in the operation information of the historical pasting.
[0337] like Figure 7F As shown, the electronic device 100 can display the interface (i.e., user interface 720) in the game 1 application for inputting the redemption code to redeem the gift package. Since the electronic device 100 has extracted the content to be pasted from the user interface 720 as the paste page, the electronic device 100 can detect the operation on the input box 722 again based on the above Figure 3E The method shown filters the extracted content to be pasted.
[0338] Among them, the electronic device 100 can filter the content to be pasted based on the historical pasting operation information. As can be seen from the above description, the historical pasting operation information contains information that the redemption code "2023gfhaigonsh" has been pasted. Therefore, the electronic device 100 can filter out the redemption code "2023gfhaigonsh" in the content to be pasted, and provide the remaining retained redemption codes to the user as paste options.
[0339] That is to say, in response to Figure 7F By operating the input box 722 as shown, the electronic device 100 can filter out the content to be pasted and display it on the user interface 720. Figure 7G The filtered content to be pasted is shown.
[0340] like Figure 7G As shown, the user interface 720 may include a prompt box 725. The prompt box 725 may display the filtered content to be pasted. Among them, the prompt box 725 may include a paste option 725A and a paste option 725B. It can be seen that the paste option 725A is based on the aforementioned Fig.7D Paste option 724B is shown. Paste option 725B is the aforementioned Fig.7D Paste option 724C is shown. Thus, the user can Figure 7G The paste option shown enters the redemption code that has not yet been used into the input box 722.
[0341] like Figure 7G As shown, in response to selecting the operation of the paste option 725A, the electronic device 100 may display Figure 7H User interface 720 is shown.
[0342] like Figure 7H As shown, the electronic device 100 can paste the redemption code "2023asongalghd" corresponding to the above-mentioned paste option 725A into the input box 722. Figure 7G As shown, the redemption code "2023asongalghd" corresponding to the paste option 725A is pasted into the input box 722 by selecting the paste option 725A, and the electronic device 100 can mark the redemption code "2023asongalghd". For example, the electronic device 100 can add information that the redemption code "2023asongalghd" has been pasted in the historical pasted operation information. In this way, when the electronic device 100 displays the user interface 720 again, the electronic device 100 can filter out the redemption code "2023asongalghd" from the content to be pasted provided to the user. The above method can reduce the interference of the redemption code that has been pasted and used on the user's selection of the redemption code for redemption, and avoid the situation where the user repeatedly selects the redemption code that has been pasted and used for redemption again.
[0343] In some embodiments, Figure 7B The copied content shown may belong to the electronic device 100 display Figure 7C The most recent m1 copies of the content before the user interface 720 shown. The m1 above may be a positive integer. Optionally, Figure 7C The user interface 720 shown may be a display of the electronic device 100 upon detecting Fig. 7A and Figure 7B The interface shown is displayed within a preset time period after the copy operation.
[0344] By the above Figure 7A to Figure 7H As can be seen from the scenario shown, the electronic device 100 can analyze the pasting scenario and user intention in combination with the copy page information and the paste page information, and then extract the content to be pasted that meets the user's intention and matches the pasting scenario from the copied content. The electronic device 100 can also provide the user with multiple pieces of information of the same type in the content to be pasted as different paste options. This can provide the user with more paste options, better meet the user's copy and paste needs, and facilitate the user to select one or more pieces of information in the copied content to paste into the input box of the paste page. In addition, the electronic device 100 can also filter the content to be pasted. This can reduce the situation where users repeatedly paste expired information when part of the information in the content to be pasted becomes invalid after being pasted, and reduce the interference of other information to the user.
[0345] Paste scene 5: Contact adding scene
[0346] FIG. 8A to FIG. 8I The following is a schematic diagram showing some contact adding scenarios.
[0347] like Fig. 8A As shown, the electronic device 100 may display a user interface 810. The user interface 810 may be an interface of a text messaging application. The user interface 810 may include a text message 811. For example, the text message 811 may include the identity of a user named "Xiao Zhang": an account manager of DD Company, a mobile phone number: 188********, and a contact ID on application E: xiaozhang. The above application E may be an instant messaging application.
[0348] In some embodiments, in response to an operation on the text message 811, such as a long press operation, the electronic device 100 may display Fig. 8A The function option box 812 shown. The function option box 812 may include a copy option 812A. In the case where all the text in the text message 811 is selected, in response to Fig. 8AThe operation of the copy option 812A, such as a click operation, can cause the electronic device 100 to store all the text in the text message 811 to the clipboard, that is, all the text in the text message 811 can be the copy content. The user interface 810 can be a copy page.
[0349] By the aforementioned Figure 3A As can be seen from the method shown, the electronic device 100 can perform page parsing on the user interface 810 to obtain the copy page information. The copy page information may include context information of the copy content. For example, Fig. 8A The context information of the copied content may include information displayed before and after the text message 811. In some embodiments, the context information of the copied content may also be empty, that is, no other information is displayed before and after the copied content in the copy page.
[0350] Here is the user copy Fig. 8A The text message 811 is shown and then application E in the electronic device 100 is opened as an example for explanation.
[0351] like Figure 8B As shown, the electronic device 100 may display a user interface 820. The user interface 820 may be an interface for adding contacts in the above application E. The user interface 820 may include an input box 821. The input box 821 may be used to input and search for information such as an account number or a mobile phone number. Figure 8B As shown, when the input box 821 is operated, such as a click operation, the electronic device 100 may display Figure 8C User interface 830 is shown.
[0352] like Figure 8C As shown, the user interface 830 may include an input box 831. The input box 831 may be Figure 8B The same input box as shown in input box 821 can be used to input and search for information such as account numbers or mobile phone numbers.
[0353] It should be noted that when Figure 8B As shown in the operation of input box 821, electronic device 100 can determine user interface 820 as a paste page, and perform page parsing to obtain paste page information. The paste page information may include the APP category to which user interface 820 belongs (i.e., communication APP), the input box clicked in user interface 820 (i.e., input box 821), and the type of content to be entered in input box 821 (e.g., account number or mobile phone number). In addition, Figure 8C The user interface 830 shown is a display of the electronic device 100 in response to the Figure 8BThe user interface 830 may also be a paste page. The user interface 830 and the user interface 820 belong to the same APP, and the input box 831 and the input box 821 are also the same. Therefore, the paste page information obtained by parsing the user interface 830 may be the same as the paste page information obtained by parsing the user interface 820.
[0354] The electronic device 100 may be configured according to Fig. 8A The copied page information determined by the user interface 810 is consistent with the Figure 8B The user interface 820 shown determines the paste page information, identifies the paste scenario as a contact adding scenario, and identifies the user's intention to search for contacts to be added in application E. Based on the above paste scenario and user intention, the electronic device 100 can generate extraction prompt information: extract the mobile phone number and the account in application E from the given content. Among them, the above mobile phone number and the account in application E can be used to uniquely identify the user who has created an account in application E in application E. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and the language model can be used to extract the content to be pasted from the copied content: xiaozhang, 188********.
[0355] The electronic device 100 may provide the content to be pasted on the pasting page. Figure 8C As shown, when jumping to user interface 830, electronic device 100 may display prompt box 832. The above-mentioned content to be pasted may be displayed in prompt box 832. Prompt box 832 may include paste option 832A and paste option 832B. Paste option 832A can be used to input the account "xiaozhang" in application E into input box 831. Paste option 832B can be used to input the mobile phone number "188********" into input box 831. It can be seen that electronic device 100 can provide the mobile phone number and the account in application E as different paste options to the user. That is, electronic device 100 can provide multiple pieces of information in the content to be pasted to the user as multiple different paste options. This can facilitate users to choose to use one of the two pieces of information, mobile phone number and account in application E, to search for related contacts.
[0356] like Figure 8C In response to selecting the paste option 832A, the electronic device 100 may display Fig.8D User interface 830 is shown.
[0357] like Fig.8DAs shown, the electronic device 100 can input the content "xiaozhang" in the paste option 832A in the input box 831. After detecting that "xiaozhang" is input in the input box 831, the application E in the electronic device 100 can display Fig.8D The search result 833 shown in FIG. The search result 833 may be a search result for searching for a contact with an account number "xiaozhang" in application E. The search result 833 may include an add control 833A. The add control 833A may be used to add the contact with the account number "xiaozhang". Fig.8D For the operation of adding control 833A, the electronic device 100 may display Fig. 8E User interface 840 is shown.
[0358] like Fig. 8E As shown, the user interface 840 can be an application interface for adding contacts in application E. The user interface 840 can include an application information input box 841, a note input box 842, a label input box 843, a description input box 844, and a send control 845. The application information input box 841 can be used to input information sent to the other end (i.e., the contact to be added) when requesting to add a contact. For example, the user can enter his name, identity, purpose of adding a contact, and other information in the application information input box 841, so that the contact to be added knows who the user is, so that he can quickly agree to add the application. The note input box 842 can be used to enter the note information of the contact, so that after adding the contact, you know who the contact is. For example, the user can enter the name, identity, and other information of the contact in the note input box 842. The label input box 843 can be used to enter the label of the contact to classify the contact. The description input box 844 can be used to enter the note information of more contacts. The send control 845 can be used to trigger the electronic device 100 to send the content in the above application information input box 841 to the contact to be added. The user interface 840 may include more or fewer input boxes, which is not limited in this embodiment of the present application.
[0359] In some embodiments, when displaying Fig. 8EIn the user interface 840 shown, the electronic device 100 can determine the user interface 840 as a paste page, and perform page parsing to obtain the paste page information. The paste page information may include the APP category to which the user interface 840 belongs (i.e., communication APP), and the type of content to be entered in the input box contained in the user interface 840. Since the user interface 840 includes multiple input boxes, the type of content to be entered in the input box contained in the user interface 840 may include: the type of content to be entered in the application information input box 841 (such as the name and identity of the user requesting to add a contact), and the type of content to be entered in the remarks input box 842 (such as the name and identity of the user to add a contact).
[0360] The electronic device 100 may be configured according to Fig. 8A The copied page information determined by the user interface 810 is consistent with the Fig. 8E The pasting page information determined by the user interface 840 shown recognizes that the pasting scenario is a contact adding scenario, and recognizes that the user's intention is to apply to add a contact. Based on the above-mentioned pasting scenario and user intention, the electronic device 100 can generate extraction prompt information: extract the user's identity information and the identity information of the contact to be added from the given content. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and can extract the content to be pasted from the copied content through the language model: Miss Xu, Xiao Zhang, the account manager of DD Company. It can be seen that "Miss Xu" is the identity information of the user. "Xiao Zhang, the account manager of DD Company" is the identity information of the contact to be added.
[0361] The electronic device 100 may provide the content to be pasted on the pasting page (ie, the user interface 840). Fig. 8E In the user interface 840 shown, the electronic device 100 can directly fill the content to be pasted into the corresponding input boxes according to the type of content to be input in the input boxes contained in the user interface 840. For example, the electronic device 100 can fill in the user's identity information "Ms. Xu" in the application information input box 841, and fill in the identity information of the contact to be added "DD Company Account Manager Xiao Zhang" in the remarks input box 842. In this way, the user does not need to manually enter information in the above-mentioned application interface for adding contacts. This can improve the efficiency and experience of users adding contacts. In another possible implementation, Fig. 8EThe information in the application information input box 841 and the remarks input box 842 may be filled in by the electronic device 100 according to the user selecting the paste option provided by the electronic device 100. The electronic device 100 may provide the user with different paste options for the multiple pieces of information in the content to be pasted. For example, the electronic device 100 may display the paste option corresponding to the information "Ms. Xu" and the paste option corresponding to the information "DD Company Account Manager Xiao Zhang" on the user interface 840 ( Fig. 8E The scenario in which the electronic device 100 displays the paste option can refer to the aforementioned Figure 5D , Fig.6D , Fig. 6F , Fig.7D When the input focus is on the application information input box 841, the electronic device 100 can respond to the user selecting the paste option corresponding to the information "Miss Xu" by inputting "Miss Xu" in the application information input box 841. When the input focus is on the remark input box 842, the electronic device 100 can respond to the user selecting the paste option corresponding to the information "DD company account manager Xiao Zhang" by inputting "DD company account manager Xiao Zhang" in the remark input box 842.
[0362] In some embodiments, when the paste page includes multiple input boxes, the electronic device 100 may provide a paste option corresponding to the content to be pasted that matches the type of the content to be input in the input box where the input focus is located. Fig. 8E In the example, the user interface 840 includes an application information input box 841 and a remark input box 842. In response to an operation (such as a click operation) on the application information input box 841, the electronic device 100 can determine that the input focus is located in the application information input box 841. The electronic device 100 can select the identity information "Miss Xu" from the above-extracted content to be pasted, and provide a paste option corresponding to the identity information "Miss Xu" in the user interface 840. In response to an operation on the paste option corresponding to the identity information "Miss Xu", the electronic device 100 can fill in the user's identity information "Miss Xu" in the application information input box 841. In response to an operation (such as a click operation) on the remark input box 842, the electronic device 100 can determine that the input focus is located in the remark input box 842. The electronic device 100 can select the identity information "Xiao Zhang, the account manager of DD Company" of the contact to be added from the above-extracted content to be pasted, and provide a paste option corresponding to the identity information "Xiao Zhang, the account manager of DD Company" of the contact to be added in the user interface 840. In response to the operation of the paste option corresponding to the identity information “DD company account manager Xiao Zhang” of the contact to be added, the electronic device 100 can fill in the identity information “DD company account manager Xiao Zhang” of the contact to be added in the note input box 842 .
[0363] Optionally, when you are redirected to the application interface for adding contacts (such as Fig. 8E In the case of the user interface 840 shown in FIG. 8 , the electronic device 100 may determine whether the contact to be added is a duplicate content (eg, Fig. 8A The electronic device 100 can determine the contact person in the text message 811 shown. Fig.8D The electronic device 100 determines whether the contact searched in the user interface 830 is a contact in the copied content. Figure 8C If the contact to be added is input by selecting the paste option 832A or the paste option 832B shown in the figure, the electronic device 100 can determine that the contact to be added is a contact in the copied content. Then, after jumping to the user interface 840, the electronic device 100 can provide the user interface 840 with Fig. 8E The content to be pasted is shown. It is understandable that Fig. 8A In addition to the account and phone number used to search for contacts, the copied content shown also contains the user's identity information and the identity information of the contact to be added. If the user uses the account or phone number in the copied content to search for contacts, the user will usually fill in the user's identity information and the identity information of the contact to be added in the application interface for adding contacts. The above method can more accurately provide users with relevant content to be pasted in the application interface for adding contacts, thereby improving the user experience of adding contacts after copying the information of the contact to be added.
[0364] In the embodiment of the present application, the electronic device 100 is Figure 8C and Fig. 8E The method for providing the content to be pasted on the paste page shown is not limited. Figure 8C The user interface 830 shown is for pasting a page from Fig. 8A When the copied content is extracted to be pasted, in addition to extracting the mobile phone number of the contact to be added and the account number in application E, the identity information of the user and the identity information of the contact to be added can also be extracted. Then, the electronic device 100 can Figure 8C and Fig. 8E The paste page shown above contains the content to be pasted. Fig. 8E The electronic device 100 can paste the page shown in the figure according to Fig. 8E The user intention determined by the paste page shown in the figure filters the content to be pasted. Among them, the electronic device 100 can filter out the mobile phone number of the contact to be added in the content to be pasted and the account number in the application E, so as to Fig. 8E The user interface shown provides the identity information of the above-mentioned user and the identity information of the contact to be added.
[0365] Here, copy the user Fig. 8A The example of opening the contact application in the electronic device 100 after the text message 811 is used to illustrate the pasting process in the contact adding scenario.
[0366] like Fig.8F As shown, the electronic device 100 may display a user interface 850. The user interface 850 may be a user interface of a contact application. The contact application may be an APP for storing contact information. The user interface 850 may include an add control 851. In response to Fig.8F As shown in the operation of adding control 851, such as clicking operation, electronic device 100 can display Figure 8G User interface 860 is shown.
[0367] like Figure 8G As shown, user interface 860 may include a name input box 861, a unit input box 862, a mobile phone number input box 863, a cursor 864, and a completion control 865. Name input box 861 may be used to input the name of the contact. Unit input box 862 may be used to input the work unit of the contact. Mobile phone number input box 863 may be used to input the mobile phone number of the contact. Cursor 864 may be used to indicate the location of the input focus. For example, cursor 864 may be located at Figure 8G The name input box 861 shown may indicate that the input focus is currently in the name input box 861. The electronic device 100 may input the information input by the user into the input box where the input focus is. The completion control 865 may be used to trigger the electronic device 100 to save the contact information input in the user interface 860.
[0368] When jumping to the user interface 860, the electronic device 100 can determine the user interface 860 as a paste page, and perform page parsing to obtain paste page information. The paste page information may include the APP category to which the user interface 860 belongs (i.e., communication APP), the type of content to be entered in the name input box 861 (such as a person's name), the type of content to be entered in the unit input box 862 (such as a company name), and the type of content to be entered in the mobile phone number input box 863 (such as a mobile phone number).
[0369] The electronic device 100 can copy the page information determined by the user interface 810 shown in FIG8A and the Figure 8GThe user interface 860 shown determines the paste page information, identifies the paste scenario as a contact adding scenario, and identifies the user's intention to save the contact information. Based on the above paste scenario and user intention, the electronic device 100 can generate extraction prompt information: extract the name, unit and mobile phone number of the contact to be added from the given content. The electronic device 100 inputs the copied content and the extraction prompt information into the language model, and the language model can be used to extract the content to be pasted from the copied content: Xiao Zhang, DD Company, 188********.
[0370] The electronic device 100 may provide the content to be pasted on the pasting page.
[0371] In a possible implementation, the electronic device 100 may provide part of the information in the content to be pasted as a paste option to the user. If the user selects the paste option, the electronic device 100 may fill in the multiple pieces of information in the content to be pasted into the Figure 8G In the multiple input boxes of the user interface shown.
[0372] For example, Figure 8G As shown, when jumping to the user interface 860, the electronic device 100 may provide a paste option 866 in the user interface 860. The content in the paste option 866 may include the contact name "Xiao Zhang" in the content to be pasted. The paste option 866 may be used to prompt the user to fill in the content to be pasted into the multiple input boxes in the user interface 860. Figure 8G The operation of selecting the paste option 866 is shown, and the electronic device 100 can display Figure 8H The user interface 860 shown. Figure 8H It can be seen that the electronic device 100 fills each piece of information in the content to be pasted into the corresponding input box in the user interface 860. Among them, the electronic device 100 fills in the name input box 861 with the name of the contact in the content to be pasted "Xiao Zhang", fills in the work unit of the contact in the content to be pasted "DD Company" in the unit input box 862, and fills in the mobile phone number of the contact in the content to be pasted "188********" in the mobile phone number input box 863.
[0373] Optionally, the electronic device 100 may also provide the user with multiple pieces of information in the content to be pasted as different paste options. The user may move the cursor 864 to the input box where information needs to be input, and then select the corresponding paste option to input the corresponding contact information in the input box.
[0374] Wherein, when the paste page contains multiple input boxes, the electronic device 100 may provide a paste option corresponding to the content to be pasted that matches the type of the content to be input in the input box where the input focus is located. Figure 8G In the example, user interface 860 includes a name input box 861, a unit input box 862, and a mobile phone number input box 863. In response to a click operation on name input box 861, electronic device 100 may determine that the input focus is located in name input box 861. Electronic device 100 may determine that the contact name "Xiao Zhang" in the content to be pasted matches name input box 861 (i.e., matches the type of content to be input in name input box 861). Electronic device 100 may provide a paste option corresponding to the contact name "Xiao Zhang" in user interface 860 (refer to Figure 8G Paste option 866 shown). In response to the operation of the paste option corresponding to the contact name "Xiao Zhang", the electronic device 100 can fill in the contact name "Xiao Zhang" in the name input box 861. Further, in response to the click operation on the unit input box 862, the electronic device 100 can determine that the input focus is located in the unit input box 862. Alternatively, when the corresponding content is entered in the above-mentioned name input box 861, the electronic device 100 can automatically move the input focus from the name input box 861 to the unit input box 862. The embodiment of the present application does not limit the method for the above-mentioned electronic device 100 to determine the input box where the input focus is located. The electronic device 100 can determine that the contact work unit "DD Company" in the above-mentioned content to be pasted matches the unit input box 862. The electronic device 100 can provide a paste option corresponding to the contact work unit "DD Company" in the user interface 860. In response to the operation of the paste option corresponding to the contact work unit "DD Company", the electronic device 100 can fill in the contact work unit "DD Company" in the unit input box 862. Similarly, when the input focus moves to the mobile phone number input box 863, the electronic device 100 may provide a paste option corresponding to the contact mobile phone number "188********" in the content to be pasted, so that the user can paste the contact mobile phone number "188********" in the mobile phone number input box 863. It can be seen that the user can paste the corresponding content one by one in multiple input boxes of the paste page according to the paste options corresponding to the content to be pasted that match the input box provided by the electronic device 100.
[0375] In another possible implementation, the electronic device 100 can provide the above content to be pasted to the user in full, so that the user can confirm whether the content to be pasted is the content that the user needs to paste. Then the user can fill in multiple pieces of information in the content to be pasted into the Figure 8G In the multiple input boxes of the user interface shown.
[0376] For example, Figure 8I As shown, in response to Fig.8F The operation of adding control 851 shown in FIG. 1 may cause the electronic device 100 to display Figure 8IThe user interface 870 shown in FIG. 870 may include a name input box 871, a unit input box 872, a mobile phone number input box 873, and a prompt box 874. The name input box 871, the unit input box 872, and the mobile phone number input box 873 may refer to the aforementioned Figure 8G The name input box 861, the unit input box 862, and the mobile phone number input box 863 are shown. The prompt box 874 may include a display area 874A for content to be pasted, a confirmation control 874B, and a close control 874C. Among them, the display area 874A for content to be pasted may display the content to be pasted (such as contact name, work unit, and mobile phone number) extracted by the electronic device 100. The confirmation control 874B can be used to input each piece of information in the above content to be pasted into the name input box 871, the unit input box 872, and the mobile phone number input box 873 respectively. The close control 874C can be used to trigger the electronic device 100 to close the prompt box 874. In response to an operation on the confirmation control 874B, such as a click operation, the electronic device 100 can fill in the above content to be pasted in the input box in the user interface 870 (refer to Figure 8H User interface 860 shown).
[0377] It can be seen that the above embodiment can improve the efficiency of users in creating and saving contact information. After the user copies the text containing contact information, the user can quickly input multiple pieces of information to be pasted in the copied content into corresponding input boxes.
[0378] In some embodiments, Fig. 8A The copied content shown may belong to the electronic device 100 display Figure 8B The user interface 820 shown in the figure shows the most recent m1 copies of the content, and may belong to the electronic device 100 display Fig. 8E The most recent m1 copies of the user interface 840 shown in the figure may also belong to the electronic device 100 display Figure 8G The most recent m1 copies of the content before the user interface 860 shown. The above m1 can be a positive integer. Optionally, Figure 8B The user interface 820 shown, Fig. 8E The user interface 840 shown, Figure 8G The user interfaces 860 shown can all be the electronic device 100 detecting Fig. 8A The interface shown is displayed within a preset time period after the copy operation.
[0379] By the above FIG. 8A to FIG. 8I As shown in the scenario, users can directly copy Fig. 8AThe entire text in the text message 811 shown in the figure can be copied without adjusting the selected and copied text by moving the cursor. After the user copies all the contents in the text message 811, the relevant contact information can be quickly entered in multiple input boxes of the paste page through the content to be pasted provided by the electronic device 100. In this way, when the text message 811 contains multiple pieces of information that the user needs to copy and paste, the user only needs to perform a copy operation once, and the multiple pieces of information that need to be pasted in the copied content can be pasted in multiple input boxes of the paste page. The user does not need to repeatedly switch between the text message application and the application that needs to paste the information (such as the above-mentioned application E, the contact application, etc.) to perform multiple copy and paste operations. The above method can effectively improve the efficiency of user copy and paste and improve the user's copy and paste experience.
[0380] Paste scene 6: information entry scene
[0381] Figures 9A to 9H The following is a schematic diagram showing some information entry scenarios by way of example.
[0382] like Fig. 9A As shown, the electronic device 100 can display a user interface 910. The user interface 910 can be a chat interface with the user "Zhang San" in an instant messaging application. The user interface 910 can include chat records 911 to 913. It can be seen that chat records 911 to 913 can be personal identity information sent by the user "Zhang San". Among them, chat record 911 includes the name of the user "Zhang San". Chat record 912 includes the mobile phone number of the user "Zhang San". Chat record 913 includes the ID number of the user "Zhang San".
[0383] like Fig. 9B As shown, the electronic device 100 may also display a user interface 920. The user interface 920 may be a chat interface with the user "Li Si" in an instant messaging application. The user interface 920 may include chat records 921 to 923. It can be seen that chat records 921 to 923 may be personal identity information sent by the user "Li Si". Among them, chat record 921 includes the name of the user "Li Si". Chat record 922 includes the mobile phone number of the user "Li Si". Chat record 923 includes the ID number of the user "Li Si".
[0384] like Fig. 9C As shown, the user can copy the personal identity information of the user "Zhang San" and the personal identity information of the user "Li Si" multiple times. Fig. 9AWhen the user interface 910 is shown, the electronic device 100 can store the entire text of the chat record 911 to the clipboard in response to the user's operation of copying the chat record 911. Similarly, the electronic device 100 can store the entire text of the chat record 912 and the chat record 913 to the clipboard in response to the user's operation of copying the chat record 912 and the chat record 913 respectively. Fig. 9B When the user interface 920 is shown, the electronic device 100 can store all the texts of chat records 921 to 921 to the clipboard in response to the user's operation of copying chat records 921 to 921 respectively.
[0385] Among them, chat record 911 may be the copied content of the first copy. Chat record 912 may be the copied content of the second copy. Chat record 913 may be the copied content of the third copy. Chat record 921 may be the copied content of the fourth copy. Chat record 922 may be the copied content of the fifth copy. Chat record 923 may be the copied content of the sixth copy. User interface 910 and user interface 920 are both copy pages.
[0386] By the aforementioned Figure 3A As can be seen from the method shown, the electronic device 100 can perform page analysis on the user interface 910 to obtain the copy page information of the user interface 910. The electronic device 100 can also perform page analysis on the user interface 920 to obtain the copy page information of the user interface 920.
[0387] Here is the user copy Fig. 9A Chat records 911 to 913 shown and Fig. 9B The chat records 921 to 923 shown are explained by taking the example of opening the information entry application in the electronic device 100.
[0388] like Fig.9DAs shown, the electronic device 100 can display a user interface 930. The user interface 930 can be a user interface for information entry in the above-mentioned information entry application. The user interface 930 can include a name input box 931, a certificate type input box 932, a certificate number input box 933, a gender input box 934, a birthday input box 935, a region input box 936, a mobile phone number input box 937, and a cursor 931A. Among them, the name input box 931 can be used to enter the user's name. The certificate type input box 932 can be used to enter the user's certificate type (such as an ID card). The certificate number input box 933 can be used to enter the user's certificate number. The gender input box 934 can be used to enter the user's gender. The birthday input box 935 can be used to enter the user's birthday. The region input box 936 can be used to enter the user's region. The mobile phone number input box 937 can be used to enter the user's mobile phone number. The cursor 931A can be used to indicate the input box where the input focus is located.
[0389] The electronic device 100 can perform page parsing with the user interface 930 as the pasting page to obtain the pasting page information. The pasting page information may include the APP category (i.e., information entry APP) described in the user interface 930 and the type of content to be input in the input box included in the user interface 930.
[0390] The electronic device 100 may be configured according to Fig. 9A The copied page information determined by the user interface 910 shown in FIG. Fig. 9B The copied page information determined by the user interface 920 and the Fig.9D The user interface 930 determines the pasted page information, identifies the pasting scenario as an information entry scenario, and identifies the user intention as the intention to enter user information. Based on the above pasting scenario and user intention, the electronic device 100 can generate extraction prompt information: extract user information from the given content. The electronic device 100 copies the content (i.e. Fig. 9A Chat records 911 to 913 shown and Fig. 9B The chat records 921 to 923 shown in the figure and the extraction prompt information are input into the language model, and the content to be pasted can be extracted from the copied content through the language model. The content to be pasted may include the personal identity information of the user "Zhang San" and the personal identity information of the user "Li Si".
[0391] The electronic device 100 may provide the content to be pasted on the pasting page.
[0392] In a possible implementation, the electronic device 100 may provide the user with a paste option for indicating the information of the user "Zhang San" and a paste option for indicating the information of the user "Li Si". In this way, the user can input multiple pieces of information of one user in the content to be pasted in multiple input boxes of the user interface 930 through the above paste options.
[0393] For example, Fig.9D As shown, electronic device 100 may display paste option 938 and paste option 939 on user interface 930. Paste option 938 may be used to indicate information of user "Zhang San". Paste option 939 may be used to indicate information of user "Li Si". Fig.9D As shown, when the paste option 938 is operated, such as a click operation, the electronic device 100 may display Fig.9E The user interface 930 shown. Fig.9E It can be seen that the electronic device 100 fills the information of the user "Zhang San" in the content to be pasted (such as name, ID number, mobile phone number) into the corresponding input box in the user interface 930.
[0394] In another possible implementation, the electronic device 100 may also provide the user with multiple pieces of information in the above-mentioned content to be pasted as different paste options. The user may move the cursor 931A to the input box where information needs to be input, and then select the corresponding paste option to enter the corresponding contact information in the input box. Among them, the electronic device 100 may provide a paste option corresponding to the information matching the type in the content to be pasted according to the type of content to be input in the input box where the cursor 931A is located. The above-mentioned matching with the type of content to be input in the input box may be referred to as matching with the input box.
[0395] For example, Fig.9D As shown in FIG. 1 , when cursor 931A is located at name input box 931, electronic device 100 can filter out information matching name input box 931 (i.e., the user's name) from the content to be pasted, thereby providing paste option 938 and paste option 939. Paste option 938 can be a paste option corresponding to the name of user "Zhang San". Paste option 939 can be a paste option corresponding to the name of user "Li Si". Fig.9D For the operation of the paste option 938, the electronic device 100 may display Fig.9F The user interface 930 shown. Fig.9F It can be seen that the electronic device 100 inputs the name of the user "Zhang San" in the name input box 931 according to the paste option 938. In addition, the electronic device 100 can move the cursor 931A from Fig.9D Move the position shown to Fig.9FThe electronic device 100 can filter out information that matches the certificate number input box 933 (i.e., the user's ID number) from the content to be pasted, thereby providing a paste option 941. Paste option 941 can be a paste option corresponding to the ID number of the user "Zhang San". It can be understood that since the electronic device 100 has entered the name of the user "Zhang San" in the name input box 931, the information entered by the electronic device 100 in other input boxes in the user interface 930 should all be the information of the user "Zhang San". Then, when the electronic device filters out information that matches the certificate number input box 933 from the content to be pasted, it can only filter out the ID number of the user "Zhang San".
[0396] like Fig.9F As shown, in response to the operation of the paste option 941, the electronic device 100 may display Figure 9G The user interface 930 shown. Figure 9G It can be seen that the electronic device 100 can input the ID number of the user "Zhang San" in the ID number input box 933 according to the position of the cursor 931A. The contents in the gender input box 934 and the birthday input box 935 can both be determined based on the ID number input in the ID number input box 933. Therefore, the electronic device 100 can input the ID number of the user "Zhang San" in the ID number input box 933, input the gender of the user "Zhang San" (such as "male") in the gender input box 934, and input the birthday of the user "Zhang San" in the birthday input box 935. In addition, the electronic device 100 can move the cursor 931A from Fig.9F Move the position shown to Figure 9G The electronic device 100 can filter out information matching the mobile phone number input box 937 (i.e., the user's mobile phone number) from the content to be pasted, thereby providing a paste option 942. The paste option 942 can be a paste option corresponding to the mobile phone number of the user "Zhang San". Figure 9G As shown in the operation of the paste option 942 , the electronic device 100 can input the mobile phone number of the user “Zhang San” in the mobile phone number input box 937 .
[0397] Optionally, the electronic device 100 can also provide the above-mentioned content to be pasted to the user in full, so that the user can confirm whether the content to be pasted is the content that the user needs to paste. Then the user can fill in multiple pieces of information in the content to be pasted into the Fig.9D The method can refer to the aforementioned Figure 8I An introduction to the embodiments of the present invention.
[0398] In some embodiments, when the user follows the above Figure 9D to Figure 9HIn the scenario shown, the information of the user "Zhang San" is entered into the information entry application. When the electronic device 100 opens the user interface for entering information in the information entry application again, the content to be pasted as prompted above can be filtered. Among them, the electronic device 100 can filter out the information that has been pasted in the content to be pasted, thereby providing a paste option corresponding to the information that has not been pasted (that is, the information that has not been entered) in the user interface for entering information, so that the user can continue to enter the user's information that has not been entered. The above filtering method can refer to the above Figure 3E The method shown is described.
[0399] For example, Figure 9H As shown, the electronic device 100 displays the user interface 930 again. The electronic device 100 can provide a paste option 943 according to the filtered content to be pasted. The paste option 943 can be a paste option corresponding to the information of the user "Li Si". The electronic device 100 can input the information of the user "Li Si" in the input box in the user interface 930 in response to the operation of the paste option 943.
[0400] By the above Figures 9A to 9H As can be seen from the scenario shown, the electronic device 100 can use the multiple copied contents in the clipboard to extract the content to be pasted. In this way, when a user interface contains multiple pieces of information that need to be copied, the user can perform multiple copy operations and then open the paste page that needs to be pasted, so as to quickly paste the multiple copied contents into one or more input boxes in the paste page. The user does not need to repeatedly switch between the copy page (such as the chat page of the instant messaging application) and the paste page (such as the page of the information entry application). The above method can effectively improve the efficiency of user copy and paste and improve the user's copy and paste experience.
[0401] It is understandable that the pasting method provided in the embodiment of the present application is not limited to the above-mentioned pasting scenes 1 to 6, and the pasting method provided in the embodiment of the present application can also be applied to other scenes. The embodiment of the present application does not limit this.
[0402] It is understandable that the various user interfaces described in the embodiments of the present application are only example interfaces and do not limit the present application scheme. In other embodiments, the user interface may adopt a different interface layout, may include more or fewer controls, and may increase or decrease other functional options, as long as they are based on the same inventive concept provided by the present application, they are all within the scope of protection of the present application.
[0403] It should be noted that, without causing any contradiction or conflict, any feature in any embodiment of the present application, or any part of any feature, can be combined, and the combined technical solution is also within the scope of the embodiments of the present application.
[0404] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for pasting clipboard contents, characterized in that: The method comprises: The electronic device receives a first operation on a first content on a first page, and stores the first content in a clipboard; The electronic device receives a second operation of entering a second page, and displays the second page; The electronic device provides a first paste option on the second page, the first paste option is used to paste second content, the second content is obtained after the first content is processed, and the second content is related to the second page; The electronic device receives a third operation of entering a third page, and displays the third page; The electronic device provides a second paste option on the third page, where the second paste option is used to paste third content, where the third content is obtained after processing the first content, and the third content is related to the third page.
2. The method according to claim 1, characterized in that: Before the electronic device provides the first paste option on the second page, the method further includes: The electronic device extracts fourth content from the first content according to the first page and the second page, The second content is the fourth content, or is content obtained after processing the fourth content.
3. The method according to claim 2, characterized in that The method further comprises: The electronic device determines that the fourth content has one or more errors by using a public knowledge base, and performs error correction on the fourth content, wherein the public knowledge base includes public knowledge in one or more fields.
4. The method according to claim 3, characterized in that The method further comprises: The electronic device uses the user's personal knowledge base and / or the public knowledge base to supplement the sixth content in the fifth content to obtain the second content, and the fifth content is the content obtained by performing the error correction processing on the fourth content; the user's personal knowledge base includes one or more of the following user information: user's age group, user's home and company address, user preferences, and user habits.
5. The method according to claim 2, characterized in that: The method further comprises: The electronic device uses the user's personal knowledge base and / or the public knowledge base to supplement the seventh content in the fourth content to obtain the second content, and the user's personal knowledge base contains one or more of the following user information: user's age group, user's home and company address, user preferences, user habits, and the public knowledge base contains public knowledge in one or more fields.
6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: The electronic device determines, based on a user personal knowledge base, that the user's preference for the eighth content is higher than the preference for the second content, the user personal knowledge base comprising one or more of the following user information: the user's age group, the user's home and company address, the user's preferences, and the user's habits, the eighth content is obtained after processing the first content, and the eighth content is related to the second page; The electronic device provides a first paste option on the second page, specifically including: The electronic device provides the first paste option and a third paste option on the second page, and the third paste option is used to paste the eighth content; wherein a display position of the third paste option is higher than a display position of the first paste option.
7. The method according to any one of claims 1 to 6, characterized in that The electronic device provides a first paste option on the second page, specifically including: The electronic device provides the first paste option and a fourth paste option on the second page, the fourth paste option is used to paste a ninth content, the ninth content is obtained after processing the first content, and the ninth content is related to the second page; After the electronic device provides the first paste option on the second page, the method further includes: The electronic device receives an operation on the first paste option, and pastes the second content in an input box on the second page; After the electronic device exits the second page, it receives an operation of entering the second page again, and displays the second page; The electronic device provides the fourth paste option on the second page, wherein the paste options on the second page do not include the first paste option.
8. The method according to any one of claims 1 to 7, characterized in that The method further comprises: The electronic device provides a first paste option on the second page, specifically including: The electronic device provides the first paste option and a fifth paste option on the second page, the fifth paste option is used to paste a tenth content, the tenth content is obtained after processing the first content, and the tenth content is related to the second page; After the electronic device provides the first paste option on the second page, the method further includes: The electronic device receives the operation on the first paste option, pastes the second content in the input box of the second page, and jumps to the fourth page; The electronic device provides the fifth paste option on the fourth page, wherein the paste options on the fourth page do not include the first paste option.
9. The method according to any one of claims 2 to 8, characterized in that: The electronic device extracts fourth content from the first content according to the first page and the second page, specifically including: The electronic device determines first page information according to the first page, and determines second page information according to the second page; The electronic device identifies a first pasting scenario and a first user intention according to the first page information and the second page information; The electronic device determines first extraction prompt information according to the first pasting scenario and the first user intention; The electronic device extracts the fourth content from the first content using a language model according to the first extraction prompt information.
10. The method according to any one of claims 9, characterized in that The first page information includes the first content and / or context information of the first content, and the second page information includes one or more of the following: the APP category to which the second page belongs, the type of content to be entered in the input box of the second page, and operation information related to the second page.
11. The method according to any one of claims 1 to 10, characterized in that Before the electronic device provides the first paste option on the second page, the method further includes: The electronic device receives an operation on the first input box on the second page; After the electronic device provides the first paste option on the second page, the method further includes: The electronic device receives an operation on the first paste option and pastes the second content in the first input box.
12. The method according to claim 11, characterized in that The second page also includes a second input box, and the method further includes: The electronic device receives an operation on the second input box, and provides a sixth paste option on the second page, where the sixth paste option is used to paste an eleventh content, where the eleventh content is obtained after processing the first content, and the eleventh content is related to the second page; The electronic device receives an operation on the sixth paste option, and pastes the eleventh content in the second input box.
13. The method according to any one of claims 1 to 10, characterized in that The second page includes n1 input boxes, where n1 is a positive integer greater than 1, and the second content includes n1 pieces of information; after the electronic device provides the first paste option on the second page, the method further includes: The electronic device receives an operation on the first paste option, and pastes the n1 pieces of information in the n1 input boxes respectively.
14. The method according to any one of claims 1 to 13, characterized in that The first content belongs to the most recent m1 copied or cut content before the electronic device displays the second page, where m1 is a positive integer, or the second page is a page displayed by the electronic device within a first time period after receiving the first operation.
15. The method according to any one of claims 1 to 14, characterized in that The method further comprises: The electronic device receives an operation on a twelfth content on a fifth page, and stores the twelfth content in a clipboard, wherein the fifth page is the same as or different from the first page, and the twelfth content is different from the first content; The electronic device receives an operation of entering a sixth page and displays the sixth page; The electronic device provides a seventh paste option and an eighth paste option on the sixth page, the seventh paste option is used to paste a thirteenth content, the eighth paste option is used to paste a fourteenth content, the thirteenth content is obtained after processing the first content, the thirteenth content is related to the sixth page, and the fourteenth content is obtained after processing the twelfth content, and the fourteenth content is related to the sixth page.
16. An electronic device, characterized in that: The electronic device includes a display screen, a memory and a processor, wherein the display screen is used to display application pages; the memory is used to store computer programs; and the processor is used to call the computer program so that the electronic device executes the method described in any one of claims 1-15.
17. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 15.
18. A computer program product, characterized in that The computer program product comprises computer instructions, and when the computer instructions are run on an electronic device, the electronic device executes the method according to any one of claims 1 to 15.
Citation Information
Cited By
Clipboard content pasting method and related apparatus
EP4693048A1
Clipboard content pasting method and related apparatus
WO2025007787A1