Information display method and device
By determining keywords on the first page of the electronic device and matching them with the database, and directly displaying relevant information, the problem of cumbersome cross-application information input is solved, and the input efficiency and information accuracy are improved.
Patent Information
- Application Number
- CN202411418155.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-11
- Publication Date
- 2025-02-11
AI Technical Summary
In the prior art, the process of inputting information across applications is cumbersome and time-consuming, resulting in low efficiency in inputting information of electronic devices.
By determining M first keywords in the first page and matching them with the keywords in the first database, information associated with these keywords is obtained directly from the database and displayed in the first page.
Simplifies the steps to obtain information from other applications, improves the efficiency of information input across applications, and ensures the accuracy of information.
Smart Images

Figure CN119415201A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of artificial intelligence technology, and specifically relates to an information display method and device thereof. Background Art
[0002] Currently, when an electronic device displays an application interface, if a user wants to display information in another application in the application interface, the user can display the information in the required application interface by copying and pasting. For example, when a conversation application interface is displayed, if a user wants to enter the contact information of another contact in an input box, the user can search for the contact's phone number through the phone application, copy the phone number, and then paste the phone number in the required application interface; thus, the phone number can be displayed in the above application interface.
[0003] However, since the above method requires multiple steps to complete the display of cross-application information, the process of cross-application information input is relatively cumbersome and time-consuming. As a result, the efficiency of cross-application information input in electronic devices is low. Summary of the invention
[0004] The purpose of the embodiments of the present application is to provide an information display method and device thereof, which can improve the efficiency of information input across applications of an electronic device.
[0005] In a first aspect, an embodiment of the present application provides an information display method, which includes: determining M first keywords based on the page content of a first page, where M is a positive integer; when the M first keywords match the keywords in a first database, determining first information associated with the M first keywords from the first database based on the M first keywords; and displaying the first information on the first page.
[0006] In a second aspect, an embodiment of the present application provides an information display device, which includes: a determination module and a display module. The determination module is used to determine M first keywords based on the page content of the first page, where M is a positive integer; when the M first keywords match the keywords in the first database, first information associated with the M first keywords is determined from the first database based on the M first keywords. The display module is used to display the first information determined by the determination module on the first page.
[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0009] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.
[0010] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.
[0011] In an embodiment of the present application, M first keywords can be determined based on the page content of the first page, where M is a positive integer; then, when the M first keywords match the keywords in the first database, first information associated with the M first keywords is determined from the first database based on the M first keywords; finally, the first information is displayed in the first page. In this solution, when the M first keywords in the first page match the keywords in the first database, the user's input intention can be determined, that is, the user wants to input information associated with the M first keywords; therefore, the electronic device can directly display the first information associated with the M first keywords from the first database in the first page, without the user having to manually obtain the first information from other applications, thereby simplifying the steps of obtaining the first information from other applications, thereby improving the efficiency of cross-application information input. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figure 1 It is one of the flow charts of an information display method provided in an embodiment of the present application;
[0013] Figure 2 This is the second flowchart of an information display method provided in an embodiment of the present application;
[0014] Figure 3 This is a flowchart of a method for displaying information provided by an embodiment of the present application;
[0015] Figure 4 This is one of the example diagrams of a conversation interface provided in an embodiment of the present application;
[0016] Figure 5 This is one of the example diagrams of a form interface provided in an embodiment of the present application;
[0017] Figure 6 This is a fourth flowchart of an information display method provided in an embodiment of the present application;
[0018] Figure 7 This is a second example diagram of a conversation interface provided in an embodiment of the present application;
[0019] Figure 8 This is a second example diagram of a form interface provided in an embodiment of the present application;
[0020] Fig. 9 This is a third example diagram of a form interface provided in an embodiment of the present application;
[0021] Fig.10 This is the fifth flow chart of an information display method provided in an embodiment of the present application;
[0022] Fig.11 is a structural schematic diagram of an information display device provided in an embodiment of the present application;
[0023] Fig.12 This is one of the hardware structure diagrams of an electronic device provided in an embodiment of the present application;
[0024] Fig.13 This is the second schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0025] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0026] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0027] The terms "at least one (item)", "at least one of" and the like in the specification and claims of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".
[0028] The information display method, device, electronic device and storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.
[0029] The information display method and device provided in the embodiments of the present application can be applied in information filling scenarios, such as text filling scenarios, picture filling scenarios, number filling scenarios, and document filling scenarios.
[0030] With the rapid development and popularization of electronic devices, users need to frequently fill in and submit various types of information in various application scenarios in daily life. Usually, the content that users need to enter includes: ID number, phone number, contact address, bank card number and other text information. In addition, in some scenarios, users also need to upload image files such as photos of the front and back of their ID card and driver's license photos.
[0031] In a chat scenario, users may need to send information such as phone numbers or home addresses to the other party. In most cases, users need to manually enter this information through the input method, or switch to other applications to copy the corresponding information, and then return to the chat window to paste it, which is cumbersome and time-consuming. If you need to share files such as ID photos, users must also enter the album to find the target photo, and then share it through a series of steps.
[0032] When filling out forms, whether in shopping applications or web forms, users usually need to enter information such as name, ID number, address, etc. line by line. For sensitive data with long characters, such as ID number or bank card number, users not only need to spend a lot of time to enter, but also need to carefully check whether the input content is correct. The process is cumbersome and it is easy to cause input errors due to misoperation.
[0033] However, although current electronic devices can meet the information input needs of users in different scenarios, in most cases, the input method still relies on manual operation or copy and paste, which has many obvious defects. First, manual input is not only time-consuming and complicated, but also easy to cause multiple modifications and checks due to input errors, especially for data with long characters or complex structures, such as ID card numbers, bank card numbers, etc., which significantly increases the complexity of user operations. Especially in chat scenarios, frequent switching of applications for copy and paste operations affects the user's coherent operation experience. In addition, the sharing of image files also faces the problem of multi-step operations.
[0034] In the information display method and device provided in the embodiments of the present application, when the M first keywords in the first page match the keywords in the first database, the user's input intention can be determined, that is, the user wants to input information associated with the M first keywords; therefore, the electronic device can directly display the first information associated with the M first keywords from the first database directly on the first page, without the user having to manually obtain the first information from other applications, thus simplifying the steps of obtaining the first information from other applications, thereby improving the efficiency of cross-application information input. Furthermore, since the above-mentioned first information is obtained from the first database, there is no need for the user to manually input it, which simplifies the input process and can also ensure the accuracy of the first information.
[0035] The information display method provided in the embodiment of the present application may be executed by an information display device, which may be an electronic device or a functional module in an electronic device. The technical solution provided in the embodiment of the present application is described below using an electronic device as an example.
[0036] The present application embodiment provides an information display method. Figure 1 FIG. 1 is a flow chart of an information display method provided by an embodiment of the present application. Figure 1 As shown, the information display method provided in the embodiment of the present application may include the following steps 201 to 203.
[0037] Step 201: The electronic device determines M first keywords based on the page content of the first page, where M is a positive integer.
[0038] In the embodiment of the present application, when displaying the first page, the electronic device can determine M first keywords based on the page content of the first page.
[0039] Optionally, in an embodiment of the present application, the first page may be any page in the first application.
[0040] Optionally, in the embodiment of the present application, the first application may be any application in the electronic device.
[0041] Optionally, in the embodiment of the present application, the first application may be any one of the following: a chat application, a shopping application, a browser application, or an e-book application, etc. The specific application may be determined according to actual usage, and the embodiment of the present application does not limit this.
[0042] Exemplarily, when the first application is a chat application, the first page may be a conversation page; when the first application is a shopping application, the first page may be a delivery address editing page; when the first application is a browser application, the first page may be an A qualification certificate registration page.
[0043] Optionally, in the embodiment of the present application, the above page content may include at least one of the following: text, picture, form, video, audio, symbol, emoticon package, etc. The specific content may be determined according to actual usage, and the embodiment of the present application does not limit it.
[0044] Exemplarily, when the first page is a conversation page, the page content may be a conversation message; when the first page is a delivery address editing page, the page content may be a delivery address form; when the first page is an A qualification certificate registration page, the page content may be a registration form.
[0045] Optionally, in an embodiment of the present application, the M first keywords may be directly extracted from the first page; or, the M first keywords may be generated based on the page content of the first page.
[0046] Optionally, in an embodiment of the present application, when displaying the first page, the electronic device may receive user input on the first page, so that the electronic device may enter a smart fill mode, in which the electronic device may determine M first keywords.
[0047] In one example, the first page may include a smart fill control, and a user may make a first input to the smart fill control so that the electronic device may enter a smart fill mode, and the electronic device may determine M first keywords.
[0048] In another example, the first page may include an input method control, and the user may make a first input to the input method control so that the electronic device may enter a smart fill mode, and the electronic device may determine M first keywords.
[0049] Optionally, in an embodiment of the present application, the above-mentioned first input includes but is not limited to: a click input of the above-mentioned control (smart fill control or input method control) by a user through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible input, which can be determined based on actual usage requirements and is not limited in the embodiment of the present application.
[0050] In some embodiments of the present application, the above-mentioned specific gesture can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture.
[0051] In some embodiments of the present application, the click input may be a single click input, a double click input, or any number of click inputs, etc., and may also be a long press input or a short press input. For example, the first input may be a single click input of the user to the control.
[0052] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Figure 2 As shown, the above step 201 can be specifically implemented through the following steps 201a and 201b.
[0053] Step 201a: The electronic device determines an information input scenario corresponding to the page content based on the page content.
[0054] Optionally, in an embodiment of the present application, the above-mentioned information input scenario can be any one of the following: a chat input scenario or a form input scenario.
[0055] For example, the chat input scenario may be a scenario of inputting text, pictures or documents in a conversation interface, which may be determined according to actual usage, and is not limited in the present application.
[0056] For example, the above form input scenario can be a scenario of filling in a delivery address of a shopping application, a scenario of filling in a form of a login or registration page, a scenario of filling in a personal information form, etc. The specific scenario can be determined according to actual usage, and the embodiment of the present application is not limited thereto.
[0057] In the embodiment of the present application, the electronic device can determine the information input scenario corresponding to the page content based on the content elements of the page content.
[0058] Optionally, in the embodiment of the present application, the above-mentioned content element includes at least one of the following: text, picture, audio, video, etc. The specific content element can be determined according to actual usage, and the embodiment of the present application does not limit it.
[0059] Optionally, in an embodiment of the present application, the electronic device may input content elements into a first algorithm to determine an information input scenario through the first algorithm.
[0060] Optionally, in an embodiment of the present application, the first algorithm may be any one of the following: an artificial intelligence (AI) algorithm, a neural network algorithm or a large model.
[0061] Exemplarily, taking the content element as text, the electronic device can input the content element into the neural network algorithm, and the neural network algorithm can perform convolution processing on the text to extract the semantic information of the text. If the neural network algorithm determines through the semantic information that it is interactive semantics, that is, question and answer, then the neural network algorithm can output the information input scene as a chat input scene; if the neural network algorithm determines through the semantic information that the above text belongs to a field, that is, a single noun, then the neural network algorithm can output the information input scene as a form input scene.
[0062] Optionally, in an embodiment of the present application, the electronic device may determine the information input scenario through the application type of the first application and the user interface (UI) elements of the first page.
[0063] Optionally, in an embodiment of the present application, the electronic device may determine the application type of the first application through the installation package of the first application; or, the electronic device may determine the application type of the first application through the main function of the first application.
[0064] Optionally, in an embodiment of the present application, the above-mentioned UI element may include at least one of the following: a page layout of the first page, a layout method of page content in the first page, and a control in the first page.
[0065] For example, when it is detected that the first application running in the foreground is a chat application, and there is a text input box and dialogue bubbles arranged vertically on the first page, the electronic device can determine it as a chat input scene; when it is detected that the first application running in the foreground is a shopping application, and the UI elements are multiple continuous input boxes and labels (such as name, phone number, address, etc.), the electronic device can determine it as a form input scene. It should be noted that if a form is filled in a chat application, it is also determined to be a form scene.
[0066] Step 201b: The electronic device extracts keywords from the page content based on the information input scenario to obtain M first keywords.
[0067] In the embodiment of the present application, the electronic device can obtain M first keywords according to the keyword extraction rule corresponding to the information input scenario.
[0068] Optionally, in an embodiment of the present application, the electronic device may extract keywords from the page content using the first algorithm to obtain M first keywords.
[0069] Exemplarily, after the neural network algorithm determines the information input scenario, the neural network algorithm may use nouns in the page content as keywords, and then extract M nouns in the page content to obtain M first keywords.
[0070] Optionally, in an embodiment of the present application, the electronic device may extract different keywords according to different information input scenarios.
[0071] In the embodiment of the present application, the electronic device can obtain different keywords according to different information input scenarios, which improves the flexibility of the electronic device in obtaining keywords, and the keywords obtained according to the information input scenario are more in line with user needs.
[0072] Optionally, in the embodiment of the present application, combined with Figure 2 ,like Figure 3 As shown, the above step 201b can be specifically implemented through the following step 201b1 or step 201b2.
[0073] Step 201b1: When the information input scenario is a conversation input scenario, the electronic device extracts keywords from the conversation message content in the first page to obtain M first keywords.
[0074] In the embodiment of the present application, when the information input scenario is a conversation input scenario, the electronic device can extract all nouns in the current conversation message content in the first page as M first keywords.
[0075] For example, Figure 4 As shown, taking the electronic device as a mobile phone as an example, when displaying a conversation interface 10 with Xiaohong, the conversation interface 10 includes three conversation messages, namely "Are you there?", "Yes, what's the matter?" and "Please send me Wang Wu's phone number"; at this time, the mobile phone can determine the nouns in the three messages, namely "Wang Wu" and "phone number", and then, the mobile phone can determine "Wang Wu" and "phone number" as keywords and extract "Wang Wu" and "phone number".
[0076] Step 201b2: When the information input scenario is a form input scenario, the electronic device obtains fields in the form information in the first page to obtain M first keywords.
[0077] In the embodiment of the present application, when the information input scenario is a form input scenario, the electronic device can extract all nouns (ie, the above-mentioned fields) in the form information in the first page as M first keywords.
[0078] For example, Figure 5As shown, when the mobile phone displays the information login table page 11, the information login table page 11 contains 5 fields, namely "name", "telephone number", "ID number", "ID photo" and "contact information". At this time, the mobile phone can determine the nouns in the information login table page 11, that is, the above 5 fields; then, the mobile phone can determine the above 5 fields as keywords and extract the above 5 fields.
[0079] In the embodiment of the present application, the electronic device can extract keywords through different keyword extraction methods according to different information input scenarios, thereby improving the flexibility and accuracy of the electronic device in acquiring keywords.
[0080] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Figure 6 As shown, the above step 201 can be specifically implemented through the following steps 301 and 302.
[0081] Step 301: The electronic device determines intent information based on page content.
[0082] In the embodiment of the present application, the above-mentioned intention information is used to characterize the intention of the user inputting information.
[0083] In an embodiment of the present application, the electronic device can input the above page content into a large model to obtain intent information.
[0084] Exemplarily, the electronic device may input the page content into a large model, and the large model may determine semantic information corresponding to the page content based on the page content, and then determine the intent information based on the semantic information.
[0085] For example, assuming the above semantic information is "send Zhang San's phone number", the intention information is "find Zhang San's phone number".
[0086] Optionally, in an embodiment of the present application, when the information input scenario is a conversation input scenario, the electronic device may input the historical chat records and the conversation messages of the first page into the large model to obtain intent information.
[0087] Exemplarily, the electronic device can obtain the intention information through the instruction of Prompt.
[0088] Prompt: Please provide information based on the user's chat history and current conversation messages.
[0089] Suppose there is the following conversation in a chat scenario: User A: Do you know Zhang San? User B: Yes, what can I do for you? User A: Can you send me his phone number? At this point, the intent information output by the big model is: send Zhang San’s phone number.
[0090] Step 302: The electronic device generates M first keywords based on the intention information.
[0091] In the embodiment of the present application, the electronic device may extract nouns from the intent information and then use the nouns as the M first keywords.
[0092] Exemplarily, the above intention information is: send a phone number to Zhang San, then the M first keywords are "Zhang San" and "phone number".
[0093] Optionally, in an embodiment of the present application, when the information input scenario is a conversation input scenario, the electronic device can generate M first keywords through intent information; or, when the information input scenario is a form input scenario, the electronic device can also generate M first keywords through intent information.
[0094] In the embodiment of the present application, the electronic device can generate M first keywords through the intent information. When there is no clear keyword in the first page, the electronic device can also determine the M first keywords through the intent information, which improves the flexibility of the electronic device in determining the M first keywords. Moreover, the keywords determined through the intent information can better meet the needs of users.
[0095] Step 202: When the M first keywords match the keywords in the first database, the electronic device determines first information associated with the M first keywords from the first database based on the M first keywords.
[0096] In the embodiment of the present application, the matching of the M first keywords with the keywords in the first database refers to a one-to-one matching of the M first keywords with the M keywords in the first database.
[0097] Optionally, in an embodiment of the present application, the above-mentioned matching means that the similarity between the M first keywords and the keywords in the first database is greater than or equal to a first threshold.
[0098] For example, assuming that the M first keywords are "name" and "telephone number", and the keywords in the first database include "name", "telephone number", "address", and "email address", after the electronic device obtains the first keywords "name" and "telephone number", it can calculate the similarity value between the first keyword "name" and all the keywords in the first database, and then determine that the keywords with a similarity value greater than 90% match the first keyword "name". The first keyword "telephone number" is similar, and it will not be repeated here to avoid repetition.
[0099] In the embodiment of the present application, the electronic device searches the first database based on M first keywords to obtain the first information.
[0100] Optionally, in an embodiment of the present application, the above-mentioned first information may be one or more.
[0101] Exemplarily, when the electronic device determines that the first keyword is "Wang Wu" and "telephone number", the electronic device can perform a fuzzy search in the first database, and then retrieve "name": Wang Wu, "telephone number": 18000003333, that is, the above-mentioned first information.
[0102] As another example, when the electronic device determines that the first keyword is "Wang Wu" and "ID card photo", the electronic device can perform a fuzzy search in the first database, and then the electronic device will retrieve the "name": Wang Wu, "ID card photo": ID card front side picture IMG_001.jpg and ID card back side photo IMG_002.jpg, that is, the above-mentioned first information.
[0103] As another example, when the electronic device determines that the first keyword is "name", "telephone number", "ID number" and "contact address", the electronic device can perform a fuzzy search in the first database, and then the electronic device will retrieve two records, namely:
[0104] Record 1: Name: Zhang San, Phone number: 18000001111, ID number: 3301100…, Contact address: A, Zhejiang Province.
[0105] Record 2: Name: Li Si, Phone number: 18000002222, ID number: None, Contact address: None.
[0106] Step 203: The electronic device displays first information on the first page.
[0107] Optionally, in an embodiment of the present application, the electronic device may display the first information in a blank area of the first page; or, the electronic device may display the first information in the first page through a pop-up window.
[0108] In one example, when the first page is a conversation page, the electronic device may display the first information in a blank area or an input method area of the conversation page.
[0109] For example, in combination Figure 4 ,like Figure 7 As shown, when the mobile phone determines that the first keyword is "Wang Wu" and "telephone number", the mobile phone can perform a fuzzy search in the first database, and then the mobile phone will retrieve: Name: Wang Wu, Phone Number: 18000003333, that is, the above-mentioned first information; then, the mobile phone can display Wang Wu: 18000003333 in the input box of the input method control 14.
[0110] In another example, when the first page is a form page, the electronic device may display the first information in an input control corresponding to each field in the form page.
[0111] For example, in combination Figure 5 ,like Figure 8 As shown, when the electronic device determines that the first keyword is "Zhang San", "telephone number", "ID number" and "contact address", the electronic device can perform a fuzzy search in the first database, and then the electronic device will retrieve: Name: Zhang San, Phone number: 18000001111, ID number: 330110000000000000, Contact address: Zhejiang Province A. Zhang San is displayed in the input control corresponding to the name field, 18000001111 is displayed in the input control corresponding to the phone number field, 330110000000000000 is displayed in the input control corresponding to the ID number field, and Zhejiang Province A is displayed in the input control corresponding to the contact address field.
[0112] Optionally, in an embodiment of the present application, when there are multiple pieces of the first information, the electronic device may display all of the first information on the first page, and then determine the target information based on the user's input.
[0113] For example, in combination Figure 5 ,like Fig. 9 As shown, when the electronic device determines that the first keyword is "name", "telephone number", "ID number" and "contact address", the electronic device can perform a fuzzy search in the first database, and then the electronic device will retrieve two records, namely:
[0114] Record 1: Name: Zhang San, Phone number: 18000001111, ID number: 330110000000000000, Contact address: A, Zhejiang Province.
[0115] Record 2: Name: Li Si, Phone number: 18000002222, ID number: None, Contact address: None.
[0116] Then, the mobile phone can display both records on the form page, and then the user can click and enter record 1. Figure 8 As shown, the mobile phone can fill in record 1 in the form page.
[0117] Optionally, in an embodiment of the present application, when there are multiple first information, the electronic device can display the multiple first information through a pop-up window, and then the user can input in the pop-up window, so that the electronic device can update and display the multiple first information in the pop-up window.
[0118] Optionally, in an embodiment of the present application, after the electronic device displays the first information, if the user believes that the first information is incorrect, the first information can be input so that the electronic device can display an editing interface for the first information, and the user can edit the first information in the editing page, and after the editing is completed, the electronic device can update the first information stored in the first database.
[0119] In the information display method provided in the embodiment of the present application, when the first page is displayed, M first keywords can be determined based on the page content of the first page, where M is a positive integer; then, when the M first keywords match the keywords in the first database, the first information associated with the M first keywords is determined from the first database based on the M first keywords; finally, the first information is displayed in the first page. In this solution, when the first page is displayed and the M first keywords in the first page match the keywords in the first database, the user's input intention can be determined, that is, the user wants to input information associated with the M first keywords; therefore, the electronic device can directly display the first information associated with the M first keywords from the first database in the first page, without the user having to manually obtain the first information from other applications, thereby simplifying the steps of obtaining the first information from other applications, thereby improving the efficiency of cross-application information input.
[0120] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Fig.10 As shown, before the above step 201, the information display method provided in the embodiment of the present application also includes the following steps 401 to 403.
[0121] Step 401: The electronic device obtains N second keywords and N second information based on the application type of at least one application program in the electronic device.
[0122] In the embodiment of the present application, each of the at least one application corresponds to at least one second information, and the N second keywords correspond one-to-one to the N second information, where N is a positive integer.
[0123] Optionally, in the embodiment of the present application, the above application type may be any of the following: shopping application type, photo album application type, video application type or communication application type, etc. The specific application type may be determined according to actual usage, and the embodiment of the present application does not limit the application type.
[0124] Optionally, in the embodiment of the present application, the second information may include at least one of the following: text, picture, document, video, audio, emoticon package, etc. The specific information may be determined according to actual usage, and the present application does not impose any limitation thereto.
[0125] In the embodiment of the present application, after acquiring the second information, the electronic device can obtain N second keywords based on the semantic information of the second information.
[0126] Exemplarily, the electronic device may input the second information into the first algorithm to obtain semantic information corresponding to the second information through the first algorithm, and then the electronic device may determine the word corresponding to the semantic information as the second keyword.
[0127] For example, taking the second information as a picture, assuming that the semantic information corresponding to the picture is the identity number: 4100000000000000000; the electronic device can determine the word "ID number" corresponding to the ID number as the second keyword.
[0128] It should be noted that, for each second keyword in the above N second keywords, the electronic device can refer to the above embodiments in detail, and will not be described again here to avoid repetition.
[0129] Optionally, in an embodiment of the present application, the electronic device may obtain L pieces of third information based on the application type of at least one application in the electronic device, and then determine N pieces of second information from the L pieces of third information, where L is a positive integer.
[0130] Optionally, in the embodiment of the present application, the third information may include at least one of the following: text, picture, document, video, audio, emoticon package, etc. The specific information may be determined according to actual usage, and the present application does not impose any limitation thereto.
[0131] In one example, taking the third information as a picture, the electronic device can perform content recognition and processing on all the photos in the album application to determine the card ID photos (i.e., the second information mentioned above) from all the photos in the album application, such as "ID card", "bank card", "driver's license", "vehicle registration certificate", "household registration book" and other photos.
[0132] Optionally, in an embodiment of the present application, the electronic device may perform content recognition and processing on all photos in the album application through a large model to extract semantic information of all photos in the album application, and then determine card ID photos based on the semantic information.
[0133] Optionally, in an embodiment of the present application, the electronic device can extract text information of all photos in the album application through optical character recognition (OCR) technology, and then compare the text information with a keyword database, and determine the photo type that matches the text information with the keywords in the keyword database as a card ID photo.
[0134] In another example, taking the third information as the delivery address text as an example, the electronic device can obtain the delivery addresses contained in all shopping applications in the electronic device, and then the electronic device can integrate the delivery addresses contained in all shopping applications to obtain the integrated information, that is, the above-mentioned second information.
[0135] Optionally, in an embodiment of the present application, the electronic device may use the recipient's name as the aggregated primary key, and then integrate the delivery addresses contained in all shopping applications to obtain integrated information.
[0136] For example, Zhang San appears most frequently, and there are multiple addresses, so the address list with the highest frequency of "Address 1, Yuhang District, Hangzhou City, Zhejiang Province" is ranked first. The final result after aggregation is shown in Table 1.
[0137] Table 1
[0138]
[0139] In another example, taking the third information as a phone number text as an example, the electronic device can obtain all the phone numbers in the electronic device and the contacts corresponding to all the phone numbers, and then the electronic device can integrate the contacts and the phone numbers corresponding to the contacts to obtain the above-mentioned second information.
[0140] Exemplarily, the electronic device can obtain the address book data in the electronic device, and the read data mainly includes information such as the contact name, contact phone number, etc. The specific examples are as follows:
[0141] Name: Zhang San, Phone number: 18000001111, Type: Address book
[0142] Name: Li Si, Phone number: 18000002222, Type: Address book
[0143] Name: Wang Wu, Phone number: 18000003333, Type: Address book
[0144] Step 402: The electronic device integrates at least one second information based on the N second keywords and the information types of the N second information to obtain at least one table.
[0145] In an embodiment of the present application, each of the at least one table includes at least one second keyword and second information associated with each second keyword in the at least one second keyword, and the second information included in each table belongs to the same information type.
[0146] In an embodiment of the present application, after obtaining N second keywords and N second information, the electronic device can divide the second information according to the types of the N second information to obtain different types of second information, and then merge the different types of second information together to obtain at least one table.
[0147] It can be understood that the above-mentioned N second keywords can be used as a table header, and the N second information can be used as table data, so that the electronic device can obtain at least one table.
[0148] Optionally, in the embodiment of the present application, the number of the above tables can be determined by the number of information types of the second information. For example, if the number of information types of the second information is 3, then the number of the at least one table is also 3.
[0149] Optionally, in an embodiment of the present application, the electronic device may divide the N second information based on information types of the N second information, and then integrate them separately to obtain at least one table.
[0150] Exemplarily, taking the information type of pictures and text as an example, the electronic device may integrate the pictures to obtain a table, and then the electronic device may integrate the text to obtain another table.
[0151] Step 403: The electronic device constructs a first database based on at least one table.
[0152] Optionally, in an embodiment of the present application, the electronic device may use the header of at least one table as a field in the first database, and use the table data in at least one table as data in the first database, so as to obtain the first database.
[0153] Optionally, in an embodiment of the present application, taking one of at least one table as a form in a database as an example, in the form, the electronic device can use the header in a table as the field of the form and the data in the above table as the form data to obtain a first database.
[0154] It should be noted that, for each of the at least one table mentioned above, a form corresponding to each table can be obtained in the above manner to obtain the first database.
[0155] For example, taking the information type including pictures, texts and documents as an example, the first database may include three parts, namely, three forms, a text library for text filling, a picture library for picture filling, and a file library for file filling. The specific structure example is as follows:
[0156] Text library: This library contains some common personal data of users, such as name, birthday, phone number, email address, company name, ID number, contact address, bank card number, etc. For details, please refer to Table 2 below.
[0157] Table 2
[0158]
[0159] Picture library: The picture library mainly contains some picture data in the album, including name, keyword, type, picture name address and other information. For details, please refer to Table 3 below.
[0160] Table 3
[0161] Name Keywords type Image Name Zhang San ID card, front picture IMG_001.jpg Zhang San ID card, back side picture IMG_002.jpg Zhang San Driver's license picture IMG_008.jpg … … … …
[0162] In an embodiment of the present application, the electronic device can establish a first database based on all information in the electronic device, so that when the electronic device is in the smart fill mode, the electronic device can directly determine the information required by the user based on the first database without cross-application search, thereby improving the efficiency of the electronic device's search without cross-application input.
[0163] The above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.
[0164] It should be noted that the information display method provided in the embodiment of the present application can be executed by an information display device. In the embodiment of the present application, the information display device executing the information display method is taken as an example to illustrate the information display device provided in the embodiment of the present application.
[0165] Fig.11 A possible structural diagram of the information display device involved in the embodiment of the present application is shown. Fig.11 As shown, the information display device 70 may include: a determination module 71 and a display module 72 .
[0166] The determination module 71 is used to determine M first keywords based on the page content of the first page, where M is a positive integer; when the M first keywords match the keywords in the first database, the first information associated with the M first keywords is determined from the first database based on the M first keywords. The display module 72 is used to display the first information determined by the determination module 71 on the first page.
[0167] In a possible implementation, the information display device 70 provided in the embodiment of the present application further includes: an extraction module. The above-mentioned determination module 71 is specifically used to determine the information input scenario corresponding to the page content based on the page content. The extraction module is used to extract keywords from the page content based on the information input scenario determined by the determination module 71 to obtain M first keywords.
[0168] In a possible implementation, the extraction module is specifically used to extract keywords in the conversation message content in the first page to obtain M first keywords when the information input scenario is a conversation input scenario; or to obtain fields in the form information in the first page to obtain M first keywords when the information input scenario is a form input scenario.
[0169] In a possible implementation, the information display device provided in the embodiment of the present application further includes: a generation module. The above-mentioned determination module 71 is specifically used to determine the intent information based on the page content, and the intent information is used to characterize the intent of the user input information. The generation module is used to generate M first keywords based on the intent information determined by the determination module 71.
[0170] In a possible implementation, the information display device 70 provided in the embodiment of the present application also includes: an acquisition module, an integration module and a processing module. The acquisition module is used to determine that the module 71 obtains N second keywords and N second information based on the application type of at least one application in the electronic device before determining the M first keywords based on the page content of the first page. Each application corresponds to at least one second information, and the N second keywords correspond one-to-one with the N second information, where N is a positive integer. The integration module is used to integrate the at least one second information based on the information type of the N second keywords and the N second information obtained by the acquisition module to obtain at least one table, each table including at least one second keyword and the second information associated with each second keyword, and the second information included in each table belongs to the same information type. The processing module is used to construct a first database based on the at least one table obtained by the integration module.
[0171] An embodiment of the present application provides an information display device, which can determine the user's input intention when M first keywords in a first page match the keywords in a first database, that is, the user wants to input information associated with the M first keywords; therefore, the electronic device can directly display the first information associated with the M first keywords from the first database on the first page, without the user having to manually obtain the first information from other applications, thereby simplifying the steps of obtaining the first information from other applications and improving the efficiency of information input across applications.
[0172] The information display device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0173] The information display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0174] The information display device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.
[0175] Alternatively, if Fig.12 As shown, an embodiment of the present application further provides an electronic device 90, including a processor 91 and a memory 92, wherein the memory 92 stores programs or instructions that can be executed on the processor 91, and when the program or instructions are executed by the processor 91, the various steps of the above-mentioned information display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.
[0176] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0177] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0178] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.
[0179] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0180] The processor 110 is used to determine M first keywords based on the page content of the first page, where M is a positive integer; and when the M first keywords match the keywords in the first database, determine the first information associated with the M first keywords from the first database based on the M first keywords. The display unit 106 is used to display the first information on the first page.
[0181] Optionally, in an embodiment of the present application, the processor 110 is specifically used to determine an information input scenario corresponding to the page content based on the page content; and based on the information input scenario, perform keyword extraction on the page content to obtain M first keywords.
[0182] Optionally, in an embodiment of the present application, the above-mentioned processor 110 is specifically used to extract keywords in the conversation message content in the first page to obtain M first keywords when the information input scenario is a conversation input scenario; or, when the information input scenario is a form input scenario, obtain fields in the form information in the first page to obtain M first keywords.
[0183] Optionally, in an embodiment of the present application, the processor 110 is specifically used to determine intent information based on page content, where the intent information is used to characterize user input information; and to generate M first keywords based on the intent information.
[0184] Optionally, in an embodiment of the present application, the processor 110 is further used to obtain N second keywords and N second information based on the application type of at least one application in the electronic device before determining the M first keywords based on the page content of the first page, each application corresponds to at least one second information, the N second keywords correspond one-to-one to the N second information, and N is a positive integer; based on the information type of the N second keywords and the N second information, perform information integration on at least one second information to obtain at least one table, each table includes at least one second keyword and second information associated with each second keyword, and the second information included in each table belongs to the same information type; and construct a first database based on at least one table.
[0185] An embodiment of the present application provides an electronic device, which can determine the user's input intention when M first keywords in a first page match the keywords in a first database, that is, the user wants to input information associated with the M first keywords; therefore, the electronic device can directly display the first information associated with the M first keywords from the first database on the first page, without the user having to manually obtain the first information from other applications, thereby simplifying the steps of obtaining the first information from other applications and improving the efficiency of information input across applications.
[0186] The electronic device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described here.
[0187] The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, they will not be described again here.
[0188] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0189] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0190] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.
[0191] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0192] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0193] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0194] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0195] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned information display method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0196] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0197] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0198] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. An information display method, characterized in that: The method comprises: Based on the page content of the first page, determine M first keywords, where M is a positive integer; In a case where the M first keywords match keywords in the first database, determining first information associated with the M first keywords from the first database based on the M first keywords; The first information is displayed in the first page.
2. The method according to claim 1, characterized in that The determining of M first keywords based on the page content of the first page, where M is a positive integer, includes: Based on the page content, determining an information input scenario corresponding to the page content; Based on the information input scenario, keywords are extracted from the page content to obtain the M first keywords.
3. The method according to claim 2, characterized in that The extracting keywords from the page content based on the information input scenario to obtain the M first keywords includes: In the case where the information input scenario is a conversation input scenario, extracting keywords from the conversation message content in the first page to obtain the M first keywords; or, When the information input scenario is a form input scenario, fields in the form information in the first page are acquired to obtain the M first keywords.
4. The method according to any one of claims 1 to 3, characterized in that The determining of M first keywords based on the page content of the first page, where M is a positive integer, includes: Determining intent information based on the page content, where the intent information is used to characterize the intent of the user inputting information; Based on the intent information, the M first keywords are generated.
5. The method according to claim 1, characterized in that Before determining the M first keywords based on the page content of the first page, the method further includes: Based on the application type of at least one application in the electronic device, obtain N second keywords and N second information, each application corresponds to at least one second information, the N second keywords correspond to the N second information one by one, and N is a positive integer; Based on the N second keywords and the information types of the N second information, the at least one second information is integrated to obtain at least one table, each table including at least one second keyword and second information associated with each second keyword, and the second information included in each table belongs to the same information type; Based on the at least one table, the first database is constructed.
6. An information display device, characterized in that: The information display device comprises: a determination module and a display module; The determination module determines M first keywords based on the page content of the first page, where M is a positive integer; and determines first information associated with the M first keywords from the first database based on the M first keywords when the M first keywords match the keywords in the first database; The display module is used to display the first information determined by the determination module in the first page.
7. The device according to claim 6, characterized in that The information display device further includes: an extraction module; The determination module is specifically used to determine the information input scenario corresponding to the page content based on the page content; The extraction module is used to extract keywords from the page content based on the information input scenario determined by the determination module to obtain the M first keywords.
8. The device according to claim 7, characterized in that The extraction module is specifically used for: When the information input scenario is a conversation input scenario, extracting keywords from the conversation message content in the first page to obtain the M first keywords; or, When the information input scenario is a form input scenario, fields in the form information in the first page are acquired to obtain the M first keywords.
9. The device according to any one of claims 6 to 8, characterized in that The information display device further includes: a generating module; The determination module is specifically used to determine the intention information based on the page content, and the intention information is used to represent the intention of the user input information; The generating module is used to generate the M first keywords based on the intention information determined by the determining module.
10. The device according to claim 6, characterized in that The information display device further includes: an acquisition module, an integration module and a processing module; The acquisition module is used to acquire N second keywords and N second information based on the application type of at least one application in the electronic device before the determination module determines the M first keywords based on the page content of the first page, each application corresponds to at least one second information, the N second keywords correspond to the N second information one by one, and N is a positive integer; The integration module is used to integrate the at least one second information based on the N second keywords and the information types of the N second information acquired by the acquisition module to obtain at least one table, each table including at least one second keyword and second information associated with each second keyword, and the second information included in each table belongs to the same information type; The processing module is used to construct the first database based on the at least one table obtained by the integration module.