Information processing method and device and computer readable storage medium

Abstract

The invention relates to an information processing method and device and a computer readable storage medium, and relates to the technical field of computers. The information processing method comprises the steps of obtaining first information input by a user; responding to a first note with the same theme as the first information in a note database, and integrating the first information and the first note to obtain a second note; in response to the situation that the second note does not meet the requirement of the user, expanding the second note to obtain a third note; and storing the third note in a note database. According to the information recording method and device, information recording is more complete and efficient.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technologies, and particularly to an information processing method and apparatus, and a computer-readable storage medium. Background Art

[0002] With the development of Internet technologies, application programs with interactive functions are increasing day by day and have become an indispensable tool in people's daily life, work and study.

[0003] In daily life, users often use recording application programs. Users can record important information by inputting text on the application program. Summary of the Invention

[0004] According to some embodiments of the present disclosure, there is provided an information processing method, including: obtaining first information input by a user; in response to a first note having the same theme as the first information being included in a note database, integrating the first information and the first note to obtain a second note; in response to the second note not meeting the user's requirements, expanding the second note to obtain a third note; and storing the third note in the note database.

[0005] According to some other embodiments of the present disclosure, there is provided an information processing apparatus, including: an obtaining module configured to obtain first information input by a user; an integrating module configured to, in response to a first note having the same theme as the first information being included in a note database, integrate the first information and the first note to obtain a second note; an expanding module configured to, in response to the second note not meeting the user's requirements, expand the second note to obtain a third note; and a storing module configured to store the third note in the note database.

[0006] According to some other embodiments of the present disclosure, there is provided an information processing apparatus, including: a memory; and a processor coupled to the memory, where the processor is configured to execute an information processing method according to any of some embodiments of the present disclosure based on instructions stored in the memory.

[0007] According to some other embodiments of the present disclosure, there is provided a computer-readable storage medium having computer program instructions stored thereon, and when the instructions are executed by a processor, an information processing method according to any of some embodiments of the present disclosure is implemented.

[0008] According to some other embodiments of the present disclosure, there is provided a computer program product including computer program instructions, and when the computer program instructions are executed by a processor, an information processing method according to any of some embodiments of the present disclosure is implemented.

[0009] Other features, aspects, and advantages of the present disclosure will become apparent from the following detailed description of the exemplary embodiments of the present disclosure with reference to the accompanying drawings. Description of the Drawings

[0010] Embodiments of the present disclosure will be described below with reference to the accompanying drawings. It should be understood that the drawings in the following description only relate to some embodiments of the present disclosure and do not constitute a limitation on the present disclosure. In the drawings:

[0011] Figure 1 A flowchart showing an information processing method according to some embodiments of the present disclosure;

[0012] Figure 2 A schematic diagram showing a dialogue interface according to some embodiments of the present disclosure;

[0013] Figures 3A - 3B A schematic diagram showing a dialogue interface according to some other embodiments of the present disclosure;

[0014] Figure 4 A schematic diagram showing a first display interface according to some embodiments of the present disclosure;

[0015] Figures 5A - 5B A schematic diagram showing a second display interface according to some embodiments of the present disclosure;

[0016] Figure 6 A block diagram showing an information processing device according to some embodiments of the present disclosure;

[0017] Figure 7 A block diagram showing an information processing device according to some embodiments of the present disclosure;

[0018] Figure 8 A block diagram showing an electronic device according to some other embodiments of the present disclosure.

[0019] It should be understood that, for the sake of convenience of description, the dimensions of the various parts shown in the drawings are not necessarily drawn according to the actual proportional relationship. The same or similar reference numerals are used in the various drawings to represent the same or similar components. Therefore, once an item is defined in one drawing, it may not be further discussed in the subsequent drawings. Detailed Embodiments

[0020] The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure. It should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein.

[0021] It should be understood that the various steps described in the method embodiments of the present disclosure may be executed in different orders and / or executed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this regard. Unless otherwise specifically stated, the relative arrangements of the components and steps set forth in these embodiments should be construed as merely exemplary and do not limit the scope of the present disclosure.

[0022] As used herein, the term "comprising" and its variants refer to open-ended terms that include at least the subsequent elements / features, but do not exclude other elements / features, that is, "including but not limited to". The term "based on" means "at least partially based on".

[0023] It should be noted that the concepts such as "first", "second", etc. mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies. Unless otherwise specified, the concepts such as "first", "second", etc. are not intended to imply that the objects so described must be in a given order in terms of time, space, ranking or any other way.

[0024] It should be noted that the modification of "one" and "plural" mentioned in the present disclosure is illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0025] The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, but the present disclosure is not limited to these specific embodiments. These specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. In addition, in one or more embodiments, specific features, structures or characteristics may be combined in any suitable manner that will be apparent to those of ordinary skill in the art from the present disclosure.

[0026] In the related art, application programs are mainly used to record the original information input by users. Sometimes, users will record complex and fragmented information. These stored fragmented information is very inconvenient to search when the user wants to view it, making it difficult for the user to quickly obtain the required key information. The present disclosure provides an information processing method, device, and computer-readable storage medium, making the recording of information more complete and efficient.

[0027] Figure 1 A flowchart showing an information processing method according to some embodiments of the present disclosure is shown.

[0028] As Figure 1As shown, the information processing method includes: Step S1, obtaining first information input by the user; Step S2, in response to the first note in the note database having the same theme as the first information, integrating the first information and the first note to obtain a second note; Step S3, in response to the second note not meeting the user's needs, expanding the second note to obtain a third note; Step S4, storing the third note in the note database.

[0029] The first information input by the user, for example, includes images, voices, texts, videos, etc. The content of the first note, the second note, and the third note can also include information such as images, voices, texts, videos, etc. The way the user inputs information, for example, includes inputting by typing with an input method, voice input, handwriting input, photo input, uploading file input, etc., and the present disclosure does not limit this. The note database can also be referred to as a knowledge database, a note knowledge base, a memo database, a notepad, etc. A note can also be referred to as a sticky note, a memo, a reminder, etc., and the present disclosure does not limit this.

[0030] "The same theme" means that, for example, the main content of the first information and the first note both revolve around the same person, thing, concept, problem, plan, goal, field, etc. The second note can include some or all of the content of the first information and the first note. "The second note does not meet the user's needs" means, for example, that just relying on the content of the second note is not sufficient to achieve the purpose for which the user records the note, such as knowledge or inspiration management, work arrangement, life record, life and work summary, etc. The third note includes information that is not in the second note. For example, the third note can include some or all of the content of the second note, as well as newly added content relative to the second note.

[0031] The order of integrating and expanding the notes can be changed. For example, it is also possible to first expand at least one of the first information and the first note, and then integrate the first information and the first note after the expansion operation.

[0032] After storing the third note in the note database, the user can view and browse the stored notes in the note database.

[0033] The information processing method of this embodiment can be executed on the client side, or partially on the server side.

[0034] According to the information processing method of the present disclosure, it includes: obtaining first information input by the user; in response to the first note in the note database having the same theme as the first information, integrating the first information and the first note to obtain a second note; in response to the second note not meeting the user's needs, expanding the second note to obtain a third note; storing the third note in the note database. By integrating and expanding the fragmented information recorded by the user, the notes are made more complete and the generation and management of the notes are made more efficient.

[0035] Figure 2 A schematic diagram showing a dialogue interface according to some embodiments of the present disclosure.

[0036] Below in conjunction with Figure 2 , a method for obtaining user input according to some embodiments of the present disclosure is introduced.

[0037] As Figure 2 shown, the user can have a conversation with the agent in the dialogue interface 2. When the user inputs information, the agent can provide corresponding responses, and the historical conversation between the agent and the user can also be displayed in the dialogue interface 2.

[0038] In some embodiments, obtaining the first information of user input includes: in the dialogue interface with the user, in response to a triggering operation of the user on the first input control, obtaining the voice information input by the user; in response to the user's hand moving from the first area where the first input control is located to the second area, determining the voice information as the first information.

[0039] For example, in the dialogue interface 2, the user can click or long-press the first input control 201 to perform voice input. While the user maintains the triggering operation on the first input control 201, the agent continuously obtains the voice information input by the user.

[0040] Figures 3A - 3B A schematic diagram showing a dialogue interface according to other embodiments of the present disclosure.

[0041] In the dialogue interface 2 as Figure 3A shown, when the user's finger remains in the first area 2101, it indicates that voice is being input. If the user's finger moves from the first area 2101 to the second area 2102, it means that the voice information just input by the user is the information that the user wants to save as a note. When the user's finger moves to the second area 2102, the display format of the second area 2102 will change, for example Figure 3B shown, changing the filling format, line format, displayed identifiers, etc.

[0042] In the dialogue interface 2 as Figure 3A shown, if the user's finger moves from the first area 2101 to the third area 2103, it means that the user wants to enter other voice modes, such as continuous voice mode. If the user's finger moves from the first area 2101 to the fourth area 2104, it means that the user wants to discard the voice information just input. If the user's finger is released from the first area 2101, the voice information just input by the user is used as the information input to the dialogue interface, and the agent generates a response for this information and displays it to the user.

[0043] Figure 4 A schematic diagram showing a first display interface according to some embodiments of the present disclosure.

[0044] Combined with the following Figure 4 , the method for obtaining user input according to some other embodiments of the present disclosure will be introduced.

[0045] As Figure 4 shown, the user can enter the note database and view the previously recorded notes in the note database. The user can also input the first information on the first display interface 3 of the note database.

[0046] In some embodiments, obtaining the first information input by the user includes: displaying a second input control on the first display interface of the note database; and obtaining the first information input by the user in response to a triggering operation of the user on the second input control.

[0047] On the first display interface 3, the second input control 310 includes, for example, a voice input control 3101, a keyboard input control 3102, an "add" control 3103, and a camera control 3104. The "add" control 3103 can be used for file uploading, taking pictures, etc. The user can click on the control to select the corresponding input method for inputting the first information. The triggering operation of the user on the control is, for example, a touch, click, double-click, long-press, etc. operation of the user on the control, or other types of operations, which will not be elaborated here.

[0048] In the first display interface 3 as Figure 4 shown, the name, thumbnail, or cover of the note can also be displayed. The user can also select the name, thumbnail, or cover of the note to enter the display interface of a specified note.

[0049] The user can also directly create a new note, for example, by triggering the Figure 4 "New Memo" to create a new note. The created new note is saved separately and will not be merged with other historical notes into one note, but can be integrated with the information input by the subsequent user into a new note.

[0050] Figures 5A - 5B The schematic diagram of the second display interface according to some embodiments of the present disclosure is shown.

[0051] Combined with the following Figure 5A , the method for obtaining user input according to some other embodiments of the present disclosure will be introduced.

[0052] As Figure 5A shown, on the second display interface 4, the content of a specific note can be displayed. The user can also input the first information on the second display interface 4.

[0053] In some embodiments, obtaining the first information input by the user includes: in response to the user's selection operation on the historical note in the first display interface, entering the second display interface for displaying the selected historical note by the user; obtaining the first information input by the user in the second display interface; and determining the selected historical note by the user as the first note.

[0054] For example, in the first display interface 3 as Figure 4 shown, the user selects note A and enters the second display interface as Figure 5A shown. The user can input the first information in the second display interface 4. Obtaining the first information input by the user in the second display interface includes, for example: in response to the user's triggering operation on the third input control, obtaining the first information input by the user. In the second display interface 4, the third input control 410 includes, for example, a voice input control 4101, a keyboard input control 4102, an "add" control 4103, and a camera control 4104. The "add" control 4103 can be used for file uploading, taking pictures, etc. The user can click the control to select the corresponding input method for inputting the first information.

[0055] If the user inputs the first information in the second display interface, it is determined that the historical note displayed in the second display interface and the first information input by the user have the same theme and can be combined into one note. Therefore, the note displayed in the second display interface can be determined as the second note.

[0056] Moreover, the intelligent agent can not only expand the note when it determines that the note does not meet the user's needs, but also expand the note in response to the user's triggering of the expansion control. The expansion control is, for example, Figure 5A the "one-key optimization" control in

[0057] In the first display interface 3, a sharing control 420 and an exit control 430 can also be displayed. The sharing control 420 is used to share the note to other applications or other users. The exit control 430 is used to exit the second display interface 4 and return to the first display interface 3.

[0058] In some embodiments, the information processing method further includes: extracting the semantic information of the first information, where the first information includes at least one of voice, text, and image; determining the theme of the first information according to the semantic information of the first information; calculating the similarity between the theme of the historical note in the note database and the theme of the first information; and determining the historical note with the highest similarity as the first note.

[0059] For example, if the first information includes voice, the voice is converted into text and then the semantic information is extracted. If the first information includes an image, the semantic information of the image can be directly extracted. The image can also be converted into text by using an image-to-text model and then the semantic information is extracted.

[0060] Based on methods such as keyword matching and topic models, the topic of the first information can be extracted. An embedding representation is generated according to the topic of the first information, and the embedding representations of the topics of each historical note are obtained. The similarity between the embedding representation of the topic of each historical note and the embedding representation of the topic of the first information is calculated, and the historical note with the highest similarity is found.

[0061] The methods of the user inputting the first information and determining the first note have been introduced above. Now, how to integrate the first information and the first note will be introduced.

[0062] In some embodiments, in response to the note database including a first note with the same topic as the first information, integrating the first information and the first note to obtain a second note includes: integrating the first information and the first note according to at least one of the content of the first information, the content of the second note, the time information of the first information, and the time information of the second note to obtain the second note.

[0063] For example, the agent divides the first note into multiple segments according to content and / or time. The first information can also be divided into multiple segments according to content and / or time, or the first information as a whole is used as one segment. The segments of the first information and the first note are sorted and arranged according to content and / or time, and duplicate and inconsistent content are removed to obtain the second note. The agent can also extract content key information and / or time key information for each segment of the first note and the first information, generate an outline based on the key information, and generate the second note according to the outline.

[0064] In some embodiments, in response to the note database including a first note with the same topic as the first information, integrating the first information and the first note to obtain a second note includes: determining multiple tasks corresponding to the first information and the first note and the priorities of the multiple tasks; determining the sorting of the multiple tasks according to the priorities of the multiple tasks; and integrating the first information and the first note according to the multiple tasks and the sorting of the multiple tasks to obtain the second note.

[0065] For example, when there are multiple tasks in the first information and the first note, the multiple tasks are arranged in descending order of priority to obtain the second note. Generating a note by sorting according to priority can help the user process tasks efficiently and orderly. If the multiple tasks in the first note are already sorted in order of priority, the tasks in the first information can be inserted into the positions corresponding to the priority sorting in the first note.

[0066] Taking travel as an example, the first note records that the user wants to travel to place A, and also records the clothes to be taken and the documents to be processed. The first information includes the specific time when the user wants to travel to place A. Then the time and the documents to be processed are of the highest priority. Booking flights and accommodation according to the specific time is of secondary priority, and the clothes to be taken are of low priority. The generated note is, for example: "1. The specific time to travel to place A; 2. The documents to be processed; 3. Round-trip flight information; 4. Hotel name and address; 5. Clothes to be taken".

[0067] In some embodiments, in response to the note database including a first note with the same theme as the first information, the first information and the first note are integrated to obtain a second note, including: in response to detecting an error in at least one of the first information and the first note, correcting the error and integrating the first information and the first note to obtain a second note.

[0068] For example, if there is a conflict in at least one of the first information and the first note, the conflicting part is modified to be consistent. If it cannot be modified to be consistent, the conflicting part in the second note is marked to remind the user. Taking travel as an example, the first note records the reservation information of a certain hotel in a certain place, and the first information includes the round-trip flight information to that place. The intelligent agent compares and finds that the hotel reservation information and the flight information are inconsistent. For example, the hotel in that place is still reserved on the second night after the plane leaves that place, indicating that at least one of them may be incorrect. Then the intelligent agent can combine the travel dates in the first note and / or the first information, and by combining other historical information previously input by the user, automatically correct the hotel reservation information and / or flight information corresponding to the correct travel date, and remind the user in the second note that the information has been corrected.

[0069] The integration of the first information and the first note is introduced above. Next, the method for expanding the second note is introduced.

[0070] In some embodiments, in response to the second note not meeting the user's needs, the second note is expanded to obtain a third note, including: in response to the second note including the user's question, determining whether there is an answer corresponding to the question in the second note; in response to there being no answer corresponding to the question in the second note, expanding the second note to obtain a third note.

[0071] For example, after generating the second note, the intelligent agent understands the user's intention and extracts keywords. If the user's intention is to obtain the answer to a certain question, the keywords of the question are retrieved in the current second note, and the matching degree between the retrieved content and the question is calculated. If there is no content with a matching degree higher than the threshold, it is determined that there is no answer corresponding to the question in the second note. The user's question can also come from the first information, that is, it can be directly determined whether there is an answer to the question included in the first information in the second note.

[0072] Still taking tourism as an example, the second note includes that the user hopes to experience the local culture. The second note already includes travel time, guides for document processing, flight and hotel reservation information, but does not include content related to the local culture. Then the agent can call the content generation model to generate content related to the local culture based on the second note and the user's question as the expanded content. Add the expanded content to the second note to obtain the third note.

[0073] In some embodiments, in response to the second note not meeting the user's needs, the second note is expanded to obtain the third note, including: in response to the second note including an activity objective, determining whether there is an activity plan corresponding to the activity objective in the second note; in response to there being no activity plan corresponding to the activity objective in the second note, expanding the second note to obtain the third note.

[0074] The user's needs are, for example, to organize an activity. The activity objective is, for example, an activity theme, such as "A Class on XX", "XX Industry Exchange Meeting", etc. The activity objective can also be specific measurement indicators, such as "XX people participate in the activity", "The repost volume exceeds XX", etc. When there is an activity objective in the second note, retrieve the activity-related plan in the second note. The activity objective can also come from the first information, that is, it can be directly determined whether there is a corresponding activity plan in the second note for the activity objective included in the first information.

[0075] If there is activity-related content in the current second note, but it is only a general plan and the content is not detailed enough to achieve the activity objective, the agent can use the content generation model to supplement the details related to the activity based on the activity objective as the expanded content. If there is no activity-related content in the current second note, the agent can also use the content generation model to generate an activity plan for the user.

[0076] In some embodiments, where in response to the second note not meeting the user's needs, the second note is expanded to obtain the third note, including: in response to the first information including an image, generating text information corresponding to the image according to the semantic information of the image and other information in the second note except the image; generating the third note according to the text information corresponding to the image and the second note.

[0077] For example, if the first piece of information is an image, the agent can generate a content introduction for the image based on the image and other content in the second note, and use the content introduction as the augmented content. The third note that includes the introduction of the content of the image is more complete, facilitating subsequent classification, management, and query of the third note containing the image. If the image includes text, the agent can also extract the text in the image and use the text in the image as the augmented content, which is convenient for the user to copy the text and also facilitates subsequent classification, management, and query of the third note containing the image.

[0078] In some embodiments, in response to the second note not meeting the user's requirements, the second note is augmented to obtain a third note, including: determining keywords according to the second note and the user's requirements; performing an online search based on the keywords to obtain relevant information about the keywords as the second information; generating a summary based on the second information; and generating the third note based on the second note and the summary.

[0079] For example, the user's requirement is: "want to know the scenic spots in place A". The second note includes the time to travel to place A. Then the keywords are "scenic spots in place A" and "time". The agent performs an online search based on the keywords, screens information from the search results, and finds the scenic spot C in place A with the most recommended times for this travel time. Then, the agent generates an introduction to scenic spot C as the summary, that is, the supplementary content.

[0080] In some embodiments, in response to the second note not meeting the user's requirements, the second note is augmented to obtain a third note, including: determining the entities in the second note and the relationships between the entities; generating a knowledge graph based on the entities and the relationships between the entities; performing reasoning on the knowledge graph to determine the missing information; generating complementary information corresponding to the missing information; and generating the third note based on the complementary information and the second note.

[0081] For example, by comparing the second note with the data in the knowledge graph and through logical reasoning, the missing information is complemented. Taking a trip as an example, the second note includes the time, location, and number of people for the trip. After the agent compares the second note with the knowledge graph and confirms that the hotel reservation information is missing in the second note, it infers the hotel information that can be recommended to the user through the hotel information in the knowledge graph related to the entities (such as time, location, number of people) in the second note. The agent can also use the hotel name, address, contact information, hotel reservation fee, etc. as the complementary information after determining the hotel to be recommended to the user.

[0082] During the period when the agent integrates and augments the note, a waiting indicator can be displayed on the second interface 4, such as Figure 5B the waiting indicator 440 shown. After the third note is generated, only the third note is displayed, and the waiting indicator 440 is no longer displayed.

[0083] In some embodiments, storing the third note in the note database includes: replacing the first note with the third note in the note database. Replacing the first note with the third note can avoid redundancy of information in the database. If the user inputs fragmented information with the same theme at different times, this information will not be scattered in different notes. Instead, the agent integrates this information into the same note in the database to form systematic knowledge, which is convenient for the user to search.

[0084] The generation of notes has been introduced above. The following introduces the application scenarios of notes.

[0085] In some embodiments, the information processing method further includes: determining at least one task and the task time corresponding to at least one task according to the third note; creating a reminder event according to the at least one task and the task time corresponding to the at least one task; and sending a reminder message to the user according to the reminder event and the task time.

[0086] For example, through a natural language processing model, identify the tasks and task times in the note. Convert the tasks and times into expressions. For example, convert "3 pm tomorrow" into: "3 / 6 / 2025 15:00".

[0087] The agent calls functions such as the mobile phone calendar, email, and application message function according to the expressions of the tasks and task times, reserves the reminder event, and reminds the user at the specified time.

[0088] In some embodiments, classify the third note to obtain the category label of the third note; in response to the user selecting the category label of the third note, display the thumbnail of the third note.

[0089] For example, the note database provides a classification viewing entry, and the user can view the classification of the notes in the note database. When the user clicks on one of the category labels, they can enter the summary page of that category. On the summary page, multiple notes can be viewed in thumbnail form. When the user clicks on the thumbnail of a certain note, they can enter the display interface of that note. Moreover, the user does not need to label the notes, and the agent can classify the notes into the corresponding labels, thereby further realizing the integration of information.

[0090] According to the information processing method of the present disclosure, users can input fragmented information anytime and anywhere, and the intelligent agent will automatically integrate and supplement it into a complete note for easy viewing by the user. For example, the user input a piece of information yesterday: I will travel to place A in October. Then the intelligent agent first supplements the information to generate Note 1. Note 1 may include, for example: "Travel to place A in October and take a round-trip flight, and need to apply for a certificate before August XXth". The user inputs another piece of information today: I will go to place A to experience a certain activity. Then the intelligent agent generates a plan for participating in a certain activity and adds the plan for participating in a certain activity to Note 1 as well, forming a more complete note: "Travel to place A in October and take a round-trip flight, need to apply for a certificate before August XXth, and need to sign up for a certain activity before September XXth".

[0091] Figure 6 The block diagram of an information processing device according to some embodiments of the present disclosure is shown.

[0092] As Figure 6 shown, the information processing device 6 includes: an acquisition module 61 configured to acquire first information input by a user; an integration module 62 configured to, in response to a first note having the same theme as the first information being included in a note database, integrate the first information and the first note to obtain a second note; an expansion module 63 configured to, in response to the second note not meeting the user's requirements, expand the second note to obtain a third note; and a storage module 64 configured to store the third note in the note database.

[0093] The acquisition module 61 of the information processing device 6 can be used to execute Figure 1 step S1. The integration module 62 of the information processing device 6 can be used to execute Figure 1 step S2. The expansion module 63 of the information processing device 6 can be used to execute Figure 1 step S3. The storage module 64 of the information processing device 6 can be used to execute Figure 1 step S4.

[0094] By integrating and expanding the fragmented information recorded by the user, the note becomes more complete, and the generation and management of the note are more efficient.

[0095] In some embodiments, the expansion module 63 is further configured to: in response to the second note including a user's question, determine whether there is an answer corresponding to the question in the second note; in response to there being no answer corresponding to the question in the second note, expand the second note to obtain a third note.

[0096] In some embodiments, in response to the second note not meeting the user's requirements, the second note is expanded to obtain a third note, including: in response to the activity objective being included in the second note, determining whether there is an activity plan corresponding to the activity objective in the second note; in response to the absence of an activity plan corresponding to the activity objective in the second note, expanding the second note to obtain a third note.

[0097] In some embodiments, the expansion module 63 is further configured to: in response to the first information including an image, generate text information corresponding to the image according to the semantic information of the image and other information in the second note except the image;

[0098] Generate a third note according to the text information corresponding to the image and the second note.

[0099] In some embodiments, the expansion module 63 is further configured to: determine keywords according to the second note and the user's requirements; perform an online search according to the keywords to obtain relevant information of the keywords as the second information; generate a summary according to the second information; generate a third note according to the second note and the summary.

[0100] In some embodiments, the expansion module 63 is further configured to: determine entities in the second note and the relationships between the entities; generate a knowledge graph according to the entities and the relationships between the entities; perform reasoning on the knowledge graph to determine missing information; generate complementary information corresponding to the missing information; generate a third note according to the complementary information and the second note.

[0101] In some embodiments, the integration module 62 is further configured to: integrate the first information and the first note according to at least one of the content of the first information, the content of the second note, the time information of the first information, and the time information of the second note to obtain the second note.

[0102] In some embodiments, the integration module 62 is further configured to: determine multiple tasks corresponding to the first information and the first note and the priorities of the multiple tasks; determine the sorting of the multiple tasks according to the priorities of the multiple tasks; integrate the first information and the first note according to the multiple tasks and the sorting of the multiple tasks to obtain the second note.

[0103] In some embodiments, the integration module 62 is further configured to: in response to detecting an error in at least one of the first information and the first note, correct the error and integrate the first information and the first note to obtain the second note.

[0104] In some embodiments, the information processing apparatus further includes: a determination module configured to extract semantic information of first information, where the first information includes at least one of speech, text, and image; determine a theme of the first information according to the semantic information of the first information; calculate a similarity between the theme of the historical notes in the note database and the theme of the first information; and determine the historical note with the highest similarity as the first note.

[0105] In some embodiments, the information processing apparatus further includes a reminder module configured to: determine at least one task and at least one task time corresponding to the at least one task according to a third note; create a reminder event according to the at least one task and the at least one task time corresponding thereto; and send a reminder message to the user according to the reminder event and at the task time.

[0106] In some embodiments, the information processing apparatus further includes a display module configured to: classify the third note to obtain a category label of the third note; and display a thumbnail of the third note in response to the user selecting the category label of the third note.

[0107] In some embodiments, the acquisition module 61 is further configured to, in a dialogue interface with the user, in response to a triggering operation of the user on the first input control, acquire voice information input by the user; and determine the voice information as the first information in response to the user's hand moving from a first area where the first input control is located to a second area.

[0108] In some embodiments, the acquisition module 61 is further configured to: display a second input control on a first display interface of the note database; and acquire the first information input by the user in response to a triggering operation of the user on the second input control.

[0109] In some embodiments, the acquisition module 61 is further configured to: enter a second display interface for displaying the historical note selected by the user in response to a selection operation of the user on the historical note in the first display interface; acquire the first information input by the user in the second display interface; and determine the historical note selected by the user as the first note.

[0110] In some embodiments, the acquisition module 61 is further configured to replace the first note with a third note in the note database.

[0111] Figure 7 A block diagram of an information processing apparatus according to some embodiments of the present disclosure is shown.

[0112] As Figure 7As shown, the information processing apparatus 7 includes: at least one memory 71; and at least one processor 72 coupled to the at least one memory 71, the at least one processor 72 being configured to execute the information processing method of any of the foregoing embodiments based on instructions stored in the at least one memory 71. By integrating and expanding the fragmented information recorded by the user, the notes are made more complete and the generation and management of the notes are made more efficient.

[0113] The memory 71 is used to store one or more computer-readable instructions. The memory 71 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory, including but not limited to random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), flash memory. The memory 71 may store, for example, an operating system, application programs, a boot loader (BootLoader), a database, and other programs, and may also store various application programs and various data, etc.

[0114] The processor 72 is used to run the computer-readable instructions to implement the method of any of the foregoing embodiments. For the specific implementation of each step of the method, reference may be made to the above embodiments, and the repeated parts will not be elaborated here.

[0115] The processor 72 may be configured to execute Figure 1 each step in. The processor 72 may be embodied as various processing devices, such as a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The central processing unit (CPU) may be of the X86 or ARM architecture, etc.

[0116] The processor 72 and the memory 71 may communicate with each other directly or indirectly. For example, the processor 72 and the memory 71 may communicate through a network. The network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 72 and the memory 71 may also communicate with each other through a system bus, and the present disclosure does not limit this.

[0117] It should be noted that Figure 7 the components of the information processing apparatus 7 shown are exemplary and not restrictive. According to actual application needs, the information processing apparatus 7 may also have other components. The processor 72 may control other components in the information processing apparatus 7 to perform desired functions.

[0118] The information processing apparatus 7 can be implemented in software, firmware, and / or hardware, and can be integrated into a device installed with relevant application programs.

[0119] Figure 8 The block diagram of an electronic device according to some other embodiments of the present disclosure is shown.

[0120] Figure 8 The illustrated electronic device 8 can be a computer system with a dedicated hardware structure, and can perform corresponding functions when installed with relevant application programs.

[0121] The electronic device includes, but is not limited to, mobile terminals such as smart phones, laptop computers, personal digital assistants (PDAs), tablet personal computers (Tablet PCs), portable multimedia players (PMPs), in-vehicle terminals (such as in-vehicle navigation terminals), wearable devices, etc., and fixed terminals such as digital TVs, desktop computers, etc.

[0122] As Figure 8 shown, the central processing unit (CPU) 81 executes various processes according to the programs stored in the read-only memory (ROM) 82 or the programs loaded from the storage section 88 into the random access memory (RAM) 83. In the RAM 83, data required when the CPU 81 executes various processes, etc., is stored as needed. The central processing unit is merely exemplary, and it can also be other types of processors, such as the various processors mentioned above. The ROM 82, RAM 83, and storage section 88 can be various forms of computer-readable storage media. It should be noted that although Figure 8 the ROM 82, RAM 83, and storage section 88 are shown separately, one or more of them can be combined, or located in the same or different memories or storage modules.

[0123] The CPU 81, ROM 82, and RAM 83 are connected to each other via a bus 84. The input / output interface 85 is also connected to the bus 84.

[0124] The following components are connected to the input / output interface 85: an input section 86, such as a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output section 87, including a display, such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage section 88, including a hard disk, a magnetic tape, etc.; and a communication section 89, including a network interface card such as a LAN card, a modem, etc. The communication section 89 allows communication processing to be performed via a network such as the Internet. It is easy to understand that although Figure 8The parts shown in the electronic device 8 communicate via the bus 84, but they can also communicate via a network or other means. Among them, the network can include a wireless network, a wired network, and / or any combination of a wireless network and a wired network.

[0125] As needed, the driver 810 is also connected to the input / output interface 85. A removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is installed on the driver 810 as needed, so that the computer program read therefrom is installed in the storage section 88 as needed.

[0126] In the case of implementing the above series of processes by software, the program constituting the software can be installed from a network such as the Internet or a storage medium such as the removable medium 811.

[0127] According to an embodiment of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product that, when run on a computer, causes the computer to implement the method of any of the foregoing embodiments. By integrating and expanding the fragmented information of the user record, the note becomes more complete and the generation and management of the note are more efficient.

[0128] The computer program product includes computer instructions carried on a computer-readable medium, including program code for executing the method shown in the flowchart. In such an embodiment, the computer instructions can be downloaded and installed from the network via the communication section 89, or installed from the storage section 88, or installed from the ROM 82. When the computer program is executed by the CPU 81, the method of the embodiment of the present disclosure is executed.

[0129] It should be noted that in the context of the present disclosure, the computer-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.

[0130] The computer-readable medium can be a computer-readable storage medium, a computer-readable signal medium, or any combination of the two.

[0131] Computer-readable storage media include, but are not limited to: electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or components, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In the present disclosure, a computer-readable storage media can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. Computer instructions are stored on the computer-readable storage media, and when executed by a processor, implement the method of any of the foregoing embodiments. By integrating and expanding the fragmented information recorded by the user, the notes are made more complete and the generation and management of the notes are made more efficient.

[0132] A computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or component. The program code contained on the computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0133] The above computer-readable medium can be included in the above electronic device; or it can exist separately without being assembled into the electronic device.

[0134] In some embodiments, a computer program is also provided, including: instructions that, when executed by a processor, cause the processor to execute the method described in any of the foregoing embodiments. For example, the instructions can be embodied as computer program code.

[0135] In embodiments of the present disclosure, computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The foregoing programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network (including a local area network (LAN) or a wide area network (WAN)), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0136] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a portion of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur in an order different from that noted in the drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system that performs the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0137] The functions described above may be performed, at least in part, by one or more hardware logic components. By way of example and not limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), application specific standard products (ASSP), system on a chip (SOC), complex programmable logic devices (CPLD), and the like.

[0138] Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art should understand that the above examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Those skilled in the art should understand that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. An information processing method, comprising: Obtaining first information input by a user; In response to a first note with the same theme as the first information being included in a note database, integrating the first information and the first note to obtain a second note; In response to the second note not meeting the user's requirements, expanding the second note to obtain a third note; Storing the third note in the note database.

2. The information processing method according to claim 1, wherein, The step of, in response to the second note not meeting the user's requirements, expanding the second note to obtain a third note, includes: In response to the second note including the user's question, determining whether there is an answer corresponding to the question in the second note; In response to there being no answer corresponding to the question in the second note, expanding the second note to obtain a third note.

3. The information processing method according to claim 1, wherein, The step of, in response to the second note not meeting the user's requirements, expanding the second note to obtain a third note, includes: In response to the second note including an activity target, determining whether there is an activity plan corresponding to the activity target in the second note; In response to there being no activity plan corresponding to the activity target in the second note, expanding the second note to obtain a third note.

4. The information processing method according to claim 1, wherein, The step of, in response to the second note not meeting the user's requirements, expanding the second note to obtain a third note, includes: In response to the first information including an image, generating text information corresponding to the image according to the semantic information of the image and other information in the second note except the image; Generating a third note according to the text information corresponding to the image and the second note.

5. The information processing method according to claim 1, wherein The step of, in response to the second note not meeting the user's requirements, expanding the second note to obtain a third note, includes: Determining keywords according to the second note and the user's requirements; Performing an online search according to the keywords to obtain relevant information of the keywords as second information; Generating an abstract according to the second information; Generating the third note according to the second note and the abstract.

6. The information processing method according to claim 1, wherein, The step of, in response to the second note not meeting the user's requirements, expanding the second note to obtain a third note, includes: Determining entities in the second note and the relationships between the entities; Generating a knowledge graph according to the entities and the relationships between the entities; Inferring the knowledge graph to determine missing information; Generating complementary information corresponding to the missing information; Generating the third note according to the complementary information and the second note.

7. The information processing method according to claim 1, wherein The step of, in response to a first note with the same theme as the first information being included in a note database, integrating the first information and the first note to obtain a second note, includes: Integrating the first information and the first note to obtain the second note according to at least one of the content of the first information, the content of the second note, the time information of the first information, and the time information of the second note.

8. The information processing method according to claim 1, wherein, In response to the first note in the note database having the same topic as the first information, integrating the first information and the first note to obtain a second note, including: Determining a plurality of tasks corresponding to the first information and the first note and priorities of the plurality of tasks; Determining an order of the plurality of tasks according to the priorities of the plurality of tasks; Integrating the first information and the first note according to the plurality of tasks and the order of the plurality of tasks to obtain the second note.

9. The information processing method according to claim 1, wherein, In response to the first note in the note database having the same topic as the first information, integrating the first information and the first note to obtain a second note, including: In response to detecting an error in at least one of the first information and the first note, correcting the error and integrating the first information and the first note to obtain a second note.

10. The information processing method according to claim 1, further including: Extracting semantic information of the first information, where the first information includes at least one of voice, text, and image; Determining a topic of the first information according to the semantic information of the first information; Calculating a similarity between a topic of a historical note in the note database and the topic of the first information; Determining the historical note with the highest similarity as the first note.

11. The information processing method according to claim 1, further including: Determining at least one task and a task time corresponding to the at least one task according to the third note; Creating a reminder event according to the at least one task and the task time corresponding to the at least one task; Sending a reminder message to the user according to the reminder event and at the task time.

12. The information processing method according to claim 1, further including: Classifying the third note to obtain a category label of the third note; In response to the user selecting the category label of the third note, displaying a thumbnail of the third note.

13. The information processing method according to claim 1, wherein, The obtaining the first information input by the user includes: On a dialogue interface with the user, in response to a triggering operation of the user on a first input control, obtaining voice information input by the user; In response to the user's hand moving from a first area where the first input control is located to a second area, determining the voice information as the first information.

14. The information processing method according to claim 1, wherein, The obtaining the first information input by the user includes: Displaying a second input control on a first display interface of the note database; In response to a triggering operation of the user on the second input control, obtaining the first information input by the user.

15. The information processing method according to claim 1, wherein, The obtaining the first information input by the user includes: In response to a selection operation of the user on a historical note on the first display interface, entering a second display interface for displaying the historical note selected by the user; Obtaining the first information input by the user on the second display interface; Determining the historical note selected by the user as the first note.

16. The information processing method according to claim 1, wherein The storing the third note in the note database includes: Replacing the first note with the third note in the note database.

17. An information processing apparatus, including: An acquisition module, configured to acquire first information input by a user; An integration module, configured to integrate the first information and a first note in response to the first note having the same theme as the first information in a note database, to obtain a second note; An expansion module, configured to expand the second note to obtain a third note in response to the second note not meeting the user's requirements; A storage module, configured to store the third note in the note database.

18. An electronic device, comprising: A memory; And A processor coupled to the memory, the processor being configured to execute the information processing method according to any one of claims 1 to 16 based on instructions stored in the memory.

19. A computer-readable storage medium, having computer program instructions stored thereon, which when executed by a processor, implement the information processing method according to any one of claims 1 to 16.

20. A computer program product, comprising computer program instructions, which when executed by a processor, implement the information processing method according to any one of claims 1 to 16.

Images