Session-based Information Processing Method, Apparatus, Computer Device, and Storage Medium

Abstract

The present application relates to a session-based information processing method, apparatus, computer device, and storage medium. The method includes: a first terminal receives a picture message sent by a second terminal corresponding to a second user object based on a session between a first user object and the second user object; the first terminal is a terminal corresponding to the first user object; when the picture content of the picture message includes user description information, a note addition entry for a target user object corresponding to the user description information is displayed in the session interface of the session; in response to a trigger operation on the note addition entry, the target user object is noted according to the user description information identified from the picture content. By using this method, corresponding note information can be quickly and effectively added to users in a session, reducing the operation steps of users and effectively improving the efficiency of note processing for users.

Description

Technical Field

[0001] The present application relates to the field of computer technologies, and particularly to a session-based information processing method, apparatus, computer device, and storage medium. Background Art

[0002] With the rapid development of Internet technologies, various instant messaging tool applications have emerged, such as QQ, WeChat, Enterprise WeChat, and DingTalk, which can effectively achieve instant online chatting, communication, etc. It provides convenience for communication between friends and communication between enterprise employees. Usually, a session can be initiated by searching for a user account identifier, such as a mobile phone number, an email address, etc., or by scanning a user's QR code, or by initiating a session after adding the user as a friend for online communication. During the communication process, natural language processing technologies based on artificial intelligence can also be used to intelligently process session messages, making the communication sessions between users more convenient.

[0003] When it is necessary to add a note to a user, usually the user needs to manually enter the corresponding information to add a note to the user, or manually enter the recognized information into the corresponding user's note information after scanning a paper business card offline and performing OCR (Optical Character Recognition) to recognize the business card information. However, in the current methods of adding note information to users, the user needs to manually input or enter the corresponding information to add note information to the user, and the operation process is relatively cumbersome, and the efficiency of information note is relatively low. Summary of the Invention

[0004] Based on this, in view of the above technical problems, it is necessary to provide a session-based information processing method, apparatus, computer device, and storage medium that can conveniently and effectively add a note to a user.

[0005] A session-based information processing method, the method includes:

[0006] Based on a session between a first user object and a second user object, a first terminal receives a picture message sent by a second terminal corresponding to the second user object; the first terminal is a terminal corresponding to the first user object;

[0007] When the picture content of the picture message includes user description information, a note addition entry for a target user object corresponding to the user description information is displayed in a session interface of the session;

[0008] In response to a trigger operation on the note addition entry, a note is added to the target user object according to the user description information recognized from the picture content.

[0009] A session-based information processing method, the method comprising:

[0010] Receiving a picture message sent by a second terminal to a first terminal based on a session between a first user object and a second user object; the first terminal is the terminal corresponding to the first user object, and the second terminal is the terminal corresponding to the second user object;

[0011] Identifying user description information in the picture content of the picture message to obtain a picture recognition result;

[0012] When the picture recognition result includes user description information, adding the user description information to the picture message;

[0013] Sending the picture message added with user description information to the first terminal, so that the first terminal displays an entry for adding a note for the target user object corresponding to the user description information according to the user description information, and after the entry for adding a note is triggered, making a note for the target user object according to the user description information.

[0014] A session-based information processing device, the device comprising:

[0015] A message receiving module, configured to receive a picture message sent by a terminal corresponding to a second user object to a first terminal based on a session between a first user object and a second user object; the first terminal is the terminal corresponding to the first user object;

[0016] An information display module, configured to, when the picture content of the picture message includes user description information, display an entry for adding a note for the target user object corresponding to the user description information in the session interface of the session;

[0017] An information note module, configured to, in response to a trigger operation on the entry for adding a note, make a note for the target user object according to the user description information identified from the picture content.

[0018] In one embodiment, the information display module is further configured to, in response to a trigger operation on the entry for adding a note, display a note entry page for the target user object, and display the user description information on the note entry page; the information note module is further configured to, in response to an addition operation on the user description information in the note entry page, generate note information for the target user object according to the user description information.

[0019] In one embodiment, the picture message includes a picture message body and a user information description picture, and the picture message body includes the user description information identified from the user information description picture; the information note module is further configured to, in response to a trigger operation on the note entry entrance, extract note content corresponding to a note item from the user description information in the picture message body, and fill the note content into a note area corresponding to the note item to generate a note entry page; in response to a selection operation on each note item in the note entry page, fill the note content corresponding to the selected note item into the note information of the target user object.

[0020] In one embodiment, the information note module is further configured to fill the user information description picture into a picture note area corresponding to the picture note item; and fill the note content in the user description information into a text note area corresponding to the text note item.

[0021] In one embodiment, the information note module is further configured to display selection controls corresponding to each note item in the note entry page; in response to a selection operation on the selection controls corresponding to each note item in the note entry page, mark the selection controls corresponding to the selected note item as the selected state; in response to an addition operation on the selected note item in the note entry page, fill the note content corresponding to the selected note item into the note information of the target user object.

[0022] In one embodiment, the message receiving module is further configured to parse the picture message; when a description tag including the user description information is parsed out in the picture message, it is determined that the picture content of the picture message includes user description information.

[0023] In one embodiment, a first application logged in by the first user object is installed in the first terminal, and the above session-based information processing device further includes an information sharing module, configured to generate a user information sharing link for the target user object according to the user description information; share the user information sharing link to a terminal corresponding to a third user object, so that the terminal corresponding to the third user object remarks the target user object according to the user description information in the user information sharing link; or share the user information sharing link to a third application in the first terminal, so that the third application adds the user description information in the user information sharing link to the address book in the third application.

[0024] In one embodiment, a first application logged in by the first user object is installed in the first terminal. The first application is an instant messaging application used by user objects belonging to a group user to communicate with others. A second application logged in by the second user object is installed in the second terminal. The second application is an instant messaging application used by an independent user object to communicate with others. The second user object is an external contact of the first user object.

[0025] An information processing device based on a session, the device includes:

[0026] A message receiving module, configured to receive a picture message sent by the second terminal to the first terminal based on a session between the first user object and the second user object. The first terminal is the terminal corresponding to the first user object, and the second terminal is the terminal corresponding to the second user object.

[0027] A picture recognition module, configured to perform user description information recognition on the picture content in the picture message to obtain a picture recognition result.

[0028] An information adding module, configured to add the user description information to the picture message when the picture recognition result includes user description information.

[0029] An information sending module, configured to send the picture message with the added user description information to the first terminal, so that the first terminal displays an entry for adding a note for the target user object corresponding to the user description information according to the user description information, and after the note adding entry is triggered, note the target user object according to the user description information.

[0030] In one embodiment, the picture recognition module is further configured to perform edge detection on the picture in the picture message, extract the edge features corresponding to the picture; according to the edge features, extract the candidate text region features in the picture; according to the candidate text region features, extract the corresponding text information; perform user description information recognition on the text information to obtain a picture recognition result.

[0031] In one embodiment, the picture message includes a picture message body and a user information description picture. The information adding module is further configured to extract the user description information from the picture recognition result when the picture recognition result includes user description information; fill the user description information into the picture message body.

[0032] In one embodiment, the information adding module is further configured to generate a description tag corresponding to the picture message according to the picture recognition result; add the description tag to the picture message; the description tag is used to identify that the picture message includes the user description information, so that after the first terminal receives the picture message, the picture message and the note adding entry are associated and displayed according to the description tag.

[0033] In one embodiment, when the picture message is the picture message first sent by the second terminal to the first terminal in the conversation between the first user object and the second user object, the picture recognition module is further configured to perform the step of identifying the user description information in the picture content of the picture message to obtain a picture recognition result.

[0034] In one embodiment, a first application logged in by the first user object is installed in the first terminal, and the first application is an instant messaging application used by a user object belonging to a group user to communicate with others; a second application logged in by the second user object is installed in the second terminal, and the second application is an instant messaging application used by an independent user object to communicate with others; the second user object is an external contact of the first user object.

[0035] A computer device includes a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0036] The first terminal receives a picture message sent by the second terminal corresponding to the second user object based on the conversation between the first user object and the second user object; the first terminal is the terminal corresponding to the first user object;

[0037] When the picture content of the picture message includes user description information, a note adding entry for the target user object corresponding to the user description information is displayed in the conversation interface of the conversation;

[0038] In response to a trigger operation on the note adding entry, the target user object is noted according to the user description information identified from the picture content.

[0039] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0040] The first terminal receives a picture message sent by the second terminal corresponding to the second user object based on the conversation between the first user object and the second user object; the first terminal is the terminal corresponding to the first user object;

[0041] When the picture content of the picture message includes the user description information of the second user object, in the conversation interface of the conversation, a note entry addition entry for the target user object corresponding to the user description information is displayed;

[0042] In response to a trigger operation on the note entry addition entry, the target user object is noted according to the user description information identified from the picture content.

[0043] The above information processing method, device, computer device, and storage medium based on a conversation. The first terminal receives a picture message sent by a second terminal corresponding to a second user object based on a conversation between a first user object and the second user object. By performing information recognition on the picture message, when the picture content of the picture message includes user description information, a note entry addition entry for the target user object corresponding to the user description information is displayed in the conversation interface of the conversation; after a trigger operation on the note entry addition entry is obtained in the conversation interface, the target user object can be noted according to the user description information identified from the picture content. Thus, after identifying the user description information in the picture message and the trigger operation on the note entry addition entry, the target user object can be automatically noted according to the user description information. The first user object does not need to manually input information to note the target user object, nor does the user need to perform frequent operations, reducing the user's operation steps, and can quickly and effectively add corresponding note information to the user in the conversation, thereby effectively improving the efficiency of note processing for the user. Description of the Drawings

[0044] Figure 1 It is an application environment diagram of the information processing method based on a conversation in an embodiment;

[0045] Figure 2 It is a schematic flowchart of the information processing method based on a conversation in an embodiment;

[0046] Figure 3 It is a schematic diagram showing the display of a note entry addition entry for the second user object in the conversation interface in an embodiment;

[0047] Figure 4 It is a schematic diagram showing the display of a note item for the second user object in the note entry page in an embodiment;

[0048] Figure 5 It is a schematic diagram after noting the second user object in the conversation in an embodiment;

[0049] Figure 6 It is a schematic flowchart of the information processing method based on a conversation in another embodiment;

[0050] Figure 7 It is a timing diagram of the session-based information processing method in an embodiment;

[0051] Figure 8 It is a flowchart of the session-based information processing method in a specific application scenario in an embodiment;

[0052] Figure 9 It is a structural block diagram of the session-based information processing device in an embodiment;

[0053] Figure 10 It is a structural block diagram of the session-based information processing device in another embodiment;

[0054] Figure 11 It is an internal structure diagram of a computer device in an embodiment;

[0055] Figure 12 It is an internal structure diagram of a computer device in another embodiment. Detailed implementation manners

[0056] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0057] It can be understood that the terms "first", "second", etc. in the specification, claims and drawings of the present application are used to distinguish similar objects and do not necessarily need to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or server including a series of steps or units does not necessarily need to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0058] The session-based information processing method provided by the present application can be applied to, for example Figure 1In the application environment shown. Among them, the first terminal 102 communicates with the application server 104 through the network, and the second terminal 106 communicates with the application server 104 through the network. The second terminal 106 sends a picture message based on the session between the first user object and the second user object to the application server 104, and the application server 104 sends the picture message to the first terminal 102. The first terminal 102, based on the session between the first user object and the second user object, receives the picture message sent by the second terminal 106 corresponding to the second user object. By performing information recognition on the picture message, when the picture content of the picture message includes the user description information of the second user object, the first terminal 102 then displays an entry for adding a note for the second user object in the session interface of the session; after the first terminal 102 obtains a trigger operation for the note addition entry, it can add a note to the target user object according to the user description information recognized from the picture content. Among them, the first terminal 102 and the second terminal 106 can be but are not limited to various smart phones, tablet computers, notebook computers, desktop computers, smart speakers, smart watches, etc., but are not limited thereto. The application server 104 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The first terminal 102, the second terminal 106, and the server 104 can be directly or indirectly connected through wired or wireless communication methods, and this application does not limit this here.

[0059] Cloud computing refers to the delivery and usage model of IT infrastructure, which means obtaining the required resources through the network in a demand-driven and easily scalable manner; in a broad sense, cloud computing refers to the delivery and usage model of services, which means obtaining the required services through the network in a demand-driven and easily scalable manner. Such services can be related to IT and software, the Internet, or other services. Cloud computing is the product of the development and integration of traditional computer and network technologies such as grid computing, distributed computing, parallel computing, utility computing, network storage technologies, virtualization, and load balance. With the development of the Internet, real-time data streams, and the diversification of connected devices, as well as the promotion of demands such as search services, social networks, mobile commerce, and open collaboration, cloud computing has developed rapidly. Different from previous parallel and distributed computing, the emergence of cloud computing will, in concept, drive a revolutionary change in the entire Internet model and enterprise management model.

[0060] Artificial Intelligence (AI) is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a way similar to human intelligence. Artificial intelligence also studies the design principles and implementation methods of various intelligent machines to enable the machines to have the functions of perception, reasoning, and decision-making. Computer Vision Technology (CV): Computer vision is a science that studies how to enable machines to "see". More specifically, it refers to using cameras and computers to replace human eyes for tasks such as object recognition, monitoring, and measurement, which are machine vision, and further performing image processing to make the computer-processed images more suitable for human eye observation or transmission to instruments for detection. Computer vision technology usually includes technologies such as image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, and also includes common biometric recognition technologies such as face recognition and fingerprint recognition.

[0061] It can be understood that the session-based information processing method in each embodiment of the present application can use a content delivery network based on cloud computing to conduct communication sessions between multiple terminals. It can also use computer vision technology based on artificial intelligence to perform image recognition and image semantic understanding on the picture content in the picture message, so as to identify the user description information of the user object included in the picture message.

[0062] In one embodiment, as Figure 2 shown, a session-based information processing method is provided. Taking the case where this method is applied to Figure 1 the first terminal as an example, the method includes the following steps:

[0063] S202, based on the session between the first user object and the second user object, the first terminal receives a picture message sent by the second terminal corresponding to the second user object; the first terminal is the terminal corresponding to the first user object.

[0064] Among them, an application program corresponding to the user account of the first user object is installed in the first terminal, and an application program corresponding to the user account of the second user object is installed in the second terminal. The application program can be a mobile application program or a web application program. For example, it can be a social application, a mail application, a payment application or a game application, etc. Among them, social applications include application programs such as instant messaging applications, SNS (Social Network Service) applications or live broadcast applications.

[0065] It can be understood that a session refers to the process of a terminal communicating with an interactive system. The session between the first user object and the second user object refers to the session in which the first user object communicates with the second terminal of the second user object through the first terminal based on the application platform system.

[0066] Among them, the application program corresponding to the first user object and the application program corresponding to the second user object can be the same application program or different application programs. The first user object can initiate a session to the second user object through the corresponding first terminal, and the second user object can also initiate a session to the first user object through the corresponding second terminal to send or receive messages sent by each user object. It can be understood that a message refers to the object transmitted by a communication system and is the carrier of information. The messages transmitted in a communication session can include various forms of information, such as different forms of information such as text, voice, pictures, and file data. A picture message refers to a message that includes a picture.

[0067] In one embodiment, the second user object can directly initiate a session request to the user account corresponding to the first user object through the application logged in on the second terminal, so as to establish a session between the first user object and the second user object. The second user object can then send a message to the second terminal corresponding to the second user object based on the session between the first user object and the second user object through the corresponding second terminal.

[0068] In one embodiment, the first user object can initiate a friend addition request to the user account corresponding to the second user object through the application logged in on the first terminal. After the first user object and the second user object are added as friends, a session between the first user object and the second user object is established, such as a one-on-one chat session between the first user object and the second user object.

[0069] In one embodiment, the user accounts of the first user object and the second user object can belong to users in the same group. The first user object and the second user object can conduct a communication session in the same group. Specifically, the second user object can send a message in the group including the first user object through the corresponding second terminal, such as a group chat session including the first user object and the second user object. The first user object can then receive the message sent by the second terminal in the group through the corresponding first terminal.

[0070] Specifically, when the first user object and the second user object conduct a session through the corresponding application platform, the first user object can receive a picture message sent by the second terminal corresponding to the second user object based on the session between the first user object and the second user object through the corresponding first terminal.

[0071] S204, when the picture content of the picture message includes user description information, an entry for adding a note of the target user object corresponding to the user description information is displayed in the session interface of the session.

[0072] Wherein, the user description information refers to information used to describe a user, such as user business card information. It includes user information such as the name, enterprise, phone number, email, address, etc. of the user object.

[0073] It can be understood that when the first user object and the second user object conduct a session through the corresponding application platform, the first terminal and the second terminal can display the session interface for the first user object and the second user object to conduct a session in the corresponding application platform. The first user object and the second user object can send or receive messages in the corresponding session interfaces respectively.

[0074] Among them, the note addition entry refers to a control used to trigger the note processing for a user object. The note addition entry is configured with corresponding encapsulated attributes and methods for implementing the function of adding notes to the corresponding user object. The note addition entry can be in the form of text, icon, etc., and is displayed in the conversation interface.

[0075] Based on the conversation between the first user object and the second user object, after the first terminal receives the picture message sent by the second terminal corresponding to the second user object, the first terminal identifies the picture content of the picture message to obtain the corresponding text content. It can further identify the text content to obtain the recognition result. For example, the picture message may include user description information of the second user object or other user objects in the address book, such as the business card information of the user. Specifically, it can be determined whether the picture content includes the user description information of the user object by identifying whether the text content includes the user description field identifier. When it is recognized that the picture content includes the user description information, the target object corresponding to the user description information can be determined according to the corresponding user description field. For example, if the user description information includes the user description content corresponding to the "name" field identifier, the target object corresponding to the user description information can be determined according to the user description content corresponding to "name".

[0076] In one embodiment, after the first terminal receives the picture message, the first terminal identifies the picture in the picture message to extract the text information contained in the picture content, and further identifies whether the text information includes the user description information. For example, the picture can be recognized by OCR to extract the text information contained in the picture content. Among them, the OCR recognition technology is already relatively mature and will not be elaborated here.

[0077] In another embodiment, after the second user object sends a picture message to the first user object through the second terminal, the application server corresponding to the application in the first terminal obtains the picture message sent by the second terminal. The application server can also perform picture recognition on the picture to extract the text information contained in the picture content. When the recognized text information includes the user description information, the user description information is extracted, and the picture message and the user description information are sent to the first terminal together. Thus, after the first terminal receives the picture message, it can directly identify whether the picture message includes the user description information.

[0078] In another embodiment, after the first terminal receives a picture message and displays the picture message in the session interface of the session between the first user object and the second user object, the first user object can further trigger an identification operation on the picture in the picture message to detect whether the picture includes user description information. Specifically, the first terminal obtains the trigger operation of the first user object on the picture in the picture message, and then, according to the trigger operation of the first user object, identifies the picture content in the picture message and performs user description information detection to identify whether the picture content in the picture message includes user description information.

[0079] In one embodiment, the above method further includes: parsing the picture message; when a description tag indicating that the picture message includes user description information is parsed, it is determined that the picture content in the picture message includes user description information.

[0080] Among them, the description tag can be an identifier for marking the picture message, such as a flag bit or a marker bit, and is used to indicate that the picture message includes user description information.

[0081] After the application server receives the picture message sent by the second terminal to the first terminal corresponding to the first user object and performs picture recognition on the picture to obtain the corresponding picture recognition result, when the picture recognition result includes user description information, the application server also adds a description tag to the picture message. After the first terminal receives the picture message, it can directly determine that the picture message includes the user description information corresponding to the second user object according to the description tag carried by the picture message, and then trigger the display of the entry for adding a note for the target user object corresponding to the user description information.

[0082] In this embodiment, by adding a description tag to the picture message including the user description information of the second user object by the application server, the first terminal can quickly determine that the picture message includes user description information according to the description tag carried by the picture message after receiving the picture message, and after displaying the picture message in the session interface with the second user object, can immediately associate and display the entry for adding a note for the target user object.

[0083] After the first terminal receives the picture message, it displays the picture message in the session interface with the second user object. When the first terminal identifies that the picture content in the picture message includes user description information, it displays the entry for adding a note for the target user object corresponding to the user description information in the session interface of the session. The entry for adding a note displayed in the session interface can be displayed in the form of a text identifier, an icon identifier, etc. Among them, when the entry for adding a note is displayed, the picture message is associated and displayed with the corresponding entry for adding a note.

[0084] It can be understood that the user description information can be the user description information for the second user object or the user description information for other user objects. When the user description information is the user description information for the second user object, the target user object is the second user object. The first terminal can directly display an entry for adding a note for the second user object in the conversation interface with the second user object. This is used to instruct the user to trigger this entry for adding a note to add a note to the second user object.

[0085] For example, as Figure 3 shown, it is a schematic diagram showing an entry for adding a note for the second user object in the conversation interface in an embodiment. Referring to Figure 3 , when the first terminal receives a picture message and recognizes that the picture content includes the user description information of the second user object, for example, the user description information can be business card information. The first terminal then displays the picture message in the conversation interface of the conversation and displays an entry for adding a note below the picture message, that is, "Add business card information to notes".

[0086] When the user description information is the user description information for other user objects (other user objects are user objects other than the second user object), the first terminal can also directly display an entry for adding a note for the corresponding user object in the conversation interface. So that the first user object can add a note to the corresponding user object.

[0087] Furthermore, when the user description information is the user description information for other user objects, it can also first identify whether the user object is the target user object in the conversation address book. If so, an entry for adding a note for the corresponding target user object in the conversation address book is displayed in the conversation interface.

[0088] S206, in response to the trigger operation for the entry for adding a note, add a note to the target user object according to the user description information recognized from the picture content.

[0089] It can be understood that the trigger operation is that the user triggers an event processing for adding a note to the target user object by triggering the entry for adding a note displayed in the conversation interface in the first terminal, such as clicking, touching and other operations.

[0090] After the first terminal displays a note entry option in the conversation interface, the user can trigger the note entry option to add a note to the target user object. Specifically, after the first terminal responds to the trigger operation of the first user object on the note entry option, it fills the user description information recognized from the picture content into the area corresponding to the note information of the target user object, thereby realizing adding a note to the target user object. It can be understood that the area corresponding to the note information may include the address book note name area for the target user object, and may also include the note area corresponding to the personal information of the target user object.

[0091] Specifically, the application corresponding to the user account of the first user object includes a user address book, and the note information for the target user object can be stored in the account information for the target user object, such as in the note information of a contact in the address book. Specifically, the user account corresponding to the target user object and the note information can be stored in the note database set for the current first user object account. The note database can be used to store, for the user account of the first user object, the second user object and the user accounts and corresponding note information of multiple user objects, and can also store stranger accounts and corresponding note information.

[0092] For example, the target user object can be a friend in the address book of the first user object in a communication application. The note information for the target user object can be address book note information, such as the note name and other information for this friend.

[0093] In one embodiment, after the first terminal responds to the trigger operation of the first user object on the note entry option, it can directly, based on the trigger operation on the note entry option, realize one-key note adding to the target user object with the user description information recognized from the picture content.

[0094] In one embodiment, after the first terminal responds to the trigger operation of the first user object on the note entry option, it can display a note entry page for the target user object in the conversation interface, display the user description information recognized from the picture content in the note entry page, and then, according to the confirmation operation of the user on the displayed user description information, add a note to the target user object.

[0095] In one embodiment, when there is already historical note content in the note information for the target user object, the note content in the recognized user description information can also be compared with the existing historical note content. If the comparison result is inconsistent, indicating that the user description information of the target user object has been updated, the note information for the target user object is updated according to the note content in the recognized user description information.

[0096] In the above session-based information processing method, the first terminal is the terminal corresponding to the first user object; the first terminal receives a picture message sent by the second terminal corresponding to the second user object based on the session between the first user object and the second user object. By performing information recognition on the picture message, when the picture content of the picture message includes user description information, an entry for adding a note to the target user object corresponding to the user description information is displayed in the session interface of the session; when a trigger operation on the note addition entry is obtained in the session interface, the target user object can be noted according to the user description information recognized from the picture content. Thus, after recognizing the user description information in the picture message and the trigger operation of the note addition entry, the target user object can be automatically noted according to the user description information. The first user object does not need to manually input information to note the target user object, nor does the user need to perform frequent operations, reducing the user's operation steps, and can quickly and effectively add corresponding note information to the user in the session, thereby effectively improving the efficiency of note processing for the user.

[0097] In one embodiment, the above method further includes: in response to a trigger operation on the note addition entry, displaying a note entry page for the target user object, and displaying the user description information on the note entry page; in response to an addition operation on the user description information on the note entry page, generating note information for the target user object according to the user description information.

[0098] It can be understood that the note entry page refers to the page for adding and entering note information displayed, which is used to instruct the user to perform operation processing on the information to be entered as a note. For example, the first user object can select which information needs to be added to the note information for the target user object in the note entry page of the session interface.

[0099] Specifically, after the first terminal responds to the trigger operation on the note addition entry, it also displays a note entry page for the target user object, and fills the user description information into the corresponding area of the note entry page, so as to display the user description information extracted from the picture content on the note entry page. Among them, the note entry page can be directly displayed on the basis of the session interface between the first user object and the second user object, or a new page can be popped up for display, which is not limited here.

[0100] The note entry page can also include options for each user description information, and the user can select the required user description information and add it to the note information for the target user object.

[0101] The first terminal obtains an addition operation of the first user object to the user description information in the note entry page, and generates note information of the target user object according to the added user description information, thereby effectively implementing the note of the target user information.

[0102] In this embodiment, by displaying a note entry page including the identified user description information, it is possible to assist the user in conveniently adding the user description information to the note information of the target user object, so that the corresponding note information can be quickly and effectively added to the user in the conversation.

[0103] In one embodiment, the picture message includes a picture message body and a user information description picture. The picture message body includes the user description information identified from the user information description picture. The steps of making a note for the target user object according to the user description information identified from the picture content in response to a trigger operation for the note entry port include: in response to a trigger operation for the note entry port, extracting the note content corresponding to the note item from the user description information of the picture message body, and filling the note content into the note area corresponding to the note item to generate a note entry page; in response to a selection operation for each note item in the note entry page, filling the note content corresponding to the selected note item into the note information of the target user object.

[0104] Among them, the picture message received by the first terminal includes a picture message body and a user information description picture. The picture message body is a data structure of the user description picture information, which is used to store the picture information fields and the user description information identified from the picture content. The user information description picture refers to a picture including user description information, that is, the picture content includes user information, such as a business card picture and other pictures.

[0105] It can be understood that the note item is related information for adding note information of the user object, such as note items of multiple types including the user's name, enterprise, phone number, company address, email, etc. The note entry page includes each note item and the corresponding note area, and the note area is used to display the note content corresponding to each note item.

[0106] Specifically, after the first terminal receives a picture message including a picture message body and a user information description picture sent by the second terminal, it displays the user information description picture in the conversation with the second user object, and displays a note entry port for the target user object. After the first terminal obtains a trigger operation of the first user object for the note entry port, it extracts the note content corresponding to the note item from the user description information of the picture message body, and fills the note content into the note area corresponding to the note item to generate and display a note entry page.

[0107] The note entry page may also include options for each note item and note content. The user can select the desired note items and add them to the note information of the target user object.

[0108] The note entry page may also include a note addition control for triggering the addition of each note item and note content displayed on the note entry page to the note information of the corresponding user object. After the first terminal obtains the addition operation of the first user object on the user description information in the note entry page, it fills the note content corresponding to the selected note item into the note information of the target user object, thereby effectively realizing the annotation of the target user information.

[0109] In this embodiment, by displaying the note items and note content corresponding to the user description information on the note entry page, it can assist the user to conveniently add the user description information to the note information of the target user object, so that the corresponding note information can be quickly and effectively added to the user in the session.

[0110] In one embodiment, the note items include a picture note item and a text note item; filling the note content into the note area corresponding to the note item includes: filling the user information description picture into the picture note area corresponding to the picture note item; filling the note content in the user description information into the text note area corresponding to the text note item.

[0111] Among them, the note items may also include a picture note item and a text note item. The picture note item refers to a note item in the form of a picture, and the text note item refers to a note item in the form of text.

[0112] After the first terminal receives a picture message sent by the second terminal, which includes a picture message body and a user information description picture, it extracts the note content corresponding to each note item from the picture message and fills the note content into the note area corresponding to the note item.

[0113] Specifically, the first terminal extracts the user information description picture in the picture message and fills the user information description picture into the picture note area corresponding to the picture note item, that is, fills the user information description picture as the note content corresponding to the picture note item. At the same time, the first terminal extracts the user description information from the picture message body carried in the picture message, and then extracts it from the user description information into the text note area corresponding to each text note item, that is, fills each user description information as the note content corresponding to each text note item. The first terminal then generates a note entry page according to the filled note content and displays it.

[0114] In this embodiment, by displaying a picture note item and a text note item, as well as their respective corresponding note contents, on the note entry page, it is possible for the user to conveniently and effectively add user description information and use information to describe the picture into the note information of the target user object, so that the corresponding note information can be quickly and effectively added to the user in the conversation.

[0115] In one embodiment, after the first terminal displays the note entry page, it further includes: in the note entry page, displaying selection controls corresponding to each note item; in response to a selection operation on the selection controls of each note item in the note entry page, marking the selection controls corresponding to the selected note items as the selected state;

[0116] Filling the note content corresponding to the selected note item into the note information of the target user object includes: in response to an addition operation on the selected note item in the note entry page, filling the note content corresponding to the selected note item into the note information of the target user object.

[0117] The note entry page may further include selection controls corresponding to each note item. The user can select the required note items by triggering the selection controls corresponding to each note item to add them to the note information of the target user object.

[0118] The first user object can select the selection controls corresponding to each note item on the note entry page by clicking or touching operations. After the first terminal obtains the selection operation of the first user object on the selection controls of each note item, it marks the selection controls corresponding to the selected note items as the selected state.

[0119] The note entry page may further include a note addition control for triggering the addition of each note item and note content displayed on the note entry page to the note information of the corresponding user object.

[0120] After the first user object selects each note item to be added to the note information, it can also trigger the addition control by clicking or touching operations. When the first terminal obtains the addition operation of the first user object on the selected note items in the note entry page, it adds the note content corresponding to the selected note items to the note information of the target user object, thereby making a note on the target user object.

[0121] For example, when the target object is the second user object, as Figure 4 shown, it is a schematic diagram of displaying note items for the second user object on the note entry page in one embodiment. Refer to Figure 4, the note entry page includes each note item and its corresponding note content, namely "Note Name - Zhang San", "Enterprise - xxxx Company", "Phone - 131xxxxxxxx", "Business Card - Picture of User Information Description". There is also a corresponding selection control behind each note item. When the selection control corresponding to each note item is triggered and selected by the user, it will be displayed as the selected state. Below each note item, there is also an addition control. When the user selects a note item and triggers this addition control, the note content corresponding to the selected note item will be added to the note information of the second user object, thus realizing the addition of notes to the second user object. When the first terminal successfully adds notes to the second user object during a session, a prompt message of "Added" can also be displayed in the session with the second user object, and the corresponding information in the session is updated according to the note information after the addition. As Figure 5 shown, it is a schematic diagram of adding notes to the second user object in a session in an embodiment.

[0122] In this embodiment, by displaying each note item and its corresponding selection control on the note entry page, it can assist the user to conveniently select the user description information to be added to the note information, so that the corresponding note information can be quickly and effectively added to the user in the session.

[0123] In an embodiment, a first application logged in by the first user object is installed on the first terminal. The above method further includes: generating a user information sharing link for the target user object according to the user description information; sharing the user information sharing link to the terminal corresponding to the third user object, so that the terminal corresponding to the third user object can add notes to the target user object according to the user description information in the user information sharing link; or, sharing the user information sharing link to a third application in the first terminal, so that the third application adds the user description information in the user information sharing link to the address book in the third application.

[0124] It can be understood that a first application logged in by the first user object is installed on the first terminal, and the first terminal communicates with the second user object through the first application. The first user object can also communicate with the third user object through the first application installed on the first terminal. For example, the first application includes the address book corresponding to the first user object, which includes the second user object and may also include other user objects except the second user object, that is, the third user object.

[0125] After the first terminal makes a note for the target user object according to the recognized user description information, it can also generate a user information sharing link for the target user object based on the user description information. For example, taking the case where the picture message includes a business card, the first terminal can generate a corresponding user information sharing link according to the user description information recognized from the business card. It can also directly generate a business card sharing link corresponding to the business card picture according to the user information description of the picture, that is, the business card. It can also generate a business card sharing link corresponding to the target user object according to the business card picture and the recognized user description information.

[0126] After the first terminal generates a user information sharing link for the target user object, it can share the user information sharing link to the terminal corresponding to the third user object in the first application, so that the terminal corresponding to the third user object makes a note for the target user object according to the user description information in the user information sharing link. Thus, the third user object can also make a note for the target application object conveniently and effectively according to the user description information in the user information sharing link.

[0127] Specifically, when the address book corresponding to the third user object includes the target user object, it can directly make a note for the target user object according to the user description information in the user information sharing link, or update the note information of the target user object. When the address book corresponding to the third user object does not include the target user object, the third user object can, through the corresponding terminal, add the target user object to the address book corresponding to the third user object according to the user description information in the user information sharing link, such as adding the target user object as a friend or following the user account corresponding to the target user object. And further make a note for the target user object according to the user description information in the user information sharing link.

[0128] It can be understood that the first terminal is also installed with a third application logged in by the first user object, and the third application is different from the first application, that is, the third application is another application logged in by the first user object installed in the first terminal.

[0129] After the first terminal generates a user information sharing link for the target user object, it can also share the user information sharing link to a third application in the first terminal, so that the third application adds the user description information in the user information sharing link to the address book in the third application. For example, after the first terminal makes a note of the user information for the user according to the identified user description information, it can generate a user information sharing link, such as a business card sharing link. And share it with other applications in the first terminal for address book information storage, so that the first terminal can also synchronously make a note or store address book information for the account corresponding to the target user object according to the identified user description information, so as to be able to conveniently and effectively make a note of the user information or store address book information for the target user object in different applications.

[0130] In one embodiment, the same application program is installed in both the first terminal and the second terminal. The first user object logs in to the application program through the first terminal, and the second user object logs in to the application program through the corresponding second terminal. The application program can be an instant messaging application used by an independent user to communicate with others. For example, specifically, it can be the WeChat program. The first user object can use the corresponding user account to have a conversation with the user account corresponding to the second user object through the application program. Thus, the first terminal can receive the picture message sent by the second terminal corresponding to the second user object based on the conversation between the first user object and the second user object.

[0131] In another embodiment, the application program can also be an instant messaging application based on a group of users. For example, specifically, it can be the Enterprise WeChat program. Among them, the first user object and the second user object can belong to the same group of users, for example, they are user objects in the same enterprise group. In another embodiment, the first user object and the second user object can also belong to different groups of users. For example, the first user object and the second user object are user objects in enterprise groups of different enterprises.

[0132] In one embodiment, a first application logged in by the first user object is installed in the first terminal. The first application is an instant messaging application used by user objects in a group of users to communicate with others; a second application logged in by the second user object is installed in the second terminal. The second application is an instant messaging application used by an independent user object to communicate with others; the second user object is an external contact of the first user object.

[0133] It can be understood that the first application and the second application in this embodiment are two different application programs, and both the first application and the second application are application programs with communication functions. The first application is an instant messaging application used by a user object belonging to a group user to communicate with others; the second application is an instant messaging application used by an independent user object to communicate with others. Cross-application communication can be carried out between the first application and the second application.

[0134] For example, the first application can be the WeCom application, and the first user object logs in to the WeCom application on the first terminal through the corresponding WeCom account. The second application can be the WeChat application, and the second user object logs in to the WeChat application on the second terminal through the corresponding WeChat account.

[0135] The first application and the second application can also be provided with an external contact service component, which can be used to handle the friend addition service between the current first user object and a user (the second user object) outside the group user group where the first user object is located. Among them, the users outside the group where the first user object is located can include, but are not limited to, users in different group user groups of the first user object in the same application.

[0136] The external contact service component can communicate with the background of the first application (the first application server), and the first application server corresponding to the first application can communicate with the second application server corresponding to the second application to send and receive relevant data between the first user object and the second user object outside the group user group where the first user object is located.

[0137] The first end corresponding to the first application can perform friend addition operations or session processing among users in different group user groups in the first application through the external contact service component, that is, it can initiate a session after adding the second user object as a friend through the external contact service component, or directly initiate a session to the second user object through the external contact service component. Therefore, the second user object is the external contact of the first user object.

[0138] The second user object can then send a communication message (including a picture message, etc.) to the second application server through the corresponding second terminal, the second application server forwards the communication message to the first application server, and the first application server then sends the communication message to the first terminal. The first terminal can then receive the picture message sent by the second terminal corresponding to the second user object according to the session between the first user object and the second user object, and further identify and process the picture message to further add a note to the target user object.

[0139] In this embodiment, by establishing a session between external contacts in the first application and the second application, it is possible to effectively implement direct communication between the client terminals of users in two different group user groups, and directly add information remarks to users based on the picture messages sent and received during the session, greatly improving the efficiency of adding remarks to session users.

[0140] In one embodiment, as Figure 6 shown, a session-based information processing method is provided. Taking the application server in Figure 1 as an example, the method includes the following steps:

[0141] S602, receiving a picture message sent by the second terminal to the first terminal based on the session between the first user object and the second user object; the first terminal is the terminal corresponding to the first user object, and the second terminal is the terminal corresponding to the second user object.

[0142] Among them, an application program corresponding to the user account of the first user object is installed in the first terminal, and an application program corresponding to the user account of the second user object is installed in the second terminal. The application program corresponding to the first user object and the application program corresponding to the second user object can be the same application program or different application programs. The first user object can initiate a session to the second user object through the corresponding first terminal, and the second user object can also initiate a session to the first user object through the corresponding second terminal to send or receive messages sent by each user object.

[0143] The second user object can send communication messages (including picture messages, etc.) to the first user object through the application program in the corresponding second terminal to the application server. The application server can then receive the communication message sent by the second terminal and send the communication message to the first terminal corresponding to the first user object, so that the first user object and the second user object can communicate and have a session through the application programs in the corresponding terminals respectively. For example, the application server can be a server based on CDN (Content Delivery Network).

[0144] S604, identifying user description information in the picture content of the picture message to obtain a picture recognition result.

[0145] After receiving the picture message sent by the second terminal, the application server identifies the picture in the picture message to extract the text information contained in the picture content. For example, the picture can be recognized by OCR to extract the text information contained in the picture content. Then, the text information is identified for user description information to identify whether the picture content includes user description information and obtain a picture recognition result.

[0146] In one embodiment, the application server may also send the picture in the picture message to an image processing server, and the image processing server may identify the user description information in the picture content of the picture message to obtain a picture recognition result and return the picture recognition result to the application server.

[0147] In one embodiment, when the picture message is the picture message first sent by the second terminal in the conversation between the first user object and the second user object to the first terminal, the step of identifying the user description information in the picture content of the picture message to obtain a picture recognition result is performed.

[0148] It can be understood that after the first user object and the second user object establish a conversation through the corresponding application, when the second user object first sends a picture message to the first terminal through the second terminal and the application server receives the picture message sent by the second terminal, it is determined whether the picture message is the picture message first sent by the second terminal in the conversation between the first user object and the second user object. If so, the application server performs the step of identifying the user description information in the picture content of the picture message to obtain a picture recognition result. If not, the picture message sent by the second terminal is directly sent to the first terminal.

[0149] For example, in a one-on-one chat conversation, after the first user object and the second user object add each other as friends, the first picture message sent by the second user object to the first user object after adding friends is received, and the received picture is recognized to determine whether it is a business card for user information description, such as a business card.

[0150] In this embodiment, by identifying the picture content of the picture information first received in the conversation between the first user object and the second user object, it is possible to effectively avoid large resource consumption caused by performing picture recognition on each picture. Therefore, without affecting the user interaction experience, the user description information in the picture message can be effectively identified in the conversation.

[0151] S606, when the picture recognition result includes user description information, add the user description information to the picture message.

[0152] When the picture recognition result includes user description information, the application server adds the identified user description information to the picture message. For example, the identified user description information can be added to the data structure corresponding to the picture message, so that the user description information recognized by the picture message is included in the picture message.

[0153] S608, send the picture message after adding the user description information to the first terminal, so that the first terminal can display an entry for adding a note for the target user object corresponding to the user description information according to the user description information body, and after the note addition entry is triggered, the target user object is noted according to the user description information.

[0154] The application server then sends the picture message after adding the user description information to the first terminal. As a result, when the first terminal receives the picture message, it can directly recognize that the picture content of the picture message includes the user description information of the user object. The first terminal then displays an entry for adding a note for the target user object corresponding to the user description information according to the user description information body, and after the note addition entry is triggered, the target user object can be noted according to the user description information recognized from the picture content.

[0155] In the above session-based information processing method, the second terminal sends a picture message to the application server based on the session between the first user object and the second user object. After the application server receives the picture message sent by the second terminal, through information recognition of the picture message, when the picture recognition result includes user description information, the user description information is added to the picture message. The application server then sends the picture message after adding the user description information to the first terminal, so that the first terminal can display an entry for adding a note for the target user object corresponding to the user description information in the session interface of the session according to the user description information body, and after the note addition entry is triggered, the target user object can be noted according to the user description information recognized from the picture content. Thus, after recognizing the user description information in the picture message and triggering the note addition entry operation, the target user object can be automatically noted according to the user description information. The first user object does not need to manually input information to note the target user object, nor does the user need to perform frequent operations, reducing the user's operation steps, and can quickly and effectively add corresponding note information to the user in the session, thereby effectively improving the efficiency of note processing for the user.

[0156] In one embodiment, the user description information recognition of the picture content in the picture message to obtain the picture recognition result includes: performing edge detection on the picture in the picture message to extract the edge features corresponding to the picture; according to the edge features, extracting the candidate text region features in the picture; according to the candidate text region features, extracting the corresponding text information; and performing user description information recognition on the text information to obtain the picture recognition result.

[0157] After the application server receives a picture message, it performs text content recognition on the picture in the picture message. The application server first performs edge detection on the picture. Specifically, the application server first identifies the background area in the picture according to the pixel values of the picture. The background area can be an area where the pixel values in the image change relatively smoothly. Then, based on the pixel values and the background area, edge detection is performed, and the edge features in the picture are extracted.

[0158] The application server further identifies the candidate text areas other than the background area according to the edge features, extracts the candidate text area features, then, according to the candidate text area features, identifies the content pixel values in the candidate text area, and then extracts the corresponding text content according to the content pixel values, so as to obtain the corresponding text information.

[0159] The application server then performs user description information recognition on the extracted text information, that is, it recognizes whether the information category of the extracted text information is user description information. Specifically, the application server can classify the text information to obtain the corresponding information category result. When the information category result indicates that it belongs to user description information, it can be determined that the picture includes user description information. Specifically, the application server can also determine whether the text information includes a user description field identifier to determine whether the picture content includes the user description information of the user object, so as to obtain the picture recognition result of the picture message.

[0160] In this embodiment, by performing text recognition and user description information recognition on the picture content in the picture message, it is possible to accurately and effectively identify whether the picture message includes user description information, and then it is possible to conveniently and effectively add corresponding note information to the user according to the identified user description information in the session.

[0161] In one embodiment, the picture message includes a picture message body and a user information description picture; the step of adding the user description information to the picture message when the picture recognition result includes the user description information includes: when the picture recognition result includes the user description information, extracting the user description information from the picture recognition result; filling the user description information into the picture message body.

[0162] Among them, the picture message body is a data structure for describing picture information of the user, and is used to store picture information fields and the user description information identified from the picture content.

[0163] After the application server recognizes the picture content in the picture message, when the picture recognition result includes user description information, the recognized user description information is filled into the picture message body. Specifically, the application server can fill the user description information into the picture message body respectively according to the preset user information fields. The user description information can also include the recognized user information fields and the corresponding field contents, and then can be filled into the picture message body according to the user information fields and the corresponding field contents. Thus, the recognized user description information can be effectively filled directly into the picture message body included in the picture message.

[0164] In one embodiment, the above method further includes: generating a description label corresponding to the picture message according to the picture recognition result; adding the description label to the picture message; the description label is used to identify that the picture message includes user description information, so that after the first terminal receives the picture message, the picture message and the note addition entry are associated and displayed according to the description label.

[0165] After the application server receives the picture message sent by the second terminal to the first terminal corresponding to the first user object and performs picture recognition on the picture to obtain the corresponding picture recognition result. When the picture recognition result includes user description information, the application server also adds a description label to the picture message. After the first terminal receives the picture message, it can directly determine that the picture message includes user description information according to the description label carried by the picture message, and then trigger the display of the note addition entry for the target user object corresponding to the user description information. Thus, after the first terminal receives the picture message, it can quickly determine the user description information included in the picture message according to the description label, and after displaying the picture message in the conversation interface with the second user object, it can immediately associate and display the note addition entry for the target user object corresponding to the user description information.

[0166] In one embodiment, a first application logged in by the first user object is installed in the first terminal, and the first application is an instant messaging application used by a user object belonging to a group user to communicate with others; a second application logged in by the second user object is installed in the second terminal, and the second application is an instant messaging application used by an independent user object to communicate with others; the second user object is an external contact of the first user object.

[0167] The first application server corresponding to the first application can communicate with the second application server corresponding to the second application to send and receive relevant data between the first user object and the second user object outside the group user group where the first user object is located.

[0168] The second user object can send a picture message to the first user object through the corresponding second terminal to the second application server. After receiving the picture message, the second application server forwards the picture message to the first application server. After receiving the picture message, the first application server identifies the user description information in the picture content of the picture message to obtain a picture recognition result. When the picture recognition result includes the user description information of the second user object, the user description information is added to the picture message. The second application server then sends the picture message with the added user description information to the first terminal, so that the first terminal displays an entry for adding a note for the target user object corresponding to the user description information according to the user description information body, and after the note addition entry is triggered, the target user object is noted according to the user description information.

[0169] For example, after the first user object and the second user object are established as external contacts, the second user object sends a picture message with a business card to the first user object. First, the second terminal uploads the picture message to the second application server. For example, the second application server can be a CDN server. After receiving the picture message, the second application server obtains the file identifier corresponding to the picture message, such as filedid, and key information, such as AES_Key and md5 and other CDN picture information. Then the second application service forwards the obtained picture message and CDN picture information to the first application server. After receiving the picture message, the first application server first downloads the original picture data from the CDN network, then compresses the picture sent by the second user object, and at the same time encodes the picture data, such as using base64 encoding. The first application server can also send an https post request of the picture to the image processing background. This enables the image processing background to perform operations such as edge detection and OCR on this picture to extract text information, and returns the recognition result of the text information (including all text fields, border information, rotation angle, etc. on the picture) to the first application server.

[0170] In this embodiment, by establishing a session between external contacts in the first application and the second application, it is possible to effectively achieve direct communication between the clients of users in two different group user groups, and directly implement information notes for users based on the picture messages sent and received in the session, effectively improving the efficiency of adding note information to session users.

[0171] In one embodiment, as Figure 7 shown, it is a timing diagram of an information processing method based on a session in one embodiment. Referring to Figure 7 , applications with communication functions are running on the first terminal and the second terminal.

[0172] 702, The second terminal sends a picture message to the application server based on the conversation between the first user object and the second user object;

[0173] 704, The application server receives the picture message sent by the second terminal;

[0174] 706, The application server performs user description information recognition on the picture content in the picture message to obtain a picture recognition result;

[0175] 708, When the picture recognition result includes user description information, the application server adds the user description information to the picture message;

[0176] 710, The application server sends the picture message added with user description information to the first terminal;

[0177] 712, The first terminal receives the picture message sent by the application server;

[0178] 714, When the picture content of the picture message includes user description information, the first terminal displays an entry for adding a note to the target user object corresponding to the user description information in the conversation interface of the conversation;

[0179] 716, In response to a trigger operation on the note addition entry, the first terminal displays a note entry page for the target user object and displays the user description information on the note entry page;

[0180] 718, In response to an addition operation on the user description information in the note entry page, the first terminal generates note information for the target user object according to the user description information to add a note to the target user object.

[0181] In one embodiment, as Figure 8 shown, it is a flowchart of an information processing method based on a conversation in a specific application scenario. Referring to Figure 8 , The first application is an instant messaging client used by users in an enterprise, and the second application is an instant messaging client used by individuals. Both the first application and the second application have communication session functions.

[0182] The first terminal adds a second user object as an external contact through a first application and establishes a session between the first user object and the second user object. The second terminal sends a picture message in the session with the first user object through a second application and uploads it to the corresponding second application server, and the second application server forwards the received picture message to the first application server. After the first application server obtains the picture message, it performs user description information recognition on the picture content in the picture message to obtain a picture recognition result. When the picture recognition result includes user description information, the user description information is added to the picture message, and the picture message after adding the user description information is sent to the first terminal. Otherwise, only the picture message is sent to the first terminal. After receiving the picture message, the first terminal identifies whether the picture message includes user description information. If so, the first terminal displays an entry for adding a note for the target user object corresponding to the user description information according to the user description information body, and after the note addition entry is triggered, the target user object can be noted according to the user description information recognized from the picture content. Thus, corresponding note information can be quickly and effectively added to the user in the session, thereby effectively improving the efficiency of note processing for the user.

[0183] It should be understood that although Figure 2 、 6 、each step in the flowchart of 7 is shown in sequence according to the arrow indication, these steps are not necessarily executed in the order indicated by the arrow. Unless there is a clear description in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, Figure 2 、 6 、at least a part of the steps in 7 may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same moment, but can be executed at different moments, and the execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.

[0184] In one embodiment, as Figure 9 shown, an information processing device 900 based on a session is provided. This device can be a software module or a hardware module, or a combination of both to become a part of a computer device. Specifically, the device includes: a message receiving module 902, an information display module 904, and an information note module 906, where:

[0185] The message receiving module 902 is used for the first terminal to receive a picture message sent by the terminal corresponding to the second user object based on the session between the first user object and the second user object; the first terminal is the terminal corresponding to the first user object;

[0186] An information display module 904, configured to, when the picture content of a picture message includes user description information, display an entry for adding a note of a target user object corresponding to the user description information in the conversation interface of the conversation.

[0187] An information note module 906, configured to, in response to a trigger operation on the note addition entry, note the target user object according to the user description information identified from the picture content.

[0188] In one embodiment, the information display module 902 is further configured to, in response to a trigger operation on the note addition entry, display a note entry page for the target user object and display the user description information on the note entry page; the information note module is further configured to, in response to an addition operation on the user description information in the note entry page, generate note information for the target user object according to the user description information.

[0189] In one embodiment, the picture message includes a picture message body and a user information description picture, and the picture message body includes user description information identified from the user information description picture; the information note module 906 is further configured to, in response to a trigger operation on the note addition entry, extract note content corresponding to a note item from the user description information in the picture message body, and fill the note content into a note area corresponding to the note item to generate a note entry page; in response to a selection operation on each note item in the note entry page, fill the note content corresponding to the selected note item into the note information of the target user object.

[0190] In one embodiment, the information note module 906 is further configured to fill the user information description picture into a picture note area corresponding to a picture note item; and fill the note content in the user description information into a text note area corresponding to a text note item.

[0191] In one embodiment, the information display module 904 is further configured to display a selection control corresponding to each note item in the note entry page; the information note module 906 is further configured to, in response to a selection operation on the selection control corresponding to each note item in the note entry page, mark the selection control corresponding to the selected note item as a selected state; in response to an addition operation on the selected note item in the note entry page, fill the note content corresponding to the selected note item into the note information of the target user object.

[0192] In one embodiment, the message receiving module 902 is further configured to parse the picture message; when a description tag including user description information is parsed out in the picture message, it is determined that the picture content of the picture message includes user description information.

[0193] In one embodiment, a first application logged in by a first user object is installed in a first terminal. The session-based information processing device 900 further includes an information sharing module, configured to generate a user information sharing link for a target user object according to user description information; share the user information sharing link to a terminal corresponding to a third user object, so that the terminal corresponding to the third user object remarks the target user object according to the user description information in the user information sharing link; or share the user information sharing link to a third application in the first terminal, so that the third application adds the user description information in the user information sharing link to the address book in the third application.

[0194] In one embodiment, a first application logged in by a first user object is installed in a first terminal. The first application is an instant messaging application used by a user object belonging to a group user to communicate with others; a second application logged in by a second user object is installed in a second terminal. The second application is an instant messaging application used by an independent user object to communicate with others; the second user object is an external contact of the first user object.

[0195] In one embodiment, as Figure 10 shown, another session-based information processing device 1000 is provided. The device can be a software module or a hardware module, or a combination of both to form a part of a computer device. The device specifically includes: a message receiving module 902, an information display module 904, and an information remark module 906, where:

[0196] A message receiving module 1002, configured to receive a picture message sent by a second terminal to a first terminal based on a session between a first user object and a second user object; the first terminal is a terminal corresponding to the first user object, and the second terminal is a terminal corresponding to the second user object;

[0197] A picture recognition module 1004, configured to recognize user description information in the picture content of the picture message to obtain a picture recognition result;

[0198] An information adding module 1006, configured to add the user description information to the picture message when the picture recognition result includes the user description information;

[0199] An information sending module 1008, configured to send the picture message with the added user description information to the first terminal, so that the first terminal displays an entry for adding a remark for a target user object corresponding to the user description information according to the user description information, and after the entry for adding a remark is triggered, remarks the target user object according to the user description information.

[0200] In one embodiment, the picture recognition module 1004 is further configured to perform edge detection on the picture in the picture message, extract the edge features corresponding to the picture; according to the edge features, extract the candidate text region features in the picture; according to the candidate text region features, extract the corresponding text information; perform user description information recognition on the text information to obtain the picture recognition result.

[0201] In one embodiment, the picture message includes a picture message body and user information for describing the picture; the information adding module 1006 is further configured to, when the picture recognition result includes user description information, extract the user description information from the picture recognition result; and fill the user description information into the picture message body.

[0202] In one embodiment, the information adding module 1006 is further configured to generate a description label corresponding to the picture message according to the picture recognition result; add the description label to the picture message; the description label is used to identify that the picture message includes user description information, so that after the first terminal receives the picture message, the picture message and the note addition entry are associated and displayed according to the description label.

[0203] In one embodiment, when the picture message is the picture message first sent by the second terminal to the first terminal in the conversation between the first user object and the second user object, the picture recognition module 1004 is further configured to perform the step of performing user description information recognition on the picture content in the picture message to obtain the picture recognition result.

[0204] In one embodiment, a first application logged in by the first user object is installed in the first terminal, and the first application is an instant messaging application used by a user object belonging to a group user to communicate with others; a second application logged in by the second user object is installed in the second terminal, and the second application is an instant messaging application used by an independent user object to communicate with others; the second user object is an external contact of the first user object.

[0205] For the specific limitations of the session-based information processing device, reference may be made to the limitations on the session-based information processing method in the foregoing text, which will not be elaborated here. Each module in the above session-based information processing device can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or stored in the memory of the computer device in the form of software, so as to facilitate the processor to call and execute the operations corresponding to the above respective modules.

[0206] In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as Figure 11As shown in the figure. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected via a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a carrier network, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements a session-based information processing method. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball, or touchpad provided on the computer device housing, or an external keyboard, touchpad, or mouse, etc.

[0207] In one embodiment, another computer device is also provided. The computer device can be a server, and its internal structure diagram can be as Figure 12 shown in the figure. The computer device includes a processor, a memory, and a network interface connected via a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The database of the computer device is used to store data such as picture messages and user description information. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, it implements a session-based information processing method.

[0208] Those skilled in the art can understand that Figure 11 and Figure 12 the structures shown in the figure are only block diagrams of some structures related to the solution of this application, and do not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0209] In one embodiment, a computer device is also provided, including a memory and a processor. A computer program is stored in the memory, and when the processor executes the computer program, it implements the steps in the above method embodiments.

[0210] In one embodiment, a computer-readable storage medium is provided, storing a computer program, which when executed by a processor implements the steps in the above method embodiments.

[0211] In one embodiment, a computer program product or a computer program is provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the steps in the above method embodiments.

[0212] Those of ordinary skill in the art can understand that all or part of the processes of implementing the above method embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the above method embodiments. Among them, any reference to a memory, storage, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical memory, etc. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0213] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0214] The above-described embodiments merely represent several implementation manners of the present application. Their descriptions are relatively specific and detailed, but should not be construed as limiting the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application should be subject to the appended claims.

Claims

1. A session-based information processing method, characterized in that, The method includes: Based on the session between the first user object and the second user object, the first terminal receives a picture message sent by the second terminal corresponding to the second user object; the first terminal is the terminal corresponding to the first user object. Obtain an identification operation triggered by the picture content in the picture message. When the picture content of the picture message includes user description information, in the session interface of the session, associate and display the picture message with the entry for adding a note to the target user object corresponding to the user description information. In response to a trigger operation on the note addition entry, in the session interface, display a note entry page for the target user object, and display the user description information on the note entry page. In response to an addition operation on the user description information in the note entry page, generate note information for the target user object according to the user description information.

2. The method according to claim 1, wherein The picture message includes a picture message body and a user information description picture, and the picture message body includes the user description information identified from the user information description picture. The step of, in response to a trigger operation on the note addition entry, displaying a note entry page for the target user object in the session interface includes: In response to a trigger operation on the note addition entry, extract the note content corresponding to the note item from the user description information in the picture message body, and fill the note content into the note area corresponding to the note item to generate a note entry page and display it in the session interface. The step of, in response to an addition operation on the user description information in the note entry page, generating note information for the target user object according to the user description information includes: In response to a selection operation on each note item in the note entry page, fill the note content corresponding to the selected note item into the note information of the target user object.

3. The method according to claim 2, wherein The note items include a picture note item and a text note item; the step of filling the note content into the note area corresponding to the note item includes: Fill the user information description picture into the picture note area corresponding to the picture note item. Fill the note content in the user description information into the text note area corresponding to the text note item.

4. The method according to claim 2, characterized in that The method further includes: In the note entry page, display selection controls corresponding to each note item. In response to a selection operation on the selection controls corresponding to each note item in the note entry page, mark the selection controls corresponding to the selected note item as the selected state. The step of filling the note content corresponding to the selected note item into the note information of the target user object includes: In response to an addition operation on the selected note item in the note entry page, fill the note content corresponding to the selected note item into the note information of the target user object.

5. The method according to claim 1, wherein The method further includes: Parse the picture message. When the description tag including the user description information is parsed from the picture message, it is determined that the picture content in the picture message includes the user description information.

6. The method according to claim 1, wherein The first application logged in by the first user object is installed in the first terminal, and the method further includes: Generating a user information sharing link for the target user object according to the user description information; Sharing the user information sharing link to the terminal corresponding to the third user object, so that the terminal corresponding to the third user object remarks the target user object according to the user description information in the user information sharing link; or, Sharing the user information sharing link to the third application in the first terminal, so that the third application adds the user description information in the user information sharing link to the address book in the third application.

7. The method according to any one of claims 1 to 6, characterized in that The first application logged in by the first user object is installed in the first terminal, and the first application is an instant messaging application used by the user object in the group user to communicate with others; the second application logged in by the second user object is installed in the second terminal, and the second application is an instant messaging application used by an independent user object to communicate with others; the second user object is an external contact of the first user object.

8. A session-based information processing method, characterized in that, The method includes: Receiving a picture message sent by the second terminal to the first terminal based on the conversation between the first user object and the second user object; the first terminal is the terminal corresponding to the first user object, and the second terminal is the terminal corresponding to the second user object; Performing user description information recognition on the picture content in the picture message to obtain a picture recognition result; When the picture recognition result includes the user description information, adding the user description information to the picture message; Sending the picture message added with the user description information to the first terminal, so that the first terminal associates and displays the picture message with the entry for remarking the target user object corresponding to the user description information in the conversation interface of the conversation, and after the entry for remarking is triggered, a remark entry page for the target user object is displayed in the conversation interface, and the user description information is displayed on the remark entry page, and in response to the addition operation of the user description information, generating the remark information for the target user object according to the user description information.

9. The method according to claim 8, wherein The performing user description information recognition on the picture content in the picture message to obtain a picture recognition result includes: Performing edge detection on the picture in the picture message and extracting the edge features corresponding to the picture; Extracting the candidate text region features in the picture according to the edge features; Extracting the corresponding text information according to the candidate text region features; Performing user description information recognition on the text information to obtain a picture recognition result.

10. The method according to claim 8, characterized in that, The picture message includes a picture message body and a user information description picture; when the picture recognition result includes the user description information, adding the user description information to the picture message includes: When the picture recognition result includes user description information, extract the user description information from the picture recognition result; Fill the user description information into the picture message body.

11. The method according to claim 8, wherein The method further includes: Generate a description label corresponding to the picture message according to the picture recognition result; Add the description label to the picture message; the description label is used to identify that the picture message includes the user description information, so that after the first terminal receives the picture message, the picture message and the note addition entry are associated and displayed according to the description label.

12. The method according to claim 8, wherein The recognizing user description information for the picture content in the picture message to obtain a picture recognition result includes: When the picture message is the picture message first sent by the second terminal to the first terminal in the session between the first user object and the second user object, execute the step of recognizing user description information for the picture content in the picture message to obtain a picture recognition result.

13. The method according to any one of claims 8 to 12, characterized in that, The first application logged in by the first user object is installed in the first terminal, and the first application is an instant messaging application used by a user object in a group user to communicate with others; the second application logged in by the second user object is installed in the second terminal, and the second application is an instant messaging application used by an independent user object to communicate with others; the second user object is an external contact of the first user object.

14. An information processing apparatus based on a session, characterized in that, The device includes: A message receiving module, configured to receive, by the first terminal based on the session between the first user object and the second user object, a picture message sent by the second terminal corresponding to the second user object; the first terminal is the terminal corresponding to the first user object; An information display module, configured to obtain an identification operation triggered on the picture content of the picture message, and when the picture content of the picture message includes the user description information of the second user object, associate and display the picture message with the note addition entry for the target user object corresponding to the user description information in the session interface; An information note module, configured to, in response to a trigger operation on the note addition entry, display a note entry page for the target user object in the session interface, and display the user description information on the note entry page; in response to an addition operation on the user description information in the note entry page, generate note information for the target user object according to the user description information.

15. The device according to claim 14, characterized in that, The picture message includes a picture message body and a user information description picture, and the picture message body includes the user description information recognized from the user information description picture; The information note module is further configured to, in response to a trigger operation on the note addition entry, extract note content corresponding to a note item from the user description information in the picture message body, and fill the note content into the note area corresponding to the note item to generate a note entry page; In response to a selection operation on each of the note items in the note entry page, fill the note content corresponding to the selected note item into the note information of the target user object.

16. The device according to claim 15, characterized in that, The note items include a picture note item and a text note item; the information note module is further configured to fill the user information description picture into the picture note area corresponding to the picture note item; and fill the note content in the user description information into the text note area corresponding to the text note item.

17. The device according to claim 15, characterized in that The information note module is further configured to display a selection control corresponding to each of the note items in the note entry page; in response to a selection operation on the selection control corresponding to each of the note items in the note entry page, mark the selected selection control as the selected state. In response to an addition operation on the selected note items in the note entry page, fill the note content corresponding to the selected note items into the note information of the target user object.

18. The device according to claim 14, characterized in that, The message receiving module is further configured to parse the picture message; when it is parsed that the description tag of the user description information is included in the picture message, it is determined that the picture content of the picture message includes the user description information.

19. The device according to claim 14, characterized in that, The first application logged in by the first user object is installed in the first terminal, and the device further includes: An information sharing module, configured to generate a user information sharing link for the target user object according to the user description information; share the user information sharing link to the terminal corresponding to the third user object, so that the terminal corresponding to the third user object remarks the target user object according to the user description information in the user information sharing link; or share the user information sharing link to a third application in the first terminal, so that the third application adds the user description information in the user information sharing link to the address book in the third application.

20. The device according to any one of claims 14 to 19, characterized in that, The first application logged in by the first user object is installed in the first terminal, and the first application is an instant messaging application used by a user object belonging to a group user to communicate with others; the second application logged in by the second user object is installed in the second terminal, and the second application is an instant messaging application used by an independent user object to communicate with others; the second user object is an external contact of the first user object.

21. A session-based information processing device, characterized in that, The device includes: A message receiving module, configured to receive a picture message sent by the second terminal to the first terminal based on a session between the first user object and the second user object; the first terminal is the terminal corresponding to the first user object, and the second terminal is the terminal corresponding to the second user object; A picture recognition module, configured to perform user description information recognition on the picture content in the picture message to obtain a picture recognition result; An information addition module, configured to add the user description information to the picture message when the picture recognition result includes the user description information. An information sending module, configured to send the picture message after adding the user description information to the first terminal, so that the first terminal associates and displays the picture message with the note entry for the target user object corresponding to the user description information in the conversation interface of the conversation, and after the note entry is triggered, displays a note entry page for the target user object in the conversation interface, and displays the user description information on the note entry page, and in response to the addition operation of the user description information, generates note information for the target user object according to the user description information.

22. The device according to claim 21, characterized in that, The picture recognition module is further configured to perform edge detection on the picture in the picture message, extract the edge features corresponding to the picture; extract the candidate text region features in the picture according to the edge features; extract the corresponding text information according to the candidate text region features; perform user description information recognition on the text information to obtain a picture recognition result.

23. The device according to claim 21, characterized in that, The picture message includes a picture message body and a user information description picture; the information adding module is further configured to, when the picture recognition result includes user description information, extract the user description information from the picture recognition result; and fill the user description information into the picture message body.

24. The device according to claim 21, characterized in that, The information adding module is further configured to generate a description label corresponding to the picture message according to the picture recognition result; add the description label to the picture message; the description label is used to identify that the picture message includes the user description information, so that after receiving the picture message, the first terminal associates and displays the picture message and the note entry according to the description label.

25. The device according to claim 21, wherein, The picture recognition module is further configured to, when the picture message is the picture message first sent by the second terminal to the first terminal in the conversation between the first user object and the second user object, perform the step of performing user description information recognition on the picture content in the picture message to obtain a picture recognition result.

26. The device according to any one of claims 21 to 25, characterized in that, The first application logged in by the first user object is installed in the first terminal, and the first application is an instant messaging application used by a user object in a group user to communicate with others; the second application logged in by the second user object is installed in the second terminal, and the second application is an instant messaging application used by an independent user object to communicate with others; the second user object is an external contact of the first user object.

27. A computer device, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 13.

28. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 13.

29. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 13.

Images