Information processing method and information processing device

Abstract

Information processing method applied in a server, the information processing method comprising: Capturing communication information generated by a communication from a first electronic device and / or a second electronic device in a method in which the first electronic device communicates with the second electronic device; Determining a processing object based on the communication information; Analyzing the processing object to obtain link information associated with the processing object; and Performing an operation based on the link information, wherein performing the operation based on the link information comprises at least one of the following: Saving the link information; Determining for which of the first electronic device and the second electronic device the linking information is suitable based on a predetermined strategy; Transmitting the linking information to the determined first electronic device or the second electronic device, wherein transmitting the linking information to the first electronic device or the second electronic device based on the predetermined strategy comprises: Applying a semantic analysis to sound to determine for which of the first electronic device and the second electronic device the linking information is appropriate if the communication information includes information about the sound; and Transmitting the linking information to the electronic device determined to be suitable.

Description

BACKGROUND

[0001] The present disclosure relates to the field of information processing, and more particularly, the present disclosure relates to an information processing method and an information processing apparatus.

[0002] With the development of communication technology, communication applications including text communication, voice communication, and video communication have become increasingly popular. In the course of this communication, large amounts of data are generated, such as text data, voice data, video data, and the like.

[0003] Traditionally, apart from simply forwarding the data to an appropriate communicating party to implement a communication object during the course of the communication, the data is not used further.

[0004] US 2008 / 0215884 A1 discloses a communication terminal capable of making communication with the other end more active and enabling telephone conversations even for elderly people or the like who are not accustomed to operating information devices, while various video information is easily displayed by simple operation.

[0005] In view of the above case, the present disclosure provides an information processing method and an information processing apparatus that can utilize communication information generated in the course of communication, for example, to generate linked information suitable for the communicating party, in order to increase the application value of the communication and improve the user experience.

[0006] According to one embodiment, there is provided an information processing method applied in a first electronic device, the information processing method comprising: determining a processing object based on communication information generated based on the communication in a process in which the first electronic device communicates with a second electronic device; acquiring link information associated with the processing object; and executing an operation based on the link information.

[0007] Acquiring the link information associated with the processing object comprises: transmitting the processing object to a remote server; and receiving the link information from the remote server, wherein the link information is information associated with the processing object and is obtained by analyzing the processing object by the remote server.

[0008] Collecting the link information associated with the processing object includes: analyzing the processing object to determine the link information.

[0009] The communication information is information of video images, and determining the processing object includes: detecting an input operation of a user; and determining the processing object from the video image based on the input operation.

[0010] Detecting the user's input operation includes detecting an input operation to select an area in the video image; and determining the processing object includes determining a part of the video image corresponding to the area in the video image as the processing object.

[0011] Detecting the user's input operation includes: detecting a click operation for clicking the video image; and determining the processing object includes: applying image division to the video image based on a specific position in the video image corresponding to the click operation to obtain a partial video image including the specific position; and determining the partial video image as the processing object.

[0012] Detecting the user's input operation comprises: applying image recognition to the video image to determine a plurality of candidate objects; detecting a selection operation of at least one candidate object from the plurality of candidate objects by the user; and determining the processing object comprises: determining the at least one selected candidate object as the processing object based on the selection operation.

[0013] When the communication information is information of a static image, determining the processing object further comprises: applying image recognition to the static image to divide the static image into a plurality of regions; determining a target region from the plurality of regions based on predetermined criteria; and determining the processing object based on the target region.

[0014] When the communication information is dynamic image information, determining the processing object further comprises: applying image recognition to the dynamic image to recognize a specific action performed by the user in the course of communication; and determining the processing object based on the specific action.

[0015] When the communication information is audio information, determining the processing object includes: applying audio detection to the sound to determine the processing object.

[0016] Determining the processing object further comprises: determining a plurality of candidate objects based on the communication information; detecting a selection operation of at least one candidate object of the plurality of candidate objects by the user; and determining the at least one selected candidate object as the processing object based on the selection operation.

[0017] According to another embodiment, there is provided an information processing apparatus applied to an electronic device, the information processing apparatus comprising: a determination unit for determining a processing object based on communication information generated based on communication in a process in which the first electronic device communicates with a second electronic device; an acquisition unit for acquiring link information associated with the processing object; and an execution unit for executing an operation based on the link information.

[0018] The acquisition unit includes: a transmission unit for transmitting the processing object to a remote server; and a reception unit for receiving the link information from the remote server, wherein the link information is information associated with the processing object and obtained by analyzing the processing object by the remote server.

[0019] The acquisition unit includes: an analysis unit for analyzing the processing object to determine the link information.

[0020] When the communication information is information of a video image, the determination unit includes: a detection unit for detecting an input operation of a user; and a first processing object determination unit for determining the processing object from the video image based on the input operation.

[0021] The detection unit is configured to detect an input operation to select an area in the video image; and the first processing object determining unit is configured to determine a partial video image as the processing object corresponding to the area in the video image.

[0022] The detection unit is configured to detect a click operation to click the video image; and the first processing object determination unit includes: an image division unit for applying image division to the video image based on a specific position in the video image corresponding to the click operation to obtain a partial video image including the specific position; and an object determination unit for determining the partial video image as the processing object.

[0023] The detection unit includes: a recognition unit for applying image recognition to the video image to detect a plurality of candidate objects; a selection detection unit for detecting a selection operation of at least one candidate object of the plurality of candidate objects by the user; and the first processing object determination unit is configured to determine the at least one selected candidate object as the processing object based on the selection operation.

[0024] When the communication information is static image information, the determination unit further comprises: a static image recognition unit for applying image recognition to the static image to divide the static image into a plurality of regions; a target region determination unit for determining a target region from the plurality of regions based on predetermined criteria; and a second processing object determination unit for determining the processing object based on the target region.

[0025] When the communication information is dynamic image information, the determination unit further comprises: a dynamic image recognition unit for recognizing the dynamic image to recognize a specific action performed by the user in the course of communication; and a third processing object determination unit for determining the processing object based on the specific action.

[0026] When the communication information is audio information, the determination unit includes: an audio recognition unit for applying audio recognition to the sound to determine the processing object.

[0027] The determination unit further comprises: a candidate object determination unit for determining a plurality of candidate objects based on the communication information; a selection detection unit for detecting a selection operation of the at least one candidate object from the plurality of candidate objects by the user; and a fourth processing object determination unit for determining the at least one selected candidate object as the processing object based on the selection operation.

[0028] According to yet another embodiment, there is provided an information processing method applied in a server, the information processing method comprising: acquiring communication information generated by communication between a first electronic device and / or a second electronic device in a process in which the first electronic device communicates with the second electronic device; determining the processing object based on the communication information; analyzing the processing object to obtain link information associated with the processing object; and executing an operation based on the link information.

[0029] When the communication information is information of a video image, determining the processing object comprises: receiving input trace information transmitted from at least one of the first electronic device and the second electronic device, the input trace information being generated by detecting an input operation of a user by at least one of the first electronic device and the second electronic device; and determining the processing object based on the input trace information.

[0030] The input track information is obtained by detecting an input operation to select an area in the video image by the first electronic device and / or the second electronic device; and determining the processing object includes: determining a part of the video image corresponding to the area in the video image as the processing object.

[0031] The input track information is obtained by detecting a click operation for clicking the video image by at least one of the first electronic device and the second electronic device; and determining the processing object includes: applying image division to the video image based on a specific position in the video image corresponding to the click operation to obtain a partial video image including the specific position; and determining the partial video image as the processing object.

[0032] The information processing method further comprises: applying image recognition to the video image to determine a plurality of candidate objects; and transmitting the plurality of candidate objects to at least one of the first electronic device and the second electronic device; and the input trace information is obtained by detecting a selection of the at least one candidate object from the plurality of candidate objects of the user by at least one of the first electronic device and the second electronic device; and determining the processing object further comprises: determining the at least one selected candidate object as the processing object based on the selection operation.

[0033] When the communication information is information of the video image, determining the processing object includes: applying image recognition to the video image to divide the video image into a plurality of regions; determining a target region from the plurality of regions based on predetermined criteria; and determining the processing object based on the target region.

[0034] When the communication information is dynamic image information, determining the processing object further comprises: applying image recognition to the dynamic image to recognize a specific operation performed by an object in the dynamic image in the course of communication; and determining the processing object based on the specific operation.

[0035] When the communication information is audio information, determining the processing object includes: applying audio detection to the sound to determine the processing object.

[0036] Determining the processing object further comprises: determining a plurality of candidate objects based on the communication information; transmitting the plurality of candidate objects to the first electronic device and / or the second electronic device; receiving selection information for selecting at least one candidate object by the user of the first electronic device and / or the second electronic device; and determining the at least one selected candidate object as the processing object based on the selection information.

[0037] Object information of a plurality of objects is previously stored in the server, and the object information of each of the objects is stored linked with attribute information for reflecting attributes of the object; and acquiring the link information linked with the processing object includes: analyzing the processing object to determine the attribute of the processing object; determining related attribute information in the stored attribute information based on the attribute of the processing object; and determining the object information linked with the related attribute information as the link information.

[0038] According to yet another embodiment, there is provided an information processing apparatus applied in a server, the information processing apparatus comprising: a communication information acquiring unit for acquiring communication information generated by communication from the first electronic device and / or the second electronic device in a process in which the first electronic device communicates with the second electronic device; a determining unit for determining the processing object based on the communication information; a link information acquiring unit for analyzing the processing object to acquire link information associated with the processing object; and an executing unit for executing an operation based on the link information.

[0039] When the communication information is information of a video image, the determination unit includes: a receiving unit for receiving input track information transmitted from the first electronic device and / or the second electronic device, the input track information being generated by detecting an input operation of the user by the first electronic device and / or the second electronic device; and a first processing object determination unit for determining the processing object based on the input track information.

[0040] The input track information is obtained by detecting an input operation for selecting an area in the video image by at least one of the first electronic device and the second electronic device; and the first processing object determining unit is configured to determine a partial video image corresponding to the area in the video image as the processing object.

[0041] The input track information is obtained by detecting a click operation for clicking the video image by the first electronic device and / or the second electronic device; and the first processing object determining unit includes: an image division unit for applying image division to the video image based on a specific position in the video image corresponding to the click operation to obtain a partial video image including the specific position; and an object determining unit for determining the partial video image as the processing object.

[0042] The information processing device further comprises: a recognition unit for applying image recognition to the video image to determine a plurality of candidate objects; and a transmission unit for transmitting the plurality of candidate objects to at least one of the first electronic device and the second electronic device; and the input trace information is obtained by detecting a selection of the at least one candidate object of the plurality of candidate objects by the user by at least one of the first electronic device and the second electronic device; and the first processing object determination unit is configured to determine the at least one selected candidate object as the processing object based on the selection operation.

[0043] When the communication information is static image information, the determination unit includes: a static image recognition unit for applying image recognition to the static image to divide the static image into a plurality of regions; a target region determination unit for determining a target region from the plurality of regions based on predetermined criteria; and a second processing object determination unit for determining the processing object based on the target region.

[0044] When the communication information is dynamic image information, the determination unit includes: a dynamic image recognition unit for recognizing the dynamic image to recognize a specific operation performed by an object in the dynamic image in the course of communication; and a third processing object determination unit for determining the processing object based on the specific operation.

[0045] When the communication information is audio information, the determination unit includes: an audio recognition unit for applying audio recognition to the sound to determine the processing object.

[0046] The determination unit further comprises: a candidate object determination unit for determining a plurality of candidate objects based on the communication information; a transmission unit for transmitting the plurality of candidate objects to the first electronic device and / or the second electronic device; a reception unit for receiving selection information for selecting at least one candidate object by the user of the first electronic device and / or the second electronic device; and a fourth processing object determination unit for determining the at least one selected candidate object as the processing object based on the selection information.

[0047] Object information of a plurality of objects is stored in the server in advance, and the object information of each of the objects is stored linked with attribute information for reflecting attributes of the object; and the link information acquiring unit includes: an attribute determining unit for analyzing the processing object to determine the attribute of the processing object; an attribute information determining unit for determining related attribute information in the stored attribute information based on the attribute of the processing object; and an object information determining unit for determining object information linked with the related attribute information as the link information.

[0048] According to yet another embodiment, there is provided an information processing method applied to a first electronic device, the information processing method comprising: Determining a processing object based on communication information generated based on communication in a method in which the first electronic device performs multimedia communication with a second electronic device; acquiring link information associated with the processing object; and executing an operation based on the link information.

[0049] Acquiring the link information associated with the processing object comprises: transmitting the processing object to a remote server; and receiving the link information from the remote server, wherein the link information is information associated with the processing object and is obtained by analyzing the processing object by the remote server.

[0050] Collecting the link information associated with the processing object includes: analyzing the processing object to determine the link information.

[0051] Performing the operation based on the link information includes: generating a prompt icon to prompt the user to view, the prompt icon for connecting to the link information; and displaying the prompt icon.

[0052] When the communication is voice communication, performing the operation based on the linking information includes: detecting whether the first electronic device is connected to a display device; and outputting the linking information on the display device when it has detected that the first electronic device is connected to a display device, wherein the display device performs a display; based on the linking information.

[0053] When the communication is video communication, performing the operation based on the link information includes: combining an image based on the link information and an image of the video communication to generate a combined image; and displaying the combined image.

[0054] Performing the operation based on the link information comprises at least one of the following: displaying the link information; storing the link information; and transmitting the link information to the remote server and / or the second electronic device.

[0055] After storing the linkage information, the information processing method further comprises: judging whether the current time satisfies a first predetermined condition; and executing a display based on the linkage information when it is judged that the current time satisfies the first predetermined condition.

[0056] After storing the linkage information, the information processing method further comprises: deciding whether a network access satisfies a second predetermined condition when the first electronic device executes the network access; and executing the display based on the linkage information when it is decided that the network access satisfies the second predetermined condition.

[0057] After storing the linkage information, the information processing method further comprises: detecting environmental information of the first electronic device; judging whether the environmental information satisfies a third predetermined condition; and executing the display based on the linkage information when it is judged that the environmental information satisfies the third predetermined condition.

[0058] Executing the display based on the link information includes: displaying the link information and / or the prompt icon, wherein the prompt icon is used to connect to the link information.

[0059] According to yet another embodiment, there is provided an information processing apparatus applied to a first electronic device, the information processing apparatus comprising: a determination unit for determining a processing object based on communication information generated based on communication in a method in which the first electronic device performs multimedia communication with a second electronic device; an acquisition unit for acquiring link information associated with the processing object; and an execution unit for executing an operation based on the link information.

[0060] The acquisition unit includes: a transmission unit for transmitting the processing object to a remote server; and a reception unit for receiving the link information from the remote server, wherein the link information is information associated with the processing object and is obtained by analyzing the processing object by the remote server.

[0061] The acquisition unit includes: an analysis unit for analyzing the processing object to determine the link information.

[0062] The execution unit includes: an icon generation unit for generating a prompt icon to prompt the user to display, the prompt icon for connecting to the link information; and an icon display unit for displaying the prompt icon.

[0063] When the communication is voice communication, the execution unit includes: a first detection unit for detecting whether the first electronic device is connected to a display device; and an output unit for outputting the link information on the display device when it has detected that the first electronic device is connected to a display device, wherein the display device executes a display based on the link information.

[0064] When the communication is video communication, the execution unit includes: a combining unit for combining an image based on the link information and an image of the video communication to generate a combined image; and a combined image display unit for displaying the combined image.

[0065] The execution unit is configured to perform at least one of the following: displaying the link information; storing the link information; and transmitting the link information to the remote server and / or the second electronic device.

[0066] In the case where the execution unit is configured to store the link information, the execution unit further comprises: a first decision unit for deciding whether the current time point satisfies a first predetermined condition after the link information is stored; and the execution unit is configured to execute a display based on the link information when it has decided that the current time point satisfies the first predetermined condition.

[0067] In the case where the execution unit is configured to store the link information, the execution unit further comprises: a second decision unit for deciding whether a network access satisfies a second predetermined condition when the first electronic device executes the network access after storing the link information; and the execution unit is configured to perform a display based on the link information when it has decided that the network access satisfies the second predetermined condition.

[0068] In the case where the execution unit is configured to store the link information, the information processing device further comprises: an environmental information detection unit for detecting environmental information of the first electronic device after the link information has been stored; and a third decision unit for deciding whether the environmental information satisfies a third predetermined condition; and the execution unit is configured to perform display based on the link information when it has decided that the environmental information satisfies the third predetermined condition.

[0069] The execution unit is configured to display the link information and / or the prompt icon, wherein the prompt icon is used to connect to the link information.

[0070] According to yet another embodiment, there is provided an information processing method applied in a server, the information processing method comprising: acquiring communication information generated by communication from at least one of a first electronic device and a second electronic device in a process in which the first electronic device communicates with the second electronic device; determining the processing object based on the communication information; analyzing the processing object to obtain link information associated with the processing object; and executing an operation based on the link information.

[0071] Performing the operation based on the linking information comprises at least one of the following: storing the linking information; transmitting the linking information to the first electronic device and / or the second electronic device based on a predetermined strategy.

[0072] Transmitting the linking information to the first electronic device or the second electronic device based on the predetermined strategy comprises: receiving a request from the first electronic device and / or the second electronic device; and transmitting the linking information in response to the request to the electronic device making the request.

[0073] Transmitting the linking information to the first electronic device or the second electronic device based on the predetermined strategy includes: transmitting the linking information to the electronic device that transmits the communication information.

[0074] When the communication information includes audio information, transmitting the linking information to the first electronic device or the second electronic device based on the predetermined strategy includes: performing a semantic analysis of the sound to determine for which of the first electronic device and the second electronic device the linking information is appropriate; and transmitting the linking information to the electronic device determined to be appropriate.

[0075] Object information of a plurality of objects is previously stored in the server, and the object information of each of the objects is stored linked with attribute information for reflecting attributes of the object; and acquiring the link information linked with the processing object includes: analyzing the processing object to determine the attribute of the processing object; determining related attribute information in the stored attribute information based on the attribute of the processing object; and determining the object information linked with the related attribute information as the link information.

[0076] According to yet another embodiment, there is provided an information processing apparatus applied in a server, the information processing apparatus comprising: a communication information acquisition unit for acquiring communication information generated by communication from at least one of the first electronic device and the second electronic device in a process in which the first electronic device communicates with the second electronic device; a determination unit for determining the processing object based on the communication information; an analysis unit for analyzing the processing object to acquire link information linked to the processing object; and an execution unit for executing an operation based on the link information.

[0077] The execution unit is configured to perform at least one of the following: storing the link information; and transmitting the link information to the first electronic device and / or the second electronic device based on a predetermined strategy.

[0078] In the case where the execution unit is configured to transmit the link information to the first electronic device or the second electronic device based on the predetermined strategy, the execution unit comprises: a receiving unit for receiving a request from the first electronic device and / or the second electronic device; and a transmitting unit for transmitting the link information in response to the request to the electronic device making the request.

[0079] In the case where the execution unit is configured to transmit the link information to the first electronic device or the second electronic device based on the predetermined strategy, the execution unit is configured to transmit the link information to the electronic device that transmits the communication information.

[0080] When the communication information includes audio information and the execution unit is configured to transmit the linking information to the first electronic device or the second electronic device based on the predetermined strategy, the execution unit comprises: a semantic analysis unit for applying a semantic analysis to the sound to determine for which of the first electronic device and the second electronic device the linking information is appropriate; and a transmission unit for transmitting the linking information to the electronic device determined to be appropriate.

[0081] Object information of a plurality of objects is previously stored in the server, and the object information of each of the objects is stored linked with attribute information for reflecting attributes of the object; and the acquiring unit includes: an attribute acquiring unit for analyzing the processing object to acquire an attribute of the processing object; an attribute information acquiring unit for acquiring related attribute information in the stored attribute information based on the attribute of the processing object; and an object information acquiring unit for acquiring object information linked with the related attribute information as linking information.

[0082] In the information processing method and the information processing device of the embodiments, the processing object is determined based on the communication information generated by the communication, and the link information associated with the processing object is acquired, so that the operation based on the link information, such as display, storage, forwarding, or the like, can be performed. Thus, in the information processing method and the information processing device of the embodiments, the communication information generated in the communication process can be utilized, so that, in addition to implementing the communication goal, it further enhances the application value of the communication and greatly improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a flowchart showing the information processing method of a first implementation mode according to the present disclosure. Fig. 2 is a block diagram showing the main configuration of the information processing apparatus of the first implementation mode according to the present disclosure. Fig. 3 is a flowchart showing the information processing method of a second implementation type according to the present disclosure. Fig. 4 is a block diagram showing the main configuration of the information processing apparatus of the second implementation mode according to the present disclosure. Fig. 5A-5C are schematic diagrams showing displays of the first electronic device to which the information processing method of the embodiments is applied. And Fig. 6 is another schematic diagram showing the display of the first electronic device to which the information processing method of the embodiments is applied. DETAILED DESCRIPTION

[0083] The embodiments are described in detail below with reference to the accompanying drawings.

[0084] The information processing method and the information processing apparatus of the embodiments are applied in an environment where the first electronic device communicates with the second electronic device. The first electronic device and the second electronic device may be electronic devices having a communication function, such as a landline telephone, a mobile phone, a tablet, a PC, or the like. The communication may be conventional voice communication (for example, via the landline telephone), video communication (for example, via a video chat application), and text communication (for example, via an instant messaging application (text chat)). The types of the first electronic device and the second electronic device may be the same or different.

[0085] Furthermore, the communication between the first electronic device and the second electronic device may be performed over a network such as the Internet via a server (hereinafter, referred to as a remote server when appropriate). That is, either the first electronic device or the second electronic device sends communication information to the server, and the server forwards the communication information to the other of the first electronic device and the second electronic device. Of course, the communication between the first electronic device and the second electronic device may also be performed without being forwarded via the server.

[0086] In the following description, the embodiments are described using the communication between the two electronic devices, the first electronic device and the second electronic device, as an example. However, those skilled in the art will recognize that the information processing method and the information processing device of the embodiments can be applied in a scenario where more than two electronic devices communicate with each other.

[0087] Furthermore, the information processing method and the information processing apparatus of the embodiments can be applied to the first electronic device and / or the second electronic device, and can also be applied to the server. The following describes the information processing method and the information processing apparatus in the types of cases described above, respectively. (First implementation type)

[0088] In the first implementation mode of the present disclosure, the information processing method is applied to the first electronic device and / or the second electronic device. Hereinafter, it is assumed that the information processing method is applied to the first electronic device.

[0089] Hereinafter, the information processing method according to the embodiment will be described with reference to Fig. 1. When the information processing method begins, the first electronic device and the second electronic device are in the process of communicating.

[0090] As in Fig. 1, at step S101, the information processing method first determines a processing object based on communication information generated by the communication.

[0091] Determining the processing object can be implemented by detecting an input operation actively performed by the user, and it can also be implemented by automatically analyzing and recognizing the communication information by the information processing method.

[0092] Specifically, in one embodiment, the communication includes video communication, and the communication information includes information of a video image. In this case, the user specifies the processing object by applying an input operation to the video image. Accordingly, the information processing method of the embodiments determines the processing object specified by the user by detecting the input operation applied by the user to the video image.

[0093] More specifically, in the first example, the user may select, for example, an area in the video image. Accordingly, the information processing method of the embodiments detects the input operation for selecting an area in the video image. Then, the information processing method determines a part of the video image corresponding to the area in the video image as the processing object.

[0094] In a second example, the user can click a specific position in the video image. Accordingly, the information processing method of the embodiments detects a click operation for clicking the video image.

[0095] The information processing method then applies image division to the video image based on the specific position in the video image associated with the click operation to obtain a partial video image including the specific position. The technique of the information processing method applying image division to the video image is known to those skilled in the art and will not be described in further detail here.

[0096] After obtaining the partial video image including the specific position, the information processing method determines the partial video image as the processing object.

[0097] In the third example, the information processing method may apply image recognition to the video image to first identify multiple candidate objects. The information processing method may apply various types of commonly known image recognition algorithms to identify the candidate object, and this will not be described in further detail here.

[0098] After determining the plurality of candidate objects, the information processing method may present the information about the candidate object to the user for the user to select it. Then, the information processing method detects a selection operation of at least one of the plurality of candidate objects by the user. And, the information processing method determines the at least one selected candidate object as the processing object based on the selection operation when it detects the selection operation of the at least one candidate object by the user.

[0099] Various examples of determining the processing object through the input operation actively performed by the user are described above. The following describes a case of determining the processing object by automatically analyzing and recognizing the communication information.

[0100] Specifically, in the first example, the communication information includes information of a static image. In this case, the information processing method applies image recognition to the static image to divide the static image into multiple regions. For example, the information processing method divides the static image into multiple separate regions according to characteristics such as gradation, color, texture, geometric shape, or the like, so that these characteristics show consistency or similarity within a same region and obvious differences between different regions. The information processing method may apply various types of algorithms, such as a threshold-based method, a clustering-based method, a region-and-edge-based method, a global optimization-based method, or the like, to perform the image division.Of course, the image division algorithms described above are only examples and the person skilled in the art may apply various types of algorithms to perform image division, which will not be described in further detail here.

[0101] Then, the information processing method determines a target area from the plurality of areas based on predetermined criteria. For example, the information processing method may determine the target area from the plurality of areas based on the significance of the plurality of areas, the user's interest level set in advance, criteria of the positions of the areas or the area of the areas, or the like. Of course, the criteria for determining the target area described above and the associated algorithms are only examples. The information processing method of the embodiments may apply various other types of criteria and associated algorithms known to those skilled in the art to determine the target area, which will not be described in further detail here.

[0102] After determining the target area, the information processing method determines the processing object based on the target area. Specifically, the information processing method may, for example, analyze the video image of the target area to determine the processing object. For example, the information processing method may determine the processing object by recognizing the video image of the target area to determine its object types. Furthermore, the information processing method may, for example, determine the processing object by performing blur adjustment between the video image of the target area and the images previously stored in a database. Of course, the methods for determining the processing object based on the target area described above are only examples.The information processing method of the embodiments may employ various other types of methods known to those skilled in the art to determine the processing object, which will not be described in further detail here.

[0103] In the second example, the communication information includes information from a dynamic image. In this case, the information processing method can recognize the dynamic image to detect a specific action performed by the user during the communication. For example, the information processing method can apply detection similar to the above to the dynamic image, which consists of multiple individual images that are continuous in time, to detect an action performed by the user during that period.

[0104] The information processing method can then determine the processing object based on the specific action. For example, the information processing method can determine the processing object according to the specific action based on a table of link relationships between the previously stored action and the processing object.

[0105] In the third example, the communication information includes audio information. In this case, the information processing method may apply audio recognition to the sound to determine the processing object.

[0106] Specifically, the information processing method may, for example, decide whether there is a sound segment that matches a predetermined keyword in the sound. At the time of deciding that there is a sound segment that matches the predetermined keyword in the sound, the information processing method determines the sound segment as the processing object.

[0107] In addition, the information processing method applies, for example, semantic analysis to the sound and determines the processing object based on a result of the semantic analysis.

[0108] Of course, the information processing method can apply various types of algorithms that are generally known to apply audio recognition to the sound, which will not be described in further detail here.

[0109] Furthermore, in the same manner as described above, the information processing method of the embodiments may combine active input of the user and automatic recognition of the electronic device. Specifically, in the fourth example, the information processing method may determine a plurality of candidate objects based on the communication information. Then, the information processing method may present the plurality of candidate objects to the user and detect a selection operation of at least one of the plurality of candidate objects by the user. Then, the information processing method determines the at least one selected candidate object as the processing object based on the selection operation.

[0110] Furthermore, in a fifth example, the communication information includes text information. In this case, the information processing method may apply text recognition to the text to determine the processing object.

[0111] Specifically, the information processing method may, for example, decide whether there is a text segment that matches a predetermined keyword in the text. At the time of deciding that there is a text segment that matches the predetermined keyword in the text, the information processing method determines the text segment as the processing object.

[0112] In addition, the information processing method applies semantic analysis to the text and determines the processing object based on a result of the semantic analysis.

[0113] Of course, the information processing method can apply various types of algorithms that are generally known to apply text recognition to the text, which will not be described in further detail here.

[0114] Through the processing described above, in step S101, the information processing method determines the processing object based on the communication information generated by the communication.

[0115] Then, in step S102, the information processing method acquires link information associated with the processing object.

[0116] Specifically, in one embodiment, the information processing method may transmit the processing object to the remote server so that the processing object is analyzed by the remote server. The information processing method then receives the link information from the remote server. The link information is information associated with the processing object and obtained by analyzing the processing object by the remote server.

[0117] The remote server can obtain the linking information through various methods. For example, object information of multiple objects is previously stored on the remote server, and the object information of each object is stored linked with attribute information. The attribute information serves to represent attributes of objects, such as clothing, buildings, or the like.

[0118] After receiving the processing object transmitted by the information processing method, the remote server analyzes the processing object to determine the attribute of the processing object. Then, the remote server determines the related attribute information in the stored attribute information based on the attribute of the processing object, and determines the object information linked to the related attribute information as the link information.

[0119] In another embodiment, the information processing method may locally analyze the processing object to determine the link information. In this case, the information processing method may locally store the object information and the attribute information of the multiple objects in a linked manner in advance.

[0120] After acquiring the processing object, the information processing method may analyze the processing object to determine the attribute of the processing object. Then, the information processing method acquires related attribute information from the stored attribute information based on the attribute of the processing object, and acquires the object information associated with the related attribute information as the association information.

[0121] After acquiring the link information, the information processing method executes an operation based on the link information in step S103.

[0122] In the foregoing, the information processing method of the first implementation type according to the present disclosure has been described.

[0123] In the information processing method according to the first implementation mode of the present disclosure, the processing object is determined based on the communication information generated by the communication, and the link information associated with the processing object is acquired, and the operation based on the link information is executed.

[0124] Thus, in the information processing method of the first implementation mode of the present disclosure, the communication information generated in the course of communication can be used; thus, in addition to implementing a communication goal, it can further increase the application value and improve the user experience.

[0125] Further, in the information processing method of the first implementation mode of the present disclosure, on a terminal device side (ie, on the first electronic device side and / or the second electronic device side), the processing object may be determined in response to the user's input operation or automatically based on the communication information, and the above-described two modes may be combined.

[0126] Thus, in the information processing method of the first implementation mode of the present disclosure, multiple ways are provided to utilize the communication information to further enhance the user experience.

[0127] In the following, the information processing method applied in the first electronic device and / or the second electronic device will be described with reference to Fig. 2. In the following description, it is assumed that the information processing method is applied in the first electronic device.

[0128] As in Fig. 2, an information processing apparatus 200 according to the first implementation mode of the present disclosure includes: a determination unit 201, a detection unit 202, and an execution unit 203.

[0129] The determination unit 201 determines the processing object based on the communication information generated by the communication in the process in which the first electronic device communicates with the second electronic device. The acquisition unit 202 acquires the link information associated with the processing object. The execution unit 203 executes the process based on the link information.

[0130] Specifically, in one embodiment, the acquisition unit 202 includes a transmitting unit and a receiving unit (not shown). The transmitting unit transmits the processing object to the remote server. The receiving unit receives the link information from the remote server. The link information is information associated with the processing object and is obtained by analyzing the processing object by the remote server.

[0131] In another embodiment, the acquisition unit 202 comprises an analysis unit (not shown) for analyzing the processing object to determine the link information.

[0132] Further, in one embodiment, the information processing device 200 determines the processing object by detecting the input operation actively performed by the user.

[0133] Specifically, the communication information includes the information of the video image, and the determination unit 201 includes a detection unit and a first processing object determination unit (not shown). The detection unit detects the user's input operation. The first processing object determination unit determines the processing object from the video image based on the input operation.

[0134] More specifically, in the first example, the detection unit is configured to detect the input operation for selecting a region in the video image. And the first processing object determination unit is configured to determine a partial video image corresponding to the region in the video image as the processing object.

[0135] In the second example, the detection unit is configured to detect the click operation for clicking the video image; and the first processing object determination unit includes: an image division unit for applying image division to the video image based on a specific position in the video image corresponding to the click operation to obtain a partial video image including the specific position; and an object determination unit for determining the partial video image as the processing object.

[0136] In the third example, the information processing device 200 further includes a recognition unit (not shown) for applying image recognition to the video image to determine the plurality of candidate objects. Furthermore, the detection unit includes a selection detection unit for detecting the user's selection of at least one candidate object among the plurality of candidate objects. The first processing object determination unit is configured to determine the at least one selected candidate object as the processing object based on the selection.

[0137] In another embodiment, the information processing device 200 determines the processing object by automatically analyzing the communication information.

[0138] Specifically, in the first example, the communication information includes the information of the static image. The determination unit 201 further includes a static image recognition unit, a target area determination unit, and a second processing object determination unit (not shown). The static image recognition unit applies image recognition to the static image to divide the static image into multiple areas. The target area determination unit determines the target area from the multiple areas based on the predetermined criteria. The second processing object determination unit determines the processing object based on the target area.

[0139] In the second example, the communication information includes dynamic image information. The acquisition unit 201 further includes a dynamic image recognition unit and a third processing object acquisition unit (not shown). The dynamic image recognition unit recognizes the dynamic image to recognize the specific operation performed by the user during communication. The third processing object acquisition unit acquires the processing object based on the specific operation.

[0140] In the third example, the communication information includes audio information. The determination unit 201 includes an audio recognition unit for applying audio recognition to the sound to determine the processing object.

[0141] In the fourth example, the information processing apparatus 200 determines the processing object by detecting the input operation actively performed by the user and automatically analyzing the communication information.

[0142] Specifically, in this embodiment, the determination unit 201 further includes a candidate object determination unit, a selection detection unit, and a fourth processing object determination unit. The candidate object determination unit determines the plurality of candidate objects based on the communication information. The selection detection unit detects the user's selection of at least one of the plurality of candidate objects. The fourth processing object determination unit determines the at least one selected candidate object as the processing object based on the selection.

[0143] In the fifth example, the communication information includes text information. In this case, the information processing device 200 may apply text recognition to the text to determine the processing object.

[0144] Specific configurations and operations of the respective units of the information processing apparatus of the first implementation mode of the present disclosure have been described in detail in the description of the information processing method of the first implementation mode of the present disclosure with reference to Fig. 1, which is not repeated here.

[0145] In the foregoing, the information processing apparatus according to the first implementation mode of the present disclosure has been described.

[0146] In the information processing device of the first implementation mode of the present disclosure, the communication information generated during communication can be utilized. Thus, in addition to implementing a communication goal, it can further increase the application value of communication and greatly improve the user experience.

[0147] Further, in the information processing apparatus of the first implementation mode of the present disclosure, on the terminal device side (ie, the first electronic device side and / or the second electronic device side), the processing object may be determined in response to the user's input operation or automatically based on the communication information, and the above-described two modes may be combined.

[0148] Thus, in the information processing apparatus of the first implementation mode of the present disclosure, multiple ways are provided to utilize the communication information to further enhance the user experience. (Second implementation type)

[0149] In the second implementation mode of the present disclosure, an information processing method and an information processing device are provided. Different from the information processing method and the information processing device of the first implementation mode of the present disclosure, in the second implementation mode of the present disclosure, the information processing method and the information processing device are applied to a server side instead of the terminal side.

[0150] In the following, the information processing method of the second implementation mode of the present disclosure will be described with reference to Fig. 3. When the information processing method of the embodiments begins, the first electronic device and the second electronic device are in a process of communication.

[0151] As in Fig. 3, at step S301, the information processing method acquires communication information generated by communication from the first electronic device and / or the second electronic device.

[0152] The communication information is generated in the process in which the first electronic device communicates with the second electronic device and is transmitted from the first electronic device and / or the second electronic device to the server. The communication information may consist of audio information, video information, text information, or the like, or may consist of any combination of the information described above.

[0153] Then, at step S302, the information processing method determines the processing object based on the communication information.

[0154] Similar to the first implementation mode described above, the determination of the processing object can be implemented by detecting the input operation actively performed by the user, and can also be implemented by automatically analyzing and recognizing the communication information by the information processing method.

[0155] Specifically, in one embodiment, the communication includes video communication, and the communication information includes information of a video image. In this case, the user specifies the processing object by applying an input operation to the video image. Accordingly, the information processing method of the embodiments determines the processing object specified by the user by obtaining information about the input operation applied by the user to the video image.

[0156] More specifically, the information processing method receives input track information transmitted from the first electronic device and / or the second electronic device. The electronic device that transmits the input track information may be the same electronic device as the electronic device that transmits the communication information in step S301 described above, or may be a different electronic device.

[0157] The input trace information is generated by detecting the user's input operation by the first electronic device and / or the second electronic device. The input trace information may also include information of a sequence of traces formed by multiple tracking points, and may also include information of a trace formed by a single tracking point. For example, in the case where the electronic device includes a touch control unit and the user performs the input operation via the touch control unit, the input trace information may be information generated by detecting a sliding gesture of the user, and may also be information generated by detecting a clicking operation of the user.

[0158] Further, the electronic device that transmits the input track information from the first electronic device and the second electronic device may further transmit information such as the size of the displayed image of the electronic device or the like.

[0159] Then, the information processing method determines the processing object based on the input trace information.

[0160] More specifically, in the first example, the user of the first electronic device can, for example, select a region in the video image. Accordingly, the first electronic device forms the input track information by detecting the input operation for selecting a region in the video image. Thereafter, the first electronic device transmits the input track information and electronic device parameter information of the first electronic device to the server. Then, the information processing method determines a part of the video image corresponding to the region in the video image as the processing object.

[0161] In the second example, the user of the first electronic device can, for example, click on a specific position in the video image. Accordingly, the first electronic device forms the input track information by detecting the click action for clicking on the video image. The first electronic device then transmits the input track information to the server.

[0162] Next, the information processing method determines which position in the video image (i.e., the above specific position) the input track information belongs to based on the input track information. Then, the information processing method applies image division to the video image to obtain a partial video image including the specific position and determines the partial video image as the processing object. Similarly, the information processing method can perform the operations described above based on various types of image division algorithms that are well known, which will not be described in detail here.

[0163] In the third example, the information processing method may determine the processing object by combining an active input from the user and an automatic analysis by the server.

[0164] In particular, the information processing method may apply image recognition to the video image to determine the plurality of candidate objects. The information processing method may then transmit the plurality of candidate objects to the first electronic device and / or the second electronic device for selection by the user. The first electronic device and / or the second electronic device detects a selection operation of the at least one candidate object of the plurality of candidate objects to generate associated input track information and transmit it to the server.

[0165] Therefore, the server determines the at least one selected candidate object as the processing object based on the selection information (ie, the input trace information described above) obtained by detecting the selection operation.

[0166] The following describes the case of determining the processing object by automatically analyzing and recognizing the communication information.

[0167] Specifically, in the first example, the communication information includes the information of the static image. In this case, the information processing method applies image recognition to the static image to divide the static image into multiple regions. Since it is similar to the implementation described above, those skilled in the art can apply various types of algorithms to perform the image division, which will not be described in further detail here.

[0168] The information processing method then determines a target area from the plurality of areas based on predetermined criteria. Since they are similar to the implementation type described above, one skilled in the art may apply various types of criteria and associated algorithms to determine the target area, which will not be described in further detail here.

[0169] After determining the target area, the information processing method determines the processing object based on the target area. Specifically, the information processing method may, for example, analyze the video image of the target area to determine the processing object. For example, the information processing method may determine the processing object by recognizing the video image of the target area to determine the types of objects therefrom. Furthermore, the information processing method may, for example, determine the processing object by performing blur adjustment between the video image of the target area and the images previously stored in a database. Of course, the above-described method for determining the processing object based on the target area is only one example.The information processing method of the embodiments may employ several other types of methods known to those skilled in the art to determine the processing object, which will not be described in further detail here.

[0170] In the second example, the communication information includes the information of the dynamic image. In this case, the information processing method can recognize the dynamic image to detect a specific action performed by the user during the communication. For example, the information processing method can apply recognition similar to the above to the dynamic image, which consists of multiple individual images that are continuous in time, to detect an action performed by the user during that period.

[0171] The information processing method can then determine the processing object based on the specific action. For example, the information processing method can determine the processing object according to the specific action based on a table of link relationships between the previously stored action and the processing object.

[0172] In the third example, the communication information includes audio information. In this case, the information processing method may apply audio recognition to the sound to determine the processing object.

[0173] Specifically, the information processing method may, for example, decide whether there is a sound segment that matches a predetermined keyword in the sound. At the time of deciding that there is a sound segment that matches the predetermined keyword in the sound, the information processing method determines the sound segment as the processing object.

[0174] In addition, the information processing method applies, for example, semantic analysis to the sound and determines the processing object based on a result of the semantic analysis.

[0175] Of course, the information processing method can apply various types of algorithms that are generally known to apply audio recognition to the sound, which will not be described in further detail here.

[0176] Furthermore, in the same manner as described above, the information processing method of the embodiments can combine active input of the user and automatic recognition of the electronic device. Specifically, in the fourth example, the information processing method determines the plurality of candidate objects based on the communication information and transmits the plurality of candidate objects to at least one of the first electronic device and the second electronic device. The electronic device that has received the candidate object detects the selection operation for selecting at least one candidate object by the user and transmits the selection information generated by the selection operation to the server. The information processing method receives the selection information and determines the at least one selected candidate object as the processing object based on the selection information.

[0177] In the fifth example, the communication information includes text information. In this case, the information processing method may apply text recognition to the text to determine the processing object.

[0178] Specifically, the information processing method may, for example, decide whether there is a text segment that matches a predetermined keyword in the text. At the time of deciding that there is a text segment that matches the predetermined keyword in the text, the information processing method determines the text segment as the processing object.

[0179] In addition, the information processing method applies, for example, semantic analysis to the text and determines the processing object based on a result of the semantic analysis.

[0180] Of course, the information processing method can apply various types of algorithms that are generally known to apply text recognition to the text, which will not be described in further detail here.

[0181] Through the processing described above, at step S302, the information processing method determines the processing object based on the received communication information.

[0182] Next, at step S303, the information processing method analyzes the processing object to acquire link information associated with the processing object.

[0183] Specifically, in one embodiment, object information of multiple objects is previously stored in the remote server, and the object information of each of the objects is stored, linked to attribute information. The attribute information serves to represent the attribute of the object.

[0184] Thus, for example, the information processing method analyzes the processing object based on a linking relationship between the object information and the attribute information to determine the attribute of the processing object. Then, the information processing method determines related attribute information in the stored attribute information based on the attribute of the processing object. For example, the attribute information may be classified into different categories. The information processing method may determine the attribute information belonging to the same category or a corresponding category as the attribute of the processing object in the stored attribute information as the related attribute information. Then, the information processing method determines the object information linked to the related attribute information as the linking information.

[0185] In another embodiment, the attribute information includes various types of information. The information processing method may directly acquire attribute information of the processing object other than the link information after acquiring a specific attribute of the processing object.

[0186] Note that the above-described methods for acquiring link information by the information processing method are only examples. Those skilled in the art may employ various other methods to acquire link information.

[0187] Then, at step S304, the information processing method executes the operation based on the link information. Specifically, the information processing method may, for example, store the link information and transmit the link information to the first electronic device and / or the second electronic device. Of course, the information processing method may also use the link information in other ways, all of which are within the scope of the present disclosure.

[0188] In the foregoing, the information processing method according to the second implementation mode of the present disclosure has been described.

[0189] In the information processing method according to the second implementation mode of the present disclosure, the processing object is determined based on the communication information generated by the communication, and the link information associated with the processing object is acquired, and the operation based on the link information is executed.

[0190] Thus, in the information processing method of the second implementation mode of the present disclosure, the communication information generated during communication can be utilized. Therefore, in addition to implementing a communication goal, it can further increase the application value of communication and greatly improve the user experience.

[0191] Further, in the information processing method of the second implementation mode of the present disclosure, on the server side, the processing object may be determined in response to the user's input operation or may be automatically determined based on the communication information, and the above-described two modes may also be combined.

[0192] Thus, in the information processing method of the second implementation mode of the present disclosure, multiple ways of using the communication information are provided to further enhance the user experience. Furthermore, in the case where the processing capacity on the electronic device side is limited, the information processing method of the second implementation mode of the present disclosure can reduce the processing load on the electronic device side, which is particularly advantageous.

[0193] Hereinafter, the information processing apparatus applied in the server of the second implementation mode of the present disclosure will be described with reference to Fig. 4 described.

[0194] As in Fig. 4, an information processing apparatus 400 of the embodiments includes a communication information acquisition unit 401, a determination unit 402, a link information acquisition unit 403, and an execution unit 404.

[0195] The communication information acquisition unit 401 acquires the communication information generated by the communication from the first electronic device and / or the second electronic device in the process in which the first electronic device communicates with the second electronic device. The determination unit 402 determines the processing object based on the communication information. The link information acquisition unit 403 analyzes the processing object to acquire the link information associated with the processing object. The execution unit 404 executes the process based on the link information.

[0196] Specifically, in one embodiment, the communication information is static image information. The determination unit 402 includes a receiving unit and a first processing object determination unit (not shown). The receiving unit receives the electronic device parameter information and the input trace information transmitted from the first electronic device and / or the second electronic device. The input trace information is generated by detecting the user's input operation by the first electronic device and / or the second electronic device. The first processing object determination unit determines the processing object based on the electronic device parameter information and the input trace information.

[0197] More specifically, in the first example, the input track information is obtained by detecting the input operation for selecting a region in the video image by at least one of the first electronic device and the second electronic device. The first processing object determination unit is configured to determine a partial video image corresponding to the region in the video image as the processing object based on the parameter information of the electronic device.

[0198] In the second example, the input track information is obtained by detecting the click operation for clicking the video image by at least one of the first electronic device and the second electronic device. The first processing object determining unit includes an image division unit and an object determining unit. The image division unit applies image division to the video image based on the parameter information of the electronic device and the specific position in the video image corresponding to the click operation, to obtain the partial video image including the specific position. The object determining unit determines the partial video image as the processing object.

[0199] In the third example, the information processing device 400 further includes a recognition unit and a transmission unit (not shown). The recognition unit applies image recognition to the video image to determine the plurality of candidate objects. The transmission unit transmits the plurality of candidate objects to at least one of the first electronic device and the second electronic device. The input trace information is obtained by detecting the user's selection operation of the at least one candidate object of the plurality of candidate objects by at least one of the first electronic device and the second electronic device. Further, the first processing object determination unit is configured to determine the at least one selected candidate object as the processing object based on the parameter information of the electronic device and based on the selection operation.

[0200] In another embodiment, the communication information is static image information. The determination unit 402 further includes a static image recognition unit, a target area determination unit, and a second processing object determination unit. The static image recognition unit applies image recognition to the static image to divide the static image into multiple areas. The target area determination unit determines the target area from the multiple areas based on the predetermined criteria. The second processing object determination unit determines the processing object based on the target area.

[0201] In another embodiment, the communication information is dynamic image information. The determination unit 402 further includes a dynamic image recognition unit and a third processing object determination unit. The dynamic image recognition unit recognizes the dynamic image to identify the specific operation performed by the object in the dynamic image during the communication. The third processing object determination unit determines the processing object based on the specific operation.

[0202] In yet another embodiment, the communication information is audio information. The determination unit 402 includes an audio recognition unit for applying audio recognition to the sound to determine the processing object.

[0203] Furthermore, in yet another embodiment, the determination unit 402 comprises a candidate object determination unit, a transmission unit, a reception unit, and a fourth processing object determination unit (not shown).

[0204] In particular, the candidate object determination unit determines the plurality of candidate objects based on the communication information. The transmission unit transmits the plurality of candidate objects to the first electronic device and / or the second electronic device. The reception unit receives the selection information for selecting at least one candidate object by the user of the first electronic device and / or the second electronic device. The fourth processing object determination unit determines the at least one selected candidate object as the processing object based on the selection information.

[0205] Furthermore, in one embodiment, the object information of the plurality of objects is previously stored in the server. The object information of each of the objects and the attribute information representing the attribute of the object are stored linked to each other. In this embodiment, the linked information acquisition unit 403 includes an attribute acquisition unit, an attribute information acquisition unit, and an object information acquisition unit (not shown).

[0206] Specifically, the attribute acquisition unit analyzes the processing object to acquire the attribute of the processing object. The attribute information acquisition unit acquires related attribute information from the stored attribute information based on the attribute of the processing object. The object information acquisition unit acquires the object information linked to the related attribute information as the link information.

[0207] Specific configurations and operations of the respective units of the information processing apparatus of the second implementation mode of the present disclosure have been described in detail in the description of the information processing method of the second implementation mode of the present disclosure with reference to Fig. 3, which is not repeated here.

[0208] In the foregoing, the information processing apparatus according to the second implementation mode of the present disclosure has been described.

[0209] In the information processing device of the second implementation mode of the present disclosure, the communication information generated during communication can be utilized. Thus, in addition to implementing a communication goal, it can further increase the application value and greatly improve the user experience.

[0210] Further, in the information processing apparatus of the second implementation mode of the present disclosure, on the server side, the processing object may be determined in response to the user's input operation or automatically based on the communication information, and the above-described two modes may be combined.

[0211] Thus, in the information processing method of the second implementation mode of the present disclosure, multiple ways of using the communication information are provided to further enhance the user experience. Furthermore, in the case where the processing capacity on the electronic device side is limited, the information processing method of the second implementation mode of the present disclosure can reduce the processing load on the electronic device side, which is particularly advantageous. (Third implementation type)

[0212] In the third implementation mode of the present disclosure, an information processing method is provided and the information processing method is applied to the terminal side, wherein the information processing method and the information processing device can perform various types of operations such as immediate output, storage and forwarding, or the like after the link information described above is obtained.

[0213] First, the information processing method of the third implementation mode of the present disclosure will be described. Similarly, in the following description, it is assumed that the information processing method is applied to the first electronic device.

[0214] The flow of the information processing method of the third implementation mode of the present disclosure is similar to the flow of the information processing method of the first implementation mode of the present disclosure. That is, the information processing method similarly includes: determining the processing object based on communication information generated based on communication in a method in which the first electronic device performs multimedia communication with the second electronic device; acquiring the linking information associated with the processing object; and executing the operation based on the linking information.

[0215] Further, similarly, in the information processing method of the third implementation mode of the present disclosure, the information processing method may transmit the processing object to the remote server, analyze the processing object through the remote server to obtain the link information, and transmit the link information to the first electronic device. On the other hand, the information processing method may also analyze the processing object locally to determine the link information.

[0216] The following mainly describes details of the operation performed by the information processing method based on the linkage information.

[0217] In a first embodiment, the information processing method outputs the link information in the course of the communication or outputs the link information immediately after the end of the communication.

[0218] In this case, for example, in the first example, the information processing method may generate the prompt icon to prompt the user to view and display the prompt icon. The prompt icon is used to connect to the link information. Then, upon detecting that the user clicks the prompt icon, the information processing method accesses the link information.

[0219] In the second example, the communication is audio communication. In this case, the information processing method detects whether the first electronic device is connected to a display device. Note that the display device may be an external display device, but may also be a display unit provided in the first electronic device itself and in a deactivated state. For example, the information processing method may obtain information about the connection described above by detecting corresponding connection pins of the first electronic device.

[0220] The information processing method outputs the link information to the display device when it detects that the first electronic device is connected to a display device. Thus, display is performed by the display device based on the link information.

[0221] In the third example, the communication is video communication. In this case, the information processing method combines an image based on the linking information and an image of the video communication to generate a combined image and display the combined image. The image based on the linking information can be an image displaying various types of content, such as images, text, or the like.

[0222] In the second embodiment, the information processing method does not output the link information during the communication and immediately after the communication ends. Alternatively, the information processing method stores the link information, for example, in a local memory. Then, the information processing method outputs the link information only when it has determined that the predetermined condition is met.

[0223] Specifically, in the first example, the information processing method determines whether a current time satisfies a first predetermined condition. For example, the information processing method determines whether the current time is a time preset by the electronic device or the user. Furthermore, the information processing method determines, for example, whether a period of time between the current time and the end of communication is the period of time preset by the electronic device or the user. Further, the information processing method determines, for example, whether the period of time between the current time and the end of communication is greater than the period of time preset by the electronic device or the user.Then, the information processing method executes the display based on the linkage information if it has determined that the current time meets the first predetermined condition. Of course, the above first predetermined condition is only an example. Those skilled in the art can design various types of conditions other than the first predetermined condition if necessary.

[0224] In the second example, the information processing method determines whether a network access satisfies a second predetermined condition when the first electronic device executes the network access; for example, the information processing method determines whether a sink of the network access is a sink preset by the electronic device or the user. Furthermore, the information processing method locally stores, for example, a reference table between the link information and the network access sink beforehand. The information processing method determines whether the network access sink is a sink corresponding to the link information. Then, the information processing method executes the display based on the link information when it determines that the network access satisfies the second predetermined condition.Of course, the above second predetermined condition is only an example. Those skilled in the art can design various types of conditions other than the second predetermined condition if necessary.

[0225] In the third example, the information processing method may also detect environmental information of the first electronic device. The environmental information includes, for example, location information where the first electronic device is located, weather information and temperature information, or the like of an environment where the first electronic device is located. Then, the information processing method determines whether the environmental information satisfies a third predetermined condition; in the case of location information, for example, the information processing method determines whether the first electronic device reaches a location preset by the electronic device or the user. Further, the information processing method locally stores a reference table between the linkage information and the location information in advance.The information processing method decides whether the first electronic device is in a location corresponding to the link information based on the location information. Decisions about other types of environmental information are similar to this, which will not be described in further detail here. Then, the information processing method executes the display based on the link information if the environmental information satisfies the third predetermined condition. Of course, the third predetermined condition is only an example. Those skilled in the art can design various types of conditions other than the third predetermined condition if necessary.

[0226] Similarly, in the third embodiment, the information processing method does not output the link information during the communication and immediately after the communication ends. Unlike the second embodiment, the information processing method transmits the link information to the remote server and / or the second electronic device. The remote server and / or the second electronic device may, for example, store the link information or output the link information.

[0227] Further, in the above-described respective examples, the display processing may display the link information itself and may also display the prompt icon for connecting to the link information.

[0228] In the foregoing, the information processing method according to the third implementation mode of the present disclosure has been described.

[0229] In the information processing method according to the third implementation mode of the present disclosure, the processing object is determined based on the communication information generated by the communication, and the link information associated with the processing object is acquired, and the operation based on the link information is executed.

[0230] Thus, in the information processing method of the third implementation mode of the present disclosure, the communication information generated in the course of communication can be used, therefore, in addition to implementing a communication goal, it can further increase the application value of the communication and greatly improve the user experience.

[0231] Further, in the information processing method of the third implementation mode of the present disclosure, on the electronic device side, the link information and / or the prompt icon may be displayed in the course of the communication or immediately after the end of the communication, or the link information may also be stored and the output of the link information is triggered when it has decided that the predetermined condition is satisfied at a later time, or the link information may also be output to the server and / or the second electronic device to be processed.

[0232] Thus, in the information processing method of the third implementation mode of the present disclosure, multiple ways are provided to output the link information, which makes it easier for the user to perform various adjustments according to the circumstances to further improve the user experience.

[0233] The information processing device of the third implementation mode of the present disclosure will be described below. The configuration of the information processing device is similar to the configuration of the information processing device of the first implementation mode of the present disclosure, that is, it similarly includes a determination unit, an acquisition unit, and an execution unit.

[0234] The determination unit determines the processing object based on communication information generated based on communication in a process in which the first electronic device performs multimedia communication with the second electronic device. The acquisition unit acquires the link information associated with the processing object. The execution unit executes the process based on the link information.

[0235] As in the first implementation type, in one embodiment, the acquisition unit may comprise: a transmission unit for transmitting the processing object to the remote server; and a reception unit for receiving the link information from the remote server, wherein the link information is information associated with the processing object and obtained by analyzing the processing object by the remote server.

[0236] In a further embodiment, the acquisition unit may comprise an analysis unit to analyze the processing object to determine the linking information.

[0237] Further, in this type of implementation, the execution unit is configured to perform at least one of the following: displaying the link information; storing the link information; and transmitting the link information to the remote server and / or the second electronic device.

[0238] In particular, in one embodiment, the execution unit may include an icon generation unit and an icon display unit. The icon generation unit generates the prompt icon to prompt the user for display, and the prompt icon serves to link to the link information. The icon display unit displays the prompt icon.

[0239] Furthermore, in another embodiment, the communication is audio communication. The execution unit may include a first detection unit and an output unit. The first detection unit detects whether the first electronic device is connected to a display device. The output unit outputs the link information to the display device when it has detected that the first electronic device is connected to a display device, and the display device executes a display based on the link information.

[0240] In another embodiment, the communication is video communication. The execution unit may include a combining unit and a combined image display unit. The combining unit combines the image based on the link information and the image of the video communication to generate the combined image. The combined image display unit displays the combined image.

[0241] In the case where the execution unit is configured to store the link information, the information processing apparatus further comprises: a first decision unit for deciding whether the current time point satisfies the first predetermined condition after the link information is stored; and the execution unit is configured to execute the display based on the link information when it has decided that the current time point satisfies the first predetermined condition.

[0242] In another embodiment, in the case where the execution unit is configured to store the link information, the information processing device further comprises: a second decision unit for deciding whether the network access satisfies the second predetermined condition when the first electronic device executes the network access; after storing the link information; and the execution unit is configured to execute the display based on the link information when it has decided that the network access satisfies the second predetermined condition.

[0243] In another embodiment, in the case where the execution unit is configured to store the link information, the information processing device further comprises: an environmental information detection unit for detecting the environmental information of the first electronic device after storing the link information; and a third decision unit for deciding whether the environmental information satisfies the third predetermined condition; and the execution unit is configured to execute the display based on the link information when it has decided that the environmental information satisfies the third predetermined condition.

[0244] Further, in the third implementation mode of the present disclosure, the execution unit may be configured to display the link information and / or the prompt icon, and the prompt icon is for connecting to the link information.

[0245] Specific configurations and operations of the respective units of the information processing apparatus of the third implementation mode of the present disclosure have been described in detail in the description of the information processing method of the third implementation mode of the present disclosure, which will not be repeated in further detail here.

[0246] In the foregoing, the information processing apparatus according to the third implementation mode of the present disclosure has been described.

[0247] In the information processing apparatus of the third implementation mode of the present disclosure, the communication information generated in the course of communication can be used, thus, in addition to implementing a communication goal, it can further increase the application value of the communication and greatly improve the user experience.

[0248] Further, in the information processing apparatus of the third implementation mode of the present disclosure, on the electronic device side, the link information and / or the prompt icon may be displayed in the course of the communication or immediately after the end of the communication, or the link information may also be stored and the output of the link information is triggered when it has decided that the predetermined condition is satisfied at a later time, or the link information may also be output to the server and / or the second electronic device to be processed.

[0249] Thus, in the information processing apparatus of the third implementation mode of the present disclosure, multiple ways are provided to output the link information, which makes it easier for the user to perform various adjustments according to the circumstances to further improve the user experience. (Fourth implementation type)

[0250] In the fourth implementation mode of the present disclosure, an information processing method and an information processing apparatus applied to the server side are provided, wherein the information processing method and the information processing apparatus can perform various types of operations such as immediate output, storage and forwarding, or the like after the link information described above is obtained.

[0251] First, the information processing method of the fourth implementation mode of the present disclosure will be described.

[0252] The flow of the information processing method of the fourth implementation mode of the present disclosure is similar to the flow of the information processing method of the second implementation mode of the present disclosure. That is, the information processing method similarly includes: acquiring the communication information generated by the communication from the first electronic device and / or the second electronic device in the process in which the first electronic device communicates with the second electronic device; determining the processing object based on the communication information; analyzing the processing object to obtain link information associated with the processing object; and executing the operation based on the link information.

[0253] Furthermore, as in the second implementation, the object information of a plurality of objects may be previously stored in the server, and the object information of each of the objects is stored linked with attribute information representing the attribute of the object. The information processing method may analyze the processing object to determine the attribute of the processing object, determine the corresponding attribute information in the stored attribute information based on the attribute of the processing object, and determine the object information linked with the corresponding attribute information as the link information.

[0254] The following mainly describes details of the operation performed by the information processing method based on the linkage information.

[0255] Particularly, in the information processing method of the fourth implementation mode of the present disclosure, after obtaining the link information as described above, the link information may be stored to be output later, for example.

[0256] In a further embodiment, the information processing method may also transmit the linking information to the first electronic device and / or the second electronic device based on the predetermined strategy.

[0257] More specifically, in the first example, the information processing method receives the request from the first electronic device and / or the second electronic device. The request is to request the server to transmit the link information. In this example, it is assumed that the information processing method received the request from the first electronic device. Therefore, the information processing method transmits the link information in response to the request to the electronic device making the request, i.e., the first electronic device in this example.

[0258] In the second example, the information processing method does not need to respond to an extra request from the first electronic device or the second electronic device and can transmit the link information directly. In this case, the information processing method transmits the link information by default to the electronic device that transmits the communication information.

[0259] In the third example, the communication information includes audio information. The information processing method performs a semantic analysis on the audio to determine for which the linking information is appropriate. The techniques for performing the semantic analysis by the information processing method are known to those skilled in the art and will not be described in further detail here. After obtaining a determination result by the semantic analysis, the information processing method transmits the linking information to the electronic device determined to be appropriate.

[0260] In the fourth example, the communication information includes text information. Similarly, the information processing method applies semantic analysis to the text to determine for which of the first electronic device and the second electronic device the linking information is appropriate. The techniques for performing semantic analysis by the information processing method are known to those skilled in the art and will not be described in further detail here. Similarly, after obtaining a determination result by the semantic analysis, the information processing method transmits the linking information to the electronic device determined to be appropriate.

[0261] Note that the various types of strategies described above are only examples. Those skilled in the art can devise various other types of strategies to transmit the linking information to a suitable electronic device, if necessary.

[0262] In the foregoing, the information processing method according to the fourth implementation mode of the present disclosure has been described.

[0263] In the information processing method according to the fourth implementation mode of the present disclosure, the processing object is determined based on the communication information generated by the communication, and the link information associated with the processing object is acquired, and the operation based on the link information is executed.

[0264] Thus, in the information processing method of the fourth implementation mode of the present disclosure, the communication information generated in the course of communication can be used, therefore, in addition to implementing a communication goal, it can further increase the application value of the communication and greatly improve the user experience.

[0265] Further, in the information processing method of the fourth implementation mode of the present disclosure, on the server side, the link information may be stored and later output, or the link information may be transmitted to the appropriate electronic device according to various kinds of different strategies further executed by the electronic device receiving the link information.

[0266] Thus, in the information processing method of the fourth implementation mode of the present disclosure, multiple ways are provided to output the link information, and multiple ways are provided to output the link information to different electronic devices, which facilitates the service provider to perform various adjustments according to the circumstances and further improves the user experience.

[0267] The information processing apparatus of the fourth implementation mode of the present disclosure will be described below.

[0268] The configuration of the information processing apparatus is similar to the configuration of the information processing apparatus of the second implementation mode of the present disclosure, that is, it similarly includes an acquisition unit, a determination unit, an analysis unit, and an execution unit.

[0269] The acquisition unit acquires the communication information generated by the communication from the first electronic device and / or the second electronic device in the method in which the first electronic device communicates with the second electronic device. The determination unit determines the processing object based on the communication information. The analysis unit analyzes the processing object to obtain the link information associated with the processing object. The execution unit executes the process based on the link information.

[0270] Furthermore, as in the second implementation type, the object information of multiple objects can also be stored in advance on the server, and the object information of each of the objects is stored, linked to attribute information representing the attribute of the object. The acquisition unit includes an attribute acquisition unit, an attribute information acquisition unit, and an object information acquisition unit.

[0271] Specifically, the attribute acquisition unit analyzes the processing object to acquire the attribute of the processing object. The attribute information acquisition unit acquires related attribute information from the stored attribute information based on the attribute of the processing object. The object information acquisition unit acquires the object information linked to the related attribute information as the link information.

[0272] In the information processing device of the fourth implementation type, the execution unit is configured to perform at least one of the following: storing the link information; transmitting the link information to the first electronic device and / or the second electronic device based on the predetermined strategy.

[0273] In the case where the linking information is transmitted to the first electronic device or the second electronic device based on the predetermined strategy, in the first example, the execution unit includes: a receiving unit for receiving a request from the first electronic device and / or the second electronic device; and a transmitting unit for transmitting the linking information in response to the request to the electronic device making the request.

[0274] In the second example, the execution unit is configured to transmit the link information to the electronic device that transmits the communication information.

[0275] In the third example, the communication information includes audio information. The execution unit includes: a semantic analysis unit for applying the semantic analysis to the audio to determine for which the linking information is appropriate; and a transmission unit for transmitting the linking information to the electronic device determined to be appropriate.

[0276] In the fourth example, the communication information includes text information. The execution unit includes: a semantic analysis unit for applying the semantic analysis to the text to determine for which the linking information is appropriate; and a transmission unit for transmitting the linking information to the electronic device determined to be appropriate.

[0277] Specific configurations and operations of the respective units of the information processing apparatus of the fourth implementation mode of the present disclosure have been described in detail in the description of the information processing method of the fourth implementation mode of the present disclosure, which will not be repeated here.

[0278] In the foregoing, the information processing apparatus according to the fourth implementation mode of the present disclosure has been described.

[0279] In the information processing apparatus of the fourth implementation mode of the present disclosure, the communication information generated in the course of communication can be used, thus, in addition to implementing a communication goal, it can further increase the application value of the communication and greatly improve the user experience.

[0280] Further, in the information processing apparatus of the fourth implementation mode of the present disclosure, on the server side, the link information may be stored and later output, or the link information may be transmitted to the appropriate electronic apparatus according to various kinds of different strategies to be further processed by the electronic apparatus receiving the link information.

[0281] Thus, in the information processing apparatus of the fourth implementation mode of the present disclosure, multiple ways are provided to output the link information, and multiple ways are provided to output the link information to different electronic devices, which facilitates the service provider to perform various adjustments according to the circumstances and further improves the user experience.

[0282] In the foregoing, the information processing method and the information processing apparatus according to the first implementation mode to the fourth implementation mode of the present disclosure have been described.

[0283] Hereinafter, applications of the information processing method and the information processing apparatus of the embodiments will be described together with several specific scenarios.

[0284] First, the information processing method and the information processing apparatus of the embodiments will be described with reference to Fig. 5A-5C. In the scenarios described in Fig. 5A-5C, the first electronic device performs video communication with the remote second electronic device. Fig. 5A-5C are schematic diagrams showing displays on a screen 500 of the first electronic device to which the information processing method of the embodiments is applied.

[0285] The screen 500 is divided into two areas: a first area 501 and a second area 502. An image of the user of the first electronic device (hereinafter, where appropriate, referred to as the first user), captured by the first electronic device via an image capture unit, for example, a pre-positioned camera, is displayed in the first area 501. An image of the user of the second electronic device (hereinafter, where appropriate, referred to as the second user), captured by the second electronic device via an image capture unit, for example, a pre-positioned camera, is displayed in the second area 502.

[0286] In the following description, it is assumed that the display 500 of the first electronic device is a touchscreen. However, those skilled in the art will recognize that the information processing method and information processing device of the embodiments can be similarly applied to an electronic device without touch control.

[0287] In the scenario of Fig. 5A, the first user is in video communication with the second user and is interested in the second user's jacket, indicating an area 503 corresponding to the jacket on the screen 500 through a gesture. The information processing method detects the user's operation described above and determines a partial video image corresponding to the area 503 in the video image as the processing object.

[0288] Alternatively, the first user may also click each position in an area where the jacket is located on the screen 500 by a gesture. The information processing method obtains the partial video image including the position by applying image division to the video image, as also shown in 503.

[0289] Alternatively, the information processing method may also apply image recognition to the video image to divide the video image into a plurality of regions, for example, a region 503 corresponding to the jacket, a region 504 corresponding to pants, a region 505 corresponding to shoes, a region 506 corresponding to a human face, and a region 507 corresponding to a background. Then, the information processing method determines the region 503 of the plurality of regions as the processing object based on a predetermined criterion, such as the significance of the region.

[0290] Alternatively, the information processing method may also combine the user input described above with some form of automatic detection. That is, the information processing method may first automatically apply image recognition to the video image to detect multiple candidate objects, such as the jacket 503, the pants 504, and the shoes 505, and present the multiple candidate objects to the first user. The types of presentation are not limited. For example, the information processing method may display the partial video image corresponding to the areas 503, 504, and 505 in the form of a thumbnail image at an appropriate position on the screen 500. Further, the information processing method may, for example, display a prompt marker near the areas 503, 504, and 505, etc.Then, the information processing method detects a selection operation of at least one candidate object of the plurality of candidate objects by the user and determines the at least one selected candidate object as the processing object based on the selection operation.

[0291] Thus, the information processing method obtains the link information associated with the processing object and executes the operation based on the link information. Specifically, in this scenario, the information processing method determines, for example, a brand name of the jacket through image analysis, thereby obtaining attribute information such as the price, material, production location of the jacket, or the like, as the link information. Furthermore, the information processing method determines, for example, the brand name of the jacket through image analysis, and thus obtains information about other jackets belonging to the same brand as the jacket or the like as the link information. Of course, the above-described method of determining the link information by the information processing method is only an example.

[0292] After obtaining the linking information, in one embodiment, the information processing method generates the prompt icon for prompting the user to perform a display and to connect to the linking information and displays the prompt icon, for example, as indicated by an icon 508 in Fig. 5B is shown.

[0293] In a further embodiment, the information processing method generates an image based on the link information as indicated by 509 in Fig. 5C, and combines it with the video communication image to produce a combined image, and displays the combined image.

[0294] In a further embodiment, the information processing method does not output the linking information immediately after receiving it, but stores it in a local memory or transmits it to the server and / or the second electronic device.

[0295] In the case where it is stored in the local memory, in one embodiment, the information processing method may display the link information or an icon for prompting access to the link information when it has decided that the current time meets the first predetermined condition.

[0296] In a further embodiment, the information processing method may display the link information or an icon for prompting access to the link information when it has decided that the network access satisfies the second predetermined condition, for example, when it has decided that a sink of the network access is a shopping site.

[0297] In yet another embodiment, the information processing method may detect environmental information of the first electronic device, for example, location information of the first electronic device. If the information processing method determines that the environmental information satisfies the third predetermined condition, it determines, for example, that the first electronic device is located in a shopping mall, and the link information or the icon prompting access to the link information is displayed.

[0298] Please note that Fig. 5A-5C describe a case where the first user performs video communication with the second user of the second electronic device using a pre-positioned camera of the first electronic device, and the processing object consists of objects in the video image belonging to the second user.

[0299] Alternatively, the information processing method and the information processing apparatus of the embodiments can also be applied to a case where the first user performs video communication with the second user of the second electronic device with a pre-positioned camera of the first electronic device, and the processing object consists of objects in the video image belonging to the first user. Fig. Figure 6 shows a schematic diagram of a display in this case.

[0300] As in Fig. As shown in Figure 6, the screen 600 is divided into two areas: a first area 601 and a second area 602. An image on the side of the first electronic device, captured by the first electronic device via an image capture unit, for example, a pre-positioned camera, is displayed in the first area 601. An image on the side of the second electronic device, captured by the second electronic device via the image capture unit, for example, a camera, is displayed in the second area 602.

[0301] In this scenario, assume that the first user wants to describe a building in a region where the first user is close to the second user, but may not know various types of link information of the building, such as the building name or the like. At this time, the first user may know various types of link information of the building, such as a name, building data, or the like, for the information processing method of the embodiments, whose processing is similar to that described above, which will not be described in further detail here.

[0302] Note that the description here uses the case where a static image is recognized in video communication as an example. Those skilled in the art will understand that the information processing method and information processing apparatus of the embodiments can be similarly applied to recognition of a dynamic image in video communication, audio communication, text communication, or the like.

[0303] Furthermore, note that the description here uses the case where the information processing method and the information processing apparatus are applied to the first electronic device as the above example. Those skilled in the art will appreciate that the information processing method and the information processing apparatus of the embodiments can be similarly applied to the second electronic device and the server.

[0304] In the foregoing, application examples of the information processing method and the information processing apparatus of the embodiments were described with reference to Fig. 5 and Fig. 6 described.

[0305] In the information processing method and the information processing apparatus of the embodiments, the communication information generated in the course of communication can be used, therefore, in addition to implementing a communication goal, they can further increase the application value of the communication and greatly improve the user experience.

[0306] Furthermore, in the information processing method and the information processing device of the embodiments, on the electronic device side, the processing object may be determined in response to the user's input operation or may be automatically determined based on the communication information; the two methods described above may also be combined. Therefore, the information processing method and the information processing device of the embodiments provide multiple ways to utilize the communication information to further enhance the user experience.

[0307] Furthermore, in the information processing method and the information processing apparatus of the embodiments, the above-described process of determining the processing object can be executed also on the server side, thus, in the case where the processing capacity of the electronic apparatus is limited, it can reduce the processing load on the electronic apparatus side, which improves the processing efficiency on the electronic apparatus side.

[0308] Furthermore, in the information processing method and the information processing device of the embodiments, on the electronic device side, the link information and / or the prompt icon may be displayed during the communication or immediately after the communication ends, or the link information may be stored and the output of the link information may be triggered when it is judged that the predetermined condition is met at a later time, or the link information may be output to the server and / or the second electronic device for processing. Thus, it is easier for the user to perform various adjustments according to the circumstances to further enhance the user experience.

[0309] Furthermore, in the information processing method and the information processing apparatus of the embodiments, the link information may be stored on the server side and output later, or the link information may be transmitted to the appropriate electronic device according to various different strategies to be further processed by the electronic device that receives the link information. Thus, multiple ways are provided for outputting the link information to various electronic devices, which makes it easier for a service provider to perform various adjustments according to circumstances.

[0310] In the foregoing, the information processing method and the information processing apparatus according to the embodiment were described with reference to Fig. 1 to 6.

[0311] It is clear that in the description, the terms "comprises," "includes," and all other variations thereof are intended to cover non-exclusive encompassing, such that the process, method, product, or device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or includes elements inherent in that process, method, product, or device. Unless further limitations apply, the element defined by the phrase "comprises a..." does not preclude the presence of an additional like element in the process, method, product, or device comprising that element.

[0312] It should also be made clear that in the description, expressions such as "a first ... unit," "a second ... unit" are used only for differentiation purposes for convenience at the time of description and do not imply that they must be implemented as two or more physically separate units. In reality, the units may be implemented as a single comprehensive unit or, if necessary, may be implemented as multiple units.

[0313] Finally, note that the sequence of procedures described above includes not only procedures performed chronologically in the order described here, but also includes procedures performed in parallel or individually but not chronologically.

[0314] With the description of the above implementation mode, one skilled in the art can clearly see that the present disclosure can be implemented by software together with a necessary hardware platform; of course, it can also be implemented by hardware alone. Based on this understanding, the technical solution of the present disclosure, as a whole or as the part added to the conventional description, can be carried out by some kind of software product, wherein the computer software product can be stored in a storage medium, such as ROM / RAM, a magnetic disk, an optical disk, or the like, and comprises some instructions for causing a computer device (it can be a PC, a server, or network equipment, or the like) to execute the method according to the corresponding embodiments of a certain part of the embodiments.

[0315] In embodiments, the unit / module may be implemented with software to be processed by various types of processors. A selected module of executable code may, for example, comprise one or more physical or logical blocks of computer instructions; for example, it may be created as an object, procedure, or function. However, the executable code of the selected modules need not be physically located next to each other; rather, they may comprise different instructions stored in different bits. When these instructions are logically combined together, they form the units / modules and implement specific goals of the units / modules.

[0316] When the units / modules are implemented with software, considering the level of the conventional hardware process, the units / modules can be implemented through software. However, if cost is not an issue, one skilled in the art can fabricate corresponding hardware circuits to implement corresponding functions. The hardware circuits include conventional very large scale integration (VLSI) circuits or gate array circuits and conventional semiconductors, such as logic chips, transistors, or the like, or other discrete elements. The modules can also be implemented through programmable hardware devices, such as FPGAs, programmable array logic, a programmable logic utility, or the like.

[0317] The present disclosure is described in detail above. The principle and implementation method of the present disclosure are described by applying specific examples in the text. The above description of the embodiments is only for understanding the method of the present disclosure and its core idea. Meanwhile, for those skilled in the art, the specific implementation method and field of application may be changed according to the idea of the present disclosure. Thus, in summary, the content of the description should not be construed as limiting the present disclosure.

Claims

[1] Information processing method applied in a server, the information processing method comprising: Capturing communication information generated by a communication from a first electronic device and / or a second electronic device in a method in which the first electronic device communicates with the second electronic device; Determining a processing object based on the communication information; Analyzing the processing object to obtain link information associated with the processing object; and Performing an operation based on the link information, wherein performing the operation based on the link information comprises at least one of the following: Saving the link information; Determining for which of the first electronic device and the second electronic device the linking information is suitable based on a predetermined strategy; Transmitting the linking information to the determined first electronic device or the second electronic device, wherein transmitting the linking information to the first electronic device or the second electronic device based on the predetermined strategy comprises: Applying a semantic analysis to sound to determine for which of the first electronic device and the second electronic device the linking information is appropriate if the communication information includes information about the sound; and Transmitting the linking information to the electronic device determined to be suitable. [2] The information processing method according to claim 1, wherein transmitting the link information to the first electronic device or the second electronic device based on the predetermined strategy comprises at least one of the following: Receiving a request from the first electronic device and / or the second electronic device; Transmitting the linking information in response to the request to the electronic device making the request; and Transmitting the linking information to the electronic device that transmits the communication information. [3] The information processing method according to claim 1, wherein determining the processing object comprises at least one of the following: Receiving input track information transmitted from the first electronic device and / or the second electronic device in the case where the communication information is information of a video image, and Determining the processing object based on the input trace information, wherein the input trace information is generated by detecting an input operation of a user by the first electronic device and / or the second electronic device; Applying image recognition to the video image to divide a static image into a plurality of regions in the case where the communication information is information of the static image, determining a target region from the plurality of regions based on predetermined criteria, and determining the processing object based on the target region; Recognizing a dynamic image to recognize a specific operation performed by an object in the dynamic image in the course of communication in the case where the communication information is information of the dynamic image, and determining the processing object based on the specific operation; and Applying audio detection to sound to determine the processing object in the case where the communication information is information of sound. [4] An information processing method applied in a first electronic device, the information processing method comprising: Determining a processing object based on communication information generated by a communication in a method in which the first electronic device performs multimedia communication with a second electronic device; Capturing link information associated with the processing object; and Performing an operation based on the link information, wherein performing the operation based on the link information comprises storing the link information, and the information processing method further comprises at least one of the following: deciding whether the current time satisfies a first predetermined condition after storing the link information, and executing a display based on the link information when it is decided that the current time satisfies the first predetermined condition; Deciding whether a network access satisfies a second predetermined condition when the first electronic device executes the network access after the link information has been stored, and executing the display based on the link information when the network access satisfies the second predetermined condition; and Detecting environmental information of the first electronic device after storing the link information and deciding whether the environmental information satisfies a third predetermined condition, and executing the display based on the link information when the environmental information satisfies the third predetermined condition. [5] The information processing method according to claim 4, wherein acquiring the link information associated with the processing object comprises at least one of the following: Transferring the processing object to a remote server and receiving the link information from the remote server, wherein the link information is information associated with the processing object and is obtained by analyzing the processing object by the remote server; and Analyze the processing object to determine the link information. [6] The information processing method according to claim 4, wherein the communication information is information of a video image, and determining the processing object comprises: Detecting a user input; and Determining the processing object in the video image based on the input operation. [7] The information processing method according to claim 6, wherein detecting the user's input operation comprises: detecting an input operation for selecting an area in the video image; and determining the processing object comprises: determining a part of the video image belonging to the area in the video image as the processing object; or wherein detecting the user's input operation comprises: detecting a click operation for clicking the video image; and determining the processing object comprises: applying image division to the video image based on a specific position in the video image corresponding to the click operation to obtain a partial video image including the specific position, and determining the partial video image as the processing object; or wherein, in the case where image recognition is applied to the video image to determine a plurality of candidate objects, detecting the user's input operation comprises: detecting a selection operation of at least one candidate object of the plurality of candidate objects by the user; and determining the processing object comprises: determining the at least one selected candidate object as the processing object based on the selection operation. [8] The information processing method according to claim 4, wherein determining the processing object further comprises: Determining multiple candidate objects based on the communication information; Detecting a selection operation of at least one candidate object of the plurality of candidate objects by the user; and Determining the at least one selected candidate object as the processing object based on the selection process. [9] An information processing apparatus applied in a server, the information processing apparatus comprising: a detection unit for detecting communication information generated by communication from a first electronic device and / or a second electronic device in a process in which the first electronic device communicates with the second electronic device; a determination unit for determining a processing object based on the communication information; an analysis unit for analyzing the processing object to obtain the link information associated with the processing object; and an execution unit for performing an operation based on the link information, the execution unit being configured to perform at least one of the following: Storing the link information; and Transmitting the linking information to the first electronic device and / or the second electronic device based on a predetermined strategy, wherein, in the case where the execution unit is configured to transmit the link information to the first electronic device or the second electronic device based on the predetermined strategy, the execution unit is configured to perform at least one of the following: Applying a semantic analysis to sound to determine for which of the first electronic device and the second electronic device the linking information is appropriate when the communication information includes information of the sound, and transmitting the linking information to the electronic device that has been determined to be appropriate. [10] The information processing apparatus according to claim 9, wherein, in the case where the execution unit is configured to transmit the link information to the first electronic device or the second electronic device based on the predetermined strategy, the execution unit is configured to execute at least one of the following: Receiving a request from the first electronic device and / or the second electronic device and transmitting the linking information in response to the request to the electronic device making the request; Transmitting the linking information to the electronic device that transmits the communication information. [11] The information processing apparatus according to claim 9, wherein the determination unit is configured to perform at least one of the following operations: Receiving input track information transmitted from the first electronic device and / or the second electronic device in the case where the communication information is information of a video image, and Determining the processing object based on the input trace information, wherein the input trace information is generated by detecting an input operation of a user by the first electronic device and / or the second electronic device; applying image recognition to the video image to divide a static image into a plurality of regions in the case where the communication information is information of the static image, determining a target region from the plurality of regions based on a predetermined criterion, and determining the processing object based on the target region; Recognizing a dynamic image to recognize a specific operation performed by an object in the dynamic image in the course of communication in the case where the communication information is information of the dynamic image, and determining the processing object based on the specific operation; and Perform audio detection on sound to determine the processing object in the case where the communication information is information of sound. [12] An information processing apparatus applied to a first electronic device, the information processing apparatus comprising: a determination unit for determining a processing object based on communication information generated by communication in a method in which the first electronic device performs multimedia communication with a second electronic device; a detection unit for detecting link information associated with the processing object; and an execution unit for executing an operation based on the link information, wherein the execution unit is configured to store the link information, and the information processing device further comprises at least one of the following: a first decision unit for deciding whether a current time point satisfies a first predetermined condition after the link information is stored; and the execution unit is configured to execute a display based on the link information when it has decided that the current time point satisfies the first predetermined condition; a second decision unit for deciding whether a network access satisfies a second predetermined condition when the first electronic device performs the network access after the link information is stored; and the execution unit is configured to execute the display based on the link information if it has decided that the network access satisfies the second predetermined condition; and an environmental information detection unit for detecting environmental information of the first electronic device after the link information has been stored; and a third decision unit for deciding whether the environmental information satisfies a third predetermined condition, wherein the execution unit is configured to execute the display based on the link information when it has decided that the environmental information satisfies the third predetermined condition. [13] The information processing apparatus according to claim 12, wherein the detection unit is configured to perform at least one of the following operations: Transferring the processing object to a remote server and receiving the link information from the remote server, wherein the link information is information associated with the processing object and is obtained by analyzing the processing object by the remote server; and Analyze the processing object to determine the link information. [14] The information processing apparatus according to claim 12, wherein the communication information is information of a video image, and the determination unit comprises: a detection unit for detecting an input operation of a user; and a first processing object determination unit for determining the processing object from the video image based on the input process. [15] Information processing apparatus according to claim 14, wherein the detection unit is configured to detect an input operation to select an area in the video image, and the first processing object determination unit is configured to determine a partial video image as the processing object belonging to the area in the video image; or wherein the detection unit is configured to detect a click operation for clicking the video image, and the first processing object determination unit comprises: an image division unit for applying image division to the video image based on a specific position in the video image corresponding to the click operation to obtain a partial video image including the specific position; and an object determination unit for determining the partial video image as the processing object; or wherein, in the case where image recognition is applied to the video image to determine the plurality of candidate objects, the detection unit comprises a selection detection unit for detecting a selection of the at least one candidate object of the plurality of candidate objects, and the processing object determination unit is configured to determine the at least one selected candidate object as the processing object based on the selection operation. [16] The information processing apparatus according to claim 12, wherein the determination unit further comprises: a candidate object determination unit for determining a plurality of candidate objects based on the communication information; a selection detection unit for detecting a selection of the at least one candidate object of the plurality of candidate objects by the user; and a fourth processing object determining unit for determining the at least one selected candidate object as the processing object based on the selection process.

Images