Information processing method and device

Abstract

The invention provides an information processing method, which is applied to first electronic equipment, and comprises the following steps: responding to a first application in the first electronic equipment to obtain first information, and / or responding to the first electronic equipment to obtain second information, and generating first target information; the first target information has the same meaning as at least part of multimedia information collected by the first electronic equipment and / or the second electronic equipment; at least one second application in the first electronic equipment is determined, the first application is different from the second application, the second application runs in the first electronic equipment and third electronic equipment, and the first application is used for instant audio and / or video transmission between the first electronic equipment and the second electronic equipment; the second application is used for real-time audio and / or video transmission between the first electronic equipment and the third electronic equipment; and transmitting the first target information to the third electronic equipment through the second application, so that the second application of the third electronic equipment outputs the first target information.

Description

Technical Field

[0001] The present disclosure relates to the field of electronic technology, and more specifically, to an information processing method and device. Background Art

[0002] With the popularity of remote work and online meetings, more and more companies and individuals rely on various office communication software for work communication and collaboration. However, different applications are often incompatible, which makes cross-platform communication difficult. When users of multiple different applications need to hold meetings, they need to ensure that all participants use the same application or platform to achieve effective communication. Especially when it comes to multiple companies, teams or external customers, since different organizations have different choices and usage habits of communication tools, it is often difficult to implement a unified solution of using a specific tool, which affects efficient cross-platform communication. Summary of the invention

[0003] In view of this, the present disclosure provides an information processing method and device.

[0004] One aspect of the present disclosure provides an information processing method, which is applied to a first electronic device, including: generating first target information in response to a first application in the first electronic device obtaining first information, and / or in response to the first electronic device obtaining second information, wherein the first application runs in the first electronic device and the second electronic device, the first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application, and the second information includes multimedia information collected by the hardware in the first electronic device; the first target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the second electronic device; determining at least one second application in the first electronic device, the first application is different from the second application, the second application runs in the first electronic device and the third electronic device, the first application is used for instant audio and / or video transmission between the first electronic device and the second electronic device, and the second application is used for instant audio and / or video transmission between the first electronic device and the third electronic device; transmitting the first target information to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information.

[0005] According to an embodiment of the present disclosure, the first information and / or the second information is acquired in real time, and the first target information is generated, including: generating the first target information in real time according to the first information and / or the second information; transmitting the first target information to a third electronic device through a second application, including: transmitting the first target information generated in real time to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information in real time.

[0006] According to an embodiment of the present disclosure, the multimedia information includes at least one of audio information, video information, text information, and image information, and generating the first target information includes: generating the first target information based on at least one of the audio information, video information, text information, and image information collected by hardware in the second electronic device, and / or at least one of the audio information, video information, text information, and image information collected by hardware in the first electronic device.

[0007] According to an embodiment of the present disclosure, the first target information includes at least one of audio information, video information, text information, and image information, and transmitting the first target information to a third electronic device through a second application includes: determining a first type of multimedia information that the second application has transmission authority for; and transmitting, through the second application, the audio information, and / or video information, and / or text information, and / or image information that matches the first type in the first target information to the third electronic device.

[0008] According to an embodiment of the present disclosure, generating the first target information includes: determining the second type of multimedia information that can be transmitted by the second application; converting the first information, and / or at least part of the multimedia information in the second information that does not conform to the second type, into multimedia information with the same meaning and conforming to the second type; generating the first target information based on the converted multimedia information, and the multimedia information in the first information, and / or the second information that conforms to the second type.

[0009] According to an embodiment of the present disclosure, the information processing method also includes: obtaining third information in response to a second application, and / or obtaining first information in response to a first application, generating second target information, the third information including multimedia information collected by hardware in a third electronic device and transmitted to the first electronic device through the second application, the second target information having at least partial meaning identical to the multimedia information collected by the second electronic device and / or the third electronic device; and outputting the second target information.

[0010] According to an embodiment of the present disclosure, the second target information includes at least one of audio information, video information, text information, and image information, and outputting the second target information includes: determining the communication authority of the first electronic device, the communication authority characterizing the type of multimedia information that the first electronic device has the authority to output; outputting the audio information, and / or video information, and / or text information, and / or image information in the second target information that meets the communication authority.

[0011] According to an embodiment of the present disclosure, the information processing method also includes: in response to the start of a third application, determining whether the third application meets a preset communication condition, the third application runs in the first electronic device and the fourth electronic device, and the third application is different from the first application and the second application; when the third application meets the preset communication condition, when the third application obtains the fourth information, the third application is regarded as the first application, the fourth information is regarded as the first information, and the same operation as the first application and the first information is performed, the fourth information includes multimedia information collected by hardware in the fourth electronic device and transmitted to the first electronic device through the first application; when the third application meets the preset communication condition, when the multimedia information needs to be transmitted to the fourth electronic device based on the third application, the third application is regarded as the second application, and the same operation as the second application is performed.

[0012] Another aspect of the present disclosure provides an information processing device, including: a generation module, used to generate first target information in response to a first application in a first electronic device obtaining first information, and / or in response to the first electronic device obtaining second information, the first application runs in the first electronic device and the second electronic device, the first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application, and the second information includes multimedia information collected by the hardware in the first electronic device; the first target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the second electronic device; a determination module, used to determine at least one second application in the first electronic device, the first application is different from the second application, the second application runs in the first electronic device and the third electronic device, the first application is used for instant multimedia information transmission between the first electronic device and the second electronic device, and the second application is used for instant multimedia information transmission between the first electronic device and the third electronic device; and a transmission module, used to transmit the first target information to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information.

[0013] Another aspect of the present disclosure provides a first electronic device, comprising: one or more processors; and a memory for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method as described above.

[0014] Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, which are used to implement the above method when executed.

[0015] Another aspect of the present disclosure provides a computer program product, which includes computer executable instructions, and when the instructions are executed, are used to implement the method as described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0017] Figure 1 An exemplary application scenario diagram to which the information processing method according to an embodiment of the present disclosure can be applied is schematically shown;

[0018] Figure 2 Another exemplary application scenario diagram to which the information processing method according to an embodiment of the present disclosure can be applied is schematically shown;

[0019] Figure 3 Schematically illustrates the information flow in a first electronic device according to an embodiment of the present disclosure;

[0020] Figure 4 The flowchart of the information processing method according to the embodiment of the present disclosure is schematically shown;

[0021] Figure 5 Another flowchart of the information processing method according to an embodiment of the present disclosure is schematically shown;

[0022] Figure 6 Another flowchart of the information processing method according to an embodiment of the present disclosure is schematically shown;

[0023] Figure 7 A flowchart of transmitting first target information in an information processing method according to an embodiment of the present disclosure is schematically shown;

[0024] Figure 8 A flowchart of generating first target information in an information processing method according to an embodiment of the present disclosure is schematically shown;

[0025] Fig. 9 Another flowchart of the information processing method according to an embodiment of the present disclosure is schematically shown;

[0026] Fig.10 Schematically shows a flow chart of outputting second target information in the information processing method according to an embodiment of the present disclosure;

[0027] Fig.11 Another flowchart of the information processing method according to an embodiment of the present disclosure is schematically shown;

[0028] Fig.12 A block diagram schematically shows an information processing device according to an embodiment of the present disclosure; and

[0029] Fig.13 A block diagram of an electronic device suitable for implementing the method described above according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0030] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0031] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0032] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0033] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0034] In the embodiments of the present disclosure, the collection, updating, analysis, processing, use, transmission, provision, disclosure, storage, etc. of the data involved (for example, including but not limited to user personal information) are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. In particular, necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information, network security, and national security.

[0035] In the embodiments of the present disclosure, the user's authorization or consent is obtained before obtaining or collecting the user's personal information.

[0036] An embodiment of the present disclosure provides an information processing method, which is applied to a first electronic device, including: generating first target information in response to a first application in the first electronic device obtaining first information, and / or in response to the first electronic device obtaining second information, the first application runs in the first electronic device and the second electronic device, the first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application, and the second information includes multimedia information collected by the hardware in the first electronic device; the first target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the second electronic device; determining at least one second application in the first electronic device, the first application is different from the second application, the second application runs in the first electronic device and the third electronic device, the first application is used for instant audio and / or video transmission between the first electronic device and the second electronic device, and the second application is used for instant audio and / or video transmission between the first electronic device and the third electronic device; transmitting the first target information to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information.

[0037] Figure 1 The exemplary application scenario 100 to which the information processing method according to the embodiment of the present disclosure can be applied is schematically shown. It should be noted that: Figure 1 What is shown are merely examples of application scenarios to which the embodiments of the present disclosure can be applied, in order to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios.

[0038] like Figure 1 As shown, the application scenario 100 according to this embodiment may include a first electronic device 110, a second electronic device 120, a third electronic device 130, and a network 140. The network 140 is used to provide a medium for a communication link between the first electronic device 110, the second electronic device 120, and the third electronic device 130. The network 140 may include various connection types, such as wired and / or wireless communication links, etc.

[0039] The first electronic device 110 may be configured with a first application 111 and a second application 112, the second electronic device 120 may be configured with the first application 111, and the third electronic device may be configured with the second application 112. The first application 111 and the second application 112 may be used for real-time communication between different devices, such as real-time text transmission, audio transmission, video transmission, picture transmission, etc. The first application 111 and the second application 112 are different real-time transmission applications.

[0040] Based on the real-time communication between the first application 111 in the second electronic device 120 and the first application 111 in the first electronic device 110, the user of the first electronic device communicates with the user of the second electronic device in real time. Based on the real-time communication between the second application 112 in the third electronic device 130 and the second application 112 in the first electronic device 110, the user of the first electronic device communicates with the user of the third electronic device in real time.

[0041] The first electronic device 110 can process information received by the first application 111 and / or information that the first application 111 needs to send, and transmit the processed information through the second application 112, so that real-time communication is achieved between the first application 111 and the second application 112.

[0042] Figure 2 Another exemplary application scenario diagram to which the information processing method according to an embodiment of the present disclosure can be applied is schematically shown.

[0043] like Figure 2 As shown, user A inputs information A based on the first application 111 in the second electronic device 120, and the first application 111 in the second electronic device 120 transmits information A to the first application 111 in the first electronic device 110; user B inputs information B based on the second application 112 in the third electronic device 130, and the second application 112 in the third electronic device 130 transmits information B to the second application 112 in the first electronic device 110; the first electronic device 110 processes the information A obtained by the first application 111 and the information B obtained by the second application 112 to obtain processed information, for example, superimposes information A and information B, and outputs the processed information based on the output signal and the output device in the first electronic device, so that user C who uses the first electronic device 110 can know information A and information B.

[0044] User C inputs information C based on the hardware in the first electronic device, and the first electronic device 110 processes information C and information B to obtain processed information, such as superimposing information C and information B, and transmits the information to the first application 111 in the second electronic device 120 based on the first application 111 in the first electronic device 110. After obtaining the information, the first application 111 of the second electronic device 120 outputs it to the user based on the output device in the second electronic device, so that user A obtains information B and information C.

[0045] User C inputs information C based on the hardware in the first electronic device, and the first electronic device 110 processes information C and information A to obtain processed information, such as superimposing information C and information A, and transmits the information to the second application 112 in the third electronic device 130 based on the first application 112 in the first electronic device 110. After obtaining the information, the second application 112 in the third electronic device 130 outputs it to the user based on the output device in the third electronic device, so that user B obtains information A and information C.

[0046] Figure 3 The information flow in the first electronic device according to an embodiment of the present disclosure is schematically shown.

[0047] like Figure 3 As shown, when the first application 111 in the first electronic device 110 outputs information 1, it will be output by the first electronic device through the output device in the first electronic device. When the second application 112 outputs information 2, information 2 will be output by the first electronic device through the output device. When information 1 and information 2 are output by the corresponding applications at the same time, information 1 and information 2 will be processed, for example, information 1 and information 2 are superimposed and output through the output device; when the hardware of the first electronic device collects information 3, information 3 and information 2 are processed, for example, information 2 and information 3 are superimposed and input into the first application 111, so that the first application 111 transmits information 2 and information 3; accordingly, information 3 and information 1 can be processed, for example, information 1 and information 3 are superimposed and input into the second application 112, so that the second application 112 transmits information 1 and information 3.

[0048] The first electronic device 110 , the second electronic device 120 , and the third electronic device 130 may be various electronic devices with communication functions, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0049] It should be noted that the information processing method provided in the embodiment of the present disclosure can generally be executed by the first electronic device 110. Accordingly, the information processing system provided in the embodiment of the present disclosure can generally be set in the first electronic device 110. The information processing method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the first electronic device 110 and can communicate with the first electronic device 110. Accordingly, the information processing system provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the first electronic device 110 and can communicate with the first electronic device 110.

[0050] It should be understood that Figure 1 The number of electronic devices and networks in the embodiment is only for illustration. Any number of electronic devices and networks may be provided according to implementation requirements.

[0051] Figure 4 The flowchart of the information processing method according to the embodiment of the present disclosure is schematically shown.

[0052] like Figure 4 As shown, the method includes operations S410 to S430.

[0053] In operation S410, in response to a first application in a first electronic device obtaining first information, and / or in response to the first electronic device obtaining second information, first target information is generated, the first application runs in the first electronic device and the second electronic device, the first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application, and the second information includes multimedia information collected by the hardware in the first electronic device; the first target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the second electronic device.

[0054] The first application is an application running on the first electronic device and the second electronic device, and the first electronic device and the second electronic device can communicate in real time based on the first application. The second application is an application running on the first electronic device and the third electronic device and different from the first application, and the first electronic device and the third electronic device can communicate in real time based on the second application.

[0055] The first information is multimedia information collected by the second electronic device and transmitted to the first electronic device through the first application, for example, user voice collected on the second electronic device is transmitted to the first electronic device through the first application.

[0056] The second information is multimedia information collected by the hardware of the first electronic device, such as images collected by a camera or sounds collected by a microphone on the first electronic device, which is directly obtained without being transmitted through other applications.

[0057] The first target information is information processed based on the first information and the second information. The first target information with a specific meaning is generated by combining or processing the first information and / or the second information. The first target information with a specific meaning contains at least part of the meaning of the first information and / or the second information, and is a combination or extraction of these information. For example, after receiving the audio (first information) from the second electronic device, the first electronic device combines the locally collected video screen (second information) and the audio information to form a complete audio and video stream, which is the first target information.

[0058] In operation S420, at least one second application in the first electronic device is determined, the first application is different from the second application, the second application runs in the first electronic device and the third electronic device, the first application is used for instant multimedia information transmission between the first electronic device and the second electronic device, and the second application is used for instant multimedia information transmission between the first electronic device and the third electronic device.

[0059] The first electronic device identifies an application (i.e., the second application) that is different from the first application, and is used for audio and video transmission with the third electronic device. The whitelist can be used to predetermine which applications can be identified for subsequent information transmission. After the first target information is generated, the first electronic device determines whether the application in the whitelist is started, and if so, it is regarded as the second application.

[0060] In operation S430, the first target information is transmitted to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information.

[0061] Since different applications may be able to process different multimedia information, for example, the first application can be used for real-time transmission of audio information, and the second application is used for real-time transmission of text information, then the first information obtained by the first application is audio information, and when the first target information is transmitted to the third electronic device through the second application, the second application can only process text information, so the data type of the first target information also needs to be the type of text information. Under the premise of ensuring that the transmission can be achieved, the first target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the second electronic device, so as to achieve the purpose of transmitting the correct information to the third electronic device.

[0062] Based on the above, specific examples are given below:

[0063] For example, a host needs to have a video call with two different participants at the same time. A host (first electronic device) needs to have a video call with two different participants (second electronic device and third electronic device) at the same time, and the participants use different applications. The first electronic device (host) runs the first application and conducts a video conference with the second electronic device (participant A). The audio collected by the second electronic device is transmitted to the first electronic device through the first application, that is, the first information. At the same time, the first electronic device uses the local camera to collect video, that is, the second information. After obtaining the first information (audio of participant A) and the second information (locally collected video), the first electronic device synthesizes the two into the first target information. The host needs to send the synthesized first target information (audio and video stream) to another participant (participant B) on the third electronic device, and B uses the second application. Therefore, after the first electronic device determines that the second application is running on the device, it transmits the synthesized first target information through the second application. Finally, the second application on the third electronic device receives and outputs the audio and video stream, realizing multi-party real-time audio and video communication with different applications.

[0064] Figure 5 Another flowchart of the information processing method according to an embodiment of the present disclosure is schematically shown.

[0065] According to an embodiment of the present disclosure, based on the above-mentioned embodiment, the first information and / or the second information is acquired in real time. Figure 5 As shown, operation S410 may include operation S510.

[0066] In operation S510, first target information is generated in real time according to the first information and / or the second information.

[0067] On this basis, operation S430 may include operation S520.

[0068] In operation S520, the first target information generated in real time is transmitted to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information in real time.

[0069] To ensure normal communication among the first electronic device, the second electronic device, and the third electronic device, the first target information is generated in real time based on the first information acquired in real time and / or the second information.

[0070] Because the first target information is generated in real time, the first information and / or the second information may be processed as follows:

[0071] Data buffering and preprocessing are performed on the first information and / or the second information to handle the inevitable slight delays in network transmission and the irregular arrival of data packets. Specifically, the buffer created in the first electronic device is used to temporarily store the arriving data packets to smooth network jitter and provide a continuous data stream for subsequent processing. The first information and / or the second information are processed including but not limited to denoising, automatic gain control (AGC), sound clarity enhancement, brightness adjustment, contrast optimization, and preliminary motion compensation.

[0072] Data synchronization is performed on the first information and / or the second information to prevent audio-visual asynchrony. Specifically, a timestamp algorithm can be used, and each audio and video data packet is timestamped. During processing, the first electronic device synchronizes the audio and video streams according to the timestamp. A synchronization algorithm can also be used, for example, the data in the buffer can be used for cross-reference to ensure that the video frame is aligned in time with the corresponding audio segment.

[0073] Data conversion: When the first information and / or the second information are collected, the amount of information may be large in order to ensure the quality of collection. Since there is an intermediate conversion link in the embodiment of the present disclosure, in order to ensure the real-time transmission of information, the first information and / or the second information needs to be converted. For example, the sampling rate of the audio information in the first information and / or the second information is determined, and when the sampling rate is greater than or equal to the preset sampling rate threshold, the audio information in the first information and / or the second information is down-converted based on the preset sampling rate threshold. Determine the key frame interval and / or bit rate of the video information in the first information and / or the second information. When the key frame interval and / or the bit rate meet the adjustment requirements of the key frame interval and / or the bit rate, adjust the video information in the first information and / or the second information to reduce the data occupancy of the first information and / or the second information without losing the meaning content in the first information and / or the second information.

[0074] To ensure that the process of transmitting the first target information generated in real time to the third electronic device through the second application is also performed in real time, the following processing may be performed:

[0075] The first electronic device continuously monitors the network bandwidth and delay, and reduces the transmission bit rate of the audio data and / or video data in the first information and / or the second information when the network bandwidth and delay do not meet the requirements. Based on the use of the buffer in the aforementioned embodiment, it can also include: dynamically adjusting the buffer based on the data volume of the first information and / or the second information.

[0076] Figure 6 Another flowchart of the information processing method according to an embodiment of the present disclosure is schematically shown.

[0077] According to an embodiment of the present disclosure, the multimedia information includes at least one of audio information, video information, text information, and image information, and operation S410 may include operation S610.

[0078] In operation S610, first target information is generated based on at least one of the audio information, video information, text information, and image information collected by hardware in the second electronic device, and / or at least one of the audio information, video information, text information, and image information collected by hardware in the first electronic device.

[0079] Specifically, the current communication type can be determined according to the preset communication scenario setting, and the first target information can be generated according to the communication type. For example, the current scenario only requires audio communication. Assuming that the first application will transmit audio information, video information and text information as the first information at the same time, then the video and text information in the video information do not participate in the communication. Based on this, audio-related information can be extracted from the first information, and the extracted information can be used to generate the first target information.

[0080] Figure 7 The flowchart of transmitting the first target information in the information processing method according to the embodiment of the present disclosure is schematically shown.

[0081] According to an embodiment of the present disclosure, the first target information may include at least one of audio information, video information, text information, and image information. Operation S430 may include operations S710 to S720.

[0082] In operation S710, it is determined that a first type of multimedia information for which a second application has transmission authority.

[0083] In operation S720, the audio information, and / or video information, and / or text information, and / or image information that conforms to the first type in the first target information is transmitted to a third electronic device through the second application.

[0084] The first type characterizes the type of multimedia information that the second application has the communication authority for in the current scenario. For example, the first application is a real-time communication application for audio / video, and the second application is also a real-time communication application for audio / video. Assuming that the third electronic device that uses the second application to communicate with the first electronic device is an electronic device used by the speaker, and the speaker needs to display the video screen and communicate with other participants, then in this communication scenario, each communication party only needs to see the video screen transmitted by the second application, and does not need to see the video screen transmitted by the first application. Therefore, when the first application obtains the first information containing video information, the first target information generated according to the first information and / or the second information may contain video information. If the first target information is transmitted through the second application at this time, it may interfere with the screen displayed by the speaker. Therefore, it is necessary to determine the type of multimedia information that the second application has the transmission authority according to the preset communication authority, and transmit the audio information, and / or video information, and / or text information, and / or image information that meet this type in the first target information to the third electronic device to avoid interference with the multimedia information being transmitted by the second application.

[0085] Figure 8 The flowchart of generating first target information in the information processing method according to the embodiment of the present disclosure is schematically shown.

[0086] like Figure 8 As shown, based on the foregoing embodiment, operation S410 may include operations S810 to S830.

[0087] In operation S810, a second type of multimedia information that can be transmitted by a second application is determined.

[0088] The second type represents the type of multimedia information that the second application supports and can transmit. For example, if the second application is a voice call application, and its function is only to transmit audio information, then the second type corresponding to the second application is the audio information type.

[0089] In operation S820, at least a portion of the first information and / or the second information that does not conform to the second type of multimedia information is converted into multimedia information that has the same meaning and conforms to the second type.

[0090] The first information and / or the second information may contain multimedia information that does not conform to the second type. For example, the first information and / or the second information may also contain text information, video information, and other content, which cannot be transmitted through the second application. Therefore, at least part of the multimedia information in the first information and / or the second information may be converted into multimedia information with the same meaning and conforming to the second type. For example, the text information in the first information and / or the second information may be converted into audio information corresponding to the text.

[0091] In operation S830, first target information is generated according to the converted multimedia information, the first information, and / or the multimedia information that matches the second type in the second information.

[0092] First target information is generated according to the converted multimedia information and the multimedia information in the first information and / or the second information that conforms to the second type, and the generated first target information conforms to the second type so that the first target information can be transmitted by the second application.

[0093] Fig. 9 Another flowchart of the information processing method according to an embodiment of the present disclosure is schematically shown.

[0094] like Fig. 9 As shown, the information processing method may further include operations S910 to S920.

[0095] In operation S910, in response to the second application obtaining third information and / or in response to the first application obtaining first information, second target information is generated, the third information includes multimedia information collected by hardware in the third electronic device and transmitted to the first electronic device via the second application, and the second target information has the same meaning as at least part of the multimedia information collected by the second electronic device and / or the third electronic device.

[0096] In operation S920, second target information is output.

[0097] The third information is multimedia information collected by the third electronic device and transmitted to the first electronic device through the first application, for example, user voice collected on the third electronic device is transmitted to the first electronic device through the first application.

[0098] Similar to the first target information, the second target information is generated based on the first information and / or the third information. After acquiring the second target information, the first electronic device outputs the second target information. Specifically, the first electronic device outputs at least part of the content in the second target information based on the multimedia output device configured on the first electronic device. For example, based on the audio output device configured on the first electronic device, the audio information in the second target information is output; for example, based on the display device on the first electronic device, the video information and / or text information in the second target information is output.

[0099] Fig.10 The flowchart of outputting the second target information in the information processing method according to the embodiment of the present disclosure is schematically shown.

[0100] According to an embodiment of the present disclosure, the second target information includes at least one of audio information, video information, text information, and image information. Fig.10As shown, based on the foregoing embodiment, operation S920 may include operations S1010 to S1020.

[0101] In operation S1010, a communication authority of a first electronic device is determined, where the communication authority represents the type of multimedia information that the first electronic device has an authority to output.

[0102] In operation S1020, the audio information, and / or video information, and / or text information, and / or image information in the second target information that meets the communication authority is output.

[0103] and Figure 7 Similar to the embodiment shown in Figure 7 In the illustrated embodiment, the second application has corresponding communication permissions, and accordingly, the first electronic device may also have corresponding output permissions. For example, if the first electronic device is an electronic device operated by a middleman, and the audio communication content between the user of the second electronic device and the user of the third electronic device needs to be kept confidential and cannot be known by the middleman using the first electronic device, then the first electronic device does not have audio output permissions. Fig. 9 The audio information in the second target information acquired in the embodiment cannot be output, and only other information other than the audio information, such as text information, can be output.

[0104] According to the embodiment of the present disclosure, the information processing method may further include: the third information is acquired in real time; generating the second target information may include: generating the second target information in real time according to the first information and / or the third information; outputting the second target information may include: outputting the second target information in real time. Figure 5 In the illustrated embodiment, the contents of real-time generation of the first target information according to the first information and / or the second information and real-time transmission of the first target information are similar and are not elaborated herein.

[0105] According to the embodiment of the present disclosure, outputting the second target information in the information processing method may include: determining the third type of multimedia information that the first electronic device can output; converting at least part of the multimedia information in the first information and / or the third information that does not conform to the third type into multimedia information with the same meaning and conforming to the third type; generating the second target information based on the converted multimedia information and the multimedia information in the first information and / or the third information that conforms to the third type. Its specific content and explanation are similar to Figure 8 In the illustrated embodiment, the contents regarding the second type and performing data conversion according to the second type to generate the first target information are similar and will not be elaborated here.

[0106] According to the embodiment of the present disclosure, the information processing method may also include: generating third target information in response to the second application in the second electronic device obtaining fourth information, and / or in response to the first electronic device obtaining second information; the third target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the third electronic device; determining at least one second application in the first electronic device; transmitting the third target information to the second electronic device through the first application, so that the first application of the second electronic device outputs the third target information. Its specific content and explanation are similar to Figure 4 The contents regarding generating the first target information and transmitting the first target information based on the first application in the illustrated embodiment are similar and will not be elaborated here.

[0107] According to the embodiment of the present disclosure, the information processing method may further include: the fourth information is acquired in real time; the third target information is generated in real time according to the second information and / or the fourth information; the third target information is transmitted to the second electronic device through the first application, including: the third target information generated in real time is transmitted to the second electronic device in real time through the first application, so that the first application of the second electronic device outputs the third target information in real time. Its specific content and explanation are similar to Figure 5 In the illustrated embodiment, the contents of real-time generation of the first target information according to the first information and / or the second information and real-time transmission of the first target information are similar and are not elaborated herein.

[0108] According to the embodiments of the present disclosure, on the basis of the aforementioned embodiments, the information processing method may further include: the third target information includes at least one of audio information, video information, text information, and image information, and the third target information is transmitted to the second electronic device through the first application, including: determining the fifth type of multimedia information that the first application has the transmission authority; and transmitting the audio information, and / or video information, and / or text information, and / or image information that conforms to the fifth type in the third target information to the second electronic device through the first application. Its specific content and explanation are similar to Figure 7 The contents regarding transmission of the first target information in the illustrated embodiment are similar and will not be elaborated herein.

[0109] According to an embodiment of the present disclosure, on the basis of the aforementioned embodiment, generating the third target information may include: determining the sixth type of multimedia information that can be transmitted by the first application; converting the fourth information, and / or at least part of the multimedia information in the second information that does not conform to the sixth type, into multimedia information with the same meaning and conforming to the sixth type; generating the third target information based on the converted multimedia information, as well as the fourth information, and / or the multimedia information in the second information that conforms to the sixth type. The sixth type represents the type of multimedia information that the first application supports and can transmit. Its specific content and explanation are similar to Figure 8The contents regarding generating the first target information in the illustrated embodiment are similar and will not be elaborated here.

[0110] Fig.11 Another flowchart of the information processing method according to an embodiment of the present disclosure is schematically shown.

[0111] like Fig.11 As shown, based on the above-mentioned embodiment, the information processing method may further include operations S1110 to S1130.

[0112] In operation S1110, in response to the start of the third application, it is determined whether the third application meets a preset communication condition, the third application is running in the first electronic device and the fourth electronic device, and the third application is different from the first application and the second application.

[0113] In operation S1120, when the third application satisfies the preset communication condition, when the third application obtains the fourth information, the third application is regarded as the first application, the fourth information is regarded as the first information, and the same operation as the first application and the first information is performed, and the fourth information includes multimedia information collected by the hardware in the fourth electronic device and transmitted to the first electronic device through the first application.

[0114] In operation S1130, when the third application meets the preset communication condition, when it is necessary to transmit the multimedia information to the fourth electronic device based on the third application, the third application is regarded as the second application and the same operation as the second application is performed.

[0115] For example, person A uses the first application and the second application based on the first electronic device as an intermediary, person B uses the first application based on the second electronic device, and person C uses the second application based on the third electronic device. Person A, B, and C can realize multi-party cross-device cross-application real-time communication based on the method provided in the aforementioned embodiment. While personnel A, B, and C are communicating, person D hopes to join the meeting based on the third application in the fourth electronic device. Then, the third application is started in the first electronic device, and in response to the start of the third application, it is determined whether the third application meets the preset communication condition. The preset communication condition indicates that the third application has the authority to communicate with the first application and the second application, and the reflection on the personnel is that person D has the qualification to join the meeting. When the third application meets the preset communication condition, when the fourth electronic device receives information, the third application is regarded as the second application, and the operation for the second application in the aforementioned embodiment is executed; when the third application of the fourth electronic device sends information outward, the third application is regarded as the first application, and the operation for the first application in the aforementioned embodiment is executed. In this way, the third application in the fourth electronic device is added to the communication scenario of the first application and the second application.

[0116] Fig.12The block diagram schematically shows an information processing device according to an embodiment of the present disclosure.

[0117] like Fig.12 As shown, the information processing device 1200 includes a generating module 1210 , a determining module 1220 and a transmitting module 1230 .

[0118] The generation module 1210 is used to generate first target information in response to a first application in a first electronic device obtaining first information, and / or in response to the first electronic device obtaining second information, wherein the first application runs in the first electronic device and the second electronic device, the first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application, and the second information includes multimedia information collected by the hardware in the first electronic device; the first target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the second electronic device; in some embodiments, the generation module 1210 can be used to perform operation S410 in the aforementioned method, which is not repeated here.

[0119] The determination module 1220 is used to determine at least one second application in the first electronic device, the first application is different from the second application, the second application runs in the first electronic device and the third electronic device, the first application is used for instant audio and / or video transmission between the first electronic device and the second electronic device, and the second application is used for instant audio and / or video transmission between the first electronic device and the third electronic device; in some embodiments, the determination module 1220 can be used to perform operation S420 in the aforementioned method, which is not repeated here.

[0120] The transmission module 1230 is used to transmit the first target information to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information. In some embodiments, the transmission module 1230 can be used to perform operation S430 in the above method, which is not described in detail here.

[0121] According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits, or at least part of the functions of any one of them can be implemented in one module. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be split into multiple modules for implementation. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be at least partially implemented as hardware circuits, such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), systems on chips, systems on substrates, systems on packages, application specific integrated circuits (ASICs), or can be implemented by hardware or firmware in any other reasonable way of integrating or packaging circuits, or can be implemented in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, according to the embodiments of the present invention, one or more of the modules, submodules, units, and subunits can be at least partially implemented as computer program modules, and when the computer program modules are run, the corresponding functions can be performed.

[0122] For example, any multiple of the generation module 1210, the determination module 1220, and the transmission module 1230 can be combined in one module / unit / sub-unit for implementation, or any one of the modules / units / sub-units can be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more of these modules / units / sub-units can be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to an embodiment of the present disclosure, at least one of the generation module 1210, the determination module 1220, and the transmission module 1230 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware, and firmware or in a suitable combination of any of them. Alternatively, at least one of the generating module 1210 , the determining module 1220 , and the transmitting module 1230 may be at least partially implemented as a computer program module, and when the computer program module is executed, a corresponding function may be performed.

[0123] It should be noted that the data processing system part in the embodiments of the present disclosure corresponds to the data processing method part in the embodiments of the present disclosure. The description of the data processing system part specifically refers to the data processing method part, which will not be repeated here.

[0124] Fig.13A block diagram of an electronic device suitable for implementing the method described above according to an embodiment of the present disclosure is schematically shown. Fig.13 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0125] like Fig.13 As shown, the electronic device 1300 according to an embodiment of the present disclosure includes a processor 1301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1302 or a program loaded from a storage part 1308 to a random access memory (RAM) 1303. The processor 1301 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 1301 may also include an onboard memory for caching purposes. The processor 1301 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0126] In RAM 1303, various programs and data required for the operation of electronic device 1300 are stored. Processor 1301, ROM 1302 and RAM 1303 are connected to each other through bus 1304. Processor 1301 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 1302 and / or RAM 1303. It should be noted that the program can also be stored in one or more memories other than ROM 1302 and RAM 1303. Processor 1301 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0127] According to an embodiment of the present disclosure, the electronic device 1300 may further include an input / output (I / O) interface 1305, which is also connected to the bus 1304. The electronic device 1300 may further include one or more of the following components connected to the input / output (I / O) interface 1305: an input portion 1306 including a keyboard, a mouse, etc.; an output portion 1307 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 1308 including a hard disk, etc.; and a communication portion 1309 including a network interface card such as a LAN card, a modem, etc. The communication portion 1309 performs communication processing via a network such as the Internet. A drive 1310 is also connected to the input / output (I / O) interface 1305 as needed. A removable medium 1311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1310 as needed, so that a computer program read therefrom is installed into the storage portion 1308 as needed.

[0128] According to an embodiment of the present disclosure, the method flow according to an embodiment of the present disclosure can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1309, and / or installed from the removable medium 1311. When the computer program is executed by the processor 1301, the above-mentioned functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.

[0129] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0130] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. For example, it may include, but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.

[0131] For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 1302 and / or the RAM 1303 described above and / or one or more memories other than the ROM 1302 and the RAM 1303 .

[0132] An embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains a program code for executing the method provided by the embodiment of the present disclosure. When the computer program product runs on an electronic device, the program code is used to enable the electronic device to implement the information processing method provided by the embodiment of the present disclosure.

[0133] When the computer program is executed by the processor 1301, the above functions defined in the system / device of the embodiment of the present disclosure are executed. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0134] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 1309, and / or installed from the removable medium 1311. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0135] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0136] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions. It can be understood by those skilled in the art that the features recorded in the various embodiments of the present disclosure can be combined and / or combined in a variety of ways, even if such a combination or combination is not explicitly recorded in the present disclosure. In particular, without departing from the spirit and teaching of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0137] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. An information processing method, applied to a first electronic device, comprising: generating first target information in response to a first application in a first electronic device obtaining first information, and / or in response to the first electronic device obtaining second information, wherein the first application is run in the first electronic device and a second electronic device, the first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application, and the second information includes multimedia information collected by the hardware in the first electronic device; the first target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the second electronic device; Determine at least one second application in the first electronic device, the first application is different from the second application, the second application is run in the first electronic device and a third electronic device, the first application is used for instant multimedia information transmission between the first electronic device and the second electronic device, and the second application is used for instant multimedia information transmission between the first electronic device and the third electronic device; The first target information is transmitted to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information.

2. According to the method of claim 1, the first information and / or the second information is acquired in real time, and the generating of the first target information comprises: Generate the first target information in real time according to the first information and / or the second information; The transmitting the first target information to the third electronic device through the second application includes: The first target information generated in real time is transmitted to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information in real time.

3. The method according to claim 1, wherein the multimedia information comprises at least one of audio information, video information, text information, and image information, and the generating the first target information comprises: The first target information is generated based on at least one of the audio information, video information, text information, and image information collected by the hardware in the second electronic device, and / or at least one of the audio information, video information, text information, and image information collected by the hardware in the first electronic device.

4. The method according to any one of claims 1 to 3, wherein the first target information includes at least one of audio information, video information, text information, and image information, and the transmitting the first target information to the third electronic device through the second application comprises: Determining a first type of multimedia information that the second application has permission to transmit; The audio information, and / or video information, and / or text information, and / or image information that conforms to the first type in the first target information is transmitted to the third electronic device through the second application.

5. The method according to any one of claims 1 to 3, wherein generating the first target information comprises: Determining a second type of multimedia information that can be transmitted by the second application; converting the first information and / or at least part of the second information that does not conform to the second type of multimedia information into multimedia information with the same meaning and conforming to the second type; The first target information is generated according to the converted multimedia information, the first information, and / or the multimedia information in the second information that conforms to the second type.

6. The method according to claim 1, further comprising: generating second target information in response to the second application obtaining third information and / or in response to the first application obtaining first information, wherein the third information includes multimedia information collected by hardware in the third electronic device and transmitted to the first electronic device through the second application, and the second target information has the same meaning as at least part of the multimedia information collected by the second electronic device and / or the third electronic device; The second target information is output.

7. The method according to claim 6, wherein the second target information comprises at least one of audio information, video information, text information, and image information, and the outputting the second target information comprises: Determining a communication permission of the first electronic device, wherein the communication permission represents a type of multimedia information that the first electronic device has permission to output; The audio information, and / or video information, and / or text information, and / or image information in the second target information that meets the communication authority is output.

8. The method according to claim 1, further comprising: In response to starting a third application, determining whether the third application meets a preset communication condition, the third application running in the first electronic device and the fourth electronic device, the third application being different from the first application and the second application; If the third application meets the preset communication condition, when the third application obtains the fourth information, the third application is regarded as the first application, and the fourth information is regarded as the first information, and the same operation as the first application and the first information is performed, and the fourth information includes multimedia information collected by the hardware in the fourth electronic device and transmitted to the first electronic device through the first application; When the third application meets the preset communication condition, when it is necessary to transmit multimedia information to the fourth electronic device based on the third application, the third application is regarded as the second application and the same operation as the second application is performed.

9. An information processing device, comprising: a generating module, configured to generate first target information in response to a first application in a first electronic device obtaining first information, and / or in response to the first electronic device obtaining second information, wherein the first application is run in the first electronic device and a second electronic device, the first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application, and the second information includes multimedia information collected by the hardware in the first electronic device; The first target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the second electronic device; a determination module, configured to determine at least one second application in the first electronic device, the first application being different from the second application, the second application being run in the first electronic device and a third electronic device, the first application being used for instant multimedia information transmission between the first electronic device and the second electronic device, and the second application being used for instant multimedia information transmission between the first electronic device and the third electronic device; as well as A transmission module is used to transmit the first target information to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information.

10. A first electronic device, wherein a first application and a second application are configured on the first electronic device, and the first electronic device comprises: one or more processors; a memory for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the following method: In response to a first application in a first electronic device obtaining first information, and / or in response to the first electronic device obtaining second information, first target information is generated, the first application runs in the first electronic device and the second electronic device, the first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application, and the second information includes multimedia information collected by the hardware in the first electronic device; the first target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the second electronic device; at least one second application in the first electronic device is determined, the first application is different from the second application, the second application runs in the first electronic device and the third electronic device, the first application is used for instant multimedia information transmission between the first electronic device and the second electronic device, and the second application is used for instant multimedia information transmission between the first electronic device and the third electronic device; the first target information is transmitted to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information.

Images